00:00:00.001 Started by upstream project "autotest-spdk-v24.01-LTS-vs-dpdk-v22.11" build number 599 00:00:00.001 originally caused by: 00:00:00.001 Started by upstream project "nightly-trigger" build number 3264 00:00:00.001 originally caused by: 00:00:00.001 Started by timer 00:00:00.001 Started by timer 00:00:00.031 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.031 The recommended git tool is: git 00:00:00.032 using credential 00000000-0000-0000-0000-000000000002 00:00:00.033 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.048 Fetching changes from the remote Git repository 00:00:00.051 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.094 Using shallow fetch with depth 1 00:00:00.094 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.094 > git --version # timeout=10 00:00:00.116 > git --version # 'git version 2.39.2' 00:00:00.118 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.139 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.139 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:03.621 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:03.632 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:03.644 Checking out Revision 9bf0dabeadcf84e29a3d5dbec2430e38aceadf8d (FETCH_HEAD) 00:00:03.645 > git config core.sparsecheckout # timeout=10 00:00:03.654 > git read-tree -mu HEAD # timeout=10 00:00:03.668 > git checkout -f 9bf0dabeadcf84e29a3d5dbec2430e38aceadf8d # timeout=5 00:00:03.686 Commit message: "inventory: add WCP3 to free inventory" 00:00:03.686 > git rev-list --no-walk 9bf0dabeadcf84e29a3d5dbec2430e38aceadf8d # timeout=10 00:00:03.764 [Pipeline] Start of Pipeline 00:00:03.776 [Pipeline] library 00:00:03.777 Loading library shm_lib@master 00:00:03.777 Library shm_lib@master is cached. Copying from home. 00:00:03.789 [Pipeline] node 00:00:03.797 Running on GP11 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:03.798 [Pipeline] { 00:00:03.805 [Pipeline] catchError 00:00:03.806 [Pipeline] { 00:00:03.815 [Pipeline] wrap 00:00:03.821 [Pipeline] { 00:00:03.827 [Pipeline] stage 00:00:03.828 [Pipeline] { (Prologue) 00:00:03.987 [Pipeline] sh 00:00:04.262 + logger -p user.info -t JENKINS-CI 00:00:04.275 [Pipeline] echo 00:00:04.277 Node: GP11 00:00:04.283 [Pipeline] sh 00:00:04.573 [Pipeline] setCustomBuildProperty 00:00:04.583 [Pipeline] echo 00:00:04.584 Cleanup processes 00:00:04.588 [Pipeline] sh 00:00:04.864 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:04.864 2602725 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:04.877 [Pipeline] sh 00:00:05.177 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:05.177 ++ awk '{print $1}' 00:00:05.177 ++ grep -v 'sudo pgrep' 00:00:05.177 + sudo kill -9 00:00:05.177 + true 00:00:05.190 [Pipeline] cleanWs 00:00:05.198 [WS-CLEANUP] Deleting project workspace... 00:00:05.198 [WS-CLEANUP] Deferred wipeout is used... 00:00:05.203 [WS-CLEANUP] done 00:00:05.208 [Pipeline] setCustomBuildProperty 00:00:05.222 [Pipeline] sh 00:00:05.499 + sudo git config --global --replace-all safe.directory '*' 00:00:05.583 [Pipeline] httpRequest 00:00:05.612 [Pipeline] echo 00:00:05.613 Sorcerer 10.211.164.101 is alive 00:00:05.620 [Pipeline] httpRequest 00:00:05.624 HttpMethod: GET 00:00:05.624 URL: http://10.211.164.101/packages/jbp_9bf0dabeadcf84e29a3d5dbec2430e38aceadf8d.tar.gz 00:00:05.625 Sending request to url: http://10.211.164.101/packages/jbp_9bf0dabeadcf84e29a3d5dbec2430e38aceadf8d.tar.gz 00:00:05.626 Response Code: HTTP/1.1 200 OK 00:00:05.627 Success: Status code 200 is in the accepted range: 200,404 00:00:05.627 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_9bf0dabeadcf84e29a3d5dbec2430e38aceadf8d.tar.gz 00:00:06.485 [Pipeline] sh 00:00:06.764 + tar --no-same-owner -xf jbp_9bf0dabeadcf84e29a3d5dbec2430e38aceadf8d.tar.gz 00:00:06.779 [Pipeline] httpRequest 00:00:06.807 [Pipeline] echo 00:00:06.808 Sorcerer 10.211.164.101 is alive 00:00:06.814 [Pipeline] httpRequest 00:00:06.818 HttpMethod: GET 00:00:06.818 URL: http://10.211.164.101/packages/spdk_4b94202c659be49093c32ec1d2d75efdacf00691.tar.gz 00:00:06.818 Sending request to url: http://10.211.164.101/packages/spdk_4b94202c659be49093c32ec1d2d75efdacf00691.tar.gz 00:00:06.837 Response Code: HTTP/1.1 200 OK 00:00:06.838 Success: Status code 200 is in the accepted range: 200,404 00:00:06.838 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_4b94202c659be49093c32ec1d2d75efdacf00691.tar.gz 00:01:08.085 [Pipeline] sh 00:01:08.364 + tar --no-same-owner -xf spdk_4b94202c659be49093c32ec1d2d75efdacf00691.tar.gz 00:01:10.907 [Pipeline] sh 00:01:11.189 + git -C spdk log --oneline -n5 00:01:11.189 4b94202c6 lib/event: Bug fix for framework_set_scheduler 00:01:11.189 507e9ba07 nvme: add lock_depth for ctrlr_lock 00:01:11.189 62fda7b5f nvme: check pthread_mutex_destroy() return value 00:01:11.189 e03c164a1 nvme: add nvme_ctrlr_lock 00:01:11.189 d61f89a86 nvme/cuse: Add ctrlr_lock for cuse register and unregister 00:01:11.211 [Pipeline] withCredentials 00:01:11.222 > git --version # timeout=10 00:01:11.235 > git --version # 'git version 2.39.2' 00:01:11.250 Masking supported pattern matches of $GIT_PASSWORD or $GIT_ASKPASS 00:01:11.252 [Pipeline] { 00:01:11.265 [Pipeline] retry 00:01:11.267 [Pipeline] { 00:01:11.290 [Pipeline] sh 00:01:11.595 + git ls-remote http://dpdk.org/git/dpdk-stable v22.11.4 00:01:14.142 [Pipeline] } 00:01:14.164 [Pipeline] // retry 00:01:14.170 [Pipeline] } 00:01:14.185 [Pipeline] // withCredentials 00:01:14.195 [Pipeline] httpRequest 00:01:14.209 [Pipeline] echo 00:01:14.211 Sorcerer 10.211.164.101 is alive 00:01:14.219 [Pipeline] httpRequest 00:01:14.223 HttpMethod: GET 00:01:14.224 URL: http://10.211.164.101/packages/dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:01:14.224 Sending request to url: http://10.211.164.101/packages/dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:01:14.226 Response Code: HTTP/1.1 200 OK 00:01:14.227 Success: Status code 200 is in the accepted range: 200,404 00:01:14.227 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:01:19.324 [Pipeline] sh 00:01:19.611 + tar --no-same-owner -xf dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:01:21.527 [Pipeline] sh 00:01:21.811 + git -C dpdk log --oneline -n5 00:01:21.811 caf0f5d395 version: 22.11.4 00:01:21.811 7d6f1cc05f Revert "net/iavf: fix abnormal disable HW interrupt" 00:01:21.811 dc9c799c7d vhost: fix missing spinlock unlock 00:01:21.811 4307659a90 net/mlx5: fix LACP redirection in Rx domain 00:01:21.811 6ef77f2a5e net/gve: fix RX buffer size alignment 00:01:21.824 [Pipeline] } 00:01:21.845 [Pipeline] // stage 00:01:21.853 [Pipeline] stage 00:01:21.855 [Pipeline] { (Prepare) 00:01:21.873 [Pipeline] writeFile 00:01:21.887 [Pipeline] sh 00:01:22.166 + logger -p user.info -t JENKINS-CI 00:01:22.181 [Pipeline] sh 00:01:22.470 + logger -p user.info -t JENKINS-CI 00:01:22.484 [Pipeline] sh 00:01:22.767 + cat autorun-spdk.conf 00:01:22.767 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:22.767 SPDK_TEST_NVMF=1 00:01:22.767 SPDK_TEST_NVME_CLI=1 00:01:22.767 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:22.767 SPDK_TEST_NVMF_NICS=e810 00:01:22.767 SPDK_TEST_VFIOUSER=1 00:01:22.767 SPDK_RUN_UBSAN=1 00:01:22.767 NET_TYPE=phy 00:01:22.767 SPDK_TEST_NATIVE_DPDK=v22.11.4 00:01:22.767 SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:22.775 RUN_NIGHTLY=1 00:01:22.781 [Pipeline] readFile 00:01:22.819 [Pipeline] withEnv 00:01:22.822 [Pipeline] { 00:01:22.839 [Pipeline] sh 00:01:23.120 + set -ex 00:01:23.120 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:01:23.120 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:23.121 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:23.121 ++ SPDK_TEST_NVMF=1 00:01:23.121 ++ SPDK_TEST_NVME_CLI=1 00:01:23.121 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:23.121 ++ SPDK_TEST_NVMF_NICS=e810 00:01:23.121 ++ SPDK_TEST_VFIOUSER=1 00:01:23.121 ++ SPDK_RUN_UBSAN=1 00:01:23.121 ++ NET_TYPE=phy 00:01:23.121 ++ SPDK_TEST_NATIVE_DPDK=v22.11.4 00:01:23.121 ++ SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:23.121 ++ RUN_NIGHTLY=1 00:01:23.121 + case $SPDK_TEST_NVMF_NICS in 00:01:23.121 + DRIVERS=ice 00:01:23.121 + [[ tcp == \r\d\m\a ]] 00:01:23.121 + [[ -n ice ]] 00:01:23.121 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:01:23.121 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:01:23.121 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:01:23.121 rmmod: ERROR: Module irdma is not currently loaded 00:01:23.121 rmmod: ERROR: Module i40iw is not currently loaded 00:01:23.121 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:01:23.121 + true 00:01:23.121 + for D in $DRIVERS 00:01:23.121 + sudo modprobe ice 00:01:23.121 + exit 0 00:01:23.161 [Pipeline] } 00:01:23.186 [Pipeline] // withEnv 00:01:23.193 [Pipeline] } 00:01:23.215 [Pipeline] // stage 00:01:23.228 [Pipeline] catchError 00:01:23.230 [Pipeline] { 00:01:23.250 [Pipeline] timeout 00:01:23.250 Timeout set to expire in 50 min 00:01:23.253 [Pipeline] { 00:01:23.276 [Pipeline] stage 00:01:23.281 [Pipeline] { (Tests) 00:01:23.307 [Pipeline] sh 00:01:23.596 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:23.596 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:23.596 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:23.596 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:01:23.596 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:23.596 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:23.596 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:01:23.596 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:23.597 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:23.597 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:23.597 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:01:23.597 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:23.597 + source /etc/os-release 00:01:23.597 ++ NAME='Fedora Linux' 00:01:23.597 ++ VERSION='38 (Cloud Edition)' 00:01:23.597 ++ ID=fedora 00:01:23.597 ++ VERSION_ID=38 00:01:23.597 ++ VERSION_CODENAME= 00:01:23.597 ++ PLATFORM_ID=platform:f38 00:01:23.597 ++ PRETTY_NAME='Fedora Linux 38 (Cloud Edition)' 00:01:23.597 ++ ANSI_COLOR='0;38;2;60;110;180' 00:01:23.597 ++ LOGO=fedora-logo-icon 00:01:23.597 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:38 00:01:23.597 ++ HOME_URL=https://fedoraproject.org/ 00:01:23.597 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f38/system-administrators-guide/ 00:01:23.597 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:01:23.597 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:01:23.597 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:01:23.597 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=38 00:01:23.597 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:01:23.597 ++ REDHAT_SUPPORT_PRODUCT_VERSION=38 00:01:23.597 ++ SUPPORT_END=2024-05-14 00:01:23.597 ++ VARIANT='Cloud Edition' 00:01:23.597 ++ VARIANT_ID=cloud 00:01:23.597 + uname -a 00:01:23.597 Linux spdk-gp-11 6.7.0-68.fc38.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jan 15 00:59:40 UTC 2024 x86_64 GNU/Linux 00:01:23.597 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:01:24.532 Hugepages 00:01:24.532 node hugesize free / total 00:01:24.532 node0 1048576kB 0 / 0 00:01:24.532 node0 2048kB 0 / 0 00:01:24.532 node1 1048576kB 0 / 0 00:01:24.532 node1 2048kB 0 / 0 00:01:24.532 00:01:24.532 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:24.532 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:01:24.532 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:01:24.532 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:01:24.532 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:01:24.532 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:01:24.532 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:01:24.532 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:01:24.532 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:01:24.532 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:01:24.532 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:01:24.532 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:01:24.532 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:01:24.532 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:01:24.532 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:01:24.532 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:01:24.532 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:01:24.532 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:01:24.532 + rm -f /tmp/spdk-ld-path 00:01:24.532 + source autorun-spdk.conf 00:01:24.532 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:24.532 ++ SPDK_TEST_NVMF=1 00:01:24.532 ++ SPDK_TEST_NVME_CLI=1 00:01:24.532 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:24.532 ++ SPDK_TEST_NVMF_NICS=e810 00:01:24.532 ++ SPDK_TEST_VFIOUSER=1 00:01:24.532 ++ SPDK_RUN_UBSAN=1 00:01:24.532 ++ NET_TYPE=phy 00:01:24.532 ++ SPDK_TEST_NATIVE_DPDK=v22.11.4 00:01:24.532 ++ SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:24.532 ++ RUN_NIGHTLY=1 00:01:24.532 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:24.532 + [[ -n '' ]] 00:01:24.532 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:24.532 + for M in /var/spdk/build-*-manifest.txt 00:01:24.532 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:24.532 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:24.532 + for M in /var/spdk/build-*-manifest.txt 00:01:24.532 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:24.532 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:24.532 ++ uname 00:01:24.532 + [[ Linux == \L\i\n\u\x ]] 00:01:24.532 + sudo dmesg -T 00:01:24.791 + sudo dmesg --clear 00:01:24.791 + dmesg_pid=2603421 00:01:24.791 + [[ Fedora Linux == FreeBSD ]] 00:01:24.791 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:24.791 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:24.791 + sudo dmesg -Tw 00:01:24.791 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:24.791 + [[ -x /usr/src/fio-static/fio ]] 00:01:24.791 + export FIO_BIN=/usr/src/fio-static/fio 00:01:24.791 + FIO_BIN=/usr/src/fio-static/fio 00:01:24.791 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:24.791 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:24.791 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:24.791 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:24.791 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:24.791 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:24.791 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:24.791 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:24.791 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:24.791 Test configuration: 00:01:24.791 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:24.791 SPDK_TEST_NVMF=1 00:01:24.791 SPDK_TEST_NVME_CLI=1 00:01:24.791 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:24.791 SPDK_TEST_NVMF_NICS=e810 00:01:24.791 SPDK_TEST_VFIOUSER=1 00:01:24.791 SPDK_RUN_UBSAN=1 00:01:24.791 NET_TYPE=phy 00:01:24.791 SPDK_TEST_NATIVE_DPDK=v22.11.4 00:01:24.791 SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:24.791 RUN_NIGHTLY=1 09:47:30 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:24.791 09:47:30 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:24.791 09:47:30 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:24.791 09:47:30 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:24.791 09:47:30 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:24.791 09:47:30 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:24.791 09:47:30 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:24.791 09:47:30 -- paths/export.sh@5 -- $ export PATH 00:01:24.791 09:47:30 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:24.791 09:47:30 -- common/autobuild_common.sh@434 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:24.791 09:47:30 -- common/autobuild_common.sh@435 -- $ date +%s 00:01:24.791 09:47:30 -- common/autobuild_common.sh@435 -- $ mktemp -dt spdk_1720856850.XXXXXX 00:01:24.791 09:47:30 -- common/autobuild_common.sh@435 -- $ SPDK_WORKSPACE=/tmp/spdk_1720856850.qB8Pj5 00:01:24.791 09:47:30 -- common/autobuild_common.sh@437 -- $ [[ -n '' ]] 00:01:24.792 09:47:30 -- common/autobuild_common.sh@441 -- $ '[' -n v22.11.4 ']' 00:01:24.792 09:47:30 -- common/autobuild_common.sh@442 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:24.792 09:47:30 -- common/autobuild_common.sh@442 -- $ scanbuild_exclude=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk' 00:01:24.792 09:47:30 -- common/autobuild_common.sh@448 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:01:24.792 09:47:30 -- common/autobuild_common.sh@450 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:01:24.792 09:47:30 -- common/autobuild_common.sh@451 -- $ get_config_params 00:01:24.792 09:47:30 -- common/autotest_common.sh@387 -- $ xtrace_disable 00:01:24.792 09:47:30 -- common/autotest_common.sh@10 -- $ set +x 00:01:24.792 09:47:30 -- common/autobuild_common.sh@451 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build' 00:01:24.792 09:47:30 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:24.792 09:47:30 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:24.792 09:47:30 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:24.792 09:47:30 -- spdk/autobuild.sh@16 -- $ date -u 00:01:24.792 Sat Jul 13 07:47:30 AM UTC 2024 00:01:24.792 09:47:30 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:24.792 LTS-59-g4b94202c6 00:01:24.792 09:47:30 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:24.792 09:47:30 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:24.792 09:47:30 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:24.792 09:47:30 -- common/autotest_common.sh@1077 -- $ '[' 3 -le 1 ']' 00:01:24.792 09:47:30 -- common/autotest_common.sh@1083 -- $ xtrace_disable 00:01:24.792 09:47:30 -- common/autotest_common.sh@10 -- $ set +x 00:01:24.792 ************************************ 00:01:24.792 START TEST ubsan 00:01:24.792 ************************************ 00:01:24.792 09:47:30 -- common/autotest_common.sh@1104 -- $ echo 'using ubsan' 00:01:24.792 using ubsan 00:01:24.792 00:01:24.792 real 0m0.000s 00:01:24.792 user 0m0.000s 00:01:24.792 sys 0m0.000s 00:01:24.792 09:47:30 -- common/autotest_common.sh@1105 -- $ xtrace_disable 00:01:24.792 09:47:30 -- common/autotest_common.sh@10 -- $ set +x 00:01:24.792 ************************************ 00:01:24.792 END TEST ubsan 00:01:24.792 ************************************ 00:01:24.792 09:47:30 -- spdk/autobuild.sh@27 -- $ '[' -n v22.11.4 ']' 00:01:24.792 09:47:30 -- spdk/autobuild.sh@28 -- $ build_native_dpdk 00:01:24.792 09:47:30 -- common/autobuild_common.sh@427 -- $ run_test build_native_dpdk _build_native_dpdk 00:01:24.792 09:47:30 -- common/autotest_common.sh@1077 -- $ '[' 2 -le 1 ']' 00:01:24.792 09:47:30 -- common/autotest_common.sh@1083 -- $ xtrace_disable 00:01:24.792 09:47:30 -- common/autotest_common.sh@10 -- $ set +x 00:01:24.792 ************************************ 00:01:24.792 START TEST build_native_dpdk 00:01:24.792 ************************************ 00:01:24.792 09:47:30 -- common/autotest_common.sh@1104 -- $ _build_native_dpdk 00:01:24.792 09:47:30 -- common/autobuild_common.sh@48 -- $ local external_dpdk_dir 00:01:24.792 09:47:30 -- common/autobuild_common.sh@49 -- $ local external_dpdk_base_dir 00:01:24.792 09:47:30 -- common/autobuild_common.sh@50 -- $ local compiler_version 00:01:24.792 09:47:30 -- common/autobuild_common.sh@51 -- $ local compiler 00:01:24.792 09:47:30 -- common/autobuild_common.sh@52 -- $ local dpdk_kmods 00:01:24.792 09:47:30 -- common/autobuild_common.sh@53 -- $ local repo=dpdk 00:01:24.792 09:47:30 -- common/autobuild_common.sh@55 -- $ compiler=gcc 00:01:24.792 09:47:30 -- common/autobuild_common.sh@61 -- $ export CC=gcc 00:01:24.792 09:47:30 -- common/autobuild_common.sh@61 -- $ CC=gcc 00:01:24.792 09:47:30 -- common/autobuild_common.sh@63 -- $ [[ gcc != *clang* ]] 00:01:24.792 09:47:30 -- common/autobuild_common.sh@63 -- $ [[ gcc != *gcc* ]] 00:01:24.792 09:47:30 -- common/autobuild_common.sh@68 -- $ gcc -dumpversion 00:01:24.792 09:47:30 -- common/autobuild_common.sh@68 -- $ compiler_version=13 00:01:24.792 09:47:30 -- common/autobuild_common.sh@69 -- $ compiler_version=13 00:01:24.792 09:47:30 -- common/autobuild_common.sh@70 -- $ external_dpdk_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:24.792 09:47:30 -- common/autobuild_common.sh@71 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:24.792 09:47:30 -- common/autobuild_common.sh@71 -- $ external_dpdk_base_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:24.792 09:47:30 -- common/autobuild_common.sh@73 -- $ [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk ]] 00:01:24.792 09:47:30 -- common/autobuild_common.sh@82 -- $ orgdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:24.792 09:47:30 -- common/autobuild_common.sh@83 -- $ git -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk log --oneline -n 5 00:01:24.792 caf0f5d395 version: 22.11.4 00:01:24.792 7d6f1cc05f Revert "net/iavf: fix abnormal disable HW interrupt" 00:01:24.792 dc9c799c7d vhost: fix missing spinlock unlock 00:01:24.792 4307659a90 net/mlx5: fix LACP redirection in Rx domain 00:01:24.792 6ef77f2a5e net/gve: fix RX buffer size alignment 00:01:24.792 09:47:30 -- common/autobuild_common.sh@85 -- $ dpdk_cflags='-fPIC -g -fcommon' 00:01:24.792 09:47:30 -- common/autobuild_common.sh@86 -- $ dpdk_ldflags= 00:01:24.792 09:47:30 -- common/autobuild_common.sh@87 -- $ dpdk_ver=22.11.4 00:01:24.792 09:47:30 -- common/autobuild_common.sh@89 -- $ [[ gcc == *gcc* ]] 00:01:24.792 09:47:30 -- common/autobuild_common.sh@89 -- $ [[ 13 -ge 5 ]] 00:01:24.792 09:47:30 -- common/autobuild_common.sh@90 -- $ dpdk_cflags+=' -Werror' 00:01:24.792 09:47:30 -- common/autobuild_common.sh@93 -- $ [[ gcc == *gcc* ]] 00:01:24.792 09:47:30 -- common/autobuild_common.sh@93 -- $ [[ 13 -ge 10 ]] 00:01:24.792 09:47:30 -- common/autobuild_common.sh@94 -- $ dpdk_cflags+=' -Wno-stringop-overflow' 00:01:24.792 09:47:30 -- common/autobuild_common.sh@100 -- $ DPDK_DRIVERS=("bus" "bus/pci" "bus/vdev" "mempool/ring" "net/i40e" "net/i40e/base") 00:01:24.792 09:47:30 -- common/autobuild_common.sh@102 -- $ local mlx5_libs_added=n 00:01:24.792 09:47:30 -- common/autobuild_common.sh@103 -- $ [[ 0 -eq 1 ]] 00:01:24.792 09:47:30 -- common/autobuild_common.sh@103 -- $ [[ 0 -eq 1 ]] 00:01:24.792 09:47:30 -- common/autobuild_common.sh@139 -- $ [[ 0 -eq 1 ]] 00:01:24.792 09:47:30 -- common/autobuild_common.sh@167 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:24.792 09:47:30 -- common/autobuild_common.sh@168 -- $ uname -s 00:01:24.792 09:47:30 -- common/autobuild_common.sh@168 -- $ '[' Linux = Linux ']' 00:01:24.792 09:47:30 -- common/autobuild_common.sh@169 -- $ lt 22.11.4 21.11.0 00:01:24.792 09:47:30 -- scripts/common.sh@372 -- $ cmp_versions 22.11.4 '<' 21.11.0 00:01:24.792 09:47:30 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:01:24.792 09:47:30 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:01:24.792 09:47:30 -- scripts/common.sh@335 -- $ IFS=.-: 00:01:24.792 09:47:30 -- scripts/common.sh@335 -- $ read -ra ver1 00:01:24.792 09:47:30 -- scripts/common.sh@336 -- $ IFS=.-: 00:01:24.792 09:47:30 -- scripts/common.sh@336 -- $ read -ra ver2 00:01:24.792 09:47:30 -- scripts/common.sh@337 -- $ local 'op=<' 00:01:24.792 09:47:30 -- scripts/common.sh@339 -- $ ver1_l=3 00:01:24.792 09:47:30 -- scripts/common.sh@340 -- $ ver2_l=3 00:01:24.792 09:47:30 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:01:24.792 09:47:30 -- scripts/common.sh@343 -- $ case "$op" in 00:01:24.792 09:47:30 -- scripts/common.sh@344 -- $ : 1 00:01:24.792 09:47:30 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:01:24.792 09:47:30 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:01:24.792 09:47:30 -- scripts/common.sh@364 -- $ decimal 22 00:01:24.792 09:47:30 -- scripts/common.sh@352 -- $ local d=22 00:01:24.792 09:47:30 -- scripts/common.sh@353 -- $ [[ 22 =~ ^[0-9]+$ ]] 00:01:24.792 09:47:30 -- scripts/common.sh@354 -- $ echo 22 00:01:24.792 09:47:30 -- scripts/common.sh@364 -- $ ver1[v]=22 00:01:24.792 09:47:30 -- scripts/common.sh@365 -- $ decimal 21 00:01:24.792 09:47:30 -- scripts/common.sh@352 -- $ local d=21 00:01:24.792 09:47:30 -- scripts/common.sh@353 -- $ [[ 21 =~ ^[0-9]+$ ]] 00:01:24.792 09:47:30 -- scripts/common.sh@354 -- $ echo 21 00:01:24.792 09:47:30 -- scripts/common.sh@365 -- $ ver2[v]=21 00:01:24.792 09:47:30 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:01:24.792 09:47:30 -- scripts/common.sh@366 -- $ return 1 00:01:24.792 09:47:30 -- common/autobuild_common.sh@173 -- $ patch -p1 00:01:24.792 patching file config/rte_config.h 00:01:24.792 Hunk #1 succeeded at 60 (offset 1 line). 00:01:24.792 09:47:30 -- common/autobuild_common.sh@177 -- $ dpdk_kmods=false 00:01:24.792 09:47:30 -- common/autobuild_common.sh@178 -- $ uname -s 00:01:24.792 09:47:30 -- common/autobuild_common.sh@178 -- $ '[' Linux = FreeBSD ']' 00:01:24.792 09:47:30 -- common/autobuild_common.sh@182 -- $ printf %s, bus bus/pci bus/vdev mempool/ring net/i40e net/i40e/base 00:01:24.792 09:47:30 -- common/autobuild_common.sh@182 -- $ meson build-tmp --prefix=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build --libdir lib -Denable_docs=false -Denable_kmods=false -Dtests=false -Dc_link_args= '-Dc_args=-fPIC -g -fcommon -Werror -Wno-stringop-overflow' -Dmachine=native -Denable_drivers=bus,bus/pci,bus/vdev,mempool/ring,net/i40e,net/i40e/base, 00:01:28.978 The Meson build system 00:01:28.978 Version: 1.3.1 00:01:28.978 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:28.978 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp 00:01:28.978 Build type: native build 00:01:28.978 Program cat found: YES (/usr/bin/cat) 00:01:28.978 Project name: DPDK 00:01:28.978 Project version: 22.11.4 00:01:28.978 C compiler for the host machine: gcc (gcc 13.2.1 "gcc (GCC) 13.2.1 20231011 (Red Hat 13.2.1-4)") 00:01:28.978 C linker for the host machine: gcc ld.bfd 2.39-16 00:01:28.978 Host machine cpu family: x86_64 00:01:28.978 Host machine cpu: x86_64 00:01:28.978 Message: ## Building in Developer Mode ## 00:01:28.978 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:28.978 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/check-symbols.sh) 00:01:28.978 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/options-ibverbs-static.sh) 00:01:28.978 Program objdump found: YES (/usr/bin/objdump) 00:01:28.978 Program python3 found: YES (/usr/bin/python3) 00:01:28.978 Program cat found: YES (/usr/bin/cat) 00:01:28.978 config/meson.build:83: WARNING: The "machine" option is deprecated. Please use "cpu_instruction_set" instead. 00:01:28.978 Checking for size of "void *" : 8 00:01:28.978 Checking for size of "void *" : 8 (cached) 00:01:28.978 Library m found: YES 00:01:28.978 Library numa found: YES 00:01:28.978 Has header "numaif.h" : YES 00:01:28.978 Library fdt found: NO 00:01:28.978 Library execinfo found: NO 00:01:28.978 Has header "execinfo.h" : YES 00:01:28.978 Found pkg-config: YES (/usr/bin/pkg-config) 1.8.0 00:01:28.978 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:28.978 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:28.978 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:28.978 Run-time dependency openssl found: YES 3.0.9 00:01:28.978 Run-time dependency libpcap found: YES 1.10.4 00:01:28.978 Has header "pcap.h" with dependency libpcap: YES 00:01:28.978 Compiler for C supports arguments -Wcast-qual: YES 00:01:28.978 Compiler for C supports arguments -Wdeprecated: YES 00:01:28.978 Compiler for C supports arguments -Wformat: YES 00:01:28.978 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:28.978 Compiler for C supports arguments -Wformat-security: NO 00:01:28.978 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:28.978 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:28.978 Compiler for C supports arguments -Wnested-externs: YES 00:01:28.978 Compiler for C supports arguments -Wold-style-definition: YES 00:01:28.978 Compiler for C supports arguments -Wpointer-arith: YES 00:01:28.978 Compiler for C supports arguments -Wsign-compare: YES 00:01:28.978 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:28.978 Compiler for C supports arguments -Wundef: YES 00:01:28.978 Compiler for C supports arguments -Wwrite-strings: YES 00:01:28.978 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:28.978 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:28.978 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:28.978 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:28.978 Compiler for C supports arguments -mavx512f: YES 00:01:28.978 Checking if "AVX512 checking" compiles: YES 00:01:28.978 Fetching value of define "__SSE4_2__" : 1 00:01:28.978 Fetching value of define "__AES__" : 1 00:01:28.978 Fetching value of define "__AVX__" : 1 00:01:28.978 Fetching value of define "__AVX2__" : (undefined) 00:01:28.978 Fetching value of define "__AVX512BW__" : (undefined) 00:01:28.978 Fetching value of define "__AVX512CD__" : (undefined) 00:01:28.978 Fetching value of define "__AVX512DQ__" : (undefined) 00:01:28.978 Fetching value of define "__AVX512F__" : (undefined) 00:01:28.978 Fetching value of define "__AVX512VL__" : (undefined) 00:01:28.978 Fetching value of define "__PCLMUL__" : 1 00:01:28.978 Fetching value of define "__RDRND__" : 1 00:01:28.978 Fetching value of define "__RDSEED__" : (undefined) 00:01:28.978 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:28.978 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:28.978 Message: lib/kvargs: Defining dependency "kvargs" 00:01:28.978 Message: lib/telemetry: Defining dependency "telemetry" 00:01:28.978 Checking for function "getentropy" : YES 00:01:28.978 Message: lib/eal: Defining dependency "eal" 00:01:28.978 Message: lib/ring: Defining dependency "ring" 00:01:28.978 Message: lib/rcu: Defining dependency "rcu" 00:01:28.978 Message: lib/mempool: Defining dependency "mempool" 00:01:28.978 Message: lib/mbuf: Defining dependency "mbuf" 00:01:28.978 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:28.978 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:28.978 Compiler for C supports arguments -mpclmul: YES 00:01:28.978 Compiler for C supports arguments -maes: YES 00:01:28.978 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:28.978 Compiler for C supports arguments -mavx512bw: YES 00:01:28.978 Compiler for C supports arguments -mavx512dq: YES 00:01:28.978 Compiler for C supports arguments -mavx512vl: YES 00:01:28.978 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:28.978 Compiler for C supports arguments -mavx2: YES 00:01:28.978 Compiler for C supports arguments -mavx: YES 00:01:28.978 Message: lib/net: Defining dependency "net" 00:01:28.978 Message: lib/meter: Defining dependency "meter" 00:01:28.978 Message: lib/ethdev: Defining dependency "ethdev" 00:01:28.978 Message: lib/pci: Defining dependency "pci" 00:01:28.978 Message: lib/cmdline: Defining dependency "cmdline" 00:01:28.978 Message: lib/metrics: Defining dependency "metrics" 00:01:28.978 Message: lib/hash: Defining dependency "hash" 00:01:28.978 Message: lib/timer: Defining dependency "timer" 00:01:28.978 Fetching value of define "__AVX2__" : (undefined) (cached) 00:01:28.978 Compiler for C supports arguments -mavx2: YES (cached) 00:01:28.978 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:28.978 Fetching value of define "__AVX512VL__" : (undefined) (cached) 00:01:28.978 Fetching value of define "__AVX512CD__" : (undefined) (cached) 00:01:28.978 Fetching value of define "__AVX512BW__" : (undefined) (cached) 00:01:28.978 Compiler for C supports arguments -mavx512f -mavx512vl -mavx512cd -mavx512bw: YES 00:01:28.978 Message: lib/acl: Defining dependency "acl" 00:01:28.978 Message: lib/bbdev: Defining dependency "bbdev" 00:01:28.978 Message: lib/bitratestats: Defining dependency "bitratestats" 00:01:28.978 Run-time dependency libelf found: YES 0.190 00:01:28.978 Message: lib/bpf: Defining dependency "bpf" 00:01:28.978 Message: lib/cfgfile: Defining dependency "cfgfile" 00:01:28.978 Message: lib/compressdev: Defining dependency "compressdev" 00:01:28.978 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:28.978 Message: lib/distributor: Defining dependency "distributor" 00:01:28.978 Message: lib/efd: Defining dependency "efd" 00:01:28.978 Message: lib/eventdev: Defining dependency "eventdev" 00:01:28.978 Message: lib/gpudev: Defining dependency "gpudev" 00:01:28.978 Message: lib/gro: Defining dependency "gro" 00:01:28.978 Message: lib/gso: Defining dependency "gso" 00:01:28.978 Message: lib/ip_frag: Defining dependency "ip_frag" 00:01:28.978 Message: lib/jobstats: Defining dependency "jobstats" 00:01:28.978 Message: lib/latencystats: Defining dependency "latencystats" 00:01:28.978 Message: lib/lpm: Defining dependency "lpm" 00:01:28.978 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:28.978 Fetching value of define "__AVX512DQ__" : (undefined) (cached) 00:01:28.978 Fetching value of define "__AVX512IFMA__" : (undefined) 00:01:28.978 Compiler for C supports arguments -mavx512f -mavx512dq -mavx512ifma: YES 00:01:28.978 Message: lib/member: Defining dependency "member" 00:01:28.978 Message: lib/pcapng: Defining dependency "pcapng" 00:01:28.978 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:28.978 Message: lib/power: Defining dependency "power" 00:01:28.978 Message: lib/rawdev: Defining dependency "rawdev" 00:01:28.978 Message: lib/regexdev: Defining dependency "regexdev" 00:01:28.978 Message: lib/dmadev: Defining dependency "dmadev" 00:01:28.978 Message: lib/rib: Defining dependency "rib" 00:01:28.978 Message: lib/reorder: Defining dependency "reorder" 00:01:28.978 Message: lib/sched: Defining dependency "sched" 00:01:28.978 Message: lib/security: Defining dependency "security" 00:01:28.978 Message: lib/stack: Defining dependency "stack" 00:01:28.978 Has header "linux/userfaultfd.h" : YES 00:01:28.978 Message: lib/vhost: Defining dependency "vhost" 00:01:28.978 Message: lib/ipsec: Defining dependency "ipsec" 00:01:28.978 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:28.978 Fetching value of define "__AVX512DQ__" : (undefined) (cached) 00:01:28.978 Compiler for C supports arguments -mavx512f -mavx512dq: YES 00:01:28.978 Compiler for C supports arguments -mavx512bw: YES (cached) 00:01:28.978 Message: lib/fib: Defining dependency "fib" 00:01:28.978 Message: lib/port: Defining dependency "port" 00:01:28.978 Message: lib/pdump: Defining dependency "pdump" 00:01:28.978 Message: lib/table: Defining dependency "table" 00:01:28.978 Message: lib/pipeline: Defining dependency "pipeline" 00:01:28.978 Message: lib/graph: Defining dependency "graph" 00:01:28.978 Message: lib/node: Defining dependency "node" 00:01:28.978 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:28.978 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:28.978 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:28.979 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:28.979 Compiler for C supports arguments -Wno-sign-compare: YES 00:01:28.979 Compiler for C supports arguments -Wno-unused-value: YES 00:01:29.911 Compiler for C supports arguments -Wno-format: YES 00:01:29.911 Compiler for C supports arguments -Wno-format-security: YES 00:01:29.911 Compiler for C supports arguments -Wno-format-nonliteral: YES 00:01:29.911 Compiler for C supports arguments -Wno-strict-aliasing: YES 00:01:29.911 Compiler for C supports arguments -Wno-unused-but-set-variable: YES 00:01:29.911 Compiler for C supports arguments -Wno-unused-parameter: YES 00:01:29.911 Fetching value of define "__AVX2__" : (undefined) (cached) 00:01:29.911 Compiler for C supports arguments -mavx2: YES (cached) 00:01:29.911 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:29.911 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:29.911 Compiler for C supports arguments -mavx512bw: YES (cached) 00:01:29.911 Compiler for C supports arguments -march=skylake-avx512: YES 00:01:29.911 Message: drivers/net/i40e: Defining dependency "net_i40e" 00:01:29.911 Program doxygen found: YES (/usr/bin/doxygen) 00:01:29.911 Configuring doxy-api.conf using configuration 00:01:29.911 Program sphinx-build found: NO 00:01:29.911 Configuring rte_build_config.h using configuration 00:01:29.911 Message: 00:01:29.911 ================= 00:01:29.911 Applications Enabled 00:01:29.911 ================= 00:01:29.911 00:01:29.911 apps: 00:01:29.911 dumpcap, pdump, proc-info, test-acl, test-bbdev, test-cmdline, test-compress-perf, test-crypto-perf, 00:01:29.911 test-eventdev, test-fib, test-flow-perf, test-gpudev, test-pipeline, test-pmd, test-regex, test-sad, 00:01:29.911 test-security-perf, 00:01:29.911 00:01:29.911 Message: 00:01:29.911 ================= 00:01:29.911 Libraries Enabled 00:01:29.911 ================= 00:01:29.911 00:01:29.911 libs: 00:01:29.911 kvargs, telemetry, eal, ring, rcu, mempool, mbuf, net, 00:01:29.911 meter, ethdev, pci, cmdline, metrics, hash, timer, acl, 00:01:29.911 bbdev, bitratestats, bpf, cfgfile, compressdev, cryptodev, distributor, efd, 00:01:29.911 eventdev, gpudev, gro, gso, ip_frag, jobstats, latencystats, lpm, 00:01:29.911 member, pcapng, power, rawdev, regexdev, dmadev, rib, reorder, 00:01:29.911 sched, security, stack, vhost, ipsec, fib, port, pdump, 00:01:29.911 table, pipeline, graph, node, 00:01:29.911 00:01:29.911 Message: 00:01:29.911 =============== 00:01:29.911 Drivers Enabled 00:01:29.911 =============== 00:01:29.911 00:01:29.911 common: 00:01:29.911 00:01:29.911 bus: 00:01:29.911 pci, vdev, 00:01:29.911 mempool: 00:01:29.911 ring, 00:01:29.911 dma: 00:01:29.911 00:01:29.911 net: 00:01:29.911 i40e, 00:01:29.911 raw: 00:01:29.911 00:01:29.911 crypto: 00:01:29.911 00:01:29.911 compress: 00:01:29.911 00:01:29.911 regex: 00:01:29.911 00:01:29.911 vdpa: 00:01:29.911 00:01:29.911 event: 00:01:29.911 00:01:29.911 baseband: 00:01:29.911 00:01:29.911 gpu: 00:01:29.911 00:01:29.911 00:01:29.911 Message: 00:01:29.911 ================= 00:01:29.911 Content Skipped 00:01:29.911 ================= 00:01:29.911 00:01:29.911 apps: 00:01:29.911 00:01:29.911 libs: 00:01:29.911 kni: explicitly disabled via build config (deprecated lib) 00:01:29.911 flow_classify: explicitly disabled via build config (deprecated lib) 00:01:29.911 00:01:29.911 drivers: 00:01:29.911 common/cpt: not in enabled drivers build config 00:01:29.911 common/dpaax: not in enabled drivers build config 00:01:29.911 common/iavf: not in enabled drivers build config 00:01:29.911 common/idpf: not in enabled drivers build config 00:01:29.911 common/mvep: not in enabled drivers build config 00:01:29.911 common/octeontx: not in enabled drivers build config 00:01:29.911 bus/auxiliary: not in enabled drivers build config 00:01:29.911 bus/dpaa: not in enabled drivers build config 00:01:29.911 bus/fslmc: not in enabled drivers build config 00:01:29.911 bus/ifpga: not in enabled drivers build config 00:01:29.911 bus/vmbus: not in enabled drivers build config 00:01:29.911 common/cnxk: not in enabled drivers build config 00:01:29.911 common/mlx5: not in enabled drivers build config 00:01:29.911 common/qat: not in enabled drivers build config 00:01:29.911 common/sfc_efx: not in enabled drivers build config 00:01:29.911 mempool/bucket: not in enabled drivers build config 00:01:29.911 mempool/cnxk: not in enabled drivers build config 00:01:29.911 mempool/dpaa: not in enabled drivers build config 00:01:29.911 mempool/dpaa2: not in enabled drivers build config 00:01:29.911 mempool/octeontx: not in enabled drivers build config 00:01:29.911 mempool/stack: not in enabled drivers build config 00:01:29.911 dma/cnxk: not in enabled drivers build config 00:01:29.911 dma/dpaa: not in enabled drivers build config 00:01:29.911 dma/dpaa2: not in enabled drivers build config 00:01:29.911 dma/hisilicon: not in enabled drivers build config 00:01:29.911 dma/idxd: not in enabled drivers build config 00:01:29.911 dma/ioat: not in enabled drivers build config 00:01:29.911 dma/skeleton: not in enabled drivers build config 00:01:29.911 net/af_packet: not in enabled drivers build config 00:01:29.911 net/af_xdp: not in enabled drivers build config 00:01:29.911 net/ark: not in enabled drivers build config 00:01:29.911 net/atlantic: not in enabled drivers build config 00:01:29.911 net/avp: not in enabled drivers build config 00:01:29.911 net/axgbe: not in enabled drivers build config 00:01:29.911 net/bnx2x: not in enabled drivers build config 00:01:29.911 net/bnxt: not in enabled drivers build config 00:01:29.912 net/bonding: not in enabled drivers build config 00:01:29.912 net/cnxk: not in enabled drivers build config 00:01:29.912 net/cxgbe: not in enabled drivers build config 00:01:29.912 net/dpaa: not in enabled drivers build config 00:01:29.912 net/dpaa2: not in enabled drivers build config 00:01:29.912 net/e1000: not in enabled drivers build config 00:01:29.912 net/ena: not in enabled drivers build config 00:01:29.912 net/enetc: not in enabled drivers build config 00:01:29.912 net/enetfec: not in enabled drivers build config 00:01:29.912 net/enic: not in enabled drivers build config 00:01:29.912 net/failsafe: not in enabled drivers build config 00:01:29.912 net/fm10k: not in enabled drivers build config 00:01:29.912 net/gve: not in enabled drivers build config 00:01:29.912 net/hinic: not in enabled drivers build config 00:01:29.912 net/hns3: not in enabled drivers build config 00:01:29.912 net/iavf: not in enabled drivers build config 00:01:29.912 net/ice: not in enabled drivers build config 00:01:29.912 net/idpf: not in enabled drivers build config 00:01:29.912 net/igc: not in enabled drivers build config 00:01:29.912 net/ionic: not in enabled drivers build config 00:01:29.912 net/ipn3ke: not in enabled drivers build config 00:01:29.912 net/ixgbe: not in enabled drivers build config 00:01:29.912 net/kni: not in enabled drivers build config 00:01:29.912 net/liquidio: not in enabled drivers build config 00:01:29.912 net/mana: not in enabled drivers build config 00:01:29.912 net/memif: not in enabled drivers build config 00:01:29.912 net/mlx4: not in enabled drivers build config 00:01:29.912 net/mlx5: not in enabled drivers build config 00:01:29.912 net/mvneta: not in enabled drivers build config 00:01:29.912 net/mvpp2: not in enabled drivers build config 00:01:29.912 net/netvsc: not in enabled drivers build config 00:01:29.912 net/nfb: not in enabled drivers build config 00:01:29.912 net/nfp: not in enabled drivers build config 00:01:29.912 net/ngbe: not in enabled drivers build config 00:01:29.912 net/null: not in enabled drivers build config 00:01:29.912 net/octeontx: not in enabled drivers build config 00:01:29.912 net/octeon_ep: not in enabled drivers build config 00:01:29.912 net/pcap: not in enabled drivers build config 00:01:29.912 net/pfe: not in enabled drivers build config 00:01:29.912 net/qede: not in enabled drivers build config 00:01:29.912 net/ring: not in enabled drivers build config 00:01:29.912 net/sfc: not in enabled drivers build config 00:01:29.912 net/softnic: not in enabled drivers build config 00:01:29.912 net/tap: not in enabled drivers build config 00:01:29.912 net/thunderx: not in enabled drivers build config 00:01:29.912 net/txgbe: not in enabled drivers build config 00:01:29.912 net/vdev_netvsc: not in enabled drivers build config 00:01:29.912 net/vhost: not in enabled drivers build config 00:01:29.912 net/virtio: not in enabled drivers build config 00:01:29.912 net/vmxnet3: not in enabled drivers build config 00:01:29.912 raw/cnxk_bphy: not in enabled drivers build config 00:01:29.912 raw/cnxk_gpio: not in enabled drivers build config 00:01:29.912 raw/dpaa2_cmdif: not in enabled drivers build config 00:01:29.912 raw/ifpga: not in enabled drivers build config 00:01:29.912 raw/ntb: not in enabled drivers build config 00:01:29.912 raw/skeleton: not in enabled drivers build config 00:01:29.912 crypto/armv8: not in enabled drivers build config 00:01:29.912 crypto/bcmfs: not in enabled drivers build config 00:01:29.912 crypto/caam_jr: not in enabled drivers build config 00:01:29.912 crypto/ccp: not in enabled drivers build config 00:01:29.912 crypto/cnxk: not in enabled drivers build config 00:01:29.912 crypto/dpaa_sec: not in enabled drivers build config 00:01:29.912 crypto/dpaa2_sec: not in enabled drivers build config 00:01:29.912 crypto/ipsec_mb: not in enabled drivers build config 00:01:29.912 crypto/mlx5: not in enabled drivers build config 00:01:29.912 crypto/mvsam: not in enabled drivers build config 00:01:29.912 crypto/nitrox: not in enabled drivers build config 00:01:29.912 crypto/null: not in enabled drivers build config 00:01:29.912 crypto/octeontx: not in enabled drivers build config 00:01:29.912 crypto/openssl: not in enabled drivers build config 00:01:29.912 crypto/scheduler: not in enabled drivers build config 00:01:29.912 crypto/uadk: not in enabled drivers build config 00:01:29.912 crypto/virtio: not in enabled drivers build config 00:01:29.912 compress/isal: not in enabled drivers build config 00:01:29.912 compress/mlx5: not in enabled drivers build config 00:01:29.912 compress/octeontx: not in enabled drivers build config 00:01:29.912 compress/zlib: not in enabled drivers build config 00:01:29.912 regex/mlx5: not in enabled drivers build config 00:01:29.912 regex/cn9k: not in enabled drivers build config 00:01:29.912 vdpa/ifc: not in enabled drivers build config 00:01:29.912 vdpa/mlx5: not in enabled drivers build config 00:01:29.912 vdpa/sfc: not in enabled drivers build config 00:01:29.912 event/cnxk: not in enabled drivers build config 00:01:29.912 event/dlb2: not in enabled drivers build config 00:01:29.912 event/dpaa: not in enabled drivers build config 00:01:29.912 event/dpaa2: not in enabled drivers build config 00:01:29.912 event/dsw: not in enabled drivers build config 00:01:29.912 event/opdl: not in enabled drivers build config 00:01:29.912 event/skeleton: not in enabled drivers build config 00:01:29.912 event/sw: not in enabled drivers build config 00:01:29.912 event/octeontx: not in enabled drivers build config 00:01:29.912 baseband/acc: not in enabled drivers build config 00:01:29.912 baseband/fpga_5gnr_fec: not in enabled drivers build config 00:01:29.912 baseband/fpga_lte_fec: not in enabled drivers build config 00:01:29.912 baseband/la12xx: not in enabled drivers build config 00:01:29.912 baseband/null: not in enabled drivers build config 00:01:29.912 baseband/turbo_sw: not in enabled drivers build config 00:01:29.912 gpu/cuda: not in enabled drivers build config 00:01:29.912 00:01:29.912 00:01:29.912 Build targets in project: 316 00:01:29.912 00:01:29.912 DPDK 22.11.4 00:01:29.912 00:01:29.912 User defined options 00:01:29.912 libdir : lib 00:01:29.912 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:29.912 c_args : -fPIC -g -fcommon -Werror -Wno-stringop-overflow 00:01:29.912 c_link_args : 00:01:29.912 enable_docs : false 00:01:29.912 enable_drivers: bus,bus/pci,bus/vdev,mempool/ring,net/i40e,net/i40e/base, 00:01:29.912 enable_kmods : false 00:01:29.912 machine : native 00:01:29.912 tests : false 00:01:29.912 00:01:29.912 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:29.912 WARNING: Running the setup command as `meson [options]` instead of `meson setup [options]` is ambiguous and deprecated. 00:01:30.174 09:47:35 -- common/autobuild_common.sh@186 -- $ ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp -j48 00:01:30.174 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp' 00:01:30.174 [1/745] Generating lib/rte_kvargs_mingw with a custom command 00:01:30.174 [2/745] Generating lib/rte_kvargs_def with a custom command 00:01:30.174 [3/745] Generating lib/rte_telemetry_def with a custom command 00:01:30.174 [4/745] Generating lib/rte_telemetry_mingw with a custom command 00:01:30.174 [5/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:30.174 [6/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:30.174 [7/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:30.174 [8/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:30.174 [9/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:30.174 [10/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:30.434 [11/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:30.434 [12/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:30.434 [13/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:30.434 [14/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:30.434 [15/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:30.434 [16/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:30.434 [17/745] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:30.434 [18/745] Linking static target lib/librte_kvargs.a 00:01:30.434 [19/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:30.434 [20/745] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:30.434 [21/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:30.434 [22/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:30.434 [23/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:30.434 [24/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:30.434 [25/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:30.434 [26/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:30.434 [27/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:30.434 [28/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:30.434 [29/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:30.434 [30/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:30.434 [31/745] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:30.434 [32/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:30.434 [33/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_log.c.o 00:01:30.434 [34/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:30.434 [35/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:30.434 [36/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:30.434 [37/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:30.434 [38/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:30.434 [39/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:30.434 [40/745] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:30.434 [41/745] Generating lib/rte_eal_def with a custom command 00:01:30.434 [42/745] Generating lib/rte_eal_mingw with a custom command 00:01:30.434 [43/745] Generating lib/rte_ring_def with a custom command 00:01:30.434 [44/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:30.434 [45/745] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:30.434 [46/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:30.434 [47/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:30.434 [48/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:30.434 [49/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:30.434 [50/745] Generating lib/rte_ring_mingw with a custom command 00:01:30.435 [51/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:30.435 [52/745] Generating lib/rte_rcu_def with a custom command 00:01:30.435 [53/745] Generating lib/rte_rcu_mingw with a custom command 00:01:30.697 [54/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:30.697 [55/745] Generating lib/rte_mempool_def with a custom command 00:01:30.697 [56/745] Generating lib/rte_mempool_mingw with a custom command 00:01:30.697 [57/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:30.697 [58/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:30.697 [59/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:30.697 [60/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_log.c.o 00:01:30.697 [61/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:30.697 [62/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:30.697 [63/745] Generating lib/rte_mbuf_def with a custom command 00:01:30.697 [64/745] Generating lib/rte_mbuf_mingw with a custom command 00:01:30.697 [65/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:30.697 [66/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:30.697 [67/745] Generating lib/rte_meter_def with a custom command 00:01:30.697 [68/745] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:30.697 [69/745] Generating lib/rte_net_mingw with a custom command 00:01:30.697 [70/745] Generating lib/rte_net_def with a custom command 00:01:30.697 [71/745] Generating lib/rte_meter_mingw with a custom command 00:01:30.697 [72/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:30.697 [73/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:30.697 [74/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:30.697 [75/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:30.697 [76/745] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:30.697 [77/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:30.697 [78/745] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.697 [79/745] Generating lib/rte_ethdev_def with a custom command 00:01:30.697 [80/745] Linking target lib/librte_kvargs.so.23.0 00:01:30.697 [81/745] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:30.697 [82/745] Linking static target lib/librte_ring.a 00:01:30.697 [83/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:30.697 [84/745] Generating lib/rte_ethdev_mingw with a custom command 00:01:30.960 [85/745] Generating lib/rte_pci_def with a custom command 00:01:30.960 [86/745] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:30.960 [87/745] Linking static target lib/librte_meter.a 00:01:30.960 [88/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:30.960 [89/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:30.960 [90/745] Generating lib/rte_pci_mingw with a custom command 00:01:30.960 [91/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:30.960 [92/745] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:30.960 [93/745] Linking static target lib/librte_pci.a 00:01:30.960 [94/745] Generating symbol file lib/librte_kvargs.so.23.0.p/librte_kvargs.so.23.0.symbols 00:01:30.960 [95/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:31.224 [96/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:31.224 [97/745] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:31.224 [98/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:31.224 [99/745] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:31.224 [100/745] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:31.224 [101/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:31.224 [102/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:31.224 [103/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:31.224 [104/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:31.224 [105/745] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:31.224 [106/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:31.224 [107/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:31.224 [108/745] Generating lib/rte_cmdline_def with a custom command 00:01:31.224 [109/745] Generating lib/rte_cmdline_mingw with a custom command 00:01:31.224 [110/745] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:31.224 [111/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:31.224 [112/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:31.224 [113/745] Linking static target lib/librte_telemetry.a 00:01:31.224 [114/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:31.224 [115/745] Generating lib/rte_metrics_def with a custom command 00:01:31.485 [116/745] Generating lib/rte_metrics_mingw with a custom command 00:01:31.485 [117/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:31.485 [118/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:31.485 [119/745] Generating lib/rte_hash_def with a custom command 00:01:31.485 [120/745] Generating lib/rte_hash_mingw with a custom command 00:01:31.485 [121/745] Generating lib/rte_timer_def with a custom command 00:01:31.485 [122/745] Generating lib/rte_timer_mingw with a custom command 00:01:31.485 [123/745] Compiling C object lib/librte_metrics.a.p/metrics_rte_metrics.c.o 00:01:31.485 [124/745] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:31.748 [125/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:31.748 [126/745] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:31.748 [127/745] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:31.748 [128/745] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:31.748 [129/745] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:31.748 [130/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:31.748 [131/745] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:31.748 [132/745] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:31.748 [133/745] Generating lib/rte_acl_def with a custom command 00:01:31.748 [134/745] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:31.748 [135/745] Generating lib/rte_acl_mingw with a custom command 00:01:31.748 [136/745] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:31.748 [137/745] Generating lib/rte_bbdev_mingw with a custom command 00:01:31.748 [138/745] Generating lib/rte_bbdev_def with a custom command 00:01:31.748 [139/745] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:31.748 [140/745] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:31.748 [141/745] Generating lib/rte_bitratestats_def with a custom command 00:01:31.748 [142/745] Generating lib/rte_bitratestats_mingw with a custom command 00:01:32.008 [143/745] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:32.008 [144/745] Linking target lib/librte_telemetry.so.23.0 00:01:32.008 [145/745] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:32.008 [146/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:32.008 [147/745] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:32.008 [148/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:32.008 [149/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:32.008 [150/745] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:32.008 [151/745] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:32.008 [152/745] Generating lib/rte_bpf_def with a custom command 00:01:32.008 [153/745] Generating lib/rte_bpf_mingw with a custom command 00:01:32.008 [154/745] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:32.008 [155/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:32.008 [156/745] Generating lib/rte_cfgfile_def with a custom command 00:01:32.008 [157/745] Generating lib/rte_cfgfile_mingw with a custom command 00:01:32.008 [158/745] Generating symbol file lib/librte_telemetry.so.23.0.p/librte_telemetry.so.23.0.symbols 00:01:32.274 [159/745] Generating lib/rte_compressdev_def with a custom command 00:01:32.274 [160/745] Generating lib/rte_compressdev_mingw with a custom command 00:01:32.274 [161/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:32.274 [162/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:32.274 [163/745] Generating lib/rte_cryptodev_def with a custom command 00:01:32.274 [164/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:32.274 [165/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:32.274 [166/745] Generating lib/rte_cryptodev_mingw with a custom command 00:01:32.274 [167/745] Linking static target lib/librte_cmdline.a 00:01:32.274 [168/745] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:32.274 [169/745] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:32.274 [170/745] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:32.274 [171/745] Linking static target lib/librte_timer.a 00:01:32.274 [172/745] Linking static target lib/librte_rcu.a 00:01:32.274 [173/745] Generating lib/rte_distributor_def with a custom command 00:01:32.274 [174/745] Generating lib/rte_distributor_mingw with a custom command 00:01:32.274 [175/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:32.274 [176/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:32.274 [177/745] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:32.274 [178/745] Linking static target lib/librte_net.a 00:01:32.274 [179/745] Generating lib/rte_efd_def with a custom command 00:01:32.274 [180/745] Generating lib/rte_efd_mingw with a custom command 00:01:32.537 [181/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:32.537 [182/745] Compiling C object lib/librte_metrics.a.p/metrics_rte_metrics_telemetry.c.o 00:01:32.537 [183/745] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:32.537 [184/745] Linking static target lib/librte_metrics.a 00:01:32.537 [185/745] Linking static target lib/librte_mempool.a 00:01:32.537 [186/745] Compiling C object lib/librte_cfgfile.a.p/cfgfile_rte_cfgfile.c.o 00:01:32.537 [187/745] Linking static target lib/librte_cfgfile.a 00:01:32.796 [188/745] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:32.796 [189/745] Compiling C object lib/librte_acl.a.p/acl_tb_mem.c.o 00:01:32.796 [190/745] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:32.796 [191/745] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:32.796 [192/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:32.796 [193/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:32.796 [194/745] Compiling C object lib/librte_acl.a.p/acl_rte_acl.c.o 00:01:32.796 [195/745] Generating lib/rte_eventdev_def with a custom command 00:01:32.796 [196/745] Linking static target lib/librte_eal.a 00:01:33.064 [197/745] Generating lib/rte_eventdev_mingw with a custom command 00:01:33.064 [198/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf.c.o 00:01:33.064 [199/745] Generating lib/rte_gpudev_def with a custom command 00:01:33.064 [200/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_stub.c.o 00:01:33.064 [201/745] Compiling C object lib/librte_acl.a.p/acl_acl_gen.c.o 00:01:33.064 [202/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_dump.c.o 00:01:33.064 [203/745] Generating lib/rte_gpudev_mingw with a custom command 00:01:33.064 [204/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_load.c.o 00:01:33.064 [205/745] Compiling C object lib/librte_bitratestats.a.p/bitratestats_rte_bitrate.c.o 00:01:33.064 [206/745] Linking static target lib/librte_bitratestats.a 00:01:33.064 [207/745] Generating lib/cfgfile.sym_chk with a custom command (wrapped by meson to capture output) 00:01:33.064 [208/745] Generating lib/rte_gro_def with a custom command 00:01:33.064 [209/745] Generating lib/metrics.sym_chk with a custom command (wrapped by meson to capture output) 00:01:33.064 [210/745] Generating lib/rte_gro_mingw with a custom command 00:01:33.325 [211/745] Compiling C object lib/librte_acl.a.p/acl_acl_run_scalar.c.o 00:01:33.325 [212/745] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:33.325 [213/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_load_elf.c.o 00:01:33.325 [214/745] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:33.325 [215/745] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor_match_sse.c.o 00:01:33.325 [216/745] Generating lib/bitratestats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:33.325 [217/745] Generating lib/rte_gso_def with a custom command 00:01:33.586 [218/745] Generating lib/rte_gso_mingw with a custom command 00:01:33.586 [219/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_convert.c.o 00:01:33.586 [220/745] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:33.586 [221/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_exec.c.o 00:01:33.586 [222/745] Compiling C object lib/librte_eventdev.a.p/eventdev_eventdev_private.c.o 00:01:33.586 [223/745] Generating lib/rte_ip_frag_def with a custom command 00:01:33.586 [224/745] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:33.586 [225/745] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor_single.c.o 00:01:33.586 [226/745] Compiling C object lib/librte_bbdev.a.p/bbdev_rte_bbdev.c.o 00:01:33.586 [227/745] Linking static target lib/librte_bbdev.a 00:01:33.586 [228/745] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:33.586 [229/745] Generating lib/rte_ip_frag_mingw with a custom command 00:01:33.586 [230/745] Generating lib/rte_jobstats_def with a custom command 00:01:33.847 [231/745] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:33.847 [232/745] Generating lib/rte_jobstats_mingw with a custom command 00:01:33.847 [233/745] Generating lib/rte_latencystats_def with a custom command 00:01:33.847 [234/745] Generating lib/rte_latencystats_mingw with a custom command 00:01:33.847 [235/745] Compiling C object lib/librte_eventdev.a.p/eventdev_eventdev_trace_points.c.o 00:01:33.847 [236/745] Generating lib/rte_lpm_def with a custom command 00:01:33.847 [237/745] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:33.847 [238/745] Generating lib/rte_lpm_mingw with a custom command 00:01:33.847 [239/745] Linking static target lib/librte_compressdev.a 00:01:33.847 [240/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_ring.c.o 00:01:33.847 [241/745] Compiling C object lib/librte_jobstats.a.p/jobstats_rte_jobstats.c.o 00:01:33.847 [242/745] Linking static target lib/librte_jobstats.a 00:01:34.111 [243/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_pkt.c.o 00:01:34.111 [244/745] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:34.372 [245/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_validate.c.o 00:01:34.372 [246/745] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor.c.o 00:01:34.372 [247/745] Generating lib/rte_member_def with a custom command 00:01:34.372 [248/745] Linking static target lib/librte_distributor.a 00:01:34.372 [249/745] Compiling C object lib/librte_gso.a.p/gso_gso_udp4.c.o 00:01:34.372 [250/745] Generating lib/rte_member_mingw with a custom command 00:01:34.372 [251/745] Compiling C object lib/librte_gso.a.p/gso_gso_tcp4.c.o 00:01:34.372 [252/745] Generating lib/jobstats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.372 [253/745] Generating lib/rte_pcapng_mingw with a custom command 00:01:34.372 [254/745] Generating lib/rte_pcapng_def with a custom command 00:01:34.636 [255/745] Compiling C object lib/librte_gso.a.p/gso_gso_tunnel_udp4.c.o 00:01:34.636 [256/745] Compiling C object lib/librte_gso.a.p/gso_gso_tunnel_tcp4.c.o 00:01:34.636 [257/745] Generating lib/bbdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.636 [258/745] Compiling C object lib/librte_gso.a.p/gso_rte_gso.c.o 00:01:34.636 [259/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_jit_x86.c.o 00:01:34.636 [260/745] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:34.636 [261/745] Linking static target lib/librte_bpf.a 00:01:34.636 [262/745] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:34.636 [263/745] Compiling C object lib/librte_gro.a.p/gro_gro_tcp4.c.o 00:01:34.636 [264/745] Compiling C object lib/librte_gro.a.p/gro_gro_udp4.c.o 00:01:34.636 [265/745] Compiling C object lib/librte_gro.a.p/gro_rte_gro.c.o 00:01:34.636 [266/745] Compiling C object lib/librte_gpudev.a.p/gpudev_gpudev.c.o 00:01:34.636 [267/745] Generating lib/rte_power_def with a custom command 00:01:34.636 [268/745] Linking static target lib/librte_gpudev.a 00:01:34.636 [269/745] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:34.636 [270/745] Generating lib/rte_power_mingw with a custom command 00:01:34.636 [271/745] Generating lib/distributor.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.636 [272/745] Compiling C object lib/librte_gro.a.p/gro_gro_vxlan_udp4.c.o 00:01:34.636 [273/745] Compiling C object lib/librte_gro.a.p/gro_gro_vxlan_tcp4.c.o 00:01:34.636 [274/745] Linking static target lib/librte_gro.a 00:01:34.899 [275/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv4_reassembly.c.o 00:01:34.899 [276/745] Generating lib/rte_rawdev_def with a custom command 00:01:34.899 [277/745] Generating lib/rte_rawdev_mingw with a custom command 00:01:34.899 [278/745] Generating lib/rte_regexdev_def with a custom command 00:01:34.899 [279/745] Generating lib/rte_regexdev_mingw with a custom command 00:01:34.899 [280/745] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:34.899 [281/745] Generating lib/rte_dmadev_def with a custom command 00:01:34.899 [282/745] Generating lib/rte_dmadev_mingw with a custom command 00:01:34.899 [283/745] Generating lib/rte_rib_def with a custom command 00:01:34.899 [284/745] Generating lib/rte_rib_mingw with a custom command 00:01:34.899 [285/745] Generating lib/rte_reorder_def with a custom command 00:01:34.899 [286/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv6_reassembly.c.o 00:01:35.165 [287/745] Generating lib/rte_reorder_mingw with a custom command 00:01:35.165 [288/745] Compiling C object lib/librte_power.a.p/power_rte_power_empty_poll.c.o 00:01:35.165 [289/745] Generating lib/bpf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:35.165 [290/745] Generating lib/gro.sym_chk with a custom command (wrapped by meson to capture output) 00:01:35.165 [291/745] Compiling C object lib/librte_member.a.p/member_rte_member.c.o 00:01:35.165 [292/745] Generating lib/rte_sched_def with a custom command 00:01:35.165 [293/745] Generating lib/rte_sched_mingw with a custom command 00:01:35.165 [294/745] Compiling C object lib/librte_latencystats.a.p/latencystats_rte_latencystats.c.o 00:01:35.165 [295/745] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:35.165 [296/745] Linking static target lib/librte_latencystats.a 00:01:35.165 [297/745] Compiling C object lib/librte_acl.a.p/acl_acl_bld.c.o 00:01:35.165 [298/745] Compiling C object lib/member/libsketch_avx512_tmp.a.p/rte_member_sketch_avx512.c.o 00:01:35.165 [299/745] Linking static target lib/member/libsketch_avx512_tmp.a 00:01:35.165 [300/745] Compiling C object lib/librte_sched.a.p/sched_rte_red.c.o 00:01:35.165 [301/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_ip_frag_internal.c.o 00:01:35.165 [302/745] Compiling C object lib/librte_sched.a.p/sched_rte_pie.c.o 00:01:35.165 [303/745] Generating lib/rte_security_def with a custom command 00:01:35.429 [304/745] Generating lib/rte_security_mingw with a custom command 00:01:35.429 [305/745] Compiling C object lib/librte_sched.a.p/sched_rte_approx.c.o 00:01:35.429 [306/745] Compiling C object lib/librte_member.a.p/member_rte_member_vbf.c.o 00:01:35.429 [307/745] Generating lib/rte_stack_def with a custom command 00:01:35.429 [308/745] Generating lib/rte_stack_mingw with a custom command 00:01:35.429 [309/745] Compiling C object lib/librte_rawdev.a.p/rawdev_rte_rawdev.c.o 00:01:35.429 [310/745] Linking static target lib/librte_rawdev.a 00:01:35.429 [311/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv6_fragmentation.c.o 00:01:35.429 [312/745] Compiling C object lib/librte_stack.a.p/stack_rte_stack_std.c.o 00:01:35.429 [313/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_crypto_adapter.c.o 00:01:35.429 [314/745] Compiling C object lib/librte_stack.a.p/stack_rte_stack_lf.c.o 00:01:35.429 [315/745] Compiling C object lib/librte_stack.a.p/stack_rte_stack.c.o 00:01:35.429 [316/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ip_frag_common.c.o 00:01:35.429 [317/745] Linking static target lib/librte_stack.a 00:01:35.429 [318/745] Compiling C object lib/librte_lpm.a.p/lpm_rte_lpm.c.o 00:01:35.429 [319/745] Generating lib/rte_vhost_def with a custom command 00:01:35.429 [320/745] Generating lib/rte_vhost_mingw with a custom command 00:01:35.429 [321/745] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:35.693 [322/745] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:35.693 [323/745] Linking static target lib/librte_dmadev.a 00:01:35.693 [324/745] Generating lib/latencystats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:35.693 [325/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_eventdev.c.o 00:01:35.693 [326/745] Generating lib/rte_ipsec_def with a custom command 00:01:35.693 [327/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv4_fragmentation.c.o 00:01:35.693 [328/745] Linking static target lib/librte_ip_frag.a 00:01:35.693 [329/745] Generating lib/rte_ipsec_mingw with a custom command 00:01:35.693 [330/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_eth_tx_adapter.c.o 00:01:35.693 [331/745] Generating lib/stack.sym_chk with a custom command (wrapped by meson to capture output) 00:01:35.956 [332/745] Compiling C object lib/librte_acl.a.p/acl_acl_run_sse.c.o 00:01:35.956 [333/745] Generating lib/gpudev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:35.956 [334/745] Compiling C object lib/librte_power.a.p/power_rte_power_intel_uncore.c.o 00:01:36.220 [335/745] Generating lib/rawdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:36.220 [336/745] Compiling C object lib/librte_fib.a.p/fib_rte_fib.c.o 00:01:36.220 [337/745] Generating lib/rte_fib_def with a custom command 00:01:36.220 [338/745] Generating lib/ip_frag.sym_chk with a custom command (wrapped by meson to capture output) 00:01:36.220 [339/745] Generating lib/rte_fib_mingw with a custom command 00:01:36.220 [340/745] Compiling C object lib/librte_gso.a.p/gso_gso_common.c.o 00:01:36.220 [341/745] Linking static target lib/librte_gso.a 00:01:36.220 [342/745] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:36.220 [343/745] Compiling C object lib/librte_regexdev.a.p/regexdev_rte_regexdev.c.o 00:01:36.220 [344/745] Linking static target lib/librte_regexdev.a 00:01:36.220 [345/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:36.479 [346/745] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:36.479 [347/745] Compiling C object lib/librte_member.a.p/member_rte_member_ht.c.o 00:01:36.479 [348/745] Generating lib/gso.sym_chk with a custom command (wrapped by meson to capture output) 00:01:36.479 [349/745] Compiling C object lib/librte_efd.a.p/efd_rte_efd.c.o 00:01:36.479 [350/745] Linking static target lib/librte_efd.a 00:01:36.743 [351/745] Compiling C object lib/librte_pcapng.a.p/pcapng_rte_pcapng.c.o 00:01:36.743 [352/745] Linking static target lib/librte_pcapng.a 00:01:36.743 [353/745] Compiling C object lib/librte_lpm.a.p/lpm_rte_lpm6.c.o 00:01:36.743 [354/745] Linking static target lib/librte_lpm.a 00:01:36.743 [355/745] Compiling C object lib/librte_ipsec.a.p/ipsec_ses.c.o 00:01:36.743 [356/745] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:36.743 [357/745] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:36.743 [358/745] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:36.743 [359/745] Linking static target lib/librte_reorder.a 00:01:36.743 [360/745] Compiling C object lib/librte_rib.a.p/rib_rte_rib.c.o 00:01:36.743 [361/745] Compiling C object lib/librte_ipsec.a.p/ipsec_ipsec_telemetry.c.o 00:01:37.007 [362/745] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:37.007 [363/745] Generating lib/efd.sym_chk with a custom command (wrapped by meson to capture output) 00:01:37.007 [364/745] Generating lib/rte_port_def with a custom command 00:01:37.007 [365/745] Generating lib/rte_port_mingw with a custom command 00:01:37.007 [366/745] Generating lib/rte_pdump_def with a custom command 00:01:37.007 [367/745] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:37.007 [368/745] Compiling C object lib/acl/libavx2_tmp.a.p/acl_run_avx2.c.o 00:01:37.007 [369/745] Compiling C object lib/fib/libtrie_avx512_tmp.a.p/trie_avx512.c.o 00:01:37.007 [370/745] Linking static target lib/acl/libavx2_tmp.a 00:01:37.007 [371/745] Linking static target lib/fib/libtrie_avx512_tmp.a 00:01:37.007 [372/745] Generating lib/rte_pdump_mingw with a custom command 00:01:37.007 [373/745] Generating lib/pcapng.sym_chk with a custom command (wrapped by meson to capture output) 00:01:37.007 [374/745] Compiling C object lib/fib/libdir24_8_avx512_tmp.a.p/dir24_8_avx512.c.o 00:01:37.268 [375/745] Linking static target lib/fib/libdir24_8_avx512_tmp.a 00:01:37.268 [376/745] Compiling C object lib/librte_ipsec.a.p/ipsec_sa.c.o 00:01:37.268 [377/745] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:37.268 [378/745] Linking static target lib/librte_security.a 00:01:37.268 [379/745] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:37.268 [380/745] Generating lib/lpm.sym_chk with a custom command (wrapped by meson to capture output) 00:01:37.268 [381/745] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:37.268 [382/745] Compiling C object lib/librte_fib.a.p/fib_rte_fib6.c.o 00:01:37.268 [383/745] Compiling C object lib/librte_ipsec.a.p/ipsec_ipsec_sad.c.o 00:01:37.268 [384/745] Generating lib/regexdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:37.268 [385/745] Compiling C object lib/librte_table.a.p/table_rte_swx_keycmp.c.o 00:01:37.530 [386/745] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:37.530 [387/745] Linking static target lib/librte_power.a 00:01:37.530 [388/745] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:37.530 [389/745] Linking static target lib/librte_hash.a 00:01:37.530 [390/745] Compiling C object lib/acl/libavx512_tmp.a.p/acl_run_avx512.c.o 00:01:37.530 [391/745] Linking static target lib/acl/libavx512_tmp.a 00:01:37.530 [392/745] Linking static target lib/librte_acl.a 00:01:37.530 [393/745] Compiling C object lib/librte_rib.a.p/rib_rte_rib6.c.o 00:01:37.530 [394/745] Linking static target lib/librte_rib.a 00:01:37.530 [395/745] Compiling C object lib/librte_table.a.p/table_rte_swx_table_learner.c.o 00:01:37.791 [396/745] Compiling C object lib/librte_port.a.p/port_rte_port_sched.c.o 00:01:37.791 [397/745] Compiling C object lib/librte_table.a.p/table_rte_swx_table_em.c.o 00:01:37.791 [398/745] Generating lib/rte_table_def with a custom command 00:01:37.791 [399/745] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:37.791 [400/745] Generating lib/rte_table_mingw with a custom command 00:01:38.057 [401/745] Generating lib/acl.sym_chk with a custom command (wrapped by meson to capture output) 00:01:38.057 [402/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:38.057 [403/745] Linking static target lib/librte_ethdev.a 00:01:38.319 [404/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_eth_rx_adapter.c.o 00:01:38.319 [405/745] Generating lib/rib.sym_chk with a custom command (wrapped by meson to capture output) 00:01:38.319 [406/745] Compiling C object lib/librte_port.a.p/port_rte_port_frag.c.o 00:01:38.319 [407/745] Compiling C object lib/librte_port.a.p/port_rte_port_fd.c.o 00:01:38.319 [408/745] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:38.319 [409/745] Linking static target lib/librte_mbuf.a 00:01:38.319 [410/745] Compiling C object lib/librte_fib.a.p/fib_trie.c.o 00:01:38.319 [411/745] Generating lib/rte_pipeline_def with a custom command 00:01:38.319 [412/745] Compiling C object lib/librte_table.a.p/table_rte_table_array.c.o 00:01:38.319 [413/745] Compiling C object lib/librte_table.a.p/table_rte_swx_table_selector.c.o 00:01:38.602 [414/745] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:38.602 [415/745] Generating lib/rte_pipeline_mingw with a custom command 00:01:38.602 [416/745] Compiling C object lib/librte_table.a.p/table_rte_swx_table_wm.c.o 00:01:38.602 [417/745] Compiling C object lib/librte_port.a.p/port_rte_port_ras.c.o 00:01:38.602 [418/745] Compiling C object lib/librte_port.a.p/port_rte_port_ethdev.c.o 00:01:38.602 [419/745] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:38.602 [420/745] Generating lib/rte_graph_def with a custom command 00:01:38.602 [421/745] Generating lib/rte_graph_mingw with a custom command 00:01:38.602 [422/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_cuckoo.c.o 00:01:38.602 [423/745] Compiling C object lib/librte_fib.a.p/fib_dir24_8.c.o 00:01:38.602 [424/745] Linking static target lib/librte_fib.a 00:01:38.602 [425/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_timer_adapter.c.o 00:01:38.870 [426/745] Linking static target lib/librte_eventdev.a 00:01:38.870 [427/745] Compiling C object lib/librte_table.a.p/table_rte_table_acl.c.o 00:01:38.870 [428/745] Compiling C object lib/librte_table.a.p/table_rte_table_lpm.c.o 00:01:38.870 [429/745] Compiling C object lib/librte_port.a.p/port_rte_swx_port_ethdev.c.o 00:01:38.870 [430/745] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:38.870 [431/745] Compiling C object lib/librte_port.a.p/port_rte_port_sym_crypto.c.o 00:01:38.870 [432/745] Compiling C object lib/librte_member.a.p/member_rte_member_sketch.c.o 00:01:38.870 [433/745] Compiling C object lib/librte_port.a.p/port_rte_swx_port_fd.c.o 00:01:38.870 [434/745] Linking static target lib/librte_member.a 00:01:38.870 [435/745] Compiling C object lib/librte_node.a.p/node_null.c.o 00:01:38.870 [436/745] Generating lib/rte_node_def with a custom command 00:01:38.870 [437/745] Generating lib/rte_node_mingw with a custom command 00:01:38.870 [438/745] Compiling C object lib/librte_table.a.p/table_rte_table_stub.c.o 00:01:38.870 [439/745] Compiling C object lib/librte_table.a.p/table_rte_table_lpm_ipv6.c.o 00:01:39.131 [440/745] Generating lib/fib.sym_chk with a custom command (wrapped by meson to capture output) 00:01:39.131 [441/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:39.131 [442/745] Compiling C object lib/librte_port.a.p/port_rte_port_eventdev.c.o 00:01:39.131 [443/745] Generating drivers/rte_bus_pci_def with a custom command 00:01:39.131 [444/745] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:39.131 [445/745] Compiling C object lib/librte_sched.a.p/sched_rte_sched.c.o 00:01:39.395 [446/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_port_in_action.c.o 00:01:39.395 [447/745] Linking static target lib/librte_sched.a 00:01:39.395 [448/745] Generating drivers/rte_bus_pci_mingw with a custom command 00:01:39.395 [449/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:39.395 [450/745] Generating drivers/rte_bus_vdev_def with a custom command 00:01:39.395 [451/745] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:39.395 [452/745] Generating drivers/rte_bus_vdev_mingw with a custom command 00:01:39.395 [453/745] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:39.395 [454/745] Generating lib/member.sym_chk with a custom command (wrapped by meson to capture output) 00:01:39.395 [455/745] Generating drivers/rte_mempool_ring_def with a custom command 00:01:39.395 [456/745] Generating drivers/rte_mempool_ring_mingw with a custom command 00:01:39.395 [457/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key8.c.o 00:01:39.395 [458/745] Compiling C object lib/librte_port.a.p/port_rte_swx_port_ring.c.o 00:01:39.395 [459/745] Compiling C object lib/librte_ipsec.a.p/ipsec_esp_outb.c.o 00:01:39.656 [460/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:39.656 [461/745] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:39.656 [462/745] Linking static target lib/librte_cryptodev.a 00:01:39.656 [463/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:39.656 [464/745] Compiling C object lib/librte_pdump.a.p/pdump_rte_pdump.c.o 00:01:39.656 [465/745] Linking static target lib/librte_pdump.a 00:01:39.656 [466/745] Compiling C object lib/librte_graph.a.p/graph_graph_debug.c.o 00:01:39.656 [467/745] Compiling C object lib/librte_graph.a.p/graph_graph_ops.c.o 00:01:39.656 [468/745] Compiling C object lib/librte_graph.a.p/graph_graph_populate.c.o 00:01:39.656 [469/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key16.c.o 00:01:39.656 [470/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_ext.c.o 00:01:39.656 [471/745] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:39.656 [472/745] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:39.917 [473/745] Compiling C object lib/librte_node.a.p/node_ethdev_ctrl.c.o 00:01:39.917 [474/745] Compiling C object lib/librte_graph.a.p/graph_node.c.o 00:01:39.917 [475/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:39.917 [476/745] Compiling C object lib/librte_graph.a.p/graph_graph.c.o 00:01:39.917 [477/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_lru.c.o 00:01:39.917 [478/745] Generating lib/sched.sym_chk with a custom command (wrapped by meson to capture output) 00:01:39.917 [479/745] Compiling C object lib/librte_node.a.p/node_log.c.o 00:01:39.917 [480/745] Generating drivers/rte_net_i40e_def with a custom command 00:01:39.917 [481/745] Generating drivers/rte_net_i40e_mingw with a custom command 00:01:40.179 [482/745] Generating lib/pdump.sym_chk with a custom command (wrapped by meson to capture output) 00:01:40.179 [483/745] Compiling C object lib/librte_node.a.p/node_pkt_drop.c.o 00:01:40.179 [484/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key32.c.o 00:01:40.179 [485/745] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:40.179 [486/745] Linking static target lib/librte_table.a 00:01:40.179 [487/745] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:40.179 [488/745] Linking static target drivers/librte_bus_vdev.a 00:01:40.179 [489/745] Compiling C object lib/librte_ipsec.a.p/ipsec_esp_inb.c.o 00:01:40.179 [490/745] Linking static target lib/librte_ipsec.a 00:01:40.179 [491/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_pipeline.c.o 00:01:40.179 [492/745] Compiling C object drivers/librte_bus_vdev.so.23.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:40.445 [493/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:40.445 [494/745] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:40.445 [495/745] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:40.705 [496/745] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_main.c.o 00:01:40.705 [497/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_diag.c.o 00:01:40.705 [498/745] Compiling C object lib/librte_port.a.p/port_rte_swx_port_source_sink.c.o 00:01:40.705 [499/745] Generating lib/ipsec.sym_chk with a custom command (wrapped by meson to capture output) 00:01:40.705 [500/745] Compiling C object lib/librte_graph.a.p/graph_graph_stats.c.o 00:01:40.705 [501/745] Linking static target lib/librte_graph.a 00:01:40.964 [502/745] Compiling C object lib/librte_node.a.p/node_ethdev_tx.c.o 00:01:40.964 [503/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_ctl.c.o 00:01:40.964 [504/745] Compiling C object app/dpdk-test-cmdline.p/test-cmdline_cmdline_test.c.o 00:01:40.964 [505/745] Compiling C object app/dpdk-test-cmdline.p/test-cmdline_commands.c.o 00:01:40.964 [506/745] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:40.964 [507/745] Compiling C object lib/librte_node.a.p/node_ethdev_rx.c.o 00:01:40.964 [508/745] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:40.964 [509/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_hmc.c.o 00:01:40.964 [510/745] Linking static target drivers/librte_bus_pci.a 00:01:40.964 [511/745] Compiling C object drivers/librte_bus_pci.so.23.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:41.225 [512/745] Compiling C object lib/librte_port.a.p/port_rte_port_ring.c.o 00:01:41.225 [513/745] Generating lib/table.sym_chk with a custom command (wrapped by meson to capture output) 00:01:41.225 [514/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_dcb.c.o 00:01:41.491 [515/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_vf_representor.c.o 00:01:41.491 [516/745] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:41.491 [517/745] Generating lib/eventdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:41.491 [518/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_lan_hmc.c.o 00:01:41.750 [519/745] Compiling C object lib/librte_port.a.p/port_rte_port_source_sink.c.o 00:01:41.750 [520/745] Linking static target lib/librte_port.a 00:01:41.750 [521/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_hash.c.o 00:01:42.012 [522/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_tm.c.o 00:01:42.012 [523/745] Compiling C object app/dpdk-test-acl.p/test-acl_main.c.o 00:01:42.012 [524/745] Compiling C object app/dpdk-dumpcap.p/dumpcap_main.c.o 00:01:42.012 [525/745] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:42.012 [526/745] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:42.012 [527/745] Generating lib/graph.sym_chk with a custom command (wrapped by meson to capture output) 00:01:42.276 [528/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_pf.c.o 00:01:42.276 [529/745] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:42.276 [530/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_options_parse.c.o 00:01:42.276 [531/745] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:42.276 [532/745] Linking static target drivers/librte_mempool_ring.a 00:01:42.276 [533/745] Compiling C object drivers/librte_mempool_ring.so.23.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:42.537 [534/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_test.c.o 00:01:42.537 [535/745] Compiling C object app/dpdk-proc-info.p/proc-info_main.c.o 00:01:42.537 [536/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_main.c.o 00:01:42.537 [537/745] Generating lib/port.sym_chk with a custom command (wrapped by meson to capture output) 00:01:42.537 [538/745] Compiling C object app/dpdk-pdump.p/pdump_main.c.o 00:01:42.537 [539/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_common.c.o 00:01:42.801 [540/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_parser.c.o 00:01:42.801 [541/745] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:43.063 [542/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_options_parsing.c.o 00:01:43.063 [543/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_ops.c.o 00:01:43.063 [544/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_fdir.c.o 00:01:43.063 [545/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_vectors.c.o 00:01:43.326 [546/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_vector_parsing.c.o 00:01:43.326 [547/745] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev_vector.c.o 00:01:43.326 [548/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_main.c.o 00:01:43.326 [549/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_pipeline_spec.c.o 00:01:43.584 [550/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_main.c.o 00:01:43.584 [551/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_options.c.o 00:01:43.584 [552/745] Compiling C object drivers/net/i40e/libi40e_avx512_lib.a.p/i40e_rxtx_vec_avx512.c.o 00:01:43.584 [553/745] Linking static target drivers/net/i40e/libi40e_avx512_lib.a 00:01:43.848 [554/745] Compiling C object drivers/net/i40e/libi40e_avx2_lib.a.p/i40e_rxtx_vec_avx2.c.o 00:01:43.848 [555/745] Linking static target drivers/net/i40e/libi40e_avx2_lib.a 00:01:44.107 [556/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_common.c.o 00:01:44.107 [557/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_adminq.c.o 00:01:44.107 [558/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_common.c.o 00:01:44.107 [559/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_flow.c.o 00:01:44.369 [560/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_queue.c.o 00:01:44.369 [561/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_atq.c.o 00:01:44.633 [562/745] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_flow_gen.c.o 00:01:44.633 [563/745] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_items_gen.c.o 00:01:44.633 [564/745] Compiling C object lib/librte_node.a.p/node_pkt_cls.c.o 00:01:44.633 [565/745] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:01:44.895 [566/745] Compiling C object app/dpdk-test-gpudev.p/test-gpudev_main.c.o 00:01:44.895 [567/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_init.c.o 00:01:44.895 [568/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_config.c.o 00:01:44.895 [569/745] Linking target lib/librte_eal.so.23.0 00:01:44.895 [570/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_nvm.c.o 00:01:44.895 [571/745] Linking static target drivers/net/i40e/base/libi40e_base.a 00:01:44.895 [572/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_main.c.o 00:01:44.895 [573/745] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_actions_gen.c.o 00:01:45.158 [574/745] Generating symbol file lib/librte_eal.so.23.0.p/librte_eal.so.23.0.symbols 00:01:45.158 [575/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_atq.c.o 00:01:45.158 [576/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_acl.c.o 00:01:45.158 [577/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_rte_pmd_i40e.c.o 00:01:45.158 [578/745] Linking target lib/librte_ring.so.23.0 00:01:45.158 [579/745] Linking target lib/librte_meter.so.23.0 00:01:45.158 [580/745] Linking target lib/librte_pci.so.23.0 00:01:45.158 [581/745] Linking target lib/librte_timer.so.23.0 00:01:45.158 [582/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_lpm.c.o 00:01:45.417 [583/745] Linking target lib/librte_acl.so.23.0 00:01:45.417 [584/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_stub.c.o 00:01:45.417 [585/745] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.417 [586/745] Generating symbol file lib/librte_meter.so.23.0.p/librte_meter.so.23.0.symbols 00:01:45.417 [587/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_hash.c.o 00:01:45.417 [588/745] Generating symbol file lib/librte_ring.so.23.0.p/librte_ring.so.23.0.symbols 00:01:45.417 [589/745] Generating symbol file lib/librte_timer.so.23.0.p/librte_timer.so.23.0.symbols 00:01:45.417 [590/745] Generating symbol file lib/librte_pci.so.23.0.p/librte_pci.so.23.0.symbols 00:01:45.417 [591/745] Linking target lib/librte_cfgfile.so.23.0 00:01:45.417 [592/745] Linking target lib/librte_jobstats.so.23.0 00:01:45.417 [593/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_atq.c.o 00:01:45.417 [594/745] Linking target lib/librte_rawdev.so.23.0 00:01:45.417 [595/745] Linking target lib/librte_dmadev.so.23.0 00:01:45.417 [596/745] Linking target lib/librte_rcu.so.23.0 00:01:45.417 [597/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_lpm_ipv6.c.o 00:01:45.417 [598/745] Linking target lib/librte_stack.so.23.0 00:01:45.417 [599/745] Linking target lib/librte_mempool.so.23.0 00:01:45.417 [600/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_queue.c.o 00:01:45.417 [601/745] Linking target lib/librte_graph.so.23.0 00:01:45.417 [602/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_common.c.o 00:01:45.417 [603/745] Linking target drivers/librte_bus_pci.so.23.0 00:01:45.417 [604/745] Linking target drivers/librte_bus_vdev.so.23.0 00:01:45.689 [605/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_queue.c.o 00:01:45.689 [606/745] Generating symbol file lib/librte_acl.so.23.0.p/librte_acl.so.23.0.symbols 00:01:45.689 [607/745] Compiling C object app/dpdk-test-fib.p/test-fib_main.c.o 00:01:45.689 [608/745] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev.c.o 00:01:45.689 [609/745] Generating symbol file lib/librte_dmadev.so.23.0.p/librte_dmadev.so.23.0.symbols 00:01:45.689 [610/745] Generating symbol file lib/librte_rcu.so.23.0.p/librte_rcu.so.23.0.symbols 00:01:45.689 [611/745] Generating symbol file lib/librte_mempool.so.23.0.p/librte_mempool.so.23.0.symbols 00:01:45.689 [612/745] Generating symbol file lib/librte_graph.so.23.0.p/librte_graph.so.23.0.symbols 00:01:45.689 [613/745] Generating symbol file drivers/librte_bus_vdev.so.23.0.p/librte_bus_vdev.so.23.0.symbols 00:01:45.689 [614/745] Generating symbol file drivers/librte_bus_pci.so.23.0.p/librte_bus_pci.so.23.0.symbols 00:01:45.689 [615/745] Linking target lib/librte_mbuf.so.23.0 00:01:45.689 [616/745] Linking target lib/librte_rib.so.23.0 00:01:45.948 [617/745] Linking target drivers/librte_mempool_ring.so.23.0 00:01:45.948 [618/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_rxtx_vec_sse.c.o 00:01:45.948 [619/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmd_flex_item.c.o 00:01:45.948 [620/745] Generating symbol file lib/librte_mbuf.so.23.0.p/librte_mbuf.so.23.0.symbols 00:01:45.948 [621/745] Generating symbol file lib/librte_rib.so.23.0.p/librte_rib.so.23.0.symbols 00:01:46.216 [622/745] Linking target lib/librte_net.so.23.0 00:01:46.216 [623/745] Linking target lib/librte_bbdev.so.23.0 00:01:46.216 [624/745] Linking target lib/librte_compressdev.so.23.0 00:01:46.216 [625/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_verify.c.o 00:01:46.216 [626/745] Linking target lib/librte_cryptodev.so.23.0 00:01:46.216 [627/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_throughput.c.o 00:01:46.216 [628/745] Generating symbol file lib/librte_net.so.23.0.p/librte_net.so.23.0.symbols 00:01:46.216 [629/745] Linking target lib/librte_distributor.so.23.0 00:01:46.477 [630/745] Linking target lib/librte_gpudev.so.23.0 00:01:46.477 [631/745] Compiling C object app/dpdk-testpmd.p/test-pmd_5tswap.c.o 00:01:46.477 [632/745] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_main.c.o 00:01:46.477 [633/745] Linking target lib/librte_cmdline.so.23.0 00:01:46.477 [634/745] Linking target lib/librte_regexdev.so.23.0 00:01:46.477 [635/745] Linking target lib/librte_ethdev.so.23.0 00:01:46.477 [636/745] Linking target lib/librte_hash.so.23.0 00:01:46.477 [637/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_mtr.c.o 00:01:46.477 [638/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_runtime.c.o 00:01:46.477 [639/745] Linking target lib/librte_reorder.so.23.0 00:01:46.477 [640/745] Linking target lib/librte_sched.so.23.0 00:01:46.477 [641/745] Generating symbol file lib/librte_cryptodev.so.23.0.p/librte_cryptodev.so.23.0.symbols 00:01:46.477 [642/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_pmd_cyclecount.c.o 00:01:46.477 [643/745] Linking target lib/librte_fib.so.23.0 00:01:46.477 [644/745] Linking target lib/librte_security.so.23.0 00:01:46.735 [645/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_tm.c.o 00:01:46.735 [646/745] Generating symbol file lib/librte_ethdev.so.23.0.p/librte_ethdev.so.23.0.symbols 00:01:46.735 [647/745] Generating symbol file lib/librte_hash.so.23.0.p/librte_hash.so.23.0.symbols 00:01:46.735 [648/745] Generating symbol file lib/librte_sched.so.23.0.p/librte_sched.so.23.0.symbols 00:01:46.735 [649/745] Linking target lib/librte_pcapng.so.23.0 00:01:46.735 [650/745] Linking target lib/librte_metrics.so.23.0 00:01:46.735 [651/745] Linking target lib/librte_gso.so.23.0 00:01:46.735 [652/745] Linking target lib/librte_efd.so.23.0 00:01:46.735 [653/745] Linking target lib/librte_bpf.so.23.0 00:01:46.735 [654/745] Linking target lib/librte_gro.so.23.0 00:01:46.735 [655/745] Linking target lib/librte_power.so.23.0 00:01:46.735 [656/745] Compiling C object lib/librte_node.a.p/node_ip4_lookup.c.o 00:01:46.735 [657/745] Linking target lib/librte_eventdev.so.23.0 00:01:46.736 [658/745] Generating symbol file lib/librte_security.so.23.0.p/librte_security.so.23.0.symbols 00:01:46.736 [659/745] Linking target lib/librte_ip_frag.so.23.0 00:01:46.736 [660/745] Linking target lib/librte_lpm.so.23.0 00:01:46.736 [661/745] Linking target lib/librte_member.so.23.0 00:01:46.736 [662/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_throughput.c.o 00:01:46.736 [663/745] Compiling C object app/dpdk-testpmd.p/test-pmd_ieee1588fwd.c.o 00:01:46.994 [664/745] Compiling C object app/dpdk-testpmd.p/test-pmd_flowgen.c.o 00:01:46.994 [665/745] Linking target lib/librte_ipsec.so.23.0 00:01:46.994 [666/745] Generating symbol file lib/librte_metrics.so.23.0.p/librte_metrics.so.23.0.symbols 00:01:46.994 [667/745] Generating symbol file lib/librte_bpf.so.23.0.p/librte_bpf.so.23.0.symbols 00:01:46.994 [668/745] Generating symbol file lib/librte_pcapng.so.23.0.p/librte_pcapng.so.23.0.symbols 00:01:46.994 [669/745] Compiling C object app/dpdk-testpmd.p/test-pmd_bpf_cmd.c.o 00:01:46.994 [670/745] Generating symbol file lib/librte_eventdev.so.23.0.p/librte_eventdev.so.23.0.symbols 00:01:46.994 [671/745] Generating symbol file lib/librte_ip_frag.so.23.0.p/librte_ip_frag.so.23.0.symbols 00:01:46.994 [672/745] Linking target lib/librte_latencystats.so.23.0 00:01:46.994 [673/745] Linking target lib/librte_bitratestats.so.23.0 00:01:46.994 [674/745] Linking target lib/librte_pdump.so.23.0 00:01:46.994 [675/745] Generating symbol file lib/librte_lpm.so.23.0.p/librte_lpm.so.23.0.symbols 00:01:46.994 [676/745] Compiling C object app/dpdk-testpmd.p/test-pmd_iofwd.c.o 00:01:46.994 [677/745] Compiling C object app/dpdk-testpmd.p/test-pmd_icmpecho.c.o 00:01:47.252 [678/745] Linking target lib/librte_port.so.23.0 00:01:47.252 [679/745] Compiling C object app/dpdk-testpmd.p/test-pmd_shared_rxq_fwd.c.o 00:01:47.252 [680/745] Compiling C object app/dpdk-testpmd.p/test-pmd_util.c.o 00:01:47.252 [681/745] Compiling C object app/dpdk-testpmd.p/test-pmd_macfwd.c.o 00:01:47.252 [682/745] Compiling C object app/dpdk-testpmd.p/test-pmd_macswap.c.o 00:01:47.252 [683/745] Generating symbol file lib/librte_port.so.23.0.p/librte_port.so.23.0.symbols 00:01:47.510 [684/745] Compiling C object app/dpdk-test-security-perf.p/test-security-perf_test_security_perf.c.o 00:01:47.510 [685/745] Compiling C object app/dpdk-testpmd.p/test-pmd_rxonly.c.o 00:01:47.510 [686/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_common.c.o 00:01:47.510 [687/745] Linking target lib/librte_table.so.23.0 00:01:47.511 [688/745] Compiling C object app/dpdk-test-sad.p/test-sad_main.c.o 00:01:47.511 [689/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_rxtx.c.o 00:01:47.511 [690/745] Generating symbol file lib/librte_table.so.23.0.p/librte_table.so.23.0.symbols 00:01:47.511 [691/745] Compiling C object app/dpdk-testpmd.p/.._drivers_net_i40e_i40e_testpmd.c.o 00:01:47.511 [692/745] Compiling C object app/dpdk-test-regex.p/test-regex_main.c.o 00:01:47.768 [693/745] Compiling C object app/dpdk-testpmd.p/test-pmd_parameters.c.o 00:01:47.768 [694/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_latency.c.o 00:01:48.026 [695/745] Compiling C object app/dpdk-testpmd.p/test-pmd_csumonly.c.o 00:01:48.026 [696/745] Compiling C object app/dpdk-test-security-perf.p/test_test_cryptodev_security_ipsec.c.o 00:01:48.284 [697/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_common.c.o 00:01:48.284 [698/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_cyclecount.c.o 00:01:48.541 [699/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_verify.c.o 00:01:48.541 [700/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline.c.o 00:01:48.799 [701/745] Compiling C object app/dpdk-testpmd.p/test-pmd_testpmd.c.o 00:01:48.799 [702/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_ethdev.c.o 00:01:48.799 [703/745] Linking static target drivers/libtmp_rte_net_i40e.a 00:01:49.364 [704/745] Compiling C object app/dpdk-testpmd.p/test-pmd_noisy_vnf.c.o 00:01:49.364 [705/745] Generating drivers/rte_net_i40e.pmd.c with a custom command 00:01:49.364 [706/745] Compiling C object drivers/librte_net_i40e.a.p/meson-generated_.._rte_net_i40e.pmd.c.o 00:01:49.364 [707/745] Compiling C object drivers/librte_net_i40e.so.23.0.p/meson-generated_.._rte_net_i40e.pmd.c.o 00:01:49.364 [708/745] Linking static target drivers/librte_net_i40e.a 00:01:49.621 [709/745] Compiling C object app/dpdk-testpmd.p/test-pmd_txonly.c.o 00:01:49.621 [710/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_pipeline.c.o 00:01:49.879 [711/745] Generating drivers/rte_net_i40e.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.879 [712/745] Linking target drivers/librte_net_i40e.so.23.0 00:01:50.445 [713/745] Compiling C object lib/librte_node.a.p/node_ip4_rewrite.c.o 00:01:50.445 [714/745] Linking static target lib/librte_node.a 00:01:50.703 [715/745] Generating lib/node.sym_chk with a custom command (wrapped by meson to capture output) 00:01:50.703 [716/745] Linking target lib/librte_node.so.23.0 00:01:50.961 [717/745] Compiling C object app/dpdk-testpmd.p/test-pmd_config.c.o 00:01:51.559 [718/745] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev_perf.c.o 00:01:52.126 [719/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_flow.c.o 00:02:00.235 [720/745] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:02:32.301 [721/745] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:02:32.301 [722/745] Linking static target lib/librte_vhost.a 00:02:32.301 [723/745] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:02:32.301 [724/745] Linking target lib/librte_vhost.so.23.0 00:02:54.215 [725/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_table_action.c.o 00:02:54.215 [726/745] Linking static target lib/librte_pipeline.a 00:02:54.473 [727/745] Linking target app/dpdk-test-acl 00:02:54.473 [728/745] Linking target app/dpdk-dumpcap 00:02:54.473 [729/745] Linking target app/dpdk-test-sad 00:02:54.473 [730/745] Linking target app/dpdk-test-gpudev 00:02:54.473 [731/745] Linking target app/dpdk-test-fib 00:02:54.473 [732/745] Linking target app/dpdk-test-pipeline 00:02:54.473 [733/745] Linking target app/dpdk-test-eventdev 00:02:54.473 [734/745] Linking target app/dpdk-test-crypto-perf 00:02:54.473 [735/745] Linking target app/dpdk-proc-info 00:02:54.473 [736/745] Linking target app/dpdk-test-cmdline 00:02:54.473 [737/745] Linking target app/dpdk-test-security-perf 00:02:54.473 [738/745] Linking target app/dpdk-test-bbdev 00:02:54.473 [739/745] Linking target app/dpdk-test-flow-perf 00:02:54.473 [740/745] Linking target app/dpdk-test-compress-perf 00:02:54.473 [741/745] Linking target app/dpdk-test-regex 00:02:54.473 [742/745] Linking target app/dpdk-pdump 00:02:54.473 [743/745] Linking target app/dpdk-testpmd 00:02:56.432 [744/745] Generating lib/pipeline.sym_chk with a custom command (wrapped by meson to capture output) 00:02:56.432 [745/745] Linking target lib/librte_pipeline.so.23.0 00:02:56.432 09:49:02 -- common/autobuild_common.sh@187 -- $ ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp -j48 install 00:02:56.432 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp' 00:02:56.432 [0/1] Installing files. 00:02:56.694 Installing subdir /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples 00:02:56.694 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.694 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.694 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_default_v4.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_route.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_route_parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_fib.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_default_v6.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event_internal_port.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_sequential.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_route_parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_default_v4.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_default_v6.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl_scalar.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq_dcb/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq_dcb 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq_dcb/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq_dcb 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/flow_blocks.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_classify/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_classify 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_classify/flow_classify.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_classify 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_classify/ipv4_rules_file.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_classify 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event_internal_port.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_poll.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_common.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_poll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/parse_obj_list.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/parse_obj_list.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/pkt_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/neon/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/neon 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/altivec/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/altivec 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/sse/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/sse 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ptpclient/ptpclient.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ptpclient 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ptpclient/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ptpclient 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/helloworld/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/helloworld 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/helloworld/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/helloworld 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/rxtx_callbacks/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/rxtx_callbacks 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/rxtx_callbacks/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/rxtx_callbacks 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor_x86.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/vm_power_cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_manager.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_monitor.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_monitor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor_nop.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_manager.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/vm_power_cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/power_manager.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/power_manager.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/vm_power_cli_guest.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/vm_power_cli_guest.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/app_thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_ov.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cfg_file.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cmdline.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cfg_file.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/stats.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_red.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_pie.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/l2fwd-cat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/cat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/cat.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/perf_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:56.695 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/perf_core.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/vdpa_blk_compact.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/virtio_net.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/blk_spec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk_compat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/blk.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_ecdsa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_aes.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_sha.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_tdes.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_dev_self_test.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_rsa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_dev_self_test.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_gcm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_cmac.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_xts.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_hmac.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_ccm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/dma/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/dma 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/dma/dmafwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/dma 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/mp_commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/mp_commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/symmetric_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/symmetric_mp 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/symmetric_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/symmetric_mp 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/args.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/init.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_client/client.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_client 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_client/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_client 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/shared/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/shared 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-graph/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-graph 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-graph/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-graph 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-jobstats/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-jobstats 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-jobstats/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-jobstats 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_fragmentation/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_fragmentation 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_fragmentation/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_fragmentation 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/packet_ordering/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/packet_ordering 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/packet_ordering/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/packet_ordering 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-crypto/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-crypto 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-crypto/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-crypto 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/shm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/shm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/ka-agent/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive/ka-agent 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/ka-agent/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive/ka-agent 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/skeleton/basicfwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/skeleton 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/skeleton/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/skeleton 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/service_cores/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/service_cores 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/service_cores/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/service_cores 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/distributor/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/distributor 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/distributor/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/distributor 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_worker_tx.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_worker_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/esp.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/event_helper.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_worker.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipip.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ep1.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sp4.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/flow.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_process.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/flow.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/rt.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_worker.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/event_helper.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sad.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sad.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/esp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec-secgw.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sp6.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/parser.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ep0.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/parser.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec-secgw.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_3descbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_3descbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aescbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/load_env.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesctr_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_null_header_reconstruct.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/run_test.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesgcm_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/common_defs_secgw.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_3descbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesctr_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesctr_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/data_rxtx.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/bypass_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_ipv6opts.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesgcm_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesgcm_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesctr_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/pkttest.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesgcm_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aescbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/pkttest.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_3descbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/linux_test.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.696 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aescbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aescbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipv4_multicast/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipv4_multicast 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipv4_multicast/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipv4_multicast 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/args.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/init.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/node/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/node 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/node/node.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/node 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/shared/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/shared 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tap.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tmgr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/swq.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/pipeline.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/kni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/swq.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/action.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/conn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tap.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/link.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cryptodev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/mempool.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/conn.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/parser.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/link.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cryptodev.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/parser.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/mempool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tmgr.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/kni.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/route_ecmp.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/rss.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/flow.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/kni.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/firewall.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/tap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/l2fwd.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/route.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/flow_crypto.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t1.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t3.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/README to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/dummy.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t2.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/link_status_interrupt/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/link_status_interrupt 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/link_status_interrupt/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/link_status_interrupt 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_reassembly/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_reassembly 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_reassembly/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_reassembly 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bbdev_app/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bbdev_app 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bbdev_app/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bbdev_app 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/conn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/obj.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/conn.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/obj.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/hash_func.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/mirroring.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ethdev.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/mirroring.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/varbit.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/recirculation.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/recirculation.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/varbit.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_routing_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_nexthop_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/learner.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/registers.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_nexthop_group_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/registers.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/packet.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/meter.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/hash_func.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/pcap.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_table.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/learner.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/meter.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/rte_policer.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/rte_policer.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/ethapp.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/ethapp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/rte_ethtool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/rte_ethtool.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:56.697 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:02:56.698 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/ntb_fwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:02:56.698 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_crypto/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_crypto 00:02:56.698 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_crypto/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_crypto 00:02:56.698 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/timer/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/timer 00:02:56.698 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/timer/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/timer 00:02:56.698 Installing lib/librte_kvargs.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_kvargs.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_telemetry.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_telemetry.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_eal.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_eal.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_ring.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_ring.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_rcu.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_rcu.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_mempool.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_mempool.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_mbuf.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_mbuf.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_net.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_net.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_meter.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_meter.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_ethdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_ethdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_pci.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_pci.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_cmdline.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_cmdline.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_metrics.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_metrics.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_hash.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_hash.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_timer.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_timer.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_acl.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_acl.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_bbdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_bbdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_bitratestats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_bitratestats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_bpf.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_bpf.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_cfgfile.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_cfgfile.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_compressdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_compressdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_cryptodev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_cryptodev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_distributor.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_distributor.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_efd.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_efd.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_eventdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_eventdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_gpudev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_gpudev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_gro.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_gro.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_gso.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_gso.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_ip_frag.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_ip_frag.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_jobstats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_jobstats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_latencystats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_latencystats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_lpm.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_lpm.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_member.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_member.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_pcapng.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_pcapng.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_power.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_power.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_rawdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_rawdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_regexdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_regexdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_dmadev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_dmadev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_rib.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_rib.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_reorder.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_reorder.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_sched.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_sched.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_security.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_security.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_stack.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_stack.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_vhost.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_vhost.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_ipsec.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_ipsec.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_fib.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_fib.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_port.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_port.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_pdump.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.698 Installing lib/librte_pdump.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.271 Installing lib/librte_table.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.271 Installing lib/librte_table.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.271 Installing lib/librte_pipeline.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.271 Installing lib/librte_pipeline.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.271 Installing lib/librte_graph.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.271 Installing lib/librte_graph.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.271 Installing lib/librte_node.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.271 Installing lib/librte_node.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.271 Installing drivers/librte_bus_pci.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.271 Installing drivers/librte_bus_pci.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0 00:02:57.271 Installing drivers/librte_bus_vdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.271 Installing drivers/librte_bus_vdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0 00:02:57.271 Installing drivers/librte_mempool_ring.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.271 Installing drivers/librte_mempool_ring.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0 00:02:57.271 Installing drivers/librte_net_i40e.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.271 Installing drivers/librte_net_i40e.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0 00:02:57.271 Installing app/dpdk-dumpcap to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.272 Installing app/dpdk-pdump to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.272 Installing app/dpdk-proc-info to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.272 Installing app/dpdk-test-acl to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.272 Installing app/dpdk-test-bbdev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.272 Installing app/dpdk-test-cmdline to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.272 Installing app/dpdk-test-compress-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.272 Installing app/dpdk-test-crypto-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.272 Installing app/dpdk-test-eventdev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.272 Installing app/dpdk-test-fib to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.272 Installing app/dpdk-test-flow-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.272 Installing app/dpdk-test-gpudev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.272 Installing app/dpdk-test-pipeline to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.272 Installing app/dpdk-testpmd to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.272 Installing app/dpdk-test-regex to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.272 Installing app/dpdk-test-sad to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.272 Installing app/dpdk-test-security-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/config/rte_config.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/kvargs/rte_kvargs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/telemetry/rte_telemetry.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_atomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_byteorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_cpuflags.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_cycles.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_io.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_memcpy.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_pause.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_power_intrinsics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_prefetch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_rwlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_spinlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_vect.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_cpuflags.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_cycles.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_io.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_memcpy.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_pause.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_power_intrinsics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_prefetch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_rtm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_rwlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_spinlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_vect.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic_32.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic_64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder_32.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder_64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_alarm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bitmap.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bitops.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_branch_prediction.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bus.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_class.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_compat.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_debug.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_dev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_devargs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal_memconfig.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_errno.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_epoll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_fbarray.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_hexdump.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_hypervisor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_interrupts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_keepalive.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_launch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_lcore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_log.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_malloc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_mcslock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_memory.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_memzone.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pci_dev_feature_defs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pci_dev_features.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_per_lcore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pflock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_random.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_reciprocal.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_seqcount.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_seqlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_service.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_service_component.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_string_fns.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_tailq.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_ticketlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_time.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace_point.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace_point_register.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_uuid.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_version.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_vfio.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/linux/include/rte_os.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_elem.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_c11_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_generic_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_hts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_hts_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek_zc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_rts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_rts_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rcu/rte_rcu_qsbr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.272 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_ptype.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_pool_ops.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_dyn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ip.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_tcp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_udp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_esp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_sctp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_icmp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_arp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ether.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_macsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_vxlan.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_gre.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_gtp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_net.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_net_crc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_mpls.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_higig.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ecpri.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_geneve.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_l2tpv2.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ppp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/meter/rte_meter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_cman.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_dev_info.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_flow.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_flow_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_mtr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_mtr_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_tm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_tm_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_eth_ctrl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pci/rte_pci.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_num.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_ipaddr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_etheraddr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_string.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_rdline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_vt100.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_socket.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_cirbuf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_portlist.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/metrics/rte_metrics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/metrics/rte_metrics_telemetry.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_fbk_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_hash_crc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_jhash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash_gfni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_generic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_sw.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_x86.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash_x86_gfni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/timer/rte_timer.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/acl/rte_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/acl/rte_acl_osdep.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev_pmd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev_op.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bitratestats/rte_bitrate.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/bpf_def.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/rte_bpf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/rte_bpf_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cfgfile/rte_cfgfile.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/compressdev/rte_compressdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/compressdev/rte_comp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto_sym.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto_asym.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/distributor/rte_distributor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/efd/rte_efd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_crypto_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_eth_rx_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_eth_tx_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_timer_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gpudev/rte_gpudev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gro/rte_gro.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gso/rte_gso.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ip_frag/rte_ip_frag.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/jobstats/rte_jobstats.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/latencystats/rte_latencystats.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_scalar.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_sve.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/member/rte_member.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pcapng/rte_pcapng.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.273 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_empty_poll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_intel_uncore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_pmd_mgmt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_guest_channel.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rawdev/rte_rawdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rawdev/rte_rawdev_pmd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dmadev/rte_dmadev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dmadev/rte_dmadev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rib/rte_rib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rib/rte_rib6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/reorder/rte_reorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_approx.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_red.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_sched.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_sched_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_pie.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/security/rte_security.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/security/rte_security_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_std.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_generic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_c11.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_stubs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vdpa.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost_async.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_sa.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_sad.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/fib/rte_fib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/fib/rte_fib6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_fd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_frag.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ras.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_sched.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_source_sink.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_sym_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_eventdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_fd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_source_sink.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pdump/rte_pdump.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_hash_func.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_em.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_learner.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_selector.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_wm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_array.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_cuckoo.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_func.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_lpm_ipv6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_stub.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru_x86.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_func_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_port_in_action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_table_action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_extern.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_ctl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_worker.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_ip4_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_eth_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/bus/pci/rte_bus_pci.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/bus/vdev/rte_bus_vdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/net/i40e/rte_pmd_i40e.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-devbind.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-pmdinfo.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-telemetry.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-hugepages.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/rte_build_config.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/meson-private/libdpdk-libs.pc to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig 00:02:57.274 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/meson-private/libdpdk.pc to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig 00:02:57.274 Installing symlink pointing to librte_kvargs.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_kvargs.so.23 00:02:57.274 Installing symlink pointing to librte_kvargs.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_kvargs.so 00:02:57.274 Installing symlink pointing to librte_telemetry.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_telemetry.so.23 00:02:57.274 Installing symlink pointing to librte_telemetry.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_telemetry.so 00:02:57.274 Installing symlink pointing to librte_eal.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eal.so.23 00:02:57.274 Installing symlink pointing to librte_eal.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eal.so 00:02:57.274 Installing symlink pointing to librte_ring.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ring.so.23 00:02:57.274 Installing symlink pointing to librte_ring.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ring.so 00:02:57.274 Installing symlink pointing to librte_rcu.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rcu.so.23 00:02:57.274 Installing symlink pointing to librte_rcu.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rcu.so 00:02:57.274 Installing symlink pointing to librte_mempool.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mempool.so.23 00:02:57.274 Installing symlink pointing to librte_mempool.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mempool.so 00:02:57.274 Installing symlink pointing to librte_mbuf.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mbuf.so.23 00:02:57.274 Installing symlink pointing to librte_mbuf.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mbuf.so 00:02:57.274 Installing symlink pointing to librte_net.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_net.so.23 00:02:57.274 Installing symlink pointing to librte_net.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_net.so 00:02:57.274 Installing symlink pointing to librte_meter.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_meter.so.23 00:02:57.274 Installing symlink pointing to librte_meter.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_meter.so 00:02:57.274 Installing symlink pointing to librte_ethdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ethdev.so.23 00:02:57.274 Installing symlink pointing to librte_ethdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ethdev.so 00:02:57.274 Installing symlink pointing to librte_pci.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pci.so.23 00:02:57.274 Installing symlink pointing to librte_pci.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pci.so 00:02:57.274 Installing symlink pointing to librte_cmdline.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cmdline.so.23 00:02:57.274 Installing symlink pointing to librte_cmdline.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cmdline.so 00:02:57.274 Installing symlink pointing to librte_metrics.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_metrics.so.23 00:02:57.274 Installing symlink pointing to librte_metrics.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_metrics.so 00:02:57.274 Installing symlink pointing to librte_hash.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_hash.so.23 00:02:57.274 Installing symlink pointing to librte_hash.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_hash.so 00:02:57.274 Installing symlink pointing to librte_timer.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_timer.so.23 00:02:57.274 Installing symlink pointing to librte_timer.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_timer.so 00:02:57.275 Installing symlink pointing to librte_acl.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_acl.so.23 00:02:57.275 Installing symlink pointing to librte_acl.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_acl.so 00:02:57.275 Installing symlink pointing to librte_bbdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bbdev.so.23 00:02:57.275 Installing symlink pointing to librte_bbdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bbdev.so 00:02:57.275 Installing symlink pointing to librte_bitratestats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bitratestats.so.23 00:02:57.275 Installing symlink pointing to librte_bitratestats.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bitratestats.so 00:02:57.275 Installing symlink pointing to librte_bpf.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bpf.so.23 00:02:57.275 Installing symlink pointing to librte_bpf.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bpf.so 00:02:57.275 Installing symlink pointing to librte_cfgfile.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cfgfile.so.23 00:02:57.275 Installing symlink pointing to librte_cfgfile.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cfgfile.so 00:02:57.275 Installing symlink pointing to librte_compressdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_compressdev.so.23 00:02:57.275 Installing symlink pointing to librte_compressdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_compressdev.so 00:02:57.275 Installing symlink pointing to librte_cryptodev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cryptodev.so.23 00:02:57.275 Installing symlink pointing to librte_cryptodev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cryptodev.so 00:02:57.275 Installing symlink pointing to librte_distributor.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_distributor.so.23 00:02:57.275 Installing symlink pointing to librte_distributor.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_distributor.so 00:02:57.275 Installing symlink pointing to librte_efd.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_efd.so.23 00:02:57.275 Installing symlink pointing to librte_efd.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_efd.so 00:02:57.275 Installing symlink pointing to librte_eventdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eventdev.so.23 00:02:57.275 Installing symlink pointing to librte_eventdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eventdev.so 00:02:57.275 Installing symlink pointing to librte_gpudev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gpudev.so.23 00:02:57.275 Installing symlink pointing to librte_gpudev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gpudev.so 00:02:57.275 Installing symlink pointing to librte_gro.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gro.so.23 00:02:57.275 Installing symlink pointing to librte_gro.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gro.so 00:02:57.275 Installing symlink pointing to librte_gso.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gso.so.23 00:02:57.275 Installing symlink pointing to librte_gso.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gso.so 00:02:57.275 Installing symlink pointing to librte_ip_frag.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ip_frag.so.23 00:02:57.275 Installing symlink pointing to librte_ip_frag.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ip_frag.so 00:02:57.275 Installing symlink pointing to librte_jobstats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_jobstats.so.23 00:02:57.275 Installing symlink pointing to librte_jobstats.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_jobstats.so 00:02:57.275 Installing symlink pointing to librte_latencystats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_latencystats.so.23 00:02:57.275 Installing symlink pointing to librte_latencystats.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_latencystats.so 00:02:57.275 Installing symlink pointing to librte_lpm.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_lpm.so.23 00:02:57.275 Installing symlink pointing to librte_lpm.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_lpm.so 00:02:57.275 Installing symlink pointing to librte_member.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_member.so.23 00:02:57.275 Installing symlink pointing to librte_member.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_member.so 00:02:57.275 Installing symlink pointing to librte_pcapng.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pcapng.so.23 00:02:57.275 Installing symlink pointing to librte_pcapng.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pcapng.so 00:02:57.275 Installing symlink pointing to librte_power.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_power.so.23 00:02:57.275 Installing symlink pointing to librte_power.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_power.so 00:02:57.275 Installing symlink pointing to librte_rawdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rawdev.so.23 00:02:57.275 Installing symlink pointing to librte_rawdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rawdev.so 00:02:57.275 Installing symlink pointing to librte_regexdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_regexdev.so.23 00:02:57.275 Installing symlink pointing to librte_regexdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_regexdev.so 00:02:57.275 Installing symlink pointing to librte_dmadev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dmadev.so.23 00:02:57.275 Installing symlink pointing to librte_dmadev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dmadev.so 00:02:57.275 Installing symlink pointing to librte_rib.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rib.so.23 00:02:57.275 Installing symlink pointing to librte_rib.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rib.so 00:02:57.275 Installing symlink pointing to librte_reorder.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_reorder.so.23 00:02:57.275 Installing symlink pointing to librte_reorder.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_reorder.so 00:02:57.275 Installing symlink pointing to librte_sched.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_sched.so.23 00:02:57.275 Installing symlink pointing to librte_sched.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_sched.so 00:02:57.275 Installing symlink pointing to librte_security.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_security.so.23 00:02:57.275 Installing symlink pointing to librte_security.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_security.so 00:02:57.275 Installing symlink pointing to librte_stack.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_stack.so.23 00:02:57.275 Installing symlink pointing to librte_stack.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_stack.so 00:02:57.275 Installing symlink pointing to librte_vhost.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_vhost.so.23 00:02:57.275 Installing symlink pointing to librte_vhost.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_vhost.so 00:02:57.275 Installing symlink pointing to librte_ipsec.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ipsec.so.23 00:02:57.275 Installing symlink pointing to librte_ipsec.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ipsec.so 00:02:57.275 Installing symlink pointing to librte_fib.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_fib.so.23 00:02:57.275 Installing symlink pointing to librte_fib.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_fib.so 00:02:57.275 Installing symlink pointing to librte_port.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_port.so.23 00:02:57.275 Installing symlink pointing to librte_port.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_port.so 00:02:57.275 Installing symlink pointing to librte_pdump.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdump.so.23 00:02:57.275 Installing symlink pointing to librte_pdump.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdump.so 00:02:57.275 Installing symlink pointing to librte_table.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_table.so.23 00:02:57.275 Installing symlink pointing to librte_table.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_table.so 00:02:57.275 Installing symlink pointing to librte_pipeline.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pipeline.so.23 00:02:57.275 Installing symlink pointing to librte_pipeline.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pipeline.so 00:02:57.275 Installing symlink pointing to librte_graph.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_graph.so.23 00:02:57.275 Installing symlink pointing to librte_graph.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_graph.so 00:02:57.275 Installing symlink pointing to librte_node.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_node.so.23 00:02:57.275 Installing symlink pointing to librte_node.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_node.so 00:02:57.275 Installing symlink pointing to librte_bus_pci.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_pci.so.23 00:02:57.275 Installing symlink pointing to librte_bus_pci.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_pci.so 00:02:57.275 Installing symlink pointing to librte_bus_vdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_vdev.so.23 00:02:57.275 Installing symlink pointing to librte_bus_vdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_vdev.so 00:02:57.275 './librte_bus_pci.so' -> 'dpdk/pmds-23.0/librte_bus_pci.so' 00:02:57.275 './librte_bus_pci.so.23' -> 'dpdk/pmds-23.0/librte_bus_pci.so.23' 00:02:57.275 './librte_bus_pci.so.23.0' -> 'dpdk/pmds-23.0/librte_bus_pci.so.23.0' 00:02:57.275 './librte_bus_vdev.so' -> 'dpdk/pmds-23.0/librte_bus_vdev.so' 00:02:57.275 './librte_bus_vdev.so.23' -> 'dpdk/pmds-23.0/librte_bus_vdev.so.23' 00:02:57.275 './librte_bus_vdev.so.23.0' -> 'dpdk/pmds-23.0/librte_bus_vdev.so.23.0' 00:02:57.275 './librte_mempool_ring.so' -> 'dpdk/pmds-23.0/librte_mempool_ring.so' 00:02:57.275 './librte_mempool_ring.so.23' -> 'dpdk/pmds-23.0/librte_mempool_ring.so.23' 00:02:57.275 './librte_mempool_ring.so.23.0' -> 'dpdk/pmds-23.0/librte_mempool_ring.so.23.0' 00:02:57.275 './librte_net_i40e.so' -> 'dpdk/pmds-23.0/librte_net_i40e.so' 00:02:57.275 './librte_net_i40e.so.23' -> 'dpdk/pmds-23.0/librte_net_i40e.so.23' 00:02:57.275 './librte_net_i40e.so.23.0' -> 'dpdk/pmds-23.0/librte_net_i40e.so.23.0' 00:02:57.275 Installing symlink pointing to librte_mempool_ring.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_mempool_ring.so.23 00:02:57.275 Installing symlink pointing to librte_mempool_ring.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_mempool_ring.so 00:02:57.275 Installing symlink pointing to librte_net_i40e.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_net_i40e.so.23 00:02:57.275 Installing symlink pointing to librte_net_i40e.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_net_i40e.so 00:02:57.275 Running custom install script '/bin/sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/config/../buildtools/symlink-drivers-solibs.sh lib dpdk/pmds-23.0' 00:02:57.275 09:49:03 -- common/autobuild_common.sh@189 -- $ uname -s 00:02:57.275 09:49:03 -- common/autobuild_common.sh@189 -- $ [[ Linux == \F\r\e\e\B\S\D ]] 00:02:57.275 09:49:03 -- common/autobuild_common.sh@200 -- $ cat 00:02:57.275 09:49:03 -- common/autobuild_common.sh@205 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:57.275 00:02:57.275 real 1m32.539s 00:02:57.275 user 14m30.132s 00:02:57.275 sys 1m48.672s 00:02:57.275 09:49:03 -- common/autotest_common.sh@1105 -- $ xtrace_disable 00:02:57.275 09:49:03 -- common/autotest_common.sh@10 -- $ set +x 00:02:57.275 ************************************ 00:02:57.275 END TEST build_native_dpdk 00:02:57.275 ************************************ 00:02:57.275 09:49:03 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:02:57.275 09:49:03 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:02:57.275 09:49:03 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:02:57.275 09:49:03 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:02:57.275 09:49:03 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:02:57.275 09:49:03 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:02:57.275 09:49:03 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:02:57.275 09:49:03 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build --with-shared 00:02:57.532 Using /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig for additional libs... 00:02:57.532 DPDK libraries: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.532 DPDK includes: //var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.532 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:02:57.790 Using 'verbs' RDMA provider 00:03:08.324 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:03:16.433 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:03:16.434 Creating mk/config.mk...done. 00:03:16.434 Creating mk/cc.flags.mk...done. 00:03:16.434 Type 'make' to build. 00:03:16.434 09:49:22 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:03:16.434 09:49:22 -- common/autotest_common.sh@1077 -- $ '[' 3 -le 1 ']' 00:03:16.434 09:49:22 -- common/autotest_common.sh@1083 -- $ xtrace_disable 00:03:16.434 09:49:22 -- common/autotest_common.sh@10 -- $ set +x 00:03:16.434 ************************************ 00:03:16.434 START TEST make 00:03:16.434 ************************************ 00:03:16.434 09:49:22 -- common/autotest_common.sh@1104 -- $ make -j48 00:03:16.691 make[1]: Nothing to be done for 'all'. 00:03:18.076 The Meson build system 00:03:18.076 Version: 1.3.1 00:03:18.076 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user 00:03:18.076 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:18.076 Build type: native build 00:03:18.076 Project name: libvfio-user 00:03:18.076 Project version: 0.0.1 00:03:18.076 C compiler for the host machine: gcc (gcc 13.2.1 "gcc (GCC) 13.2.1 20231011 (Red Hat 13.2.1-4)") 00:03:18.076 C linker for the host machine: gcc ld.bfd 2.39-16 00:03:18.076 Host machine cpu family: x86_64 00:03:18.076 Host machine cpu: x86_64 00:03:18.076 Run-time dependency threads found: YES 00:03:18.076 Library dl found: YES 00:03:18.076 Found pkg-config: YES (/usr/bin/pkg-config) 1.8.0 00:03:18.076 Run-time dependency json-c found: YES 0.17 00:03:18.076 Run-time dependency cmocka found: YES 1.1.7 00:03:18.076 Program pytest-3 found: NO 00:03:18.076 Program flake8 found: NO 00:03:18.076 Program misspell-fixer found: NO 00:03:18.076 Program restructuredtext-lint found: NO 00:03:18.076 Program valgrind found: YES (/usr/bin/valgrind) 00:03:18.076 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:03:18.076 Compiler for C supports arguments -Wmissing-declarations: YES 00:03:18.076 Compiler for C supports arguments -Wwrite-strings: YES 00:03:18.076 ../libvfio-user/test/meson.build:20: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:03:18.076 Program test-lspci.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-lspci.sh) 00:03:18.076 Program test-linkage.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-linkage.sh) 00:03:18.076 ../libvfio-user/test/py/meson.build:16: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:03:18.076 Build targets in project: 8 00:03:18.076 WARNING: Project specifies a minimum meson_version '>= 0.53.0' but uses features which were added in newer versions: 00:03:18.076 * 0.57.0: {'exclude_suites arg in add_test_setup'} 00:03:18.076 00:03:18.076 libvfio-user 0.0.1 00:03:18.076 00:03:18.076 User defined options 00:03:18.076 buildtype : debug 00:03:18.076 default_library: shared 00:03:18.076 libdir : /usr/local/lib 00:03:18.076 00:03:18.076 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:03:19.019 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:03:19.279 [1/37] Compiling C object lib/libvfio-user.so.0.0.1.p/migration.c.o 00:03:19.279 [2/37] Compiling C object lib/libvfio-user.so.0.0.1.p/irq.c.o 00:03:19.279 [3/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran.c.o 00:03:19.279 [4/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci.c.o 00:03:19.279 [5/37] Compiling C object samples/client.p/.._lib_migration.c.o 00:03:19.279 [6/37] Compiling C object samples/null.p/null.c.o 00:03:19.279 [7/37] Compiling C object samples/lspci.p/lspci.c.o 00:03:19.279 [8/37] Compiling C object samples/gpio-pci-idio-16.p/gpio-pci-idio-16.c.o 00:03:19.279 [9/37] Compiling C object samples/shadow_ioeventfd_server.p/shadow_ioeventfd_server.c.o 00:03:19.279 [10/37] Compiling C object samples/client.p/.._lib_tran.c.o 00:03:19.279 [11/37] Compiling C object test/unit_tests.p/.._lib_migration.c.o 00:03:19.279 [12/37] Compiling C object samples/server.p/server.c.o 00:03:19.279 [13/37] Compiling C object test/unit_tests.p/.._lib_irq.c.o 00:03:19.279 [14/37] Compiling C object lib/libvfio-user.so.0.0.1.p/dma.c.o 00:03:19.279 [15/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran_sock.c.o 00:03:19.279 [16/37] Compiling C object samples/client.p/.._lib_tran_sock.c.o 00:03:19.279 [17/37] Compiling C object test/unit_tests.p/.._lib_dma.c.o 00:03:19.538 [18/37] Compiling C object test/unit_tests.p/.._lib_tran.c.o 00:03:19.538 [19/37] Compiling C object test/unit_tests.p/.._lib_pci.c.o 00:03:19.538 [20/37] Compiling C object samples/client.p/client.c.o 00:03:19.538 [21/37] Compiling C object test/unit_tests.p/mocks.c.o 00:03:19.538 [22/37] Compiling C object test/unit_tests.p/.._lib_tran_pipe.c.o 00:03:19.538 [23/37] Compiling C object test/unit_tests.p/unit-tests.c.o 00:03:19.538 [24/37] Linking target samples/client 00:03:19.538 [25/37] Compiling C object test/unit_tests.p/.._lib_tran_sock.c.o 00:03:19.538 [26/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci_caps.c.o 00:03:19.538 [27/37] Compiling C object test/unit_tests.p/.._lib_pci_caps.c.o 00:03:19.538 [28/37] Compiling C object test/unit_tests.p/.._lib_libvfio-user.c.o 00:03:19.538 [29/37] Compiling C object lib/libvfio-user.so.0.0.1.p/libvfio-user.c.o 00:03:19.799 [30/37] Linking target test/unit_tests 00:03:19.799 [31/37] Linking target lib/libvfio-user.so.0.0.1 00:03:19.799 [32/37] Generating symbol file lib/libvfio-user.so.0.0.1.p/libvfio-user.so.0.0.1.symbols 00:03:20.058 [33/37] Linking target samples/gpio-pci-idio-16 00:03:20.058 [34/37] Linking target samples/server 00:03:20.058 [35/37] Linking target samples/lspci 00:03:20.058 [36/37] Linking target samples/shadow_ioeventfd_server 00:03:20.058 [37/37] Linking target samples/null 00:03:20.058 INFO: autodetecting backend as ninja 00:03:20.058 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:20.058 DESTDIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user meson install --quiet -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:20.685 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:03:20.685 ninja: no work to do. 00:03:32.880 CC lib/log/log.o 00:03:32.880 CC lib/log/log_flags.o 00:03:32.880 CC lib/ut_mock/mock.o 00:03:32.880 CC lib/log/log_deprecated.o 00:03:32.880 CC lib/ut/ut.o 00:03:32.880 LIB libspdk_ut_mock.a 00:03:32.880 SO libspdk_ut_mock.so.5.0 00:03:32.880 LIB libspdk_ut.a 00:03:32.880 LIB libspdk_log.a 00:03:32.880 SO libspdk_ut.so.1.0 00:03:32.880 SO libspdk_log.so.6.1 00:03:32.880 SYMLINK libspdk_ut_mock.so 00:03:32.880 SYMLINK libspdk_ut.so 00:03:32.880 SYMLINK libspdk_log.so 00:03:32.880 CC lib/ioat/ioat.o 00:03:32.880 CC lib/dma/dma.o 00:03:32.880 CXX lib/trace_parser/trace.o 00:03:32.880 CC lib/util/base64.o 00:03:32.880 CC lib/util/bit_array.o 00:03:32.880 CC lib/util/cpuset.o 00:03:32.880 CC lib/util/crc16.o 00:03:32.880 CC lib/util/crc32.o 00:03:32.880 CC lib/util/crc32c.o 00:03:32.880 CC lib/util/crc32_ieee.o 00:03:32.880 CC lib/util/crc64.o 00:03:32.880 CC lib/util/dif.o 00:03:32.880 CC lib/util/fd.o 00:03:32.880 CC lib/util/file.o 00:03:32.880 CC lib/util/hexlify.o 00:03:32.880 CC lib/util/iov.o 00:03:32.880 CC lib/util/math.o 00:03:32.880 CC lib/util/pipe.o 00:03:32.880 CC lib/util/strerror_tls.o 00:03:32.880 CC lib/util/string.o 00:03:32.880 CC lib/util/uuid.o 00:03:32.880 CC lib/util/fd_group.o 00:03:32.880 CC lib/util/xor.o 00:03:32.880 CC lib/util/zipf.o 00:03:32.880 CC lib/vfio_user/host/vfio_user_pci.o 00:03:32.880 CC lib/vfio_user/host/vfio_user.o 00:03:32.880 LIB libspdk_dma.a 00:03:32.880 SO libspdk_dma.so.3.0 00:03:32.880 SYMLINK libspdk_dma.so 00:03:32.880 LIB libspdk_ioat.a 00:03:32.880 SO libspdk_ioat.so.6.0 00:03:32.880 LIB libspdk_vfio_user.a 00:03:32.880 SO libspdk_vfio_user.so.4.0 00:03:32.880 SYMLINK libspdk_ioat.so 00:03:32.880 SYMLINK libspdk_vfio_user.so 00:03:32.880 LIB libspdk_util.a 00:03:32.880 SO libspdk_util.so.8.0 00:03:32.880 SYMLINK libspdk_util.so 00:03:32.880 CC lib/json/json_parse.o 00:03:32.880 CC lib/env_dpdk/env.o 00:03:32.880 CC lib/idxd/idxd.o 00:03:32.880 CC lib/vmd/vmd.o 00:03:32.880 CC lib/rdma/common.o 00:03:32.880 CC lib/json/json_util.o 00:03:32.880 CC lib/idxd/idxd_user.o 00:03:32.880 CC lib/rdma/rdma_verbs.o 00:03:32.880 CC lib/vmd/led.o 00:03:32.880 CC lib/conf/conf.o 00:03:32.880 CC lib/env_dpdk/memory.o 00:03:32.880 CC lib/json/json_write.o 00:03:32.880 CC lib/idxd/idxd_kernel.o 00:03:32.880 CC lib/env_dpdk/pci.o 00:03:32.880 CC lib/env_dpdk/init.o 00:03:32.880 CC lib/env_dpdk/threads.o 00:03:32.880 CC lib/env_dpdk/pci_ioat.o 00:03:32.880 CC lib/env_dpdk/pci_virtio.o 00:03:32.880 CC lib/env_dpdk/pci_vmd.o 00:03:32.880 CC lib/env_dpdk/pci_idxd.o 00:03:32.880 CC lib/env_dpdk/pci_event.o 00:03:32.880 CC lib/env_dpdk/sigbus_handler.o 00:03:32.880 CC lib/env_dpdk/pci_dpdk.o 00:03:32.880 CC lib/env_dpdk/pci_dpdk_2207.o 00:03:32.880 CC lib/env_dpdk/pci_dpdk_2211.o 00:03:32.880 LIB libspdk_trace_parser.a 00:03:32.880 SO libspdk_trace_parser.so.4.0 00:03:33.138 SYMLINK libspdk_trace_parser.so 00:03:33.138 LIB libspdk_conf.a 00:03:33.138 SO libspdk_conf.so.5.0 00:03:33.138 LIB libspdk_json.a 00:03:33.138 LIB libspdk_rdma.a 00:03:33.138 SYMLINK libspdk_conf.so 00:03:33.138 SO libspdk_rdma.so.5.0 00:03:33.138 SO libspdk_json.so.5.1 00:03:33.138 SYMLINK libspdk_rdma.so 00:03:33.138 SYMLINK libspdk_json.so 00:03:33.395 CC lib/jsonrpc/jsonrpc_server.o 00:03:33.395 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:03:33.395 CC lib/jsonrpc/jsonrpc_client.o 00:03:33.395 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:03:33.395 LIB libspdk_idxd.a 00:03:33.395 SO libspdk_idxd.so.11.0 00:03:33.395 SYMLINK libspdk_idxd.so 00:03:33.653 LIB libspdk_vmd.a 00:03:33.653 SO libspdk_vmd.so.5.0 00:03:33.653 SYMLINK libspdk_vmd.so 00:03:33.653 LIB libspdk_jsonrpc.a 00:03:33.653 SO libspdk_jsonrpc.so.5.1 00:03:33.653 SYMLINK libspdk_jsonrpc.so 00:03:33.911 CC lib/rpc/rpc.o 00:03:33.911 LIB libspdk_rpc.a 00:03:34.168 SO libspdk_rpc.so.5.0 00:03:34.168 SYMLINK libspdk_rpc.so 00:03:34.168 CC lib/trace/trace.o 00:03:34.168 CC lib/trace/trace_flags.o 00:03:34.168 CC lib/trace/trace_rpc.o 00:03:34.168 CC lib/notify/notify.o 00:03:34.168 CC lib/notify/notify_rpc.o 00:03:34.168 CC lib/sock/sock.o 00:03:34.168 CC lib/sock/sock_rpc.o 00:03:34.426 LIB libspdk_notify.a 00:03:34.426 SO libspdk_notify.so.5.0 00:03:34.426 LIB libspdk_trace.a 00:03:34.426 SYMLINK libspdk_notify.so 00:03:34.426 SO libspdk_trace.so.9.0 00:03:34.426 SYMLINK libspdk_trace.so 00:03:34.683 LIB libspdk_sock.a 00:03:34.683 SO libspdk_sock.so.8.0 00:03:34.683 CC lib/thread/thread.o 00:03:34.683 CC lib/thread/iobuf.o 00:03:34.683 SYMLINK libspdk_sock.so 00:03:34.683 CC lib/nvme/nvme_ctrlr_cmd.o 00:03:34.683 CC lib/nvme/nvme_ctrlr.o 00:03:34.683 CC lib/nvme/nvme_fabric.o 00:03:34.683 CC lib/nvme/nvme_ns_cmd.o 00:03:34.683 CC lib/nvme/nvme_ns.o 00:03:34.683 CC lib/nvme/nvme_pcie_common.o 00:03:34.683 CC lib/nvme/nvme_pcie.o 00:03:34.683 CC lib/nvme/nvme_qpair.o 00:03:34.683 CC lib/nvme/nvme.o 00:03:34.684 CC lib/nvme/nvme_quirks.o 00:03:34.684 CC lib/nvme/nvme_transport.o 00:03:34.684 CC lib/nvme/nvme_discovery.o 00:03:34.684 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:03:34.684 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:03:34.684 CC lib/nvme/nvme_tcp.o 00:03:34.684 CC lib/nvme/nvme_opal.o 00:03:34.684 CC lib/nvme/nvme_io_msg.o 00:03:34.684 CC lib/nvme/nvme_poll_group.o 00:03:34.684 CC lib/nvme/nvme_zns.o 00:03:34.684 CC lib/nvme/nvme_cuse.o 00:03:34.684 CC lib/nvme/nvme_vfio_user.o 00:03:34.684 CC lib/nvme/nvme_rdma.o 00:03:34.941 LIB libspdk_env_dpdk.a 00:03:34.941 SO libspdk_env_dpdk.so.13.0 00:03:35.199 SYMLINK libspdk_env_dpdk.so 00:03:36.132 LIB libspdk_thread.a 00:03:36.132 SO libspdk_thread.so.9.0 00:03:36.389 SYMLINK libspdk_thread.so 00:03:36.389 CC lib/vfu_tgt/tgt_endpoint.o 00:03:36.389 CC lib/accel/accel.o 00:03:36.389 CC lib/vfu_tgt/tgt_rpc.o 00:03:36.389 CC lib/accel/accel_rpc.o 00:03:36.389 CC lib/init/json_config.o 00:03:36.389 CC lib/virtio/virtio.o 00:03:36.389 CC lib/init/subsystem.o 00:03:36.389 CC lib/blob/blobstore.o 00:03:36.389 CC lib/virtio/virtio_vhost_user.o 00:03:36.389 CC lib/accel/accel_sw.o 00:03:36.389 CC lib/init/subsystem_rpc.o 00:03:36.389 CC lib/blob/request.o 00:03:36.389 CC lib/virtio/virtio_vfio_user.o 00:03:36.389 CC lib/init/rpc.o 00:03:36.389 CC lib/blob/zeroes.o 00:03:36.389 CC lib/virtio/virtio_pci.o 00:03:36.390 CC lib/blob/blob_bs_dev.o 00:03:36.647 LIB libspdk_init.a 00:03:36.647 SO libspdk_init.so.4.0 00:03:36.647 LIB libspdk_virtio.a 00:03:36.647 SYMLINK libspdk_init.so 00:03:36.647 LIB libspdk_vfu_tgt.a 00:03:36.904 SO libspdk_vfu_tgt.so.2.0 00:03:36.904 SO libspdk_virtio.so.6.0 00:03:36.904 SYMLINK libspdk_vfu_tgt.so 00:03:36.904 SYMLINK libspdk_virtio.so 00:03:36.904 CC lib/event/app.o 00:03:36.904 CC lib/event/reactor.o 00:03:36.904 CC lib/event/log_rpc.o 00:03:36.904 CC lib/event/app_rpc.o 00:03:36.904 CC lib/event/scheduler_static.o 00:03:37.161 LIB libspdk_nvme.a 00:03:37.161 SO libspdk_nvme.so.12.0 00:03:37.161 LIB libspdk_event.a 00:03:37.419 SO libspdk_event.so.12.0 00:03:37.419 SYMLINK libspdk_event.so 00:03:37.419 SYMLINK libspdk_nvme.so 00:03:37.419 LIB libspdk_accel.a 00:03:37.419 SO libspdk_accel.so.14.0 00:03:37.677 SYMLINK libspdk_accel.so 00:03:37.677 CC lib/bdev/bdev.o 00:03:37.677 CC lib/bdev/bdev_rpc.o 00:03:37.677 CC lib/bdev/bdev_zone.o 00:03:37.677 CC lib/bdev/scsi_nvme.o 00:03:37.677 CC lib/bdev/part.o 00:03:39.580 LIB libspdk_blob.a 00:03:39.580 SO libspdk_blob.so.10.1 00:03:39.580 SYMLINK libspdk_blob.so 00:03:39.580 CC lib/blobfs/blobfs.o 00:03:39.580 CC lib/blobfs/tree.o 00:03:39.580 CC lib/lvol/lvol.o 00:03:40.146 LIB libspdk_blobfs.a 00:03:40.146 LIB libspdk_bdev.a 00:03:40.146 SO libspdk_blobfs.so.9.0 00:03:40.146 LIB libspdk_lvol.a 00:03:40.146 SO libspdk_bdev.so.14.0 00:03:40.412 SO libspdk_lvol.so.9.1 00:03:40.412 SYMLINK libspdk_blobfs.so 00:03:40.412 SYMLINK libspdk_lvol.so 00:03:40.412 SYMLINK libspdk_bdev.so 00:03:40.412 CC lib/nbd/nbd.o 00:03:40.412 CC lib/ublk/ublk.o 00:03:40.412 CC lib/ftl/ftl_core.o 00:03:40.412 CC lib/nvmf/ctrlr.o 00:03:40.412 CC lib/scsi/dev.o 00:03:40.412 CC lib/nbd/nbd_rpc.o 00:03:40.412 CC lib/ublk/ublk_rpc.o 00:03:40.412 CC lib/ftl/ftl_init.o 00:03:40.412 CC lib/scsi/lun.o 00:03:40.412 CC lib/nvmf/ctrlr_discovery.o 00:03:40.412 CC lib/ftl/ftl_layout.o 00:03:40.412 CC lib/scsi/port.o 00:03:40.412 CC lib/nvmf/ctrlr_bdev.o 00:03:40.412 CC lib/ftl/ftl_debug.o 00:03:40.412 CC lib/scsi/scsi.o 00:03:40.412 CC lib/nvmf/subsystem.o 00:03:40.412 CC lib/scsi/scsi_bdev.o 00:03:40.412 CC lib/ftl/ftl_io.o 00:03:40.412 CC lib/nvmf/nvmf.o 00:03:40.412 CC lib/scsi/scsi_pr.o 00:03:40.412 CC lib/ftl/ftl_sb.o 00:03:40.412 CC lib/nvmf/nvmf_rpc.o 00:03:40.412 CC lib/nvmf/transport.o 00:03:40.412 CC lib/ftl/ftl_l2p.o 00:03:40.412 CC lib/scsi/scsi_rpc.o 00:03:40.412 CC lib/ftl/ftl_l2p_flat.o 00:03:40.412 CC lib/scsi/task.o 00:03:40.412 CC lib/nvmf/tcp.o 00:03:40.412 CC lib/nvmf/vfio_user.o 00:03:40.412 CC lib/nvmf/rdma.o 00:03:40.412 CC lib/ftl/ftl_nv_cache.o 00:03:40.412 CC lib/ftl/ftl_band.o 00:03:40.412 CC lib/ftl/ftl_band_ops.o 00:03:40.412 CC lib/ftl/ftl_writer.o 00:03:40.412 CC lib/ftl/ftl_rq.o 00:03:40.412 CC lib/ftl/ftl_reloc.o 00:03:40.412 CC lib/ftl/ftl_l2p_cache.o 00:03:40.412 CC lib/ftl/ftl_p2l.o 00:03:40.412 CC lib/ftl/mngt/ftl_mngt.o 00:03:40.412 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:03:40.412 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:03:40.412 CC lib/ftl/mngt/ftl_mngt_startup.o 00:03:40.412 CC lib/ftl/mngt/ftl_mngt_md.o 00:03:40.412 CC lib/ftl/mngt/ftl_mngt_misc.o 00:03:40.412 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:03:40.412 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:03:40.412 CC lib/ftl/mngt/ftl_mngt_band.o 00:03:40.412 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:03:40.979 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:03:40.979 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:03:40.979 CC lib/ftl/utils/ftl_conf.o 00:03:40.979 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:03:40.979 CC lib/ftl/utils/ftl_md.o 00:03:40.979 CC lib/ftl/utils/ftl_mempool.o 00:03:40.979 CC lib/ftl/utils/ftl_bitmap.o 00:03:40.979 CC lib/ftl/utils/ftl_property.o 00:03:40.979 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:03:40.979 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:03:40.979 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:03:40.979 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:03:40.979 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:03:40.979 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:03:40.979 CC lib/ftl/upgrade/ftl_sb_v3.o 00:03:40.979 CC lib/ftl/upgrade/ftl_sb_v5.o 00:03:40.979 CC lib/ftl/nvc/ftl_nvc_dev.o 00:03:40.979 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:03:40.979 CC lib/ftl/base/ftl_base_dev.o 00:03:40.979 CC lib/ftl/base/ftl_base_bdev.o 00:03:40.979 CC lib/ftl/ftl_trace.o 00:03:41.238 LIB libspdk_nbd.a 00:03:41.238 SO libspdk_nbd.so.6.0 00:03:41.238 SYMLINK libspdk_nbd.so 00:03:41.534 LIB libspdk_scsi.a 00:03:41.534 SO libspdk_scsi.so.8.0 00:03:41.534 LIB libspdk_ublk.a 00:03:41.534 SYMLINK libspdk_scsi.so 00:03:41.534 SO libspdk_ublk.so.2.0 00:03:41.534 SYMLINK libspdk_ublk.so 00:03:41.534 CC lib/iscsi/conn.o 00:03:41.534 CC lib/vhost/vhost.o 00:03:41.534 CC lib/vhost/vhost_rpc.o 00:03:41.534 CC lib/iscsi/init_grp.o 00:03:41.534 CC lib/iscsi/iscsi.o 00:03:41.534 CC lib/vhost/vhost_scsi.o 00:03:41.534 CC lib/vhost/vhost_blk.o 00:03:41.534 CC lib/iscsi/md5.o 00:03:41.534 CC lib/vhost/rte_vhost_user.o 00:03:41.534 CC lib/iscsi/param.o 00:03:41.534 CC lib/iscsi/portal_grp.o 00:03:41.534 CC lib/iscsi/tgt_node.o 00:03:41.534 CC lib/iscsi/iscsi_subsystem.o 00:03:41.534 CC lib/iscsi/iscsi_rpc.o 00:03:41.534 CC lib/iscsi/task.o 00:03:41.792 LIB libspdk_ftl.a 00:03:41.792 SO libspdk_ftl.so.8.0 00:03:42.356 SYMLINK libspdk_ftl.so 00:03:42.921 LIB libspdk_vhost.a 00:03:42.921 SO libspdk_vhost.so.7.1 00:03:42.921 SYMLINK libspdk_vhost.so 00:03:42.921 LIB libspdk_nvmf.a 00:03:42.921 LIB libspdk_iscsi.a 00:03:42.921 SO libspdk_nvmf.so.17.0 00:03:43.179 SO libspdk_iscsi.so.7.0 00:03:43.179 SYMLINK libspdk_nvmf.so 00:03:43.179 SYMLINK libspdk_iscsi.so 00:03:43.437 CC module/env_dpdk/env_dpdk_rpc.o 00:03:43.437 CC module/vfu_device/vfu_virtio.o 00:03:43.437 CC module/vfu_device/vfu_virtio_blk.o 00:03:43.437 CC module/vfu_device/vfu_virtio_scsi.o 00:03:43.437 CC module/vfu_device/vfu_virtio_rpc.o 00:03:43.437 CC module/accel/ioat/accel_ioat.o 00:03:43.437 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:03:43.437 CC module/accel/ioat/accel_ioat_rpc.o 00:03:43.437 CC module/scheduler/dynamic/scheduler_dynamic.o 00:03:43.437 CC module/blob/bdev/blob_bdev.o 00:03:43.437 CC module/accel/dsa/accel_dsa.o 00:03:43.437 CC module/accel/error/accel_error.o 00:03:43.437 CC module/accel/iaa/accel_iaa.o 00:03:43.437 CC module/accel/dsa/accel_dsa_rpc.o 00:03:43.437 CC module/scheduler/gscheduler/gscheduler.o 00:03:43.437 CC module/accel/iaa/accel_iaa_rpc.o 00:03:43.437 CC module/accel/error/accel_error_rpc.o 00:03:43.437 CC module/sock/posix/posix.o 00:03:43.695 LIB libspdk_env_dpdk_rpc.a 00:03:43.695 SO libspdk_env_dpdk_rpc.so.5.0 00:03:43.695 SYMLINK libspdk_env_dpdk_rpc.so 00:03:43.695 LIB libspdk_scheduler_gscheduler.a 00:03:43.695 LIB libspdk_scheduler_dpdk_governor.a 00:03:43.695 SO libspdk_scheduler_gscheduler.so.3.0 00:03:43.695 SO libspdk_scheduler_dpdk_governor.so.3.0 00:03:43.695 LIB libspdk_accel_error.a 00:03:43.695 LIB libspdk_accel_ioat.a 00:03:43.695 LIB libspdk_scheduler_dynamic.a 00:03:43.695 LIB libspdk_accel_iaa.a 00:03:43.695 SO libspdk_accel_error.so.1.0 00:03:43.695 SO libspdk_accel_ioat.so.5.0 00:03:43.695 SO libspdk_scheduler_dynamic.so.3.0 00:03:43.695 SYMLINK libspdk_scheduler_gscheduler.so 00:03:43.695 SYMLINK libspdk_scheduler_dpdk_governor.so 00:03:43.695 SO libspdk_accel_iaa.so.2.0 00:03:43.695 LIB libspdk_accel_dsa.a 00:03:43.695 SYMLINK libspdk_accel_error.so 00:03:43.695 SYMLINK libspdk_accel_ioat.so 00:03:43.695 SYMLINK libspdk_scheduler_dynamic.so 00:03:43.695 LIB libspdk_blob_bdev.a 00:03:43.695 SO libspdk_accel_dsa.so.4.0 00:03:43.695 SYMLINK libspdk_accel_iaa.so 00:03:43.695 SO libspdk_blob_bdev.so.10.1 00:03:43.956 SYMLINK libspdk_accel_dsa.so 00:03:43.956 SYMLINK libspdk_blob_bdev.so 00:03:43.956 CC module/blobfs/bdev/blobfs_bdev.o 00:03:43.956 CC module/bdev/raid/bdev_raid.o 00:03:43.956 CC module/bdev/zone_block/vbdev_zone_block.o 00:03:43.956 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:03:43.956 CC module/bdev/delay/vbdev_delay_rpc.o 00:03:43.956 CC module/bdev/delay/vbdev_delay.o 00:03:43.956 CC module/bdev/null/bdev_null.o 00:03:43.956 CC module/bdev/aio/bdev_aio.o 00:03:43.956 CC module/bdev/raid/bdev_raid_rpc.o 00:03:43.956 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:03:43.956 CC module/bdev/nvme/bdev_nvme.o 00:03:43.956 CC module/bdev/lvol/vbdev_lvol.o 00:03:43.956 CC module/bdev/aio/bdev_aio_rpc.o 00:03:43.956 CC module/bdev/raid/bdev_raid_sb.o 00:03:43.956 CC module/bdev/null/bdev_null_rpc.o 00:03:43.956 CC module/bdev/error/vbdev_error.o 00:03:43.956 CC module/bdev/nvme/bdev_nvme_rpc.o 00:03:43.956 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:03:43.956 CC module/bdev/raid/raid0.o 00:03:43.956 CC module/bdev/raid/raid1.o 00:03:43.956 CC module/bdev/malloc/bdev_malloc.o 00:03:43.956 CC module/bdev/gpt/gpt.o 00:03:43.956 CC module/bdev/nvme/nvme_rpc.o 00:03:43.956 CC module/bdev/error/vbdev_error_rpc.o 00:03:43.956 CC module/bdev/malloc/bdev_malloc_rpc.o 00:03:43.956 CC module/bdev/split/vbdev_split.o 00:03:43.956 CC module/bdev/raid/concat.o 00:03:43.956 CC module/bdev/gpt/vbdev_gpt.o 00:03:43.956 CC module/bdev/nvme/bdev_mdns_client.o 00:03:43.956 CC module/bdev/split/vbdev_split_rpc.o 00:03:43.956 CC module/bdev/nvme/vbdev_opal.o 00:03:43.956 CC module/bdev/virtio/bdev_virtio_scsi.o 00:03:43.956 CC module/bdev/virtio/bdev_virtio_blk.o 00:03:43.956 CC module/bdev/nvme/vbdev_opal_rpc.o 00:03:43.956 CC module/bdev/virtio/bdev_virtio_rpc.o 00:03:43.956 CC module/bdev/iscsi/bdev_iscsi.o 00:03:43.956 CC module/bdev/passthru/vbdev_passthru.o 00:03:43.956 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:03:43.956 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:03:43.956 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:03:43.956 CC module/bdev/ftl/bdev_ftl.o 00:03:43.956 CC module/bdev/ftl/bdev_ftl_rpc.o 00:03:44.214 LIB libspdk_vfu_device.a 00:03:44.214 SO libspdk_vfu_device.so.2.0 00:03:44.214 LIB libspdk_sock_posix.a 00:03:44.475 SYMLINK libspdk_vfu_device.so 00:03:44.475 SO libspdk_sock_posix.so.5.0 00:03:44.475 LIB libspdk_blobfs_bdev.a 00:03:44.475 LIB libspdk_bdev_error.a 00:03:44.475 SO libspdk_blobfs_bdev.so.5.0 00:03:44.475 SYMLINK libspdk_sock_posix.so 00:03:44.475 LIB libspdk_bdev_split.a 00:03:44.475 LIB libspdk_bdev_gpt.a 00:03:44.475 SO libspdk_bdev_error.so.5.0 00:03:44.475 SO libspdk_bdev_gpt.so.5.0 00:03:44.475 SO libspdk_bdev_split.so.5.0 00:03:44.475 LIB libspdk_bdev_iscsi.a 00:03:44.475 LIB libspdk_bdev_aio.a 00:03:44.475 SYMLINK libspdk_blobfs_bdev.so 00:03:44.475 SO libspdk_bdev_aio.so.5.0 00:03:44.475 SO libspdk_bdev_iscsi.so.5.0 00:03:44.475 SYMLINK libspdk_bdev_error.so 00:03:44.475 LIB libspdk_bdev_null.a 00:03:44.475 LIB libspdk_bdev_ftl.a 00:03:44.475 SYMLINK libspdk_bdev_gpt.so 00:03:44.475 SYMLINK libspdk_bdev_split.so 00:03:44.475 LIB libspdk_bdev_zone_block.a 00:03:44.475 SO libspdk_bdev_null.so.5.0 00:03:44.475 SO libspdk_bdev_ftl.so.5.0 00:03:44.475 LIB libspdk_bdev_passthru.a 00:03:44.475 SO libspdk_bdev_zone_block.so.5.0 00:03:44.475 SYMLINK libspdk_bdev_aio.so 00:03:44.475 SYMLINK libspdk_bdev_iscsi.so 00:03:44.475 SO libspdk_bdev_passthru.so.5.0 00:03:44.733 SYMLINK libspdk_bdev_null.so 00:03:44.733 SYMLINK libspdk_bdev_ftl.so 00:03:44.733 LIB libspdk_bdev_delay.a 00:03:44.733 SYMLINK libspdk_bdev_zone_block.so 00:03:44.733 SYMLINK libspdk_bdev_passthru.so 00:03:44.733 SO libspdk_bdev_delay.so.5.0 00:03:44.733 LIB libspdk_bdev_malloc.a 00:03:44.733 SO libspdk_bdev_malloc.so.5.0 00:03:44.733 SYMLINK libspdk_bdev_delay.so 00:03:44.733 LIB libspdk_bdev_lvol.a 00:03:44.733 LIB libspdk_bdev_virtio.a 00:03:44.733 SYMLINK libspdk_bdev_malloc.so 00:03:44.733 SO libspdk_bdev_lvol.so.5.0 00:03:44.733 SO libspdk_bdev_virtio.so.5.0 00:03:44.733 SYMLINK libspdk_bdev_lvol.so 00:03:44.733 SYMLINK libspdk_bdev_virtio.so 00:03:44.991 LIB libspdk_bdev_raid.a 00:03:45.249 SO libspdk_bdev_raid.so.5.0 00:03:45.249 SYMLINK libspdk_bdev_raid.so 00:03:46.620 LIB libspdk_bdev_nvme.a 00:03:46.620 SO libspdk_bdev_nvme.so.6.0 00:03:46.620 SYMLINK libspdk_bdev_nvme.so 00:03:46.620 CC module/event/subsystems/vmd/vmd.o 00:03:46.620 CC module/event/subsystems/vfu_tgt/vfu_tgt.o 00:03:46.620 CC module/event/subsystems/vmd/vmd_rpc.o 00:03:46.620 CC module/event/subsystems/sock/sock.o 00:03:46.620 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:03:46.620 CC module/event/subsystems/iobuf/iobuf.o 00:03:46.620 CC module/event/subsystems/scheduler/scheduler.o 00:03:46.620 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:03:46.877 LIB libspdk_event_sock.a 00:03:46.877 LIB libspdk_event_vhost_blk.a 00:03:46.877 LIB libspdk_event_vfu_tgt.a 00:03:46.877 LIB libspdk_event_scheduler.a 00:03:46.877 LIB libspdk_event_vmd.a 00:03:46.877 LIB libspdk_event_iobuf.a 00:03:46.877 SO libspdk_event_sock.so.4.0 00:03:46.877 SO libspdk_event_vhost_blk.so.2.0 00:03:46.877 SO libspdk_event_scheduler.so.3.0 00:03:46.877 SO libspdk_event_vfu_tgt.so.2.0 00:03:46.877 SO libspdk_event_vmd.so.5.0 00:03:46.877 SO libspdk_event_iobuf.so.2.0 00:03:46.877 SYMLINK libspdk_event_sock.so 00:03:46.877 SYMLINK libspdk_event_vhost_blk.so 00:03:46.877 SYMLINK libspdk_event_scheduler.so 00:03:46.877 SYMLINK libspdk_event_vfu_tgt.so 00:03:46.877 SYMLINK libspdk_event_vmd.so 00:03:46.877 SYMLINK libspdk_event_iobuf.so 00:03:47.135 CC module/event/subsystems/accel/accel.o 00:03:47.135 LIB libspdk_event_accel.a 00:03:47.135 SO libspdk_event_accel.so.5.0 00:03:47.392 SYMLINK libspdk_event_accel.so 00:03:47.392 CC module/event/subsystems/bdev/bdev.o 00:03:47.649 LIB libspdk_event_bdev.a 00:03:47.649 SO libspdk_event_bdev.so.5.0 00:03:47.649 SYMLINK libspdk_event_bdev.so 00:03:47.649 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:03:47.649 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:03:47.649 CC module/event/subsystems/scsi/scsi.o 00:03:47.649 CC module/event/subsystems/nbd/nbd.o 00:03:47.649 CC module/event/subsystems/ublk/ublk.o 00:03:47.906 LIB libspdk_event_nbd.a 00:03:47.906 LIB libspdk_event_ublk.a 00:03:47.906 LIB libspdk_event_scsi.a 00:03:47.906 SO libspdk_event_ublk.so.2.0 00:03:47.906 SO libspdk_event_nbd.so.5.0 00:03:47.906 SO libspdk_event_scsi.so.5.0 00:03:47.906 SYMLINK libspdk_event_ublk.so 00:03:47.906 SYMLINK libspdk_event_nbd.so 00:03:47.906 LIB libspdk_event_nvmf.a 00:03:47.906 SYMLINK libspdk_event_scsi.so 00:03:47.906 SO libspdk_event_nvmf.so.5.0 00:03:48.164 SYMLINK libspdk_event_nvmf.so 00:03:48.164 CC module/event/subsystems/iscsi/iscsi.o 00:03:48.164 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:03:48.164 LIB libspdk_event_vhost_scsi.a 00:03:48.164 LIB libspdk_event_iscsi.a 00:03:48.164 SO libspdk_event_vhost_scsi.so.2.0 00:03:48.422 SO libspdk_event_iscsi.so.5.0 00:03:48.422 SYMLINK libspdk_event_vhost_scsi.so 00:03:48.422 SYMLINK libspdk_event_iscsi.so 00:03:48.422 SO libspdk.so.5.0 00:03:48.422 SYMLINK libspdk.so 00:03:48.690 CC app/spdk_nvme_perf/perf.o 00:03:48.691 CC app/trace_record/trace_record.o 00:03:48.691 CC app/spdk_lspci/spdk_lspci.o 00:03:48.691 CXX app/trace/trace.o 00:03:48.691 CC app/spdk_top/spdk_top.o 00:03:48.691 CC app/spdk_nvme_discover/discovery_aer.o 00:03:48.691 CC test/rpc_client/rpc_client_test.o 00:03:48.691 CC app/spdk_nvme_identify/identify.o 00:03:48.691 TEST_HEADER include/spdk/accel.h 00:03:48.691 TEST_HEADER include/spdk/accel_module.h 00:03:48.691 TEST_HEADER include/spdk/assert.h 00:03:48.691 TEST_HEADER include/spdk/barrier.h 00:03:48.691 TEST_HEADER include/spdk/base64.h 00:03:48.691 TEST_HEADER include/spdk/bdev.h 00:03:48.691 TEST_HEADER include/spdk/bdev_module.h 00:03:48.691 TEST_HEADER include/spdk/bdev_zone.h 00:03:48.691 TEST_HEADER include/spdk/bit_array.h 00:03:48.691 TEST_HEADER include/spdk/bit_pool.h 00:03:48.691 TEST_HEADER include/spdk/blob_bdev.h 00:03:48.691 CC app/spdk_dd/spdk_dd.o 00:03:48.691 TEST_HEADER include/spdk/blobfs_bdev.h 00:03:48.691 TEST_HEADER include/spdk/blobfs.h 00:03:48.691 CC examples/interrupt_tgt/interrupt_tgt.o 00:03:48.691 TEST_HEADER include/spdk/blob.h 00:03:48.691 TEST_HEADER include/spdk/conf.h 00:03:48.691 TEST_HEADER include/spdk/config.h 00:03:48.691 CC app/nvmf_tgt/nvmf_main.o 00:03:48.691 TEST_HEADER include/spdk/cpuset.h 00:03:48.691 TEST_HEADER include/spdk/crc16.h 00:03:48.691 CC examples/ioat/verify/verify.o 00:03:48.691 TEST_HEADER include/spdk/crc32.h 00:03:48.691 CC app/vhost/vhost.o 00:03:48.691 CC examples/util/zipf/zipf.o 00:03:48.691 CC app/iscsi_tgt/iscsi_tgt.o 00:03:48.691 CC examples/ioat/perf/perf.o 00:03:48.691 TEST_HEADER include/spdk/crc64.h 00:03:48.691 TEST_HEADER include/spdk/dif.h 00:03:48.691 CC examples/nvme/nvme_manage/nvme_manage.o 00:03:48.691 CC examples/vmd/led/led.o 00:03:48.691 CC examples/nvme/hotplug/hotplug.o 00:03:48.691 TEST_HEADER include/spdk/dma.h 00:03:48.691 CC examples/vmd/lsvmd/lsvmd.o 00:03:48.691 CC examples/nvme/reconnect/reconnect.o 00:03:48.691 TEST_HEADER include/spdk/endian.h 00:03:48.691 CC examples/nvme/hello_world/hello_world.o 00:03:48.691 TEST_HEADER include/spdk/env_dpdk.h 00:03:48.691 CC test/env/vtophys/vtophys.o 00:03:48.691 CC examples/nvme/cmb_copy/cmb_copy.o 00:03:48.691 CC test/nvme/aer/aer.o 00:03:48.691 CC examples/idxd/perf/perf.o 00:03:48.691 CC examples/nvme/arbitration/arbitration.o 00:03:48.691 TEST_HEADER include/spdk/env.h 00:03:48.691 CC test/event/event_perf/event_perf.o 00:03:48.691 TEST_HEADER include/spdk/event.h 00:03:48.691 CC examples/accel/perf/accel_perf.o 00:03:48.691 CC app/fio/nvme/fio_plugin.o 00:03:48.691 TEST_HEADER include/spdk/fd_group.h 00:03:48.691 CC examples/sock/hello_world/hello_sock.o 00:03:48.691 TEST_HEADER include/spdk/fd.h 00:03:48.691 CC test/thread/poller_perf/poller_perf.o 00:03:48.691 TEST_HEADER include/spdk/file.h 00:03:48.691 TEST_HEADER include/spdk/ftl.h 00:03:48.691 TEST_HEADER include/spdk/gpt_spec.h 00:03:48.691 CC app/spdk_tgt/spdk_tgt.o 00:03:48.691 TEST_HEADER include/spdk/hexlify.h 00:03:48.691 TEST_HEADER include/spdk/histogram_data.h 00:03:48.691 TEST_HEADER include/spdk/idxd.h 00:03:48.691 TEST_HEADER include/spdk/idxd_spec.h 00:03:48.691 TEST_HEADER include/spdk/init.h 00:03:48.691 TEST_HEADER include/spdk/ioat.h 00:03:48.691 TEST_HEADER include/spdk/ioat_spec.h 00:03:48.691 CC examples/bdev/hello_world/hello_bdev.o 00:03:48.691 TEST_HEADER include/spdk/iscsi_spec.h 00:03:48.691 TEST_HEADER include/spdk/json.h 00:03:48.691 TEST_HEADER include/spdk/jsonrpc.h 00:03:48.691 CC test/bdev/bdevio/bdevio.o 00:03:48.691 TEST_HEADER include/spdk/likely.h 00:03:48.691 CC examples/blob/cli/blobcli.o 00:03:48.691 CC examples/nvmf/nvmf/nvmf.o 00:03:48.691 CC examples/blob/hello_world/hello_blob.o 00:03:48.691 TEST_HEADER include/spdk/log.h 00:03:48.691 CC examples/thread/thread/thread_ex.o 00:03:48.691 CC test/blobfs/mkfs/mkfs.o 00:03:48.691 CC test/accel/dif/dif.o 00:03:48.691 TEST_HEADER include/spdk/lvol.h 00:03:48.691 TEST_HEADER include/spdk/memory.h 00:03:48.691 CC examples/bdev/bdevperf/bdevperf.o 00:03:48.691 CC test/app/bdev_svc/bdev_svc.o 00:03:48.691 TEST_HEADER include/spdk/mmio.h 00:03:48.691 TEST_HEADER include/spdk/nbd.h 00:03:48.691 CC test/env/mem_callbacks/mem_callbacks.o 00:03:48.691 TEST_HEADER include/spdk/notify.h 00:03:48.691 CC test/dma/test_dma/test_dma.o 00:03:48.691 TEST_HEADER include/spdk/nvme.h 00:03:48.691 TEST_HEADER include/spdk/nvme_intel.h 00:03:48.691 TEST_HEADER include/spdk/nvme_ocssd.h 00:03:48.691 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:03:48.691 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:03:48.691 TEST_HEADER include/spdk/nvme_spec.h 00:03:48.691 CC test/lvol/esnap/esnap.o 00:03:48.691 TEST_HEADER include/spdk/nvme_zns.h 00:03:48.691 TEST_HEADER include/spdk/nvmf_cmd.h 00:03:48.691 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:03:48.950 TEST_HEADER include/spdk/nvmf.h 00:03:48.951 TEST_HEADER include/spdk/nvmf_spec.h 00:03:48.951 TEST_HEADER include/spdk/nvmf_transport.h 00:03:48.951 TEST_HEADER include/spdk/opal.h 00:03:48.951 TEST_HEADER include/spdk/opal_spec.h 00:03:48.951 TEST_HEADER include/spdk/pci_ids.h 00:03:48.951 TEST_HEADER include/spdk/pipe.h 00:03:48.951 TEST_HEADER include/spdk/queue.h 00:03:48.951 TEST_HEADER include/spdk/reduce.h 00:03:48.951 TEST_HEADER include/spdk/rpc.h 00:03:48.951 TEST_HEADER include/spdk/scheduler.h 00:03:48.951 TEST_HEADER include/spdk/scsi.h 00:03:48.951 TEST_HEADER include/spdk/scsi_spec.h 00:03:48.951 TEST_HEADER include/spdk/sock.h 00:03:48.951 TEST_HEADER include/spdk/stdinc.h 00:03:48.951 LINK spdk_lspci 00:03:48.951 TEST_HEADER include/spdk/string.h 00:03:48.951 TEST_HEADER include/spdk/thread.h 00:03:48.951 TEST_HEADER include/spdk/trace.h 00:03:48.951 TEST_HEADER include/spdk/trace_parser.h 00:03:48.951 TEST_HEADER include/spdk/tree.h 00:03:48.951 TEST_HEADER include/spdk/ublk.h 00:03:48.951 TEST_HEADER include/spdk/util.h 00:03:48.951 TEST_HEADER include/spdk/uuid.h 00:03:48.951 TEST_HEADER include/spdk/version.h 00:03:48.951 TEST_HEADER include/spdk/vfio_user_pci.h 00:03:48.951 TEST_HEADER include/spdk/vfio_user_spec.h 00:03:48.951 TEST_HEADER include/spdk/vhost.h 00:03:48.951 TEST_HEADER include/spdk/vmd.h 00:03:48.951 TEST_HEADER include/spdk/xor.h 00:03:48.951 TEST_HEADER include/spdk/zipf.h 00:03:48.951 CXX test/cpp_headers/accel.o 00:03:48.951 LINK rpc_client_test 00:03:48.951 LINK lsvmd 00:03:48.951 LINK spdk_nvme_discover 00:03:48.951 LINK vtophys 00:03:48.951 LINK zipf 00:03:48.951 LINK event_perf 00:03:48.951 LINK led 00:03:48.951 LINK poller_perf 00:03:48.951 LINK interrupt_tgt 00:03:48.951 LINK nvmf_tgt 00:03:48.951 LINK cmb_copy 00:03:48.951 LINK spdk_trace_record 00:03:48.951 LINK vhost 00:03:49.216 LINK verify 00:03:49.216 LINK iscsi_tgt 00:03:49.216 LINK ioat_perf 00:03:49.216 LINK spdk_tgt 00:03:49.216 LINK bdev_svc 00:03:49.216 LINK hello_world 00:03:49.216 LINK mem_callbacks 00:03:49.216 LINK mkfs 00:03:49.216 LINK hotplug 00:03:49.216 LINK hello_sock 00:03:49.216 LINK hello_bdev 00:03:49.216 LINK hello_blob 00:03:49.216 LINK aer 00:03:49.216 LINK thread 00:03:49.216 CC test/nvme/reset/reset.o 00:03:49.216 CXX test/cpp_headers/accel_module.o 00:03:49.216 LINK arbitration 00:03:49.216 LINK idxd_perf 00:03:49.478 LINK nvmf 00:03:49.478 LINK spdk_dd 00:03:49.478 LINK reconnect 00:03:49.478 CC examples/nvme/abort/abort.o 00:03:49.478 LINK spdk_trace 00:03:49.478 CXX test/cpp_headers/assert.o 00:03:49.478 CXX test/cpp_headers/barrier.o 00:03:49.478 CC test/event/reactor/reactor.o 00:03:49.478 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:03:49.478 CC test/env/memory/memory_ut.o 00:03:49.478 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:03:49.478 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:03:49.478 CC test/env/pci/pci_ut.o 00:03:49.478 CC app/fio/bdev/fio_plugin.o 00:03:49.478 LINK bdevio 00:03:49.478 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:03:49.478 LINK dif 00:03:49.478 CC test/nvme/sgl/sgl.o 00:03:49.478 CC test/nvme/e2edp/nvme_dp.o 00:03:49.478 CXX test/cpp_headers/base64.o 00:03:49.478 LINK test_dma 00:03:49.478 CC test/app/histogram_perf/histogram_perf.o 00:03:49.478 CC test/app/jsoncat/jsoncat.o 00:03:49.478 CXX test/cpp_headers/bdev.o 00:03:49.478 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:03:49.478 LINK accel_perf 00:03:49.478 LINK nvme_manage 00:03:49.743 LINK nvme_fuzz 00:03:49.743 CC test/event/reactor_perf/reactor_perf.o 00:03:49.743 CXX test/cpp_headers/bdev_module.o 00:03:49.743 CC test/nvme/overhead/overhead.o 00:03:49.743 CC test/event/app_repeat/app_repeat.o 00:03:49.743 CXX test/cpp_headers/bdev_zone.o 00:03:49.743 CXX test/cpp_headers/bit_array.o 00:03:49.743 CC test/app/stub/stub.o 00:03:49.743 LINK reactor 00:03:49.743 LINK blobcli 00:03:49.743 LINK env_dpdk_post_init 00:03:49.743 CXX test/cpp_headers/bit_pool.o 00:03:49.743 CC test/nvme/err_injection/err_injection.o 00:03:49.743 LINK spdk_nvme 00:03:49.743 CC test/nvme/startup/startup.o 00:03:49.743 CXX test/cpp_headers/blob_bdev.o 00:03:49.743 CC test/nvme/reserve/reserve.o 00:03:49.743 CXX test/cpp_headers/blobfs_bdev.o 00:03:49.743 CC test/nvme/simple_copy/simple_copy.o 00:03:49.743 CXX test/cpp_headers/blobfs.o 00:03:49.743 CC test/event/scheduler/scheduler.o 00:03:49.743 CC test/nvme/connect_stress/connect_stress.o 00:03:49.743 LINK reset 00:03:49.743 LINK jsoncat 00:03:49.743 CC test/nvme/boot_partition/boot_partition.o 00:03:49.743 CXX test/cpp_headers/blob.o 00:03:49.743 LINK histogram_perf 00:03:50.003 CC test/nvme/compliance/nvme_compliance.o 00:03:50.003 CXX test/cpp_headers/conf.o 00:03:50.003 CXX test/cpp_headers/config.o 00:03:50.003 LINK reactor_perf 00:03:50.003 CXX test/cpp_headers/cpuset.o 00:03:50.003 LINK pmr_persistence 00:03:50.003 LINK app_repeat 00:03:50.003 CXX test/cpp_headers/crc16.o 00:03:50.003 CXX test/cpp_headers/crc32.o 00:03:50.003 CXX test/cpp_headers/crc64.o 00:03:50.003 CC test/nvme/fused_ordering/fused_ordering.o 00:03:50.003 CC test/nvme/doorbell_aers/doorbell_aers.o 00:03:50.003 CXX test/cpp_headers/dif.o 00:03:50.003 LINK nvme_dp 00:03:50.003 CXX test/cpp_headers/dma.o 00:03:50.003 CXX test/cpp_headers/endian.o 00:03:50.003 CXX test/cpp_headers/env_dpdk.o 00:03:50.003 CC test/nvme/fdp/fdp.o 00:03:50.003 LINK sgl 00:03:50.003 LINK stub 00:03:50.003 CC test/nvme/cuse/cuse.o 00:03:50.003 LINK abort 00:03:50.003 CXX test/cpp_headers/env.o 00:03:50.003 LINK spdk_nvme_perf 00:03:50.003 LINK startup 00:03:50.003 LINK err_injection 00:03:50.003 CXX test/cpp_headers/event.o 00:03:50.003 CXX test/cpp_headers/fd_group.o 00:03:50.266 CXX test/cpp_headers/fd.o 00:03:50.266 CXX test/cpp_headers/file.o 00:03:50.266 CXX test/cpp_headers/ftl.o 00:03:50.266 LINK connect_stress 00:03:50.266 LINK reserve 00:03:50.266 LINK overhead 00:03:50.266 CXX test/cpp_headers/gpt_spec.o 00:03:50.266 LINK boot_partition 00:03:50.266 CXX test/cpp_headers/hexlify.o 00:03:50.266 LINK spdk_top 00:03:50.266 LINK bdevperf 00:03:50.266 CXX test/cpp_headers/histogram_data.o 00:03:50.266 CXX test/cpp_headers/idxd.o 00:03:50.266 LINK pci_ut 00:03:50.266 CXX test/cpp_headers/idxd_spec.o 00:03:50.266 LINK spdk_nvme_identify 00:03:50.266 CXX test/cpp_headers/init.o 00:03:50.266 LINK scheduler 00:03:50.266 LINK simple_copy 00:03:50.266 LINK vhost_fuzz 00:03:50.266 CXX test/cpp_headers/ioat.o 00:03:50.266 CXX test/cpp_headers/ioat_spec.o 00:03:50.266 CXX test/cpp_headers/iscsi_spec.o 00:03:50.266 CXX test/cpp_headers/json.o 00:03:50.266 CXX test/cpp_headers/jsonrpc.o 00:03:50.266 LINK memory_ut 00:03:50.266 CXX test/cpp_headers/likely.o 00:03:50.266 CXX test/cpp_headers/log.o 00:03:50.266 CXX test/cpp_headers/lvol.o 00:03:50.530 CXX test/cpp_headers/memory.o 00:03:50.530 CXX test/cpp_headers/mmio.o 00:03:50.530 CXX test/cpp_headers/nbd.o 00:03:50.530 CXX test/cpp_headers/notify.o 00:03:50.530 CXX test/cpp_headers/nvme.o 00:03:50.530 LINK doorbell_aers 00:03:50.530 CXX test/cpp_headers/nvme_intel.o 00:03:50.530 CXX test/cpp_headers/nvme_ocssd.o 00:03:50.530 CXX test/cpp_headers/nvme_ocssd_spec.o 00:03:50.530 LINK spdk_bdev 00:03:50.530 LINK fused_ordering 00:03:50.530 CXX test/cpp_headers/nvme_spec.o 00:03:50.530 CXX test/cpp_headers/nvme_zns.o 00:03:50.530 CXX test/cpp_headers/nvmf_cmd.o 00:03:50.530 CXX test/cpp_headers/nvmf_fc_spec.o 00:03:50.530 CXX test/cpp_headers/nvmf.o 00:03:50.530 LINK nvme_compliance 00:03:50.530 CXX test/cpp_headers/nvmf_spec.o 00:03:50.530 CXX test/cpp_headers/nvmf_transport.o 00:03:50.530 CXX test/cpp_headers/opal.o 00:03:50.530 CXX test/cpp_headers/opal_spec.o 00:03:50.530 CXX test/cpp_headers/pci_ids.o 00:03:50.530 CXX test/cpp_headers/pipe.o 00:03:50.530 CXX test/cpp_headers/queue.o 00:03:50.530 CXX test/cpp_headers/reduce.o 00:03:50.530 CXX test/cpp_headers/rpc.o 00:03:50.530 CXX test/cpp_headers/scheduler.o 00:03:50.530 CXX test/cpp_headers/scsi.o 00:03:50.530 CXX test/cpp_headers/scsi_spec.o 00:03:50.530 CXX test/cpp_headers/sock.o 00:03:50.530 CXX test/cpp_headers/stdinc.o 00:03:50.530 CXX test/cpp_headers/string.o 00:03:50.530 CXX test/cpp_headers/thread.o 00:03:50.530 CXX test/cpp_headers/trace.o 00:03:50.530 CXX test/cpp_headers/trace_parser.o 00:03:50.530 CXX test/cpp_headers/tree.o 00:03:50.530 CXX test/cpp_headers/ublk.o 00:03:50.530 CXX test/cpp_headers/util.o 00:03:50.788 LINK fdp 00:03:50.788 CXX test/cpp_headers/uuid.o 00:03:50.788 CXX test/cpp_headers/version.o 00:03:50.788 CXX test/cpp_headers/vfio_user_pci.o 00:03:50.788 CXX test/cpp_headers/vfio_user_spec.o 00:03:50.788 CXX test/cpp_headers/vhost.o 00:03:50.788 CXX test/cpp_headers/vmd.o 00:03:50.788 CXX test/cpp_headers/xor.o 00:03:50.788 CXX test/cpp_headers/zipf.o 00:03:51.722 LINK cuse 00:03:51.722 LINK iscsi_fuzz 00:03:54.253 LINK esnap 00:03:54.512 00:03:54.512 real 0m38.009s 00:03:54.512 user 7m14.687s 00:03:54.512 sys 1m37.846s 00:03:54.512 09:50:00 -- common/autotest_common.sh@1105 -- $ xtrace_disable 00:03:54.512 09:50:00 -- common/autotest_common.sh@10 -- $ set +x 00:03:54.512 ************************************ 00:03:54.512 END TEST make 00:03:54.512 ************************************ 00:03:54.512 09:50:00 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:03:54.512 09:50:00 -- nvmf/common.sh@7 -- # uname -s 00:03:54.512 09:50:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:03:54.512 09:50:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:03:54.512 09:50:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:03:54.512 09:50:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:03:54.512 09:50:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:03:54.512 09:50:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:03:54.512 09:50:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:03:54.512 09:50:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:03:54.512 09:50:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:03:54.512 09:50:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:03:54.512 09:50:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:03:54.512 09:50:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:03:54.512 09:50:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:03:54.512 09:50:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:03:54.512 09:50:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:03:54.512 09:50:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:03:54.512 09:50:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:03:54.512 09:50:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:03:54.512 09:50:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:03:54.513 09:50:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:54.513 09:50:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:54.513 09:50:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:54.513 09:50:00 -- paths/export.sh@5 -- # export PATH 00:03:54.513 09:50:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:54.513 09:50:00 -- nvmf/common.sh@46 -- # : 0 00:03:54.513 09:50:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:03:54.513 09:50:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:03:54.513 09:50:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:03:54.513 09:50:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:03:54.513 09:50:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:03:54.513 09:50:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:03:54.513 09:50:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:03:54.513 09:50:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:03:54.513 09:50:00 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:03:54.513 09:50:00 -- spdk/autotest.sh@32 -- # uname -s 00:03:54.513 09:50:00 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:03:54.513 09:50:00 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:03:54.513 09:50:00 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:03:54.513 09:50:00 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:03:54.513 09:50:00 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:03:54.513 09:50:00 -- spdk/autotest.sh@44 -- # modprobe nbd 00:03:54.513 09:50:00 -- spdk/autotest.sh@46 -- # type -P udevadm 00:03:54.513 09:50:00 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:03:54.513 09:50:00 -- spdk/autotest.sh@48 -- # udevadm_pid=2658216 00:03:54.513 09:50:00 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:03:54.513 09:50:00 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:54.513 09:50:00 -- spdk/autotest.sh@54 -- # echo 2658218 00:03:54.513 09:50:00 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:54.513 09:50:00 -- spdk/autotest.sh@56 -- # echo 2658219 00:03:54.513 09:50:00 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:54.513 09:50:00 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:03:54.513 09:50:00 -- spdk/autotest.sh@60 -- # echo 2658220 00:03:54.513 09:50:00 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:03:54.513 09:50:00 -- spdk/autotest.sh@62 -- # echo 2658221 00:03:54.513 09:50:00 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:03:54.513 09:50:00 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:03:54.513 09:50:00 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:03:54.513 09:50:00 -- common/autotest_common.sh@712 -- # xtrace_disable 00:03:54.513 09:50:00 -- common/autotest_common.sh@10 -- # set +x 00:03:54.513 09:50:00 -- spdk/autotest.sh@70 -- # create_test_list 00:03:54.513 09:50:00 -- common/autotest_common.sh@736 -- # xtrace_disable 00:03:54.513 09:50:00 -- common/autotest_common.sh@10 -- # set +x 00:03:54.513 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:03:54.773 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:03:54.773 09:50:00 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:03:54.773 09:50:00 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:54.773 09:50:00 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:54.773 09:50:00 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:03:54.773 09:50:00 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:54.773 09:50:00 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:03:54.773 09:50:00 -- common/autotest_common.sh@1440 -- # uname 00:03:54.773 09:50:00 -- common/autotest_common.sh@1440 -- # '[' Linux = FreeBSD ']' 00:03:54.773 09:50:00 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:03:54.773 09:50:00 -- common/autotest_common.sh@1460 -- # uname 00:03:54.773 09:50:00 -- common/autotest_common.sh@1460 -- # [[ Linux = FreeBSD ]] 00:03:54.773 09:50:00 -- spdk/autotest.sh@82 -- # grep CC_TYPE mk/cc.mk 00:03:54.773 09:50:00 -- spdk/autotest.sh@82 -- # CC_TYPE=CC_TYPE=gcc 00:03:54.773 09:50:00 -- spdk/autotest.sh@83 -- # hash lcov 00:03:54.773 09:50:00 -- spdk/autotest.sh@83 -- # [[ CC_TYPE=gcc == *\c\l\a\n\g* ]] 00:03:54.773 09:50:00 -- spdk/autotest.sh@91 -- # export 'LCOV_OPTS= 00:03:54.773 --rc lcov_branch_coverage=1 00:03:54.773 --rc lcov_function_coverage=1 00:03:54.773 --rc genhtml_branch_coverage=1 00:03:54.773 --rc genhtml_function_coverage=1 00:03:54.773 --rc genhtml_legend=1 00:03:54.773 --rc geninfo_all_blocks=1 00:03:54.773 ' 00:03:54.773 09:50:00 -- spdk/autotest.sh@91 -- # LCOV_OPTS=' 00:03:54.773 --rc lcov_branch_coverage=1 00:03:54.773 --rc lcov_function_coverage=1 00:03:54.773 --rc genhtml_branch_coverage=1 00:03:54.773 --rc genhtml_function_coverage=1 00:03:54.773 --rc genhtml_legend=1 00:03:54.773 --rc geninfo_all_blocks=1 00:03:54.773 ' 00:03:54.773 09:50:00 -- spdk/autotest.sh@92 -- # export 'LCOV=lcov 00:03:54.773 --rc lcov_branch_coverage=1 00:03:54.773 --rc lcov_function_coverage=1 00:03:54.773 --rc genhtml_branch_coverage=1 00:03:54.773 --rc genhtml_function_coverage=1 00:03:54.773 --rc genhtml_legend=1 00:03:54.773 --rc geninfo_all_blocks=1 00:03:54.773 --no-external' 00:03:54.773 09:50:00 -- spdk/autotest.sh@92 -- # LCOV='lcov 00:03:54.773 --rc lcov_branch_coverage=1 00:03:54.773 --rc lcov_function_coverage=1 00:03:54.773 --rc genhtml_branch_coverage=1 00:03:54.773 --rc genhtml_function_coverage=1 00:03:54.773 --rc genhtml_legend=1 00:03:54.773 --rc geninfo_all_blocks=1 00:03:54.773 --no-external' 00:03:54.773 09:50:00 -- spdk/autotest.sh@94 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -v 00:03:54.773 lcov: LCOV version 1.14 00:03:54.773 09:50:00 -- spdk/autotest.sh@96 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -c -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel.gcno:no functions found 00:03:56.675 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel.gcno 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel_module.gcno:no functions found 00:03:56.675 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel_module.gcno 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/assert.gcno:no functions found 00:03:56.675 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/assert.gcno 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/barrier.gcno:no functions found 00:03:56.675 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/barrier.gcno 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/base64.gcno:no functions found 00:03:56.675 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/base64.gcno 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev.gcno:no functions found 00:03:56.675 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev.gcno 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_module.gcno:no functions found 00:03:56.675 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_module.gcno 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_zone.gcno:no functions found 00:03:56.675 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_zone.gcno 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_array.gcno:no functions found 00:03:56.675 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_array.gcno 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_pool.gcno:no functions found 00:03:56.675 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_pool.gcno 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob_bdev.gcno:no functions found 00:03:56.675 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob_bdev.gcno 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs_bdev.gcno:no functions found 00:03:56.675 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs_bdev.gcno 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs.gcno:no functions found 00:03:56.675 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs.gcno 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob.gcno:no functions found 00:03:56.675 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob.gcno 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/conf.gcno:no functions found 00:03:56.675 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/conf.gcno 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/config.gcno:no functions found 00:03:56.675 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/config.gcno 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/cpuset.gcno:no functions found 00:03:56.675 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/cpuset.gcno 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc32.gcno:no functions found 00:03:56.675 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc32.gcno 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc16.gcno:no functions found 00:03:56.675 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc16.gcno 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc64.gcno:no functions found 00:03:56.675 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc64.gcno 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dif.gcno:no functions found 00:03:56.675 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dif.gcno 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dma.gcno:no functions found 00:03:56.675 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dma.gcno 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/endian.gcno:no functions found 00:03:56.675 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/endian.gcno 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env_dpdk.gcno:no functions found 00:03:56.675 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env_dpdk.gcno 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env.gcno:no functions found 00:03:56.675 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env.gcno 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/event.gcno:no functions found 00:03:56.675 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/event.gcno 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd_group.gcno:no functions found 00:03:56.675 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd_group.gcno 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd.gcno:no functions found 00:03:56.675 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd.gcno 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ftl.gcno:no functions found 00:03:56.675 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ftl.gcno 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/file.gcno:no functions found 00:03:56.675 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/file.gcno 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/gpt_spec.gcno:no functions found 00:03:56.675 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/gpt_spec.gcno 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/hexlify.gcno:no functions found 00:03:56.675 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/hexlify.gcno 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/histogram_data.gcno:no functions found 00:03:56.675 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/histogram_data.gcno 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd.gcno:no functions found 00:03:56.675 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd.gcno 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd_spec.gcno:no functions found 00:03:56.675 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd_spec.gcno 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/init.gcno:no functions found 00:03:56.675 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/init.gcno 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat_spec.gcno:no functions found 00:03:56.675 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat_spec.gcno 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat.gcno:no functions found 00:03:56.675 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat.gcno 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/iscsi_spec.gcno:no functions found 00:03:56.675 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/iscsi_spec.gcno 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/json.gcno:no functions found 00:03:56.675 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/json.gcno 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/jsonrpc.gcno:no functions found 00:03:56.675 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/jsonrpc.gcno 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/likely.gcno:no functions found 00:03:56.675 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/likely.gcno 00:03:56.675 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/log.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/log.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/lvol.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/lvol.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/memory.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/memory.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/mmio.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/mmio.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nbd.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nbd.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/notify.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/notify.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_intel.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_intel.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd_spec.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd_spec.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_spec.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_spec.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_zns.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_zns.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_cmd.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_cmd.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_fc_spec.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_fc_spec.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_spec.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_spec.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_transport.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_transport.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pci_ids.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pci_ids.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal_spec.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal_spec.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pipe.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pipe.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/queue.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/queue.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/reduce.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/reduce.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scheduler.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scheduler.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/rpc.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/rpc.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi_spec.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi_spec.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/sock.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/sock.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/stdinc.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/stdinc.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/string.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/string.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/thread.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/thread.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace_parser.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace_parser.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/tree.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/tree.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ublk.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ublk.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/util.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/util.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/uuid.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/uuid.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/version.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/version.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_pci.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_pci.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_spec.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_spec.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vhost.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vhost.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vmd.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vmd.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/xor.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/xor.gcno 00:03:56.676 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/zipf.gcno:no functions found 00:03:56.676 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/zipf.gcno 00:04:11.544 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:04:11.544 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:04:11.544 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:04:11.544 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:04:11.544 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:04:11.544 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:04:26.415 09:50:31 -- spdk/autotest.sh@100 -- # timing_enter pre_cleanup 00:04:26.415 09:50:31 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:26.415 09:50:31 -- common/autotest_common.sh@10 -- # set +x 00:04:26.415 09:50:31 -- spdk/autotest.sh@102 -- # rm -f 00:04:26.415 09:50:31 -- spdk/autotest.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:27.347 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:04:27.347 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:04:27.347 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:04:27.347 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:04:27.347 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:04:27.347 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:04:27.347 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:04:27.347 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:04:27.347 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:04:27.347 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:04:27.605 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:04:27.605 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:04:27.605 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:04:27.605 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:04:27.605 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:04:27.605 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:04:27.605 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:04:27.605 09:50:33 -- spdk/autotest.sh@107 -- # get_zoned_devs 00:04:27.605 09:50:33 -- common/autotest_common.sh@1654 -- # zoned_devs=() 00:04:27.605 09:50:33 -- common/autotest_common.sh@1654 -- # local -gA zoned_devs 00:04:27.605 09:50:33 -- common/autotest_common.sh@1655 -- # local nvme bdf 00:04:27.605 09:50:33 -- common/autotest_common.sh@1657 -- # for nvme in /sys/block/nvme* 00:04:27.605 09:50:33 -- common/autotest_common.sh@1658 -- # is_block_zoned nvme0n1 00:04:27.605 09:50:33 -- common/autotest_common.sh@1647 -- # local device=nvme0n1 00:04:27.605 09:50:33 -- common/autotest_common.sh@1649 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:27.605 09:50:33 -- common/autotest_common.sh@1650 -- # [[ none != none ]] 00:04:27.605 09:50:33 -- spdk/autotest.sh@109 -- # (( 0 > 0 )) 00:04:27.605 09:50:33 -- spdk/autotest.sh@121 -- # ls /dev/nvme0n1 00:04:27.605 09:50:33 -- spdk/autotest.sh@121 -- # grep -v p 00:04:27.605 09:50:33 -- spdk/autotest.sh@121 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:04:27.605 09:50:33 -- spdk/autotest.sh@123 -- # [[ -z '' ]] 00:04:27.605 09:50:33 -- spdk/autotest.sh@124 -- # block_in_use /dev/nvme0n1 00:04:27.605 09:50:33 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:04:27.605 09:50:33 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:04:27.605 No valid GPT data, bailing 00:04:27.605 09:50:33 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:04:27.605 09:50:33 -- scripts/common.sh@393 -- # pt= 00:04:27.605 09:50:33 -- scripts/common.sh@394 -- # return 1 00:04:27.605 09:50:33 -- spdk/autotest.sh@125 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:04:27.605 1+0 records in 00:04:27.605 1+0 records out 00:04:27.605 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00234499 s, 447 MB/s 00:04:27.605 09:50:33 -- spdk/autotest.sh@129 -- # sync 00:04:27.862 09:50:33 -- spdk/autotest.sh@131 -- # xtrace_disable_per_cmd reap_spdk_processes 00:04:27.862 09:50:33 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:04:27.862 09:50:33 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:04:29.760 09:50:35 -- spdk/autotest.sh@135 -- # uname -s 00:04:29.760 09:50:35 -- spdk/autotest.sh@135 -- # '[' Linux = Linux ']' 00:04:29.760 09:50:35 -- spdk/autotest.sh@136 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:04:29.760 09:50:35 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:29.760 09:50:35 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:29.760 09:50:35 -- common/autotest_common.sh@10 -- # set +x 00:04:29.760 ************************************ 00:04:29.760 START TEST setup.sh 00:04:29.760 ************************************ 00:04:29.760 09:50:35 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:04:29.760 * Looking for test storage... 00:04:29.760 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:29.760 09:50:35 -- setup/test-setup.sh@10 -- # uname -s 00:04:29.760 09:50:35 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:04:29.760 09:50:35 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:04:29.760 09:50:35 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:29.760 09:50:35 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:29.760 09:50:35 -- common/autotest_common.sh@10 -- # set +x 00:04:29.760 ************************************ 00:04:29.760 START TEST acl 00:04:29.760 ************************************ 00:04:29.760 09:50:35 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:04:29.760 * Looking for test storage... 00:04:29.760 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:29.760 09:50:35 -- setup/acl.sh@10 -- # get_zoned_devs 00:04:29.760 09:50:35 -- common/autotest_common.sh@1654 -- # zoned_devs=() 00:04:29.760 09:50:35 -- common/autotest_common.sh@1654 -- # local -gA zoned_devs 00:04:29.760 09:50:35 -- common/autotest_common.sh@1655 -- # local nvme bdf 00:04:29.760 09:50:35 -- common/autotest_common.sh@1657 -- # for nvme in /sys/block/nvme* 00:04:29.760 09:50:35 -- common/autotest_common.sh@1658 -- # is_block_zoned nvme0n1 00:04:29.760 09:50:35 -- common/autotest_common.sh@1647 -- # local device=nvme0n1 00:04:29.760 09:50:35 -- common/autotest_common.sh@1649 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:29.760 09:50:35 -- common/autotest_common.sh@1650 -- # [[ none != none ]] 00:04:29.760 09:50:35 -- setup/acl.sh@12 -- # devs=() 00:04:29.760 09:50:35 -- setup/acl.sh@12 -- # declare -a devs 00:04:29.760 09:50:35 -- setup/acl.sh@13 -- # drivers=() 00:04:29.760 09:50:35 -- setup/acl.sh@13 -- # declare -A drivers 00:04:29.760 09:50:35 -- setup/acl.sh@51 -- # setup reset 00:04:29.760 09:50:35 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:29.760 09:50:35 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:31.166 09:50:36 -- setup/acl.sh@52 -- # collect_setup_devs 00:04:31.166 09:50:36 -- setup/acl.sh@16 -- # local dev driver 00:04:31.166 09:50:36 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:31.166 09:50:36 -- setup/acl.sh@15 -- # setup output status 00:04:31.166 09:50:36 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:31.166 09:50:36 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:04:32.542 Hugepages 00:04:32.542 node hugesize free / total 00:04:32.542 09:50:38 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:04:32.542 09:50:38 -- setup/acl.sh@19 -- # continue 00:04:32.542 09:50:38 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:32.542 09:50:38 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:04:32.542 09:50:38 -- setup/acl.sh@19 -- # continue 00:04:32.542 09:50:38 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:32.542 09:50:38 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:04:32.542 09:50:38 -- setup/acl.sh@19 -- # continue 00:04:32.542 09:50:38 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:32.542 00:04:32.542 Type BDF Vendor Device NUMA Driver Device Block devices 00:04:32.542 09:50:38 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:04:32.542 09:50:38 -- setup/acl.sh@19 -- # continue 00:04:32.542 09:50:38 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:32.542 09:50:38 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:04:32.542 09:50:38 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:32.542 09:50:38 -- setup/acl.sh@20 -- # continue 00:04:32.542 09:50:38 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:32.542 09:50:38 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:04:32.542 09:50:38 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:32.542 09:50:38 -- setup/acl.sh@20 -- # continue 00:04:32.542 09:50:38 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:32.542 09:50:38 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:04:32.542 09:50:38 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:32.542 09:50:38 -- setup/acl.sh@20 -- # continue 00:04:32.542 09:50:38 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:32.542 09:50:38 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:04:32.542 09:50:38 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:32.542 09:50:38 -- setup/acl.sh@20 -- # continue 00:04:32.542 09:50:38 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:32.542 09:50:38 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:04:32.542 09:50:38 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:32.542 09:50:38 -- setup/acl.sh@20 -- # continue 00:04:32.542 09:50:38 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:32.542 09:50:38 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:04:32.542 09:50:38 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:32.542 09:50:38 -- setup/acl.sh@20 -- # continue 00:04:32.542 09:50:38 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:32.542 09:50:38 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:04:32.542 09:50:38 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:32.542 09:50:38 -- setup/acl.sh@20 -- # continue 00:04:32.542 09:50:38 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:32.542 09:50:38 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:04:32.542 09:50:38 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:32.542 09:50:38 -- setup/acl.sh@20 -- # continue 00:04:32.542 09:50:38 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:32.542 09:50:38 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:04:32.542 09:50:38 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:32.542 09:50:38 -- setup/acl.sh@20 -- # continue 00:04:32.542 09:50:38 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:32.542 09:50:38 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:04:32.542 09:50:38 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:32.542 09:50:38 -- setup/acl.sh@20 -- # continue 00:04:32.542 09:50:38 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:32.542 09:50:38 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:04:32.542 09:50:38 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:32.542 09:50:38 -- setup/acl.sh@20 -- # continue 00:04:32.542 09:50:38 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:32.542 09:50:38 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:04:32.542 09:50:38 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:32.542 09:50:38 -- setup/acl.sh@20 -- # continue 00:04:32.542 09:50:38 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:32.542 09:50:38 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:04:32.542 09:50:38 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:32.542 09:50:38 -- setup/acl.sh@20 -- # continue 00:04:32.542 09:50:38 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:32.542 09:50:38 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:04:32.542 09:50:38 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:32.542 09:50:38 -- setup/acl.sh@20 -- # continue 00:04:32.542 09:50:38 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:32.542 09:50:38 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:04:32.542 09:50:38 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:32.542 09:50:38 -- setup/acl.sh@20 -- # continue 00:04:32.542 09:50:38 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:32.542 09:50:38 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:04:32.542 09:50:38 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:32.542 09:50:38 -- setup/acl.sh@20 -- # continue 00:04:32.542 09:50:38 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:32.542 09:50:38 -- setup/acl.sh@19 -- # [[ 0000:88:00.0 == *:*:*.* ]] 00:04:32.542 09:50:38 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:04:32.542 09:50:38 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:04:32.542 09:50:38 -- setup/acl.sh@22 -- # devs+=("$dev") 00:04:32.542 09:50:38 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:04:32.542 09:50:38 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:32.542 09:50:38 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:04:32.542 09:50:38 -- setup/acl.sh@54 -- # run_test denied denied 00:04:32.542 09:50:38 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:32.542 09:50:38 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:32.542 09:50:38 -- common/autotest_common.sh@10 -- # set +x 00:04:32.542 ************************************ 00:04:32.542 START TEST denied 00:04:32.542 ************************************ 00:04:32.542 09:50:38 -- common/autotest_common.sh@1104 -- # denied 00:04:32.542 09:50:38 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:88:00.0' 00:04:32.542 09:50:38 -- setup/acl.sh@38 -- # setup output config 00:04:32.542 09:50:38 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:88:00.0' 00:04:32.542 09:50:38 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:32.543 09:50:38 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:33.917 0000:88:00.0 (8086 0a54): Skipping denied controller at 0000:88:00.0 00:04:33.917 09:50:39 -- setup/acl.sh@40 -- # verify 0000:88:00.0 00:04:33.917 09:50:39 -- setup/acl.sh@28 -- # local dev driver 00:04:33.917 09:50:39 -- setup/acl.sh@30 -- # for dev in "$@" 00:04:33.917 09:50:39 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:88:00.0 ]] 00:04:33.917 09:50:39 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:88:00.0/driver 00:04:33.917 09:50:39 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:04:33.917 09:50:39 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:04:33.917 09:50:39 -- setup/acl.sh@41 -- # setup reset 00:04:33.917 09:50:39 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:33.917 09:50:39 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:36.449 00:04:36.449 real 0m3.870s 00:04:36.449 user 0m1.132s 00:04:36.449 sys 0m1.826s 00:04:36.449 09:50:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:36.449 09:50:42 -- common/autotest_common.sh@10 -- # set +x 00:04:36.449 ************************************ 00:04:36.449 END TEST denied 00:04:36.449 ************************************ 00:04:36.449 09:50:42 -- setup/acl.sh@55 -- # run_test allowed allowed 00:04:36.449 09:50:42 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:36.449 09:50:42 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:36.449 09:50:42 -- common/autotest_common.sh@10 -- # set +x 00:04:36.449 ************************************ 00:04:36.449 START TEST allowed 00:04:36.449 ************************************ 00:04:36.449 09:50:42 -- common/autotest_common.sh@1104 -- # allowed 00:04:36.449 09:50:42 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:88:00.0 00:04:36.449 09:50:42 -- setup/acl.sh@45 -- # setup output config 00:04:36.449 09:50:42 -- setup/acl.sh@46 -- # grep -E '0000:88:00.0 .*: nvme -> .*' 00:04:36.449 09:50:42 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:36.449 09:50:42 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:38.978 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:38.979 09:50:44 -- setup/acl.sh@47 -- # verify 00:04:38.979 09:50:44 -- setup/acl.sh@28 -- # local dev driver 00:04:38.979 09:50:44 -- setup/acl.sh@48 -- # setup reset 00:04:38.979 09:50:44 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:38.979 09:50:44 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:40.354 00:04:40.354 real 0m3.933s 00:04:40.354 user 0m1.041s 00:04:40.354 sys 0m1.707s 00:04:40.354 09:50:45 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:40.354 09:50:45 -- common/autotest_common.sh@10 -- # set +x 00:04:40.354 ************************************ 00:04:40.354 END TEST allowed 00:04:40.354 ************************************ 00:04:40.354 00:04:40.354 real 0m10.565s 00:04:40.354 user 0m3.274s 00:04:40.354 sys 0m5.287s 00:04:40.354 09:50:45 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:40.354 09:50:45 -- common/autotest_common.sh@10 -- # set +x 00:04:40.354 ************************************ 00:04:40.354 END TEST acl 00:04:40.354 ************************************ 00:04:40.354 09:50:46 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:04:40.354 09:50:46 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:40.354 09:50:46 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:40.354 09:50:46 -- common/autotest_common.sh@10 -- # set +x 00:04:40.354 ************************************ 00:04:40.354 START TEST hugepages 00:04:40.354 ************************************ 00:04:40.354 09:50:46 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:04:40.354 * Looking for test storage... 00:04:40.354 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:40.354 09:50:46 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:04:40.354 09:50:46 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:04:40.354 09:50:46 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:04:40.354 09:50:46 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:04:40.354 09:50:46 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:04:40.354 09:50:46 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:04:40.354 09:50:46 -- setup/common.sh@17 -- # local get=Hugepagesize 00:04:40.354 09:50:46 -- setup/common.sh@18 -- # local node= 00:04:40.354 09:50:46 -- setup/common.sh@19 -- # local var val 00:04:40.354 09:50:46 -- setup/common.sh@20 -- # local mem_f mem 00:04:40.354 09:50:46 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:40.354 09:50:46 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:40.354 09:50:46 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:40.354 09:50:46 -- setup/common.sh@28 -- # mapfile -t mem 00:04:40.354 09:50:46 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:40.354 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.354 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.355 09:50:46 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 41729616 kB' 'MemAvailable: 45237216 kB' 'Buffers: 2704 kB' 'Cached: 12242416 kB' 'SwapCached: 0 kB' 'Active: 9236224 kB' 'Inactive: 3506552 kB' 'Active(anon): 8841872 kB' 'Inactive(anon): 0 kB' 'Active(file): 394352 kB' 'Inactive(file): 3506552 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 500988 kB' 'Mapped: 181472 kB' 'Shmem: 8344216 kB' 'KReclaimable: 200636 kB' 'Slab: 573472 kB' 'SReclaimable: 200636 kB' 'SUnreclaim: 372836 kB' 'KernelStack: 12720 kB' 'PageTables: 8296 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36562304 kB' 'Committed_AS: 9963900 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195968 kB' 'VmallocChunk: 0 kB' 'Percpu: 35328 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 1838684 kB' 'DirectMap2M: 15906816 kB' 'DirectMap1G: 51380224 kB' 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.355 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.355 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.356 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.356 09:50:46 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.356 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.356 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.356 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.356 09:50:46 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.356 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.356 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.356 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.356 09:50:46 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.356 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.356 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.356 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.356 09:50:46 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.356 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.356 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.356 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.356 09:50:46 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.356 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.356 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.356 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.356 09:50:46 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.356 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.356 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.356 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.356 09:50:46 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.356 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.356 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.356 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.356 09:50:46 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.356 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.356 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.356 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.356 09:50:46 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.356 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.356 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.356 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.356 09:50:46 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.356 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.356 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.356 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.356 09:50:46 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.356 09:50:46 -- setup/common.sh@32 -- # continue 00:04:40.356 09:50:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.356 09:50:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.356 09:50:46 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:40.356 09:50:46 -- setup/common.sh@33 -- # echo 2048 00:04:40.356 09:50:46 -- setup/common.sh@33 -- # return 0 00:04:40.356 09:50:46 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:04:40.356 09:50:46 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:04:40.356 09:50:46 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:04:40.356 09:50:46 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:04:40.356 09:50:46 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:04:40.356 09:50:46 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:04:40.356 09:50:46 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:04:40.356 09:50:46 -- setup/hugepages.sh@207 -- # get_nodes 00:04:40.356 09:50:46 -- setup/hugepages.sh@27 -- # local node 00:04:40.356 09:50:46 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:40.356 09:50:46 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:04:40.356 09:50:46 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:40.356 09:50:46 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:40.356 09:50:46 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:40.356 09:50:46 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:40.356 09:50:46 -- setup/hugepages.sh@208 -- # clear_hp 00:04:40.356 09:50:46 -- setup/hugepages.sh@37 -- # local node hp 00:04:40.356 09:50:46 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:40.356 09:50:46 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:40.356 09:50:46 -- setup/hugepages.sh@41 -- # echo 0 00:04:40.356 09:50:46 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:40.356 09:50:46 -- setup/hugepages.sh@41 -- # echo 0 00:04:40.356 09:50:46 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:40.356 09:50:46 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:40.356 09:50:46 -- setup/hugepages.sh@41 -- # echo 0 00:04:40.356 09:50:46 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:40.356 09:50:46 -- setup/hugepages.sh@41 -- # echo 0 00:04:40.356 09:50:46 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:04:40.356 09:50:46 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:04:40.356 09:50:46 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:04:40.356 09:50:46 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:40.356 09:50:46 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:40.356 09:50:46 -- common/autotest_common.sh@10 -- # set +x 00:04:40.356 ************************************ 00:04:40.356 START TEST default_setup 00:04:40.356 ************************************ 00:04:40.356 09:50:46 -- common/autotest_common.sh@1104 -- # default_setup 00:04:40.356 09:50:46 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:04:40.356 09:50:46 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:40.356 09:50:46 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:04:40.356 09:50:46 -- setup/hugepages.sh@51 -- # shift 00:04:40.356 09:50:46 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:04:40.356 09:50:46 -- setup/hugepages.sh@52 -- # local node_ids 00:04:40.356 09:50:46 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:40.356 09:50:46 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:40.356 09:50:46 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:04:40.356 09:50:46 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:04:40.356 09:50:46 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:40.356 09:50:46 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:40.356 09:50:46 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:40.356 09:50:46 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:40.356 09:50:46 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:40.356 09:50:46 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:04:40.356 09:50:46 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:40.356 09:50:46 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:04:40.356 09:50:46 -- setup/hugepages.sh@73 -- # return 0 00:04:40.356 09:50:46 -- setup/hugepages.sh@137 -- # setup output 00:04:40.356 09:50:46 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:40.356 09:50:46 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:41.732 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:41.732 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:41.732 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:41.732 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:41.732 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:41.732 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:41.732 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:41.732 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:41.732 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:41.732 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:41.732 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:41.732 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:41.732 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:41.732 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:41.732 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:41.732 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:42.673 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:42.673 09:50:48 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:04:42.673 09:50:48 -- setup/hugepages.sh@89 -- # local node 00:04:42.673 09:50:48 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:42.673 09:50:48 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:42.673 09:50:48 -- setup/hugepages.sh@92 -- # local surp 00:04:42.673 09:50:48 -- setup/hugepages.sh@93 -- # local resv 00:04:42.673 09:50:48 -- setup/hugepages.sh@94 -- # local anon 00:04:42.673 09:50:48 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:42.673 09:50:48 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:42.673 09:50:48 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:42.673 09:50:48 -- setup/common.sh@18 -- # local node= 00:04:42.673 09:50:48 -- setup/common.sh@19 -- # local var val 00:04:42.673 09:50:48 -- setup/common.sh@20 -- # local mem_f mem 00:04:42.673 09:50:48 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:42.673 09:50:48 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:42.673 09:50:48 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:42.673 09:50:48 -- setup/common.sh@28 -- # mapfile -t mem 00:04:42.673 09:50:48 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:42.673 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.673 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.674 09:50:48 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 43815620 kB' 'MemAvailable: 47323228 kB' 'Buffers: 2704 kB' 'Cached: 12242512 kB' 'SwapCached: 0 kB' 'Active: 9254560 kB' 'Inactive: 3506552 kB' 'Active(anon): 8860208 kB' 'Inactive(anon): 0 kB' 'Active(file): 394352 kB' 'Inactive(file): 3506552 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 519192 kB' 'Mapped: 181576 kB' 'Shmem: 8344312 kB' 'KReclaimable: 200652 kB' 'Slab: 573028 kB' 'SReclaimable: 200652 kB' 'SUnreclaim: 372376 kB' 'KernelStack: 12688 kB' 'PageTables: 7948 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610880 kB' 'Committed_AS: 9984464 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195952 kB' 'VmallocChunk: 0 kB' 'Percpu: 35328 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1838684 kB' 'DirectMap2M: 15906816 kB' 'DirectMap1G: 51380224 kB' 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.674 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.674 09:50:48 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.675 09:50:48 -- setup/common.sh@33 -- # echo 0 00:04:42.675 09:50:48 -- setup/common.sh@33 -- # return 0 00:04:42.675 09:50:48 -- setup/hugepages.sh@97 -- # anon=0 00:04:42.675 09:50:48 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:42.675 09:50:48 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:42.675 09:50:48 -- setup/common.sh@18 -- # local node= 00:04:42.675 09:50:48 -- setup/common.sh@19 -- # local var val 00:04:42.675 09:50:48 -- setup/common.sh@20 -- # local mem_f mem 00:04:42.675 09:50:48 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:42.675 09:50:48 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:42.675 09:50:48 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:42.675 09:50:48 -- setup/common.sh@28 -- # mapfile -t mem 00:04:42.675 09:50:48 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.675 09:50:48 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 43817480 kB' 'MemAvailable: 47325088 kB' 'Buffers: 2704 kB' 'Cached: 12242512 kB' 'SwapCached: 0 kB' 'Active: 9255180 kB' 'Inactive: 3506552 kB' 'Active(anon): 8860828 kB' 'Inactive(anon): 0 kB' 'Active(file): 394352 kB' 'Inactive(file): 3506552 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 520268 kB' 'Mapped: 182012 kB' 'Shmem: 8344312 kB' 'KReclaimable: 200652 kB' 'Slab: 573184 kB' 'SReclaimable: 200652 kB' 'SUnreclaim: 372532 kB' 'KernelStack: 12720 kB' 'PageTables: 8096 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610880 kB' 'Committed_AS: 9986228 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195904 kB' 'VmallocChunk: 0 kB' 'Percpu: 35328 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1838684 kB' 'DirectMap2M: 15906816 kB' 'DirectMap1G: 51380224 kB' 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.675 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.675 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.676 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.676 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.677 09:50:48 -- setup/common.sh@33 -- # echo 0 00:04:42.677 09:50:48 -- setup/common.sh@33 -- # return 0 00:04:42.677 09:50:48 -- setup/hugepages.sh@99 -- # surp=0 00:04:42.677 09:50:48 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:42.677 09:50:48 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:42.677 09:50:48 -- setup/common.sh@18 -- # local node= 00:04:42.677 09:50:48 -- setup/common.sh@19 -- # local var val 00:04:42.677 09:50:48 -- setup/common.sh@20 -- # local mem_f mem 00:04:42.677 09:50:48 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:42.677 09:50:48 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:42.677 09:50:48 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:42.677 09:50:48 -- setup/common.sh@28 -- # mapfile -t mem 00:04:42.677 09:50:48 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.677 09:50:48 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 43809460 kB' 'MemAvailable: 47317068 kB' 'Buffers: 2704 kB' 'Cached: 12242524 kB' 'SwapCached: 0 kB' 'Active: 9258288 kB' 'Inactive: 3506552 kB' 'Active(anon): 8863936 kB' 'Inactive(anon): 0 kB' 'Active(file): 394352 kB' 'Inactive(file): 3506552 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 522924 kB' 'Mapped: 181896 kB' 'Shmem: 8344324 kB' 'KReclaimable: 200652 kB' 'Slab: 573176 kB' 'SReclaimable: 200652 kB' 'SUnreclaim: 372524 kB' 'KernelStack: 12720 kB' 'PageTables: 8036 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610880 kB' 'Committed_AS: 9994636 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195920 kB' 'VmallocChunk: 0 kB' 'Percpu: 35328 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1838684 kB' 'DirectMap2M: 15906816 kB' 'DirectMap1G: 51380224 kB' 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.677 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.677 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.678 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.678 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.679 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.679 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.679 09:50:48 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.679 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.679 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.679 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.679 09:50:48 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.679 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.679 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.679 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.679 09:50:48 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.679 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.679 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.679 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.679 09:50:48 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.679 09:50:48 -- setup/common.sh@33 -- # echo 0 00:04:42.679 09:50:48 -- setup/common.sh@33 -- # return 0 00:04:42.679 09:50:48 -- setup/hugepages.sh@100 -- # resv=0 00:04:42.679 09:50:48 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:42.679 nr_hugepages=1024 00:04:42.679 09:50:48 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:42.679 resv_hugepages=0 00:04:42.679 09:50:48 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:42.679 surplus_hugepages=0 00:04:42.679 09:50:48 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:42.679 anon_hugepages=0 00:04:42.679 09:50:48 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:42.679 09:50:48 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:42.679 09:50:48 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:42.679 09:50:48 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:42.679 09:50:48 -- setup/common.sh@18 -- # local node= 00:04:42.679 09:50:48 -- setup/common.sh@19 -- # local var val 00:04:42.679 09:50:48 -- setup/common.sh@20 -- # local mem_f mem 00:04:42.679 09:50:48 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:42.679 09:50:48 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:42.679 09:50:48 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:42.679 09:50:48 -- setup/common.sh@28 -- # mapfile -t mem 00:04:42.679 09:50:48 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:42.679 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.679 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.679 09:50:48 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 43809912 kB' 'MemAvailable: 47317520 kB' 'Buffers: 2704 kB' 'Cached: 12242540 kB' 'SwapCached: 0 kB' 'Active: 9259044 kB' 'Inactive: 3506552 kB' 'Active(anon): 8864692 kB' 'Inactive(anon): 0 kB' 'Active(file): 394352 kB' 'Inactive(file): 3506552 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 523668 kB' 'Mapped: 182304 kB' 'Shmem: 8344340 kB' 'KReclaimable: 200652 kB' 'Slab: 573168 kB' 'SReclaimable: 200652 kB' 'SUnreclaim: 372516 kB' 'KernelStack: 12688 kB' 'PageTables: 7940 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610880 kB' 'Committed_AS: 9990256 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195892 kB' 'VmallocChunk: 0 kB' 'Percpu: 35328 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1838684 kB' 'DirectMap2M: 15906816 kB' 'DirectMap1G: 51380224 kB' 00:04:42.679 09:50:48 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.679 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.679 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.679 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.679 09:50:48 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.679 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.679 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.679 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.679 09:50:48 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.679 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.679 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.679 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.679 09:50:48 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.679 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.679 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.679 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.679 09:50:48 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.679 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.679 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.679 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.679 09:50:48 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.679 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.679 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.938 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.939 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.939 09:50:48 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.940 09:50:48 -- setup/common.sh@33 -- # echo 1024 00:04:42.940 09:50:48 -- setup/common.sh@33 -- # return 0 00:04:42.940 09:50:48 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:42.940 09:50:48 -- setup/hugepages.sh@112 -- # get_nodes 00:04:42.940 09:50:48 -- setup/hugepages.sh@27 -- # local node 00:04:42.940 09:50:48 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:42.940 09:50:48 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:42.940 09:50:48 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:42.940 09:50:48 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:42.940 09:50:48 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:42.940 09:50:48 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:42.940 09:50:48 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:42.940 09:50:48 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:42.940 09:50:48 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:42.940 09:50:48 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:42.940 09:50:48 -- setup/common.sh@18 -- # local node=0 00:04:42.940 09:50:48 -- setup/common.sh@19 -- # local var val 00:04:42.940 09:50:48 -- setup/common.sh@20 -- # local mem_f mem 00:04:42.940 09:50:48 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:42.940 09:50:48 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:42.940 09:50:48 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:42.940 09:50:48 -- setup/common.sh@28 -- # mapfile -t mem 00:04:42.940 09:50:48 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.940 09:50:48 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32829884 kB' 'MemFree: 25725344 kB' 'MemUsed: 7104540 kB' 'SwapCached: 0 kB' 'Active: 3904044 kB' 'Inactive: 110044 kB' 'Active(anon): 3793156 kB' 'Inactive(anon): 0 kB' 'Active(file): 110888 kB' 'Inactive(file): 110044 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3756200 kB' 'Mapped: 38268 kB' 'AnonPages: 261124 kB' 'Shmem: 3535268 kB' 'KernelStack: 6840 kB' 'PageTables: 4256 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 101728 kB' 'Slab: 321088 kB' 'SReclaimable: 101728 kB' 'SUnreclaim: 219360 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.940 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.940 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.941 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.941 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.941 09:50:48 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.941 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.941 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.941 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.941 09:50:48 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.941 09:50:48 -- setup/common.sh@32 -- # continue 00:04:42.941 09:50:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.941 09:50:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.941 09:50:48 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.941 09:50:48 -- setup/common.sh@33 -- # echo 0 00:04:42.941 09:50:48 -- setup/common.sh@33 -- # return 0 00:04:42.941 09:50:48 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:42.941 09:50:48 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:42.941 09:50:48 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:42.941 09:50:48 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:42.941 09:50:48 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:42.941 node0=1024 expecting 1024 00:04:42.941 09:50:48 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:42.941 00:04:42.941 real 0m2.421s 00:04:42.941 user 0m0.632s 00:04:42.941 sys 0m0.860s 00:04:42.941 09:50:48 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:42.941 09:50:48 -- common/autotest_common.sh@10 -- # set +x 00:04:42.941 ************************************ 00:04:42.941 END TEST default_setup 00:04:42.941 ************************************ 00:04:42.941 09:50:48 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:04:42.941 09:50:48 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:42.941 09:50:48 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:42.941 09:50:48 -- common/autotest_common.sh@10 -- # set +x 00:04:42.941 ************************************ 00:04:42.941 START TEST per_node_1G_alloc 00:04:42.941 ************************************ 00:04:42.941 09:50:48 -- common/autotest_common.sh@1104 -- # per_node_1G_alloc 00:04:42.941 09:50:48 -- setup/hugepages.sh@143 -- # local IFS=, 00:04:42.941 09:50:48 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:04:42.941 09:50:48 -- setup/hugepages.sh@49 -- # local size=1048576 00:04:42.941 09:50:48 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:04:42.941 09:50:48 -- setup/hugepages.sh@51 -- # shift 00:04:42.941 09:50:48 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:04:42.941 09:50:48 -- setup/hugepages.sh@52 -- # local node_ids 00:04:42.941 09:50:48 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:42.941 09:50:48 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:04:42.941 09:50:48 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:04:42.941 09:50:48 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:04:42.941 09:50:48 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:42.941 09:50:48 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:04:42.941 09:50:48 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:42.941 09:50:48 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:42.941 09:50:48 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:42.941 09:50:48 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:04:42.941 09:50:48 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:42.941 09:50:48 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:04:42.941 09:50:48 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:42.941 09:50:48 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:04:42.941 09:50:48 -- setup/hugepages.sh@73 -- # return 0 00:04:42.941 09:50:48 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:04:42.941 09:50:48 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:04:42.941 09:50:48 -- setup/hugepages.sh@146 -- # setup output 00:04:42.941 09:50:48 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:42.941 09:50:48 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:43.876 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:43.876 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:43.876 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:43.876 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:43.876 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:43.876 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:43.876 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:43.876 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:43.876 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:43.876 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:43.876 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:43.876 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:43.876 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:43.876 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:43.876 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:43.876 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:43.876 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:44.138 09:50:49 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:04:44.139 09:50:49 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:04:44.139 09:50:49 -- setup/hugepages.sh@89 -- # local node 00:04:44.139 09:50:49 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:44.139 09:50:49 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:44.139 09:50:49 -- setup/hugepages.sh@92 -- # local surp 00:04:44.139 09:50:49 -- setup/hugepages.sh@93 -- # local resv 00:04:44.139 09:50:49 -- setup/hugepages.sh@94 -- # local anon 00:04:44.139 09:50:49 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:44.139 09:50:49 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:44.139 09:50:49 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:44.139 09:50:49 -- setup/common.sh@18 -- # local node= 00:04:44.139 09:50:49 -- setup/common.sh@19 -- # local var val 00:04:44.139 09:50:49 -- setup/common.sh@20 -- # local mem_f mem 00:04:44.139 09:50:49 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:44.139 09:50:49 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:44.139 09:50:49 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:44.139 09:50:49 -- setup/common.sh@28 -- # mapfile -t mem 00:04:44.139 09:50:49 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.139 09:50:49 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 43810152 kB' 'MemAvailable: 47317760 kB' 'Buffers: 2704 kB' 'Cached: 12242592 kB' 'SwapCached: 0 kB' 'Active: 9254880 kB' 'Inactive: 3506552 kB' 'Active(anon): 8860528 kB' 'Inactive(anon): 0 kB' 'Active(file): 394352 kB' 'Inactive(file): 3506552 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 518952 kB' 'Mapped: 181508 kB' 'Shmem: 8344392 kB' 'KReclaimable: 200652 kB' 'Slab: 572884 kB' 'SReclaimable: 200652 kB' 'SUnreclaim: 372232 kB' 'KernelStack: 12704 kB' 'PageTables: 7928 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610880 kB' 'Committed_AS: 9984680 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196048 kB' 'VmallocChunk: 0 kB' 'Percpu: 35328 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1838684 kB' 'DirectMap2M: 15906816 kB' 'DirectMap1G: 51380224 kB' 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.139 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.139 09:50:49 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.140 09:50:49 -- setup/common.sh@33 -- # echo 0 00:04:44.140 09:50:49 -- setup/common.sh@33 -- # return 0 00:04:44.140 09:50:49 -- setup/hugepages.sh@97 -- # anon=0 00:04:44.140 09:50:49 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:44.140 09:50:49 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:44.140 09:50:49 -- setup/common.sh@18 -- # local node= 00:04:44.140 09:50:49 -- setup/common.sh@19 -- # local var val 00:04:44.140 09:50:49 -- setup/common.sh@20 -- # local mem_f mem 00:04:44.140 09:50:49 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:44.140 09:50:49 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:44.140 09:50:49 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:44.140 09:50:49 -- setup/common.sh@28 -- # mapfile -t mem 00:04:44.140 09:50:49 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.140 09:50:49 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 43810220 kB' 'MemAvailable: 47317828 kB' 'Buffers: 2704 kB' 'Cached: 12242596 kB' 'SwapCached: 0 kB' 'Active: 9255212 kB' 'Inactive: 3506552 kB' 'Active(anon): 8860860 kB' 'Inactive(anon): 0 kB' 'Active(file): 394352 kB' 'Inactive(file): 3506552 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 519332 kB' 'Mapped: 181508 kB' 'Shmem: 8344396 kB' 'KReclaimable: 200652 kB' 'Slab: 572884 kB' 'SReclaimable: 200652 kB' 'SUnreclaim: 372232 kB' 'KernelStack: 12720 kB' 'PageTables: 7976 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610880 kB' 'Committed_AS: 9984692 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196016 kB' 'VmallocChunk: 0 kB' 'Percpu: 35328 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1838684 kB' 'DirectMap2M: 15906816 kB' 'DirectMap1G: 51380224 kB' 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.140 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.140 09:50:49 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.141 09:50:49 -- setup/common.sh@33 -- # echo 0 00:04:44.141 09:50:49 -- setup/common.sh@33 -- # return 0 00:04:44.141 09:50:49 -- setup/hugepages.sh@99 -- # surp=0 00:04:44.141 09:50:49 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:44.141 09:50:49 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:44.141 09:50:49 -- setup/common.sh@18 -- # local node= 00:04:44.141 09:50:49 -- setup/common.sh@19 -- # local var val 00:04:44.141 09:50:49 -- setup/common.sh@20 -- # local mem_f mem 00:04:44.141 09:50:49 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:44.141 09:50:49 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:44.141 09:50:49 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:44.141 09:50:49 -- setup/common.sh@28 -- # mapfile -t mem 00:04:44.141 09:50:49 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.141 09:50:49 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 43812600 kB' 'MemAvailable: 47320208 kB' 'Buffers: 2704 kB' 'Cached: 12242608 kB' 'SwapCached: 0 kB' 'Active: 9254020 kB' 'Inactive: 3506552 kB' 'Active(anon): 8859668 kB' 'Inactive(anon): 0 kB' 'Active(file): 394352 kB' 'Inactive(file): 3506552 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 518532 kB' 'Mapped: 181468 kB' 'Shmem: 8344408 kB' 'KReclaimable: 200652 kB' 'Slab: 572940 kB' 'SReclaimable: 200652 kB' 'SUnreclaim: 372288 kB' 'KernelStack: 12768 kB' 'PageTables: 8084 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610880 kB' 'Committed_AS: 9984704 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196032 kB' 'VmallocChunk: 0 kB' 'Percpu: 35328 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1838684 kB' 'DirectMap2M: 15906816 kB' 'DirectMap1G: 51380224 kB' 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.141 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.141 09:50:49 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.142 09:50:49 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.142 09:50:49 -- setup/common.sh@33 -- # echo 0 00:04:44.142 09:50:49 -- setup/common.sh@33 -- # return 0 00:04:44.142 09:50:49 -- setup/hugepages.sh@100 -- # resv=0 00:04:44.142 09:50:49 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:44.142 nr_hugepages=1024 00:04:44.142 09:50:49 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:44.142 resv_hugepages=0 00:04:44.142 09:50:49 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:44.142 surplus_hugepages=0 00:04:44.142 09:50:49 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:44.142 anon_hugepages=0 00:04:44.142 09:50:49 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:44.142 09:50:49 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:44.142 09:50:49 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:44.142 09:50:49 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:44.142 09:50:49 -- setup/common.sh@18 -- # local node= 00:04:44.142 09:50:49 -- setup/common.sh@19 -- # local var val 00:04:44.142 09:50:49 -- setup/common.sh@20 -- # local mem_f mem 00:04:44.142 09:50:49 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:44.142 09:50:49 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:44.142 09:50:49 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:44.142 09:50:49 -- setup/common.sh@28 -- # mapfile -t mem 00:04:44.142 09:50:49 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.142 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.143 09:50:49 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 43814176 kB' 'MemAvailable: 47321784 kB' 'Buffers: 2704 kB' 'Cached: 12242612 kB' 'SwapCached: 0 kB' 'Active: 9254052 kB' 'Inactive: 3506552 kB' 'Active(anon): 8859700 kB' 'Inactive(anon): 0 kB' 'Active(file): 394352 kB' 'Inactive(file): 3506552 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 518620 kB' 'Mapped: 181468 kB' 'Shmem: 8344412 kB' 'KReclaimable: 200652 kB' 'Slab: 572940 kB' 'SReclaimable: 200652 kB' 'SUnreclaim: 372288 kB' 'KernelStack: 12784 kB' 'PageTables: 8136 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610880 kB' 'Committed_AS: 9984724 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196032 kB' 'VmallocChunk: 0 kB' 'Percpu: 35328 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1838684 kB' 'DirectMap2M: 15906816 kB' 'DirectMap1G: 51380224 kB' 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.143 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.143 09:50:49 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.144 09:50:49 -- setup/common.sh@33 -- # echo 1024 00:04:44.144 09:50:49 -- setup/common.sh@33 -- # return 0 00:04:44.144 09:50:49 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:44.144 09:50:49 -- setup/hugepages.sh@112 -- # get_nodes 00:04:44.144 09:50:49 -- setup/hugepages.sh@27 -- # local node 00:04:44.144 09:50:49 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:44.144 09:50:49 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:44.144 09:50:49 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:44.144 09:50:49 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:44.144 09:50:49 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:44.144 09:50:49 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:44.144 09:50:49 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:44.144 09:50:49 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:44.144 09:50:49 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:44.144 09:50:49 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:44.144 09:50:49 -- setup/common.sh@18 -- # local node=0 00:04:44.144 09:50:49 -- setup/common.sh@19 -- # local var val 00:04:44.144 09:50:49 -- setup/common.sh@20 -- # local mem_f mem 00:04:44.144 09:50:49 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:44.144 09:50:49 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:44.144 09:50:49 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:44.144 09:50:49 -- setup/common.sh@28 -- # mapfile -t mem 00:04:44.144 09:50:49 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.144 09:50:49 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32829884 kB' 'MemFree: 26789600 kB' 'MemUsed: 6040284 kB' 'SwapCached: 0 kB' 'Active: 3905004 kB' 'Inactive: 110044 kB' 'Active(anon): 3794116 kB' 'Inactive(anon): 0 kB' 'Active(file): 110888 kB' 'Inactive(file): 110044 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3756252 kB' 'Mapped: 37584 kB' 'AnonPages: 262428 kB' 'Shmem: 3535320 kB' 'KernelStack: 6856 kB' 'PageTables: 4252 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 101728 kB' 'Slab: 320992 kB' 'SReclaimable: 101728 kB' 'SUnreclaim: 219264 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.144 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.144 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.145 09:50:49 -- setup/common.sh@33 -- # echo 0 00:04:44.145 09:50:49 -- setup/common.sh@33 -- # return 0 00:04:44.145 09:50:49 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:44.145 09:50:49 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:44.145 09:50:49 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:44.145 09:50:49 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:44.145 09:50:49 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:44.145 09:50:49 -- setup/common.sh@18 -- # local node=1 00:04:44.145 09:50:49 -- setup/common.sh@19 -- # local var val 00:04:44.145 09:50:49 -- setup/common.sh@20 -- # local mem_f mem 00:04:44.145 09:50:49 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:44.145 09:50:49 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:44.145 09:50:49 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:44.145 09:50:49 -- setup/common.sh@28 -- # mapfile -t mem 00:04:44.145 09:50:49 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.145 09:50:49 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27711824 kB' 'MemFree: 17024696 kB' 'MemUsed: 10687128 kB' 'SwapCached: 0 kB' 'Active: 5349400 kB' 'Inactive: 3396508 kB' 'Active(anon): 5065936 kB' 'Inactive(anon): 0 kB' 'Active(file): 283464 kB' 'Inactive(file): 3396508 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8489064 kB' 'Mapped: 143884 kB' 'AnonPages: 256988 kB' 'Shmem: 4809092 kB' 'KernelStack: 5912 kB' 'PageTables: 3780 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 98924 kB' 'Slab: 251948 kB' 'SReclaimable: 98924 kB' 'SUnreclaim: 153024 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.145 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.145 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.146 09:50:49 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.146 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.146 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.146 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.146 09:50:49 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.146 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.146 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.146 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.146 09:50:49 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.146 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.146 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.146 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.146 09:50:49 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.146 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.146 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.146 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.146 09:50:49 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.146 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.146 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.146 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.146 09:50:49 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.146 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.146 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.146 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.146 09:50:49 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.146 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.146 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.146 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.146 09:50:49 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.146 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.146 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.146 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.146 09:50:49 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.146 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.146 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.146 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.146 09:50:49 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.146 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.146 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.146 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.146 09:50:49 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.146 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.146 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.146 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.146 09:50:49 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.146 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.146 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.146 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.146 09:50:49 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.146 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.146 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.146 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.146 09:50:49 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.146 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.146 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.146 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.146 09:50:49 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.146 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.146 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.146 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.146 09:50:49 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.146 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.146 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.146 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.146 09:50:49 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.146 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.146 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.146 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.146 09:50:49 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.146 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.146 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.146 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.146 09:50:49 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.146 09:50:49 -- setup/common.sh@32 -- # continue 00:04:44.146 09:50:49 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.146 09:50:49 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.146 09:50:49 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.146 09:50:49 -- setup/common.sh@33 -- # echo 0 00:04:44.146 09:50:49 -- setup/common.sh@33 -- # return 0 00:04:44.146 09:50:49 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:44.146 09:50:49 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:44.146 09:50:49 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:44.146 09:50:49 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:44.146 09:50:49 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:44.146 node0=512 expecting 512 00:04:44.146 09:50:49 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:44.146 09:50:49 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:44.146 09:50:49 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:44.146 09:50:49 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:04:44.146 node1=512 expecting 512 00:04:44.146 09:50:49 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:04:44.146 00:04:44.146 real 0m1.386s 00:04:44.146 user 0m0.574s 00:04:44.146 sys 0m0.775s 00:04:44.146 09:50:49 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:44.146 09:50:49 -- common/autotest_common.sh@10 -- # set +x 00:04:44.146 ************************************ 00:04:44.146 END TEST per_node_1G_alloc 00:04:44.146 ************************************ 00:04:44.405 09:50:49 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:04:44.405 09:50:49 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:44.405 09:50:49 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:44.405 09:50:49 -- common/autotest_common.sh@10 -- # set +x 00:04:44.405 ************************************ 00:04:44.405 START TEST even_2G_alloc 00:04:44.405 ************************************ 00:04:44.405 09:50:49 -- common/autotest_common.sh@1104 -- # even_2G_alloc 00:04:44.405 09:50:49 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:04:44.405 09:50:49 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:44.405 09:50:49 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:44.405 09:50:49 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:44.405 09:50:49 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:44.405 09:50:49 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:44.405 09:50:49 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:44.405 09:50:49 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:44.405 09:50:49 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:44.405 09:50:49 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:44.405 09:50:49 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:44.405 09:50:49 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:44.405 09:50:49 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:44.405 09:50:49 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:44.405 09:50:49 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:44.405 09:50:49 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:44.405 09:50:49 -- setup/hugepages.sh@83 -- # : 512 00:04:44.405 09:50:49 -- setup/hugepages.sh@84 -- # : 1 00:04:44.405 09:50:49 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:44.405 09:50:49 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:44.405 09:50:49 -- setup/hugepages.sh@83 -- # : 0 00:04:44.405 09:50:49 -- setup/hugepages.sh@84 -- # : 0 00:04:44.405 09:50:49 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:44.405 09:50:49 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:04:44.405 09:50:49 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:04:44.405 09:50:49 -- setup/hugepages.sh@153 -- # setup output 00:04:44.405 09:50:49 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:44.405 09:50:49 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:45.347 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:45.347 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:45.347 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:45.347 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:45.347 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:45.347 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:45.347 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:45.347 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:45.347 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:45.347 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:45.347 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:45.347 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:45.347 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:45.347 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:45.347 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:45.347 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:45.347 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:45.624 09:50:51 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:04:45.624 09:50:51 -- setup/hugepages.sh@89 -- # local node 00:04:45.624 09:50:51 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:45.624 09:50:51 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:45.624 09:50:51 -- setup/hugepages.sh@92 -- # local surp 00:04:45.624 09:50:51 -- setup/hugepages.sh@93 -- # local resv 00:04:45.624 09:50:51 -- setup/hugepages.sh@94 -- # local anon 00:04:45.624 09:50:51 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:45.624 09:50:51 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:45.624 09:50:51 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:45.624 09:50:51 -- setup/common.sh@18 -- # local node= 00:04:45.624 09:50:51 -- setup/common.sh@19 -- # local var val 00:04:45.624 09:50:51 -- setup/common.sh@20 -- # local mem_f mem 00:04:45.624 09:50:51 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:45.624 09:50:51 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:45.624 09:50:51 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:45.624 09:50:51 -- setup/common.sh@28 -- # mapfile -t mem 00:04:45.624 09:50:51 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:45.624 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.624 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.624 09:50:51 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 43828712 kB' 'MemAvailable: 47336304 kB' 'Buffers: 2704 kB' 'Cached: 12242688 kB' 'SwapCached: 0 kB' 'Active: 9255140 kB' 'Inactive: 3506552 kB' 'Active(anon): 8860788 kB' 'Inactive(anon): 0 kB' 'Active(file): 394352 kB' 'Inactive(file): 3506552 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 519520 kB' 'Mapped: 181516 kB' 'Shmem: 8344488 kB' 'KReclaimable: 200620 kB' 'Slab: 573060 kB' 'SReclaimable: 200620 kB' 'SUnreclaim: 372440 kB' 'KernelStack: 12720 kB' 'PageTables: 8012 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610880 kB' 'Committed_AS: 9984892 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196064 kB' 'VmallocChunk: 0 kB' 'Percpu: 35328 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1838684 kB' 'DirectMap2M: 15906816 kB' 'DirectMap1G: 51380224 kB' 00:04:45.624 09:50:51 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.624 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.624 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.624 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.624 09:50:51 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.624 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.624 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.624 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.624 09:50:51 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.624 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.625 09:50:51 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.625 09:50:51 -- setup/common.sh@33 -- # echo 0 00:04:45.625 09:50:51 -- setup/common.sh@33 -- # return 0 00:04:45.625 09:50:51 -- setup/hugepages.sh@97 -- # anon=0 00:04:45.625 09:50:51 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:45.625 09:50:51 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:45.625 09:50:51 -- setup/common.sh@18 -- # local node= 00:04:45.625 09:50:51 -- setup/common.sh@19 -- # local var val 00:04:45.625 09:50:51 -- setup/common.sh@20 -- # local mem_f mem 00:04:45.625 09:50:51 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:45.625 09:50:51 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:45.625 09:50:51 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:45.625 09:50:51 -- setup/common.sh@28 -- # mapfile -t mem 00:04:45.625 09:50:51 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.625 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.626 09:50:51 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 43835844 kB' 'MemAvailable: 47343436 kB' 'Buffers: 2704 kB' 'Cached: 12242692 kB' 'SwapCached: 0 kB' 'Active: 9255776 kB' 'Inactive: 3506552 kB' 'Active(anon): 8861424 kB' 'Inactive(anon): 0 kB' 'Active(file): 394352 kB' 'Inactive(file): 3506552 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 520164 kB' 'Mapped: 181516 kB' 'Shmem: 8344492 kB' 'KReclaimable: 200620 kB' 'Slab: 573044 kB' 'SReclaimable: 200620 kB' 'SUnreclaim: 372424 kB' 'KernelStack: 12720 kB' 'PageTables: 7992 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610880 kB' 'Committed_AS: 9984904 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196016 kB' 'VmallocChunk: 0 kB' 'Percpu: 35328 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1838684 kB' 'DirectMap2M: 15906816 kB' 'DirectMap1G: 51380224 kB' 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.626 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.626 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.627 09:50:51 -- setup/common.sh@33 -- # echo 0 00:04:45.627 09:50:51 -- setup/common.sh@33 -- # return 0 00:04:45.627 09:50:51 -- setup/hugepages.sh@99 -- # surp=0 00:04:45.627 09:50:51 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:45.627 09:50:51 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:45.627 09:50:51 -- setup/common.sh@18 -- # local node= 00:04:45.627 09:50:51 -- setup/common.sh@19 -- # local var val 00:04:45.627 09:50:51 -- setup/common.sh@20 -- # local mem_f mem 00:04:45.627 09:50:51 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:45.627 09:50:51 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:45.627 09:50:51 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:45.627 09:50:51 -- setup/common.sh@28 -- # mapfile -t mem 00:04:45.627 09:50:51 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.627 09:50:51 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 43836640 kB' 'MemAvailable: 47344232 kB' 'Buffers: 2704 kB' 'Cached: 12242704 kB' 'SwapCached: 0 kB' 'Active: 9255044 kB' 'Inactive: 3506552 kB' 'Active(anon): 8860692 kB' 'Inactive(anon): 0 kB' 'Active(file): 394352 kB' 'Inactive(file): 3506552 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 519440 kB' 'Mapped: 181472 kB' 'Shmem: 8344504 kB' 'KReclaimable: 200620 kB' 'Slab: 573096 kB' 'SReclaimable: 200620 kB' 'SUnreclaim: 372476 kB' 'KernelStack: 12752 kB' 'PageTables: 8076 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610880 kB' 'Committed_AS: 9984916 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196016 kB' 'VmallocChunk: 0 kB' 'Percpu: 35328 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1838684 kB' 'DirectMap2M: 15906816 kB' 'DirectMap1G: 51380224 kB' 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.627 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.627 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.628 09:50:51 -- setup/common.sh@33 -- # echo 0 00:04:45.628 09:50:51 -- setup/common.sh@33 -- # return 0 00:04:45.628 09:50:51 -- setup/hugepages.sh@100 -- # resv=0 00:04:45.628 09:50:51 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:45.628 nr_hugepages=1024 00:04:45.628 09:50:51 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:45.628 resv_hugepages=0 00:04:45.628 09:50:51 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:45.628 surplus_hugepages=0 00:04:45.628 09:50:51 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:45.628 anon_hugepages=0 00:04:45.628 09:50:51 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:45.628 09:50:51 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:45.628 09:50:51 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:45.628 09:50:51 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:45.628 09:50:51 -- setup/common.sh@18 -- # local node= 00:04:45.628 09:50:51 -- setup/common.sh@19 -- # local var val 00:04:45.628 09:50:51 -- setup/common.sh@20 -- # local mem_f mem 00:04:45.628 09:50:51 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:45.628 09:50:51 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:45.628 09:50:51 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:45.628 09:50:51 -- setup/common.sh@28 -- # mapfile -t mem 00:04:45.628 09:50:51 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.628 09:50:51 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 43836640 kB' 'MemAvailable: 47344232 kB' 'Buffers: 2704 kB' 'Cached: 12242720 kB' 'SwapCached: 0 kB' 'Active: 9255016 kB' 'Inactive: 3506552 kB' 'Active(anon): 8860664 kB' 'Inactive(anon): 0 kB' 'Active(file): 394352 kB' 'Inactive(file): 3506552 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 519440 kB' 'Mapped: 181472 kB' 'Shmem: 8344520 kB' 'KReclaimable: 200620 kB' 'Slab: 573096 kB' 'SReclaimable: 200620 kB' 'SUnreclaim: 372476 kB' 'KernelStack: 12752 kB' 'PageTables: 8076 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610880 kB' 'Committed_AS: 9984932 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196032 kB' 'VmallocChunk: 0 kB' 'Percpu: 35328 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1838684 kB' 'DirectMap2M: 15906816 kB' 'DirectMap1G: 51380224 kB' 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.628 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.628 09:50:51 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.629 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.629 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.630 09:50:51 -- setup/common.sh@33 -- # echo 1024 00:04:45.630 09:50:51 -- setup/common.sh@33 -- # return 0 00:04:45.630 09:50:51 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:45.630 09:50:51 -- setup/hugepages.sh@112 -- # get_nodes 00:04:45.630 09:50:51 -- setup/hugepages.sh@27 -- # local node 00:04:45.630 09:50:51 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:45.630 09:50:51 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:45.630 09:50:51 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:45.630 09:50:51 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:45.630 09:50:51 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:45.630 09:50:51 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:45.630 09:50:51 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:45.630 09:50:51 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:45.630 09:50:51 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:45.630 09:50:51 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:45.630 09:50:51 -- setup/common.sh@18 -- # local node=0 00:04:45.630 09:50:51 -- setup/common.sh@19 -- # local var val 00:04:45.630 09:50:51 -- setup/common.sh@20 -- # local mem_f mem 00:04:45.630 09:50:51 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:45.630 09:50:51 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:45.630 09:50:51 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:45.630 09:50:51 -- setup/common.sh@28 -- # mapfile -t mem 00:04:45.630 09:50:51 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.630 09:50:51 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32829884 kB' 'MemFree: 26820728 kB' 'MemUsed: 6009156 kB' 'SwapCached: 0 kB' 'Active: 3904524 kB' 'Inactive: 110044 kB' 'Active(anon): 3793636 kB' 'Inactive(anon): 0 kB' 'Active(file): 110888 kB' 'Inactive(file): 110044 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3756316 kB' 'Mapped: 37588 kB' 'AnonPages: 261336 kB' 'Shmem: 3535384 kB' 'KernelStack: 6808 kB' 'PageTables: 4160 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 101728 kB' 'Slab: 321120 kB' 'SReclaimable: 101728 kB' 'SUnreclaim: 219392 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.630 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.630 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.631 09:50:51 -- setup/common.sh@33 -- # echo 0 00:04:45.631 09:50:51 -- setup/common.sh@33 -- # return 0 00:04:45.631 09:50:51 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:45.631 09:50:51 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:45.631 09:50:51 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:45.631 09:50:51 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:45.631 09:50:51 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:45.631 09:50:51 -- setup/common.sh@18 -- # local node=1 00:04:45.631 09:50:51 -- setup/common.sh@19 -- # local var val 00:04:45.631 09:50:51 -- setup/common.sh@20 -- # local mem_f mem 00:04:45.631 09:50:51 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:45.631 09:50:51 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:45.631 09:50:51 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:45.631 09:50:51 -- setup/common.sh@28 -- # mapfile -t mem 00:04:45.631 09:50:51 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.631 09:50:51 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27711824 kB' 'MemFree: 17016280 kB' 'MemUsed: 10695544 kB' 'SwapCached: 0 kB' 'Active: 5350512 kB' 'Inactive: 3396508 kB' 'Active(anon): 5067048 kB' 'Inactive(anon): 0 kB' 'Active(file): 283464 kB' 'Inactive(file): 3396508 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8489136 kB' 'Mapped: 143884 kB' 'AnonPages: 258096 kB' 'Shmem: 4809164 kB' 'KernelStack: 5944 kB' 'PageTables: 3916 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 98892 kB' 'Slab: 251976 kB' 'SReclaimable: 98892 kB' 'SUnreclaim: 153084 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.631 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.631 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.632 09:50:51 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.632 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.632 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.632 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.632 09:50:51 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.632 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.632 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.632 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.632 09:50:51 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.632 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.632 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.632 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.632 09:50:51 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.632 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.632 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.632 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.632 09:50:51 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.632 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.632 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.632 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.632 09:50:51 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.632 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.632 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.632 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.632 09:50:51 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.632 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.632 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.632 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.632 09:50:51 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.632 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.632 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.632 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.632 09:50:51 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.632 09:50:51 -- setup/common.sh@32 -- # continue 00:04:45.632 09:50:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.632 09:50:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.632 09:50:51 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.632 09:50:51 -- setup/common.sh@33 -- # echo 0 00:04:45.632 09:50:51 -- setup/common.sh@33 -- # return 0 00:04:45.632 09:50:51 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:45.632 09:50:51 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:45.632 09:50:51 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:45.632 09:50:51 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:45.632 09:50:51 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:45.632 node0=512 expecting 512 00:04:45.632 09:50:51 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:45.632 09:50:51 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:45.632 09:50:51 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:45.632 09:50:51 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:04:45.632 node1=512 expecting 512 00:04:45.632 09:50:51 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:04:45.632 00:04:45.632 real 0m1.446s 00:04:45.632 user 0m0.621s 00:04:45.632 sys 0m0.786s 00:04:45.632 09:50:51 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:45.632 09:50:51 -- common/autotest_common.sh@10 -- # set +x 00:04:45.632 ************************************ 00:04:45.632 END TEST even_2G_alloc 00:04:45.632 ************************************ 00:04:45.632 09:50:51 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:04:45.632 09:50:51 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:45.632 09:50:51 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:45.632 09:50:51 -- common/autotest_common.sh@10 -- # set +x 00:04:45.632 ************************************ 00:04:45.632 START TEST odd_alloc 00:04:45.632 ************************************ 00:04:45.632 09:50:51 -- common/autotest_common.sh@1104 -- # odd_alloc 00:04:45.632 09:50:51 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:04:45.632 09:50:51 -- setup/hugepages.sh@49 -- # local size=2098176 00:04:45.632 09:50:51 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:45.632 09:50:51 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:45.632 09:50:51 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:04:45.632 09:50:51 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:45.632 09:50:51 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:45.632 09:50:51 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:45.632 09:50:51 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:04:45.632 09:50:51 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:45.632 09:50:51 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:45.632 09:50:51 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:45.632 09:50:51 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:45.632 09:50:51 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:45.632 09:50:51 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:45.632 09:50:51 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:45.632 09:50:51 -- setup/hugepages.sh@83 -- # : 513 00:04:45.632 09:50:51 -- setup/hugepages.sh@84 -- # : 1 00:04:45.632 09:50:51 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:45.632 09:50:51 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:04:45.632 09:50:51 -- setup/hugepages.sh@83 -- # : 0 00:04:45.632 09:50:51 -- setup/hugepages.sh@84 -- # : 0 00:04:45.632 09:50:51 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:45.632 09:50:51 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:04:45.632 09:50:51 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:04:45.632 09:50:51 -- setup/hugepages.sh@160 -- # setup output 00:04:45.632 09:50:51 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:45.632 09:50:51 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:47.010 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:47.010 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:47.010 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:47.010 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:47.010 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:47.010 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:47.010 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:47.010 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:47.010 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:47.010 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:47.010 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:47.010 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:47.010 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:47.010 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:47.010 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:47.010 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:47.010 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:47.010 09:50:52 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:04:47.010 09:50:52 -- setup/hugepages.sh@89 -- # local node 00:04:47.010 09:50:52 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:47.010 09:50:52 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:47.011 09:50:52 -- setup/hugepages.sh@92 -- # local surp 00:04:47.011 09:50:52 -- setup/hugepages.sh@93 -- # local resv 00:04:47.011 09:50:52 -- setup/hugepages.sh@94 -- # local anon 00:04:47.011 09:50:52 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:47.011 09:50:52 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:47.011 09:50:52 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:47.011 09:50:52 -- setup/common.sh@18 -- # local node= 00:04:47.011 09:50:52 -- setup/common.sh@19 -- # local var val 00:04:47.011 09:50:52 -- setup/common.sh@20 -- # local mem_f mem 00:04:47.011 09:50:52 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:47.011 09:50:52 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:47.011 09:50:52 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:47.011 09:50:52 -- setup/common.sh@28 -- # mapfile -t mem 00:04:47.011 09:50:52 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.011 09:50:52 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 43846044 kB' 'MemAvailable: 47353636 kB' 'Buffers: 2704 kB' 'Cached: 12242780 kB' 'SwapCached: 0 kB' 'Active: 9251948 kB' 'Inactive: 3506552 kB' 'Active(anon): 8857596 kB' 'Inactive(anon): 0 kB' 'Active(file): 394352 kB' 'Inactive(file): 3506552 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 516172 kB' 'Mapped: 180652 kB' 'Shmem: 8344580 kB' 'KReclaimable: 200620 kB' 'Slab: 573212 kB' 'SReclaimable: 200620 kB' 'SUnreclaim: 372592 kB' 'KernelStack: 12688 kB' 'PageTables: 7700 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37609856 kB' 'Committed_AS: 9970916 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196048 kB' 'VmallocChunk: 0 kB' 'Percpu: 35328 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1838684 kB' 'DirectMap2M: 15906816 kB' 'DirectMap1G: 51380224 kB' 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.011 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.011 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.012 09:50:52 -- setup/common.sh@33 -- # echo 0 00:04:47.012 09:50:52 -- setup/common.sh@33 -- # return 0 00:04:47.012 09:50:52 -- setup/hugepages.sh@97 -- # anon=0 00:04:47.012 09:50:52 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:47.012 09:50:52 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:47.012 09:50:52 -- setup/common.sh@18 -- # local node= 00:04:47.012 09:50:52 -- setup/common.sh@19 -- # local var val 00:04:47.012 09:50:52 -- setup/common.sh@20 -- # local mem_f mem 00:04:47.012 09:50:52 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:47.012 09:50:52 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:47.012 09:50:52 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:47.012 09:50:52 -- setup/common.sh@28 -- # mapfile -t mem 00:04:47.012 09:50:52 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.012 09:50:52 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 43848472 kB' 'MemAvailable: 47356064 kB' 'Buffers: 2704 kB' 'Cached: 12242780 kB' 'SwapCached: 0 kB' 'Active: 9252248 kB' 'Inactive: 3506552 kB' 'Active(anon): 8857896 kB' 'Inactive(anon): 0 kB' 'Active(file): 394352 kB' 'Inactive(file): 3506552 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 516548 kB' 'Mapped: 180752 kB' 'Shmem: 8344580 kB' 'KReclaimable: 200620 kB' 'Slab: 573272 kB' 'SReclaimable: 200620 kB' 'SUnreclaim: 372652 kB' 'KernelStack: 12736 kB' 'PageTables: 7812 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37609856 kB' 'Committed_AS: 9970928 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196000 kB' 'VmallocChunk: 0 kB' 'Percpu: 35328 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1838684 kB' 'DirectMap2M: 15906816 kB' 'DirectMap1G: 51380224 kB' 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.012 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.012 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.013 09:50:52 -- setup/common.sh@33 -- # echo 0 00:04:47.013 09:50:52 -- setup/common.sh@33 -- # return 0 00:04:47.013 09:50:52 -- setup/hugepages.sh@99 -- # surp=0 00:04:47.013 09:50:52 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:47.013 09:50:52 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:47.013 09:50:52 -- setup/common.sh@18 -- # local node= 00:04:47.013 09:50:52 -- setup/common.sh@19 -- # local var val 00:04:47.013 09:50:52 -- setup/common.sh@20 -- # local mem_f mem 00:04:47.013 09:50:52 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:47.013 09:50:52 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:47.013 09:50:52 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:47.013 09:50:52 -- setup/common.sh@28 -- # mapfile -t mem 00:04:47.013 09:50:52 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.013 09:50:52 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 43847748 kB' 'MemAvailable: 47355340 kB' 'Buffers: 2704 kB' 'Cached: 12242792 kB' 'SwapCached: 0 kB' 'Active: 9251616 kB' 'Inactive: 3506552 kB' 'Active(anon): 8857264 kB' 'Inactive(anon): 0 kB' 'Active(file): 394352 kB' 'Inactive(file): 3506552 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 515912 kB' 'Mapped: 180612 kB' 'Shmem: 8344592 kB' 'KReclaimable: 200620 kB' 'Slab: 573240 kB' 'SReclaimable: 200620 kB' 'SUnreclaim: 372620 kB' 'KernelStack: 12736 kB' 'PageTables: 7748 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37609856 kB' 'Committed_AS: 9970944 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196016 kB' 'VmallocChunk: 0 kB' 'Percpu: 35328 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1838684 kB' 'DirectMap2M: 15906816 kB' 'DirectMap1G: 51380224 kB' 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.013 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.013 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.014 09:50:52 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.014 09:50:52 -- setup/common.sh@33 -- # echo 0 00:04:47.014 09:50:52 -- setup/common.sh@33 -- # return 0 00:04:47.014 09:50:52 -- setup/hugepages.sh@100 -- # resv=0 00:04:47.014 09:50:52 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:04:47.014 nr_hugepages=1025 00:04:47.014 09:50:52 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:47.014 resv_hugepages=0 00:04:47.014 09:50:52 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:47.014 surplus_hugepages=0 00:04:47.014 09:50:52 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:47.014 anon_hugepages=0 00:04:47.014 09:50:52 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:04:47.014 09:50:52 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:04:47.014 09:50:52 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:47.014 09:50:52 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:47.014 09:50:52 -- setup/common.sh@18 -- # local node= 00:04:47.014 09:50:52 -- setup/common.sh@19 -- # local var val 00:04:47.014 09:50:52 -- setup/common.sh@20 -- # local mem_f mem 00:04:47.014 09:50:52 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:47.014 09:50:52 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:47.014 09:50:52 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:47.014 09:50:52 -- setup/common.sh@28 -- # mapfile -t mem 00:04:47.014 09:50:52 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.014 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.015 09:50:52 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 43847052 kB' 'MemAvailable: 47354644 kB' 'Buffers: 2704 kB' 'Cached: 12242808 kB' 'SwapCached: 0 kB' 'Active: 9252160 kB' 'Inactive: 3506552 kB' 'Active(anon): 8857808 kB' 'Inactive(anon): 0 kB' 'Active(file): 394352 kB' 'Inactive(file): 3506552 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 516472 kB' 'Mapped: 180612 kB' 'Shmem: 8344608 kB' 'KReclaimable: 200620 kB' 'Slab: 573240 kB' 'SReclaimable: 200620 kB' 'SUnreclaim: 372620 kB' 'KernelStack: 12784 kB' 'PageTables: 7908 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37609856 kB' 'Committed_AS: 9973492 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196032 kB' 'VmallocChunk: 0 kB' 'Percpu: 35328 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1838684 kB' 'DirectMap2M: 15906816 kB' 'DirectMap1G: 51380224 kB' 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.015 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.015 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.016 09:50:52 -- setup/common.sh@33 -- # echo 1025 00:04:47.016 09:50:52 -- setup/common.sh@33 -- # return 0 00:04:47.016 09:50:52 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:04:47.016 09:50:52 -- setup/hugepages.sh@112 -- # get_nodes 00:04:47.016 09:50:52 -- setup/hugepages.sh@27 -- # local node 00:04:47.016 09:50:52 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:47.016 09:50:52 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:47.016 09:50:52 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:47.016 09:50:52 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:04:47.016 09:50:52 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:47.016 09:50:52 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:47.016 09:50:52 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:47.016 09:50:52 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:47.016 09:50:52 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:47.016 09:50:52 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:47.016 09:50:52 -- setup/common.sh@18 -- # local node=0 00:04:47.016 09:50:52 -- setup/common.sh@19 -- # local var val 00:04:47.016 09:50:52 -- setup/common.sh@20 -- # local mem_f mem 00:04:47.016 09:50:52 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:47.016 09:50:52 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:47.016 09:50:52 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:47.016 09:50:52 -- setup/common.sh@28 -- # mapfile -t mem 00:04:47.016 09:50:52 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.016 09:50:52 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32829884 kB' 'MemFree: 26832324 kB' 'MemUsed: 5997560 kB' 'SwapCached: 0 kB' 'Active: 3903932 kB' 'Inactive: 110044 kB' 'Active(anon): 3793044 kB' 'Inactive(anon): 0 kB' 'Active(file): 110888 kB' 'Inactive(file): 110044 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3756364 kB' 'Mapped: 36868 kB' 'AnonPages: 260920 kB' 'Shmem: 3535432 kB' 'KernelStack: 6968 kB' 'PageTables: 4724 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 101728 kB' 'Slab: 321116 kB' 'SReclaimable: 101728 kB' 'SUnreclaim: 219388 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.016 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.016 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.017 09:50:52 -- setup/common.sh@33 -- # echo 0 00:04:47.017 09:50:52 -- setup/common.sh@33 -- # return 0 00:04:47.017 09:50:52 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:47.017 09:50:52 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:47.017 09:50:52 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:47.017 09:50:52 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:47.017 09:50:52 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:47.017 09:50:52 -- setup/common.sh@18 -- # local node=1 00:04:47.017 09:50:52 -- setup/common.sh@19 -- # local var val 00:04:47.017 09:50:52 -- setup/common.sh@20 -- # local mem_f mem 00:04:47.017 09:50:52 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:47.017 09:50:52 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:47.017 09:50:52 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:47.017 09:50:52 -- setup/common.sh@28 -- # mapfile -t mem 00:04:47.017 09:50:52 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.017 09:50:52 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27711824 kB' 'MemFree: 17017352 kB' 'MemUsed: 10694472 kB' 'SwapCached: 0 kB' 'Active: 5349304 kB' 'Inactive: 3396508 kB' 'Active(anon): 5065840 kB' 'Inactive(anon): 0 kB' 'Active(file): 283464 kB' 'Inactive(file): 3396508 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8489160 kB' 'Mapped: 143744 kB' 'AnonPages: 256508 kB' 'Shmem: 4809188 kB' 'KernelStack: 5992 kB' 'PageTables: 3896 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 98892 kB' 'Slab: 252116 kB' 'SReclaimable: 98892 kB' 'SUnreclaim: 153224 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.017 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.017 09:50:52 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.018 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.018 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.018 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.018 09:50:52 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.018 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.018 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.018 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.018 09:50:52 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.018 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.018 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.018 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.018 09:50:52 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.018 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.018 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.018 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.018 09:50:52 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.018 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.018 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.018 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.018 09:50:52 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.018 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.018 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.018 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.018 09:50:52 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.018 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.018 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.018 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.018 09:50:52 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.276 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.276 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.276 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.276 09:50:52 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.276 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.276 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.276 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.276 09:50:52 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.276 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.276 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.276 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.276 09:50:52 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.276 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.276 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.276 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.276 09:50:52 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.276 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.276 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.276 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.276 09:50:52 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.276 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.276 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.276 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.276 09:50:52 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.276 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.276 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.276 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.276 09:50:52 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.276 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.276 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.276 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.276 09:50:52 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.276 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.276 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.276 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.276 09:50:52 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.276 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.276 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.276 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.276 09:50:52 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.276 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.276 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.276 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.276 09:50:52 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.276 09:50:52 -- setup/common.sh@32 -- # continue 00:04:47.276 09:50:52 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.276 09:50:52 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.276 09:50:52 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.276 09:50:52 -- setup/common.sh@33 -- # echo 0 00:04:47.276 09:50:52 -- setup/common.sh@33 -- # return 0 00:04:47.276 09:50:52 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:47.276 09:50:52 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:47.276 09:50:52 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:47.276 09:50:52 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:47.276 09:50:52 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:04:47.276 node0=512 expecting 513 00:04:47.276 09:50:52 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:47.276 09:50:52 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:47.276 09:50:52 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:47.276 09:50:52 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:04:47.276 node1=513 expecting 512 00:04:47.276 09:50:52 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:04:47.276 00:04:47.276 real 0m1.398s 00:04:47.276 user 0m0.593s 00:04:47.276 sys 0m0.769s 00:04:47.276 09:50:52 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:47.276 09:50:52 -- common/autotest_common.sh@10 -- # set +x 00:04:47.276 ************************************ 00:04:47.276 END TEST odd_alloc 00:04:47.276 ************************************ 00:04:47.276 09:50:52 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:04:47.276 09:50:52 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:47.276 09:50:52 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:47.276 09:50:52 -- common/autotest_common.sh@10 -- # set +x 00:04:47.276 ************************************ 00:04:47.276 START TEST custom_alloc 00:04:47.276 ************************************ 00:04:47.276 09:50:52 -- common/autotest_common.sh@1104 -- # custom_alloc 00:04:47.276 09:50:52 -- setup/hugepages.sh@167 -- # local IFS=, 00:04:47.276 09:50:52 -- setup/hugepages.sh@169 -- # local node 00:04:47.276 09:50:52 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:04:47.276 09:50:52 -- setup/hugepages.sh@170 -- # local nodes_hp 00:04:47.276 09:50:52 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:04:47.276 09:50:52 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:04:47.276 09:50:52 -- setup/hugepages.sh@49 -- # local size=1048576 00:04:47.276 09:50:52 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:47.276 09:50:52 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:47.276 09:50:52 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:04:47.276 09:50:52 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:47.276 09:50:52 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:47.276 09:50:52 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:47.276 09:50:52 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:04:47.276 09:50:52 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:47.276 09:50:52 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:47.276 09:50:52 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:47.276 09:50:52 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:47.276 09:50:52 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:47.276 09:50:52 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:47.276 09:50:52 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:04:47.276 09:50:52 -- setup/hugepages.sh@83 -- # : 256 00:04:47.276 09:50:52 -- setup/hugepages.sh@84 -- # : 1 00:04:47.276 09:50:52 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:47.276 09:50:52 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:04:47.276 09:50:52 -- setup/hugepages.sh@83 -- # : 0 00:04:47.276 09:50:52 -- setup/hugepages.sh@84 -- # : 0 00:04:47.276 09:50:52 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:47.276 09:50:52 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:04:47.276 09:50:52 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:04:47.276 09:50:52 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:04:47.276 09:50:52 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:47.276 09:50:52 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:47.276 09:50:52 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:47.276 09:50:52 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:47.276 09:50:52 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:47.276 09:50:52 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:47.276 09:50:52 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:47.276 09:50:52 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:47.276 09:50:52 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:47.276 09:50:52 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:47.276 09:50:52 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:47.276 09:50:52 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:47.276 09:50:52 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:04:47.276 09:50:52 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:47.276 09:50:52 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:04:47.276 09:50:52 -- setup/hugepages.sh@78 -- # return 0 00:04:47.276 09:50:52 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:04:47.276 09:50:52 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:04:47.276 09:50:52 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:04:47.276 09:50:52 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:04:47.276 09:50:52 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:04:47.276 09:50:52 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:04:47.276 09:50:52 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:04:47.276 09:50:52 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:04:47.276 09:50:52 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:47.276 09:50:52 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:47.276 09:50:52 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:47.276 09:50:52 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:47.276 09:50:52 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:47.276 09:50:52 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:47.276 09:50:52 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:47.276 09:50:52 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:04:47.276 09:50:52 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:47.276 09:50:52 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:04:47.276 09:50:52 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:47.276 09:50:52 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:04:47.276 09:50:52 -- setup/hugepages.sh@78 -- # return 0 00:04:47.276 09:50:52 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:04:47.276 09:50:52 -- setup/hugepages.sh@187 -- # setup output 00:04:47.276 09:50:52 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:47.276 09:50:52 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:48.208 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:48.208 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:48.208 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:48.208 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:48.208 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:48.208 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:48.208 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:48.208 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:48.208 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:48.467 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:48.467 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:48.467 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:48.467 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:48.467 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:48.467 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:48.467 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:48.467 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:48.467 09:50:54 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:04:48.467 09:50:54 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:04:48.467 09:50:54 -- setup/hugepages.sh@89 -- # local node 00:04:48.467 09:50:54 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:48.467 09:50:54 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:48.467 09:50:54 -- setup/hugepages.sh@92 -- # local surp 00:04:48.467 09:50:54 -- setup/hugepages.sh@93 -- # local resv 00:04:48.467 09:50:54 -- setup/hugepages.sh@94 -- # local anon 00:04:48.467 09:50:54 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:48.467 09:50:54 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:48.467 09:50:54 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:48.467 09:50:54 -- setup/common.sh@18 -- # local node= 00:04:48.467 09:50:54 -- setup/common.sh@19 -- # local var val 00:04:48.467 09:50:54 -- setup/common.sh@20 -- # local mem_f mem 00:04:48.467 09:50:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:48.467 09:50:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:48.467 09:50:54 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:48.467 09:50:54 -- setup/common.sh@28 -- # mapfile -t mem 00:04:48.467 09:50:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:48.467 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.468 09:50:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 42810884 kB' 'MemAvailable: 46318476 kB' 'Buffers: 2704 kB' 'Cached: 12242876 kB' 'SwapCached: 0 kB' 'Active: 9251820 kB' 'Inactive: 3506552 kB' 'Active(anon): 8857468 kB' 'Inactive(anon): 0 kB' 'Active(file): 394352 kB' 'Inactive(file): 3506552 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 515956 kB' 'Mapped: 180656 kB' 'Shmem: 8344676 kB' 'KReclaimable: 200620 kB' 'Slab: 572976 kB' 'SReclaimable: 200620 kB' 'SUnreclaim: 372356 kB' 'KernelStack: 12752 kB' 'PageTables: 7816 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37086592 kB' 'Committed_AS: 9971076 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196064 kB' 'VmallocChunk: 0 kB' 'Percpu: 35328 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1838684 kB' 'DirectMap2M: 15906816 kB' 'DirectMap1G: 51380224 kB' 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.468 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.468 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.469 09:50:54 -- setup/common.sh@33 -- # echo 0 00:04:48.469 09:50:54 -- setup/common.sh@33 -- # return 0 00:04:48.469 09:50:54 -- setup/hugepages.sh@97 -- # anon=0 00:04:48.469 09:50:54 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:48.469 09:50:54 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:48.469 09:50:54 -- setup/common.sh@18 -- # local node= 00:04:48.469 09:50:54 -- setup/common.sh@19 -- # local var val 00:04:48.469 09:50:54 -- setup/common.sh@20 -- # local mem_f mem 00:04:48.469 09:50:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:48.469 09:50:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:48.469 09:50:54 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:48.469 09:50:54 -- setup/common.sh@28 -- # mapfile -t mem 00:04:48.469 09:50:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.469 09:50:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 42809640 kB' 'MemAvailable: 46317232 kB' 'Buffers: 2704 kB' 'Cached: 12242876 kB' 'SwapCached: 0 kB' 'Active: 9254688 kB' 'Inactive: 3506552 kB' 'Active(anon): 8860336 kB' 'Inactive(anon): 0 kB' 'Active(file): 394352 kB' 'Inactive(file): 3506552 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 518824 kB' 'Mapped: 181096 kB' 'Shmem: 8344676 kB' 'KReclaimable: 200620 kB' 'Slab: 572976 kB' 'SReclaimable: 200620 kB' 'SUnreclaim: 372356 kB' 'KernelStack: 12704 kB' 'PageTables: 7612 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37086592 kB' 'Committed_AS: 9974752 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196016 kB' 'VmallocChunk: 0 kB' 'Percpu: 35328 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1838684 kB' 'DirectMap2M: 15906816 kB' 'DirectMap1G: 51380224 kB' 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.469 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.469 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.470 09:50:54 -- setup/common.sh@33 -- # echo 0 00:04:48.470 09:50:54 -- setup/common.sh@33 -- # return 0 00:04:48.470 09:50:54 -- setup/hugepages.sh@99 -- # surp=0 00:04:48.470 09:50:54 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:48.470 09:50:54 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:48.470 09:50:54 -- setup/common.sh@18 -- # local node= 00:04:48.470 09:50:54 -- setup/common.sh@19 -- # local var val 00:04:48.470 09:50:54 -- setup/common.sh@20 -- # local mem_f mem 00:04:48.470 09:50:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:48.470 09:50:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:48.470 09:50:54 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:48.470 09:50:54 -- setup/common.sh@28 -- # mapfile -t mem 00:04:48.470 09:50:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.470 09:50:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 42805924 kB' 'MemAvailable: 46313516 kB' 'Buffers: 2704 kB' 'Cached: 12242888 kB' 'SwapCached: 0 kB' 'Active: 9257452 kB' 'Inactive: 3506552 kB' 'Active(anon): 8863100 kB' 'Inactive(anon): 0 kB' 'Active(file): 394352 kB' 'Inactive(file): 3506552 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 521692 kB' 'Mapped: 181472 kB' 'Shmem: 8344688 kB' 'KReclaimable: 200620 kB' 'Slab: 572976 kB' 'SReclaimable: 200620 kB' 'SUnreclaim: 372356 kB' 'KernelStack: 12752 kB' 'PageTables: 7780 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37086592 kB' 'Committed_AS: 9977416 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196036 kB' 'VmallocChunk: 0 kB' 'Percpu: 35328 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1838684 kB' 'DirectMap2M: 15906816 kB' 'DirectMap1G: 51380224 kB' 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.470 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.470 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.471 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.471 09:50:54 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.471 09:50:54 -- setup/common.sh@33 -- # echo 0 00:04:48.471 09:50:54 -- setup/common.sh@33 -- # return 0 00:04:48.471 09:50:54 -- setup/hugepages.sh@100 -- # resv=0 00:04:48.471 09:50:54 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:04:48.471 nr_hugepages=1536 00:04:48.471 09:50:54 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:48.471 resv_hugepages=0 00:04:48.471 09:50:54 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:48.471 surplus_hugepages=0 00:04:48.471 09:50:54 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:48.471 anon_hugepages=0 00:04:48.471 09:50:54 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:48.471 09:50:54 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:04:48.471 09:50:54 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:48.471 09:50:54 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:48.471 09:50:54 -- setup/common.sh@18 -- # local node= 00:04:48.730 09:50:54 -- setup/common.sh@19 -- # local var val 00:04:48.730 09:50:54 -- setup/common.sh@20 -- # local mem_f mem 00:04:48.730 09:50:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:48.730 09:50:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:48.730 09:50:54 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:48.730 09:50:54 -- setup/common.sh@28 -- # mapfile -t mem 00:04:48.730 09:50:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:48.730 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.730 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.730 09:50:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 42806212 kB' 'MemAvailable: 46313804 kB' 'Buffers: 2704 kB' 'Cached: 12242904 kB' 'SwapCached: 0 kB' 'Active: 9252664 kB' 'Inactive: 3506552 kB' 'Active(anon): 8858312 kB' 'Inactive(anon): 0 kB' 'Active(file): 394352 kB' 'Inactive(file): 3506552 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 516848 kB' 'Mapped: 181536 kB' 'Shmem: 8344704 kB' 'KReclaimable: 200620 kB' 'Slab: 573044 kB' 'SReclaimable: 200620 kB' 'SUnreclaim: 372424 kB' 'KernelStack: 12752 kB' 'PageTables: 7748 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37086592 kB' 'Committed_AS: 9972800 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196048 kB' 'VmallocChunk: 0 kB' 'Percpu: 35328 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1838684 kB' 'DirectMap2M: 15906816 kB' 'DirectMap1G: 51380224 kB' 00:04:48.730 09:50:54 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.730 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.730 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.730 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.730 09:50:54 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.730 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.730 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.730 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.730 09:50:54 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.730 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.730 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.730 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.730 09:50:54 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.730 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.730 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.730 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.730 09:50:54 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.730 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.730 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.730 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.730 09:50:54 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.730 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.730 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.730 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.730 09:50:54 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.730 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.730 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.730 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.730 09:50:54 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.730 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.731 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.731 09:50:54 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.731 09:50:54 -- setup/common.sh@33 -- # echo 1536 00:04:48.731 09:50:54 -- setup/common.sh@33 -- # return 0 00:04:48.731 09:50:54 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:48.731 09:50:54 -- setup/hugepages.sh@112 -- # get_nodes 00:04:48.731 09:50:54 -- setup/hugepages.sh@27 -- # local node 00:04:48.731 09:50:54 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:48.731 09:50:54 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:48.731 09:50:54 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:48.732 09:50:54 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:48.732 09:50:54 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:48.732 09:50:54 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:48.732 09:50:54 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:48.732 09:50:54 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:48.732 09:50:54 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:48.732 09:50:54 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:48.732 09:50:54 -- setup/common.sh@18 -- # local node=0 00:04:48.732 09:50:54 -- setup/common.sh@19 -- # local var val 00:04:48.732 09:50:54 -- setup/common.sh@20 -- # local mem_f mem 00:04:48.732 09:50:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:48.732 09:50:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:48.732 09:50:54 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:48.732 09:50:54 -- setup/common.sh@28 -- # mapfile -t mem 00:04:48.732 09:50:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.732 09:50:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32829884 kB' 'MemFree: 26827328 kB' 'MemUsed: 6002556 kB' 'SwapCached: 0 kB' 'Active: 3908044 kB' 'Inactive: 110044 kB' 'Active(anon): 3797156 kB' 'Inactive(anon): 0 kB' 'Active(file): 110888 kB' 'Inactive(file): 110044 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3756400 kB' 'Mapped: 37308 kB' 'AnonPages: 264796 kB' 'Shmem: 3535468 kB' 'KernelStack: 6840 kB' 'PageTables: 4172 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 101728 kB' 'Slab: 321164 kB' 'SReclaimable: 101728 kB' 'SUnreclaim: 219436 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.732 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.732 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.733 09:50:54 -- setup/common.sh@33 -- # echo 0 00:04:48.733 09:50:54 -- setup/common.sh@33 -- # return 0 00:04:48.733 09:50:54 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:48.733 09:50:54 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:48.733 09:50:54 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:48.733 09:50:54 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:48.733 09:50:54 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:48.733 09:50:54 -- setup/common.sh@18 -- # local node=1 00:04:48.733 09:50:54 -- setup/common.sh@19 -- # local var val 00:04:48.733 09:50:54 -- setup/common.sh@20 -- # local mem_f mem 00:04:48.733 09:50:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:48.733 09:50:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:48.733 09:50:54 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:48.733 09:50:54 -- setup/common.sh@28 -- # mapfile -t mem 00:04:48.733 09:50:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.733 09:50:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27711824 kB' 'MemFree: 15971500 kB' 'MemUsed: 11740324 kB' 'SwapCached: 0 kB' 'Active: 5348908 kB' 'Inactive: 3396508 kB' 'Active(anon): 5065444 kB' 'Inactive(anon): 0 kB' 'Active(file): 283464 kB' 'Inactive(file): 3396508 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8489232 kB' 'Mapped: 143896 kB' 'AnonPages: 256292 kB' 'Shmem: 4809260 kB' 'KernelStack: 5864 kB' 'PageTables: 3456 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 98892 kB' 'Slab: 251880 kB' 'SReclaimable: 98892 kB' 'SUnreclaim: 152988 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.733 09:50:54 -- setup/common.sh@32 -- # continue 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.733 09:50:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.734 09:50:54 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.734 09:50:54 -- setup/common.sh@33 -- # echo 0 00:04:48.734 09:50:54 -- setup/common.sh@33 -- # return 0 00:04:48.734 09:50:54 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:48.734 09:50:54 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:48.734 09:50:54 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:48.734 09:50:54 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:48.734 09:50:54 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:48.734 node0=512 expecting 512 00:04:48.734 09:50:54 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:48.734 09:50:54 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:48.734 09:50:54 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:48.734 09:50:54 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:04:48.734 node1=1024 expecting 1024 00:04:48.734 09:50:54 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:04:48.734 00:04:48.734 real 0m1.501s 00:04:48.734 user 0m0.638s 00:04:48.734 sys 0m0.822s 00:04:48.734 09:50:54 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:48.734 09:50:54 -- common/autotest_common.sh@10 -- # set +x 00:04:48.734 ************************************ 00:04:48.734 END TEST custom_alloc 00:04:48.734 ************************************ 00:04:48.734 09:50:54 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:04:48.734 09:50:54 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:48.734 09:50:54 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:48.734 09:50:54 -- common/autotest_common.sh@10 -- # set +x 00:04:48.734 ************************************ 00:04:48.734 START TEST no_shrink_alloc 00:04:48.734 ************************************ 00:04:48.734 09:50:54 -- common/autotest_common.sh@1104 -- # no_shrink_alloc 00:04:48.734 09:50:54 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:04:48.734 09:50:54 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:48.734 09:50:54 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:04:48.734 09:50:54 -- setup/hugepages.sh@51 -- # shift 00:04:48.734 09:50:54 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:04:48.734 09:50:54 -- setup/hugepages.sh@52 -- # local node_ids 00:04:48.734 09:50:54 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:48.734 09:50:54 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:48.734 09:50:54 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:04:48.734 09:50:54 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:04:48.734 09:50:54 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:48.734 09:50:54 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:48.734 09:50:54 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:48.734 09:50:54 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:48.734 09:50:54 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:48.734 09:50:54 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:04:48.734 09:50:54 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:48.734 09:50:54 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:04:48.734 09:50:54 -- setup/hugepages.sh@73 -- # return 0 00:04:48.734 09:50:54 -- setup/hugepages.sh@198 -- # setup output 00:04:48.734 09:50:54 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:48.734 09:50:54 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:50.107 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:50.107 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:50.107 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:50.107 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:50.107 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:50.107 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:50.107 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:50.107 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:50.107 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:50.107 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:50.107 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:50.107 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:50.107 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:50.107 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:50.107 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:50.107 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:50.107 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:50.107 09:50:55 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:04:50.107 09:50:55 -- setup/hugepages.sh@89 -- # local node 00:04:50.107 09:50:55 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:50.107 09:50:55 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:50.107 09:50:55 -- setup/hugepages.sh@92 -- # local surp 00:04:50.107 09:50:55 -- setup/hugepages.sh@93 -- # local resv 00:04:50.107 09:50:55 -- setup/hugepages.sh@94 -- # local anon 00:04:50.107 09:50:55 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:50.107 09:50:55 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:50.107 09:50:55 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:50.107 09:50:55 -- setup/common.sh@18 -- # local node= 00:04:50.107 09:50:55 -- setup/common.sh@19 -- # local var val 00:04:50.107 09:50:55 -- setup/common.sh@20 -- # local mem_f mem 00:04:50.107 09:50:55 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:50.107 09:50:55 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:50.107 09:50:55 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:50.107 09:50:55 -- setup/common.sh@28 -- # mapfile -t mem 00:04:50.107 09:50:55 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:50.107 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.107 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.107 09:50:55 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 43820980 kB' 'MemAvailable: 47328572 kB' 'Buffers: 2704 kB' 'Cached: 12242972 kB' 'SwapCached: 0 kB' 'Active: 9252156 kB' 'Inactive: 3506552 kB' 'Active(anon): 8857804 kB' 'Inactive(anon): 0 kB' 'Active(file): 394352 kB' 'Inactive(file): 3506552 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 516300 kB' 'Mapped: 180668 kB' 'Shmem: 8344772 kB' 'KReclaimable: 200620 kB' 'Slab: 573184 kB' 'SReclaimable: 200620 kB' 'SUnreclaim: 372564 kB' 'KernelStack: 12752 kB' 'PageTables: 7740 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610880 kB' 'Committed_AS: 9971368 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196048 kB' 'VmallocChunk: 0 kB' 'Percpu: 35328 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1838684 kB' 'DirectMap2M: 15906816 kB' 'DirectMap1G: 51380224 kB' 00:04:50.107 09:50:55 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.107 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.107 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.107 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.107 09:50:55 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.107 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.107 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.107 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.107 09:50:55 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.107 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.107 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.107 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.107 09:50:55 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.107 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.107 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.107 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.107 09:50:55 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.107 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.107 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.107 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.107 09:50:55 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.107 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.107 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.107 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.107 09:50:55 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.107 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.107 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.107 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.107 09:50:55 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.107 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.107 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.107 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.107 09:50:55 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.107 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.107 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.108 09:50:55 -- setup/common.sh@33 -- # echo 0 00:04:50.108 09:50:55 -- setup/common.sh@33 -- # return 0 00:04:50.108 09:50:55 -- setup/hugepages.sh@97 -- # anon=0 00:04:50.108 09:50:55 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:50.108 09:50:55 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:50.108 09:50:55 -- setup/common.sh@18 -- # local node= 00:04:50.108 09:50:55 -- setup/common.sh@19 -- # local var val 00:04:50.108 09:50:55 -- setup/common.sh@20 -- # local mem_f mem 00:04:50.108 09:50:55 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:50.108 09:50:55 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:50.108 09:50:55 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:50.108 09:50:55 -- setup/common.sh@28 -- # mapfile -t mem 00:04:50.108 09:50:55 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.108 09:50:55 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 43821540 kB' 'MemAvailable: 47329132 kB' 'Buffers: 2704 kB' 'Cached: 12242972 kB' 'SwapCached: 0 kB' 'Active: 9252104 kB' 'Inactive: 3506552 kB' 'Active(anon): 8857752 kB' 'Inactive(anon): 0 kB' 'Active(file): 394352 kB' 'Inactive(file): 3506552 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 516296 kB' 'Mapped: 180704 kB' 'Shmem: 8344772 kB' 'KReclaimable: 200620 kB' 'Slab: 573192 kB' 'SReclaimable: 200620 kB' 'SUnreclaim: 372572 kB' 'KernelStack: 12768 kB' 'PageTables: 7776 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610880 kB' 'Committed_AS: 9971380 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196016 kB' 'VmallocChunk: 0 kB' 'Percpu: 35328 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1838684 kB' 'DirectMap2M: 15906816 kB' 'DirectMap1G: 51380224 kB' 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.108 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.108 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.109 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.109 09:50:55 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.110 09:50:55 -- setup/common.sh@33 -- # echo 0 00:04:50.110 09:50:55 -- setup/common.sh@33 -- # return 0 00:04:50.110 09:50:55 -- setup/hugepages.sh@99 -- # surp=0 00:04:50.110 09:50:55 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:50.110 09:50:55 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:50.110 09:50:55 -- setup/common.sh@18 -- # local node= 00:04:50.110 09:50:55 -- setup/common.sh@19 -- # local var val 00:04:50.110 09:50:55 -- setup/common.sh@20 -- # local mem_f mem 00:04:50.110 09:50:55 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:50.110 09:50:55 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:50.110 09:50:55 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:50.110 09:50:55 -- setup/common.sh@28 -- # mapfile -t mem 00:04:50.110 09:50:55 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.110 09:50:55 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 43820552 kB' 'MemAvailable: 47328144 kB' 'Buffers: 2704 kB' 'Cached: 12242984 kB' 'SwapCached: 0 kB' 'Active: 9251956 kB' 'Inactive: 3506552 kB' 'Active(anon): 8857604 kB' 'Inactive(anon): 0 kB' 'Active(file): 394352 kB' 'Inactive(file): 3506552 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 516104 kB' 'Mapped: 180628 kB' 'Shmem: 8344784 kB' 'KReclaimable: 200620 kB' 'Slab: 573200 kB' 'SReclaimable: 200620 kB' 'SUnreclaim: 372580 kB' 'KernelStack: 12784 kB' 'PageTables: 7724 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610880 kB' 'Committed_AS: 9971396 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196048 kB' 'VmallocChunk: 0 kB' 'Percpu: 35328 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1838684 kB' 'DirectMap2M: 15906816 kB' 'DirectMap1G: 51380224 kB' 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.110 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.110 09:50:55 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.111 09:50:55 -- setup/common.sh@33 -- # echo 0 00:04:50.111 09:50:55 -- setup/common.sh@33 -- # return 0 00:04:50.111 09:50:55 -- setup/hugepages.sh@100 -- # resv=0 00:04:50.111 09:50:55 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:50.111 nr_hugepages=1024 00:04:50.111 09:50:55 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:50.111 resv_hugepages=0 00:04:50.111 09:50:55 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:50.111 surplus_hugepages=0 00:04:50.111 09:50:55 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:50.111 anon_hugepages=0 00:04:50.111 09:50:55 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:50.111 09:50:55 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:50.111 09:50:55 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:50.111 09:50:55 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:50.111 09:50:55 -- setup/common.sh@18 -- # local node= 00:04:50.111 09:50:55 -- setup/common.sh@19 -- # local var val 00:04:50.111 09:50:55 -- setup/common.sh@20 -- # local mem_f mem 00:04:50.111 09:50:55 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:50.111 09:50:55 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:50.111 09:50:55 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:50.111 09:50:55 -- setup/common.sh@28 -- # mapfile -t mem 00:04:50.111 09:50:55 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.111 09:50:55 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 43820552 kB' 'MemAvailable: 47328144 kB' 'Buffers: 2704 kB' 'Cached: 12243000 kB' 'SwapCached: 0 kB' 'Active: 9252016 kB' 'Inactive: 3506552 kB' 'Active(anon): 8857664 kB' 'Inactive(anon): 0 kB' 'Active(file): 394352 kB' 'Inactive(file): 3506552 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 516140 kB' 'Mapped: 180628 kB' 'Shmem: 8344800 kB' 'KReclaimable: 200620 kB' 'Slab: 573200 kB' 'SReclaimable: 200620 kB' 'SUnreclaim: 372580 kB' 'KernelStack: 12800 kB' 'PageTables: 7772 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610880 kB' 'Committed_AS: 9971408 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196064 kB' 'VmallocChunk: 0 kB' 'Percpu: 35328 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1838684 kB' 'DirectMap2M: 15906816 kB' 'DirectMap1G: 51380224 kB' 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.111 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.111 09:50:55 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.112 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.112 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.113 09:50:55 -- setup/common.sh@33 -- # echo 1024 00:04:50.113 09:50:55 -- setup/common.sh@33 -- # return 0 00:04:50.113 09:50:55 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:50.113 09:50:55 -- setup/hugepages.sh@112 -- # get_nodes 00:04:50.113 09:50:55 -- setup/hugepages.sh@27 -- # local node 00:04:50.113 09:50:55 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:50.113 09:50:55 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:50.113 09:50:55 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:50.113 09:50:55 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:50.113 09:50:55 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:50.113 09:50:55 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:50.113 09:50:55 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:50.113 09:50:55 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:50.113 09:50:55 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:50.113 09:50:55 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:50.113 09:50:55 -- setup/common.sh@18 -- # local node=0 00:04:50.113 09:50:55 -- setup/common.sh@19 -- # local var val 00:04:50.113 09:50:55 -- setup/common.sh@20 -- # local mem_f mem 00:04:50.113 09:50:55 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:50.113 09:50:55 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:50.113 09:50:55 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:50.113 09:50:55 -- setup/common.sh@28 -- # mapfile -t mem 00:04:50.113 09:50:55 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.113 09:50:55 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32829884 kB' 'MemFree: 25760604 kB' 'MemUsed: 7069280 kB' 'SwapCached: 0 kB' 'Active: 3903132 kB' 'Inactive: 110044 kB' 'Active(anon): 3792244 kB' 'Inactive(anon): 0 kB' 'Active(file): 110888 kB' 'Inactive(file): 110044 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3756416 kB' 'Mapped: 36884 kB' 'AnonPages: 259900 kB' 'Shmem: 3535484 kB' 'KernelStack: 6856 kB' 'PageTables: 4224 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 101728 kB' 'Slab: 321052 kB' 'SReclaimable: 101728 kB' 'SUnreclaim: 219324 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.113 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.113 09:50:55 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.114 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.114 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.114 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.114 09:50:55 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.114 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.114 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.114 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.114 09:50:55 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.114 09:50:55 -- setup/common.sh@32 -- # continue 00:04:50.114 09:50:55 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.114 09:50:55 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.114 09:50:55 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.114 09:50:55 -- setup/common.sh@33 -- # echo 0 00:04:50.114 09:50:55 -- setup/common.sh@33 -- # return 0 00:04:50.114 09:50:55 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:50.114 09:50:55 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:50.114 09:50:55 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:50.114 09:50:55 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:50.114 09:50:55 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:50.114 node0=1024 expecting 1024 00:04:50.114 09:50:55 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:50.114 09:50:55 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:04:50.114 09:50:55 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:04:50.114 09:50:55 -- setup/hugepages.sh@202 -- # setup output 00:04:50.114 09:50:55 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:50.114 09:50:55 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:51.488 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:51.488 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:51.488 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:51.488 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:51.488 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:51.488 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:51.488 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:51.488 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:51.488 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:51.488 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:51.488 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:51.488 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:51.489 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:51.489 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:51.489 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:51.489 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:51.489 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:51.489 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:04:51.489 09:50:57 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:04:51.489 09:50:57 -- setup/hugepages.sh@89 -- # local node 00:04:51.489 09:50:57 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:51.489 09:50:57 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:51.489 09:50:57 -- setup/hugepages.sh@92 -- # local surp 00:04:51.489 09:50:57 -- setup/hugepages.sh@93 -- # local resv 00:04:51.489 09:50:57 -- setup/hugepages.sh@94 -- # local anon 00:04:51.489 09:50:57 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:51.489 09:50:57 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:51.489 09:50:57 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:51.489 09:50:57 -- setup/common.sh@18 -- # local node= 00:04:51.489 09:50:57 -- setup/common.sh@19 -- # local var val 00:04:51.489 09:50:57 -- setup/common.sh@20 -- # local mem_f mem 00:04:51.489 09:50:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:51.489 09:50:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:51.489 09:50:57 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:51.489 09:50:57 -- setup/common.sh@28 -- # mapfile -t mem 00:04:51.489 09:50:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.489 09:50:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 43821052 kB' 'MemAvailable: 47328644 kB' 'Buffers: 2704 kB' 'Cached: 12243048 kB' 'SwapCached: 0 kB' 'Active: 9252460 kB' 'Inactive: 3506552 kB' 'Active(anon): 8858108 kB' 'Inactive(anon): 0 kB' 'Active(file): 394352 kB' 'Inactive(file): 3506552 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 516512 kB' 'Mapped: 180752 kB' 'Shmem: 8344848 kB' 'KReclaimable: 200620 kB' 'Slab: 573128 kB' 'SReclaimable: 200620 kB' 'SUnreclaim: 372508 kB' 'KernelStack: 12816 kB' 'PageTables: 7756 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610880 kB' 'Committed_AS: 9983272 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196176 kB' 'VmallocChunk: 0 kB' 'Percpu: 35328 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1838684 kB' 'DirectMap2M: 15906816 kB' 'DirectMap1G: 51380224 kB' 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.489 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.489 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.490 09:50:57 -- setup/common.sh@33 -- # echo 0 00:04:51.490 09:50:57 -- setup/common.sh@33 -- # return 0 00:04:51.490 09:50:57 -- setup/hugepages.sh@97 -- # anon=0 00:04:51.490 09:50:57 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:51.490 09:50:57 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:51.490 09:50:57 -- setup/common.sh@18 -- # local node= 00:04:51.490 09:50:57 -- setup/common.sh@19 -- # local var val 00:04:51.490 09:50:57 -- setup/common.sh@20 -- # local mem_f mem 00:04:51.490 09:50:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:51.490 09:50:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:51.490 09:50:57 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:51.490 09:50:57 -- setup/common.sh@28 -- # mapfile -t mem 00:04:51.490 09:50:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.490 09:50:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 43821996 kB' 'MemAvailable: 47329588 kB' 'Buffers: 2704 kB' 'Cached: 12243048 kB' 'SwapCached: 0 kB' 'Active: 9253016 kB' 'Inactive: 3506552 kB' 'Active(anon): 8858664 kB' 'Inactive(anon): 0 kB' 'Active(file): 394352 kB' 'Inactive(file): 3506552 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 517128 kB' 'Mapped: 180712 kB' 'Shmem: 8344848 kB' 'KReclaimable: 200620 kB' 'Slab: 573092 kB' 'SReclaimable: 200620 kB' 'SUnreclaim: 372472 kB' 'KernelStack: 12816 kB' 'PageTables: 7748 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610880 kB' 'Committed_AS: 9971220 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196144 kB' 'VmallocChunk: 0 kB' 'Percpu: 35328 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1838684 kB' 'DirectMap2M: 15906816 kB' 'DirectMap1G: 51380224 kB' 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.490 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.490 09:50:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.491 09:50:57 -- setup/common.sh@33 -- # echo 0 00:04:51.491 09:50:57 -- setup/common.sh@33 -- # return 0 00:04:51.491 09:50:57 -- setup/hugepages.sh@99 -- # surp=0 00:04:51.491 09:50:57 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:51.491 09:50:57 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:51.491 09:50:57 -- setup/common.sh@18 -- # local node= 00:04:51.491 09:50:57 -- setup/common.sh@19 -- # local var val 00:04:51.491 09:50:57 -- setup/common.sh@20 -- # local mem_f mem 00:04:51.491 09:50:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:51.491 09:50:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:51.491 09:50:57 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:51.491 09:50:57 -- setup/common.sh@28 -- # mapfile -t mem 00:04:51.491 09:50:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.491 09:50:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 43823048 kB' 'MemAvailable: 47330640 kB' 'Buffers: 2704 kB' 'Cached: 12243052 kB' 'SwapCached: 0 kB' 'Active: 9251784 kB' 'Inactive: 3506552 kB' 'Active(anon): 8857432 kB' 'Inactive(anon): 0 kB' 'Active(file): 394352 kB' 'Inactive(file): 3506552 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 515820 kB' 'Mapped: 180632 kB' 'Shmem: 8344852 kB' 'KReclaimable: 200620 kB' 'Slab: 573112 kB' 'SReclaimable: 200620 kB' 'SUnreclaim: 372492 kB' 'KernelStack: 12800 kB' 'PageTables: 7664 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610880 kB' 'Committed_AS: 9971240 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196144 kB' 'VmallocChunk: 0 kB' 'Percpu: 35328 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1838684 kB' 'DirectMap2M: 15906816 kB' 'DirectMap1G: 51380224 kB' 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.491 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.491 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.492 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.492 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.493 09:50:57 -- setup/common.sh@33 -- # echo 0 00:04:51.493 09:50:57 -- setup/common.sh@33 -- # return 0 00:04:51.493 09:50:57 -- setup/hugepages.sh@100 -- # resv=0 00:04:51.493 09:50:57 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:51.493 nr_hugepages=1024 00:04:51.493 09:50:57 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:51.493 resv_hugepages=0 00:04:51.493 09:50:57 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:51.493 surplus_hugepages=0 00:04:51.493 09:50:57 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:51.493 anon_hugepages=0 00:04:51.493 09:50:57 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:51.493 09:50:57 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:51.493 09:50:57 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:51.493 09:50:57 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:51.493 09:50:57 -- setup/common.sh@18 -- # local node= 00:04:51.493 09:50:57 -- setup/common.sh@19 -- # local var val 00:04:51.493 09:50:57 -- setup/common.sh@20 -- # local mem_f mem 00:04:51.493 09:50:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:51.493 09:50:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:51.493 09:50:57 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:51.493 09:50:57 -- setup/common.sh@28 -- # mapfile -t mem 00:04:51.493 09:50:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.493 09:50:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 43822796 kB' 'MemAvailable: 47330388 kB' 'Buffers: 2704 kB' 'Cached: 12243080 kB' 'SwapCached: 0 kB' 'Active: 9252276 kB' 'Inactive: 3506552 kB' 'Active(anon): 8857924 kB' 'Inactive(anon): 0 kB' 'Active(file): 394352 kB' 'Inactive(file): 3506552 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 516308 kB' 'Mapped: 180632 kB' 'Shmem: 8344880 kB' 'KReclaimable: 200620 kB' 'Slab: 573112 kB' 'SReclaimable: 200620 kB' 'SUnreclaim: 372492 kB' 'KernelStack: 12832 kB' 'PageTables: 7784 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610880 kB' 'Committed_AS: 9971620 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196144 kB' 'VmallocChunk: 0 kB' 'Percpu: 35328 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1838684 kB' 'DirectMap2M: 15906816 kB' 'DirectMap1G: 51380224 kB' 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.493 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.493 09:50:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.494 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.494 09:50:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.494 09:50:57 -- setup/common.sh@33 -- # echo 1024 00:04:51.494 09:50:57 -- setup/common.sh@33 -- # return 0 00:04:51.494 09:50:57 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:51.494 09:50:57 -- setup/hugepages.sh@112 -- # get_nodes 00:04:51.494 09:50:57 -- setup/hugepages.sh@27 -- # local node 00:04:51.494 09:50:57 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:51.494 09:50:57 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:51.494 09:50:57 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:51.494 09:50:57 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:51.494 09:50:57 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:51.494 09:50:57 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:51.494 09:50:57 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:51.494 09:50:57 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:51.494 09:50:57 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:51.495 09:50:57 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:51.495 09:50:57 -- setup/common.sh@18 -- # local node=0 00:04:51.495 09:50:57 -- setup/common.sh@19 -- # local var val 00:04:51.495 09:50:57 -- setup/common.sh@20 -- # local mem_f mem 00:04:51.495 09:50:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:51.495 09:50:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:51.495 09:50:57 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:51.495 09:50:57 -- setup/common.sh@28 -- # mapfile -t mem 00:04:51.495 09:50:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.495 09:50:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32829884 kB' 'MemFree: 25764560 kB' 'MemUsed: 7065324 kB' 'SwapCached: 0 kB' 'Active: 3903488 kB' 'Inactive: 110044 kB' 'Active(anon): 3792600 kB' 'Inactive(anon): 0 kB' 'Active(file): 110888 kB' 'Inactive(file): 110044 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3756428 kB' 'Mapped: 36888 kB' 'AnonPages: 260236 kB' 'Shmem: 3535496 kB' 'KernelStack: 6856 kB' 'PageTables: 4276 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 101728 kB' 'Slab: 321052 kB' 'SReclaimable: 101728 kB' 'SUnreclaim: 219324 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.495 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.495 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.496 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.496 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.496 09:50:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.496 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.496 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.496 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.496 09:50:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.496 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.496 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.496 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.496 09:50:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.496 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.496 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.496 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.496 09:50:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.496 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.496 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.496 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.496 09:50:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.496 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.496 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.496 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.496 09:50:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.496 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.496 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.496 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.496 09:50:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.496 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.496 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.496 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.496 09:50:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.496 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.496 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.496 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.496 09:50:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.496 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.496 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.496 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.496 09:50:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.496 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.496 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.496 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.496 09:50:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.496 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.496 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.496 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.496 09:50:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.496 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.496 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.496 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.496 09:50:57 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.496 09:50:57 -- setup/common.sh@32 -- # continue 00:04:51.496 09:50:57 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.496 09:50:57 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.496 09:50:57 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.496 09:50:57 -- setup/common.sh@33 -- # echo 0 00:04:51.496 09:50:57 -- setup/common.sh@33 -- # return 0 00:04:51.496 09:50:57 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:51.496 09:50:57 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:51.496 09:50:57 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:51.496 09:50:57 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:51.496 09:50:57 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:51.496 node0=1024 expecting 1024 00:04:51.496 09:50:57 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:51.496 00:04:51.496 real 0m2.885s 00:04:51.496 user 0m1.198s 00:04:51.496 sys 0m1.618s 00:04:51.496 09:50:57 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:51.496 09:50:57 -- common/autotest_common.sh@10 -- # set +x 00:04:51.496 ************************************ 00:04:51.496 END TEST no_shrink_alloc 00:04:51.496 ************************************ 00:04:51.496 09:50:57 -- setup/hugepages.sh@217 -- # clear_hp 00:04:51.496 09:50:57 -- setup/hugepages.sh@37 -- # local node hp 00:04:51.496 09:50:57 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:51.496 09:50:57 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:51.496 09:50:57 -- setup/hugepages.sh@41 -- # echo 0 00:04:51.496 09:50:57 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:51.496 09:50:57 -- setup/hugepages.sh@41 -- # echo 0 00:04:51.496 09:50:57 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:51.496 09:50:57 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:51.496 09:50:57 -- setup/hugepages.sh@41 -- # echo 0 00:04:51.496 09:50:57 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:51.496 09:50:57 -- setup/hugepages.sh@41 -- # echo 0 00:04:51.496 09:50:57 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:04:51.496 09:50:57 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:04:51.496 00:04:51.496 real 0m11.294s 00:04:51.496 user 0m4.365s 00:04:51.496 sys 0m5.810s 00:04:51.754 09:50:57 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:51.754 09:50:57 -- common/autotest_common.sh@10 -- # set +x 00:04:51.754 ************************************ 00:04:51.754 END TEST hugepages 00:04:51.754 ************************************ 00:04:51.754 09:50:57 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:04:51.754 09:50:57 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:51.754 09:50:57 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:51.754 09:50:57 -- common/autotest_common.sh@10 -- # set +x 00:04:51.754 ************************************ 00:04:51.754 START TEST driver 00:04:51.754 ************************************ 00:04:51.754 09:50:57 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:04:51.754 * Looking for test storage... 00:04:51.754 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:51.754 09:50:57 -- setup/driver.sh@68 -- # setup reset 00:04:51.754 09:50:57 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:51.754 09:50:57 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:54.284 09:50:59 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:04:54.284 09:50:59 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:54.284 09:50:59 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:54.284 09:50:59 -- common/autotest_common.sh@10 -- # set +x 00:04:54.284 ************************************ 00:04:54.284 START TEST guess_driver 00:04:54.284 ************************************ 00:04:54.284 09:50:59 -- common/autotest_common.sh@1104 -- # guess_driver 00:04:54.284 09:50:59 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:04:54.284 09:50:59 -- setup/driver.sh@47 -- # local fail=0 00:04:54.284 09:50:59 -- setup/driver.sh@49 -- # pick_driver 00:04:54.284 09:50:59 -- setup/driver.sh@36 -- # vfio 00:04:54.284 09:50:59 -- setup/driver.sh@21 -- # local iommu_grups 00:04:54.284 09:50:59 -- setup/driver.sh@22 -- # local unsafe_vfio 00:04:54.284 09:50:59 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:04:54.284 09:50:59 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:04:54.284 09:50:59 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:04:54.284 09:50:59 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:04:54.284 09:50:59 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:04:54.284 09:50:59 -- setup/driver.sh@14 -- # mod vfio_pci 00:04:54.284 09:50:59 -- setup/driver.sh@12 -- # dep vfio_pci 00:04:54.284 09:50:59 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:04:54.284 09:50:59 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:04:54.284 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:04:54.284 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:04:54.284 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:04:54.284 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:04:54.284 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:04:54.284 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:04:54.284 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:04:54.284 09:50:59 -- setup/driver.sh@30 -- # return 0 00:04:54.284 09:50:59 -- setup/driver.sh@37 -- # echo vfio-pci 00:04:54.284 09:50:59 -- setup/driver.sh@49 -- # driver=vfio-pci 00:04:54.284 09:50:59 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:04:54.284 09:50:59 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:04:54.284 Looking for driver=vfio-pci 00:04:54.284 09:50:59 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:54.284 09:50:59 -- setup/driver.sh@45 -- # setup output config 00:04:54.284 09:50:59 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:54.284 09:50:59 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:55.218 09:51:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:55.218 09:51:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:55.218 09:51:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:55.218 09:51:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:55.218 09:51:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:55.218 09:51:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:55.218 09:51:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:55.218 09:51:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:55.218 09:51:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:55.476 09:51:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:55.476 09:51:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:55.476 09:51:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:55.476 09:51:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:55.476 09:51:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:55.476 09:51:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:55.476 09:51:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:55.476 09:51:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:55.476 09:51:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:55.476 09:51:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:55.476 09:51:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:55.476 09:51:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:55.476 09:51:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:55.476 09:51:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:55.476 09:51:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:55.476 09:51:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:55.476 09:51:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:55.476 09:51:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:55.476 09:51:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:55.476 09:51:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:55.476 09:51:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:55.476 09:51:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:55.476 09:51:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:55.476 09:51:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:55.476 09:51:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:55.476 09:51:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:55.476 09:51:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:55.476 09:51:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:55.476 09:51:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:55.476 09:51:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:55.476 09:51:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:55.476 09:51:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:55.476 09:51:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:55.476 09:51:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:55.476 09:51:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:55.476 09:51:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:55.476 09:51:01 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:55.476 09:51:01 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:55.476 09:51:01 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:56.409 09:51:02 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:56.409 09:51:02 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:56.409 09:51:02 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:56.409 09:51:02 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:04:56.409 09:51:02 -- setup/driver.sh@65 -- # setup reset 00:04:56.409 09:51:02 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:56.409 09:51:02 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:58.937 00:04:58.937 real 0m4.779s 00:04:58.937 user 0m1.092s 00:04:58.937 sys 0m1.808s 00:04:58.937 09:51:04 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:58.937 09:51:04 -- common/autotest_common.sh@10 -- # set +x 00:04:58.937 ************************************ 00:04:58.937 END TEST guess_driver 00:04:58.937 ************************************ 00:04:58.937 00:04:58.937 real 0m7.267s 00:04:58.937 user 0m1.638s 00:04:58.937 sys 0m2.771s 00:04:58.937 09:51:04 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:58.937 09:51:04 -- common/autotest_common.sh@10 -- # set +x 00:04:58.937 ************************************ 00:04:58.937 END TEST driver 00:04:58.937 ************************************ 00:04:58.937 09:51:04 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:04:58.937 09:51:04 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:58.937 09:51:04 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:58.937 09:51:04 -- common/autotest_common.sh@10 -- # set +x 00:04:58.937 ************************************ 00:04:58.937 START TEST devices 00:04:58.937 ************************************ 00:04:58.937 09:51:04 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:04:58.937 * Looking for test storage... 00:04:58.937 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:58.937 09:51:04 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:04:58.937 09:51:04 -- setup/devices.sh@192 -- # setup reset 00:04:58.937 09:51:04 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:58.937 09:51:04 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:00.865 09:51:06 -- setup/devices.sh@194 -- # get_zoned_devs 00:05:00.865 09:51:06 -- common/autotest_common.sh@1654 -- # zoned_devs=() 00:05:00.865 09:51:06 -- common/autotest_common.sh@1654 -- # local -gA zoned_devs 00:05:00.865 09:51:06 -- common/autotest_common.sh@1655 -- # local nvme bdf 00:05:00.865 09:51:06 -- common/autotest_common.sh@1657 -- # for nvme in /sys/block/nvme* 00:05:00.865 09:51:06 -- common/autotest_common.sh@1658 -- # is_block_zoned nvme0n1 00:05:00.865 09:51:06 -- common/autotest_common.sh@1647 -- # local device=nvme0n1 00:05:00.865 09:51:06 -- common/autotest_common.sh@1649 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:05:00.865 09:51:06 -- common/autotest_common.sh@1650 -- # [[ none != none ]] 00:05:00.865 09:51:06 -- setup/devices.sh@196 -- # blocks=() 00:05:00.865 09:51:06 -- setup/devices.sh@196 -- # declare -a blocks 00:05:00.865 09:51:06 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:05:00.865 09:51:06 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:05:00.865 09:51:06 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:05:00.865 09:51:06 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:05:00.866 09:51:06 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:05:00.866 09:51:06 -- setup/devices.sh@201 -- # ctrl=nvme0 00:05:00.866 09:51:06 -- setup/devices.sh@202 -- # pci=0000:88:00.0 00:05:00.866 09:51:06 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:05:00.866 09:51:06 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:05:00.866 09:51:06 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:05:00.866 09:51:06 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:05:00.866 No valid GPT data, bailing 00:05:00.866 09:51:06 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:05:00.866 09:51:06 -- scripts/common.sh@393 -- # pt= 00:05:00.866 09:51:06 -- scripts/common.sh@394 -- # return 1 00:05:00.866 09:51:06 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:05:00.866 09:51:06 -- setup/common.sh@76 -- # local dev=nvme0n1 00:05:00.866 09:51:06 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:05:00.866 09:51:06 -- setup/common.sh@80 -- # echo 1000204886016 00:05:00.866 09:51:06 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:05:00.866 09:51:06 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:05:00.866 09:51:06 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:88:00.0 00:05:00.866 09:51:06 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:05:00.866 09:51:06 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:05:00.866 09:51:06 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:05:00.866 09:51:06 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:00.866 09:51:06 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:00.866 09:51:06 -- common/autotest_common.sh@10 -- # set +x 00:05:00.866 ************************************ 00:05:00.866 START TEST nvme_mount 00:05:00.866 ************************************ 00:05:00.866 09:51:06 -- common/autotest_common.sh@1104 -- # nvme_mount 00:05:00.866 09:51:06 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:05:00.866 09:51:06 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:05:00.866 09:51:06 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:00.866 09:51:06 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:00.866 09:51:06 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:05:00.866 09:51:06 -- setup/common.sh@39 -- # local disk=nvme0n1 00:05:00.866 09:51:06 -- setup/common.sh@40 -- # local part_no=1 00:05:00.866 09:51:06 -- setup/common.sh@41 -- # local size=1073741824 00:05:00.866 09:51:06 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:05:00.866 09:51:06 -- setup/common.sh@44 -- # parts=() 00:05:00.866 09:51:06 -- setup/common.sh@44 -- # local parts 00:05:00.866 09:51:06 -- setup/common.sh@46 -- # (( part = 1 )) 00:05:00.866 09:51:06 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:00.866 09:51:06 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:05:00.866 09:51:06 -- setup/common.sh@46 -- # (( part++ )) 00:05:00.866 09:51:06 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:00.866 09:51:06 -- setup/common.sh@51 -- # (( size /= 512 )) 00:05:00.866 09:51:06 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:05:00.866 09:51:06 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:05:01.433 Creating new GPT entries in memory. 00:05:01.433 GPT data structures destroyed! You may now partition the disk using fdisk or 00:05:01.433 other utilities. 00:05:01.433 09:51:07 -- setup/common.sh@57 -- # (( part = 1 )) 00:05:01.433 09:51:07 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:01.433 09:51:07 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:01.433 09:51:07 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:01.433 09:51:07 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:05:02.809 Creating new GPT entries in memory. 00:05:02.809 The operation has completed successfully. 00:05:02.809 09:51:08 -- setup/common.sh@57 -- # (( part++ )) 00:05:02.809 09:51:08 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:02.809 09:51:08 -- setup/common.sh@62 -- # wait 2678274 00:05:02.809 09:51:08 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:02.809 09:51:08 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:05:02.809 09:51:08 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:02.810 09:51:08 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:05:02.810 09:51:08 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:05:02.810 09:51:08 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:02.810 09:51:08 -- setup/devices.sh@105 -- # verify 0000:88:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:02.810 09:51:08 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:02.810 09:51:08 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:05:02.810 09:51:08 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:02.810 09:51:08 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:02.810 09:51:08 -- setup/devices.sh@53 -- # local found=0 00:05:02.810 09:51:08 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:02.810 09:51:08 -- setup/devices.sh@56 -- # : 00:05:02.810 09:51:08 -- setup/devices.sh@59 -- # local pci status 00:05:02.810 09:51:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.810 09:51:08 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:02.810 09:51:08 -- setup/devices.sh@47 -- # setup output config 00:05:02.810 09:51:08 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:02.810 09:51:08 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:03.744 09:51:09 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.744 09:51:09 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:05:03.744 09:51:09 -- setup/devices.sh@63 -- # found=1 00:05:03.744 09:51:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.744 09:51:09 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.744 09:51:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.744 09:51:09 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.744 09:51:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.744 09:51:09 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.744 09:51:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.744 09:51:09 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.744 09:51:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.744 09:51:09 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.744 09:51:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.744 09:51:09 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.744 09:51:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.744 09:51:09 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.744 09:51:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.744 09:51:09 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.744 09:51:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.744 09:51:09 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.744 09:51:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.744 09:51:09 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.744 09:51:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.744 09:51:09 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.744 09:51:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.744 09:51:09 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.744 09:51:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.744 09:51:09 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.744 09:51:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.744 09:51:09 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.744 09:51:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.744 09:51:09 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.744 09:51:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.744 09:51:09 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.744 09:51:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.744 09:51:09 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:03.744 09:51:09 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:05:03.744 09:51:09 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:03.744 09:51:09 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:03.744 09:51:09 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:03.744 09:51:09 -- setup/devices.sh@110 -- # cleanup_nvme 00:05:03.744 09:51:09 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:03.744 09:51:09 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:03.744 09:51:09 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:03.744 09:51:09 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:05:03.744 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:03.744 09:51:09 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:03.744 09:51:09 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:04.003 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:05:04.003 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:05:04.003 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:05:04.003 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:05:04.003 09:51:09 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:05:04.003 09:51:09 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:05:04.003 09:51:09 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:04.003 09:51:09 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:05:04.003 09:51:09 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:05:04.003 09:51:09 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:04.261 09:51:09 -- setup/devices.sh@116 -- # verify 0000:88:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:04.261 09:51:09 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:04.261 09:51:09 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:05:04.261 09:51:09 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:04.261 09:51:09 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:04.261 09:51:09 -- setup/devices.sh@53 -- # local found=0 00:05:04.261 09:51:09 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:04.261 09:51:09 -- setup/devices.sh@56 -- # : 00:05:04.261 09:51:09 -- setup/devices.sh@59 -- # local pci status 00:05:04.261 09:51:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:04.261 09:51:09 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:04.261 09:51:09 -- setup/devices.sh@47 -- # setup output config 00:05:04.261 09:51:09 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:04.261 09:51:09 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:05.196 09:51:10 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.196 09:51:10 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:05:05.196 09:51:10 -- setup/devices.sh@63 -- # found=1 00:05:05.196 09:51:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.196 09:51:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.196 09:51:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.196 09:51:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.196 09:51:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.196 09:51:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.196 09:51:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.196 09:51:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.196 09:51:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.196 09:51:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.196 09:51:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.196 09:51:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.196 09:51:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.196 09:51:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.196 09:51:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.196 09:51:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.196 09:51:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.196 09:51:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.196 09:51:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.196 09:51:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.196 09:51:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.196 09:51:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.196 09:51:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.196 09:51:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.196 09:51:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.196 09:51:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.196 09:51:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.196 09:51:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.196 09:51:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.196 09:51:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.196 09:51:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.196 09:51:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.196 09:51:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.196 09:51:11 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:05.196 09:51:11 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:05:05.196 09:51:11 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:05.196 09:51:11 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:05.196 09:51:11 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:05.196 09:51:11 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:05.454 09:51:11 -- setup/devices.sh@125 -- # verify 0000:88:00.0 data@nvme0n1 '' '' 00:05:05.454 09:51:11 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:05.454 09:51:11 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:05:05.454 09:51:11 -- setup/devices.sh@50 -- # local mount_point= 00:05:05.454 09:51:11 -- setup/devices.sh@51 -- # local test_file= 00:05:05.454 09:51:11 -- setup/devices.sh@53 -- # local found=0 00:05:05.454 09:51:11 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:05:05.454 09:51:11 -- setup/devices.sh@59 -- # local pci status 00:05:05.454 09:51:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.454 09:51:11 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:05.454 09:51:11 -- setup/devices.sh@47 -- # setup output config 00:05:05.454 09:51:11 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:05.454 09:51:11 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:06.387 09:51:11 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:06.387 09:51:11 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:05:06.387 09:51:11 -- setup/devices.sh@63 -- # found=1 00:05:06.387 09:51:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.387 09:51:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:06.387 09:51:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.387 09:51:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:06.387 09:51:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.387 09:51:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:06.387 09:51:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.387 09:51:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:06.387 09:51:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.387 09:51:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:06.387 09:51:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.387 09:51:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:06.387 09:51:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.387 09:51:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:06.387 09:51:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.387 09:51:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:06.387 09:51:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.387 09:51:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:06.387 09:51:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.387 09:51:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:06.387 09:51:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.387 09:51:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:06.387 09:51:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.387 09:51:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:06.387 09:51:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.387 09:51:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:06.387 09:51:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.387 09:51:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:06.387 09:51:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.387 09:51:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:06.387 09:51:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.387 09:51:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:06.387 09:51:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.645 09:51:12 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:06.645 09:51:12 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:05:06.645 09:51:12 -- setup/devices.sh@68 -- # return 0 00:05:06.645 09:51:12 -- setup/devices.sh@128 -- # cleanup_nvme 00:05:06.645 09:51:12 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:06.645 09:51:12 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:06.645 09:51:12 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:06.645 09:51:12 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:06.645 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:06.645 00:05:06.645 real 0m5.990s 00:05:06.645 user 0m1.319s 00:05:06.645 sys 0m2.266s 00:05:06.645 09:51:12 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:06.645 09:51:12 -- common/autotest_common.sh@10 -- # set +x 00:05:06.645 ************************************ 00:05:06.645 END TEST nvme_mount 00:05:06.645 ************************************ 00:05:06.645 09:51:12 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:05:06.645 09:51:12 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:06.645 09:51:12 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:06.645 09:51:12 -- common/autotest_common.sh@10 -- # set +x 00:05:06.645 ************************************ 00:05:06.645 START TEST dm_mount 00:05:06.645 ************************************ 00:05:06.645 09:51:12 -- common/autotest_common.sh@1104 -- # dm_mount 00:05:06.645 09:51:12 -- setup/devices.sh@144 -- # pv=nvme0n1 00:05:06.645 09:51:12 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:05:06.645 09:51:12 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:05:06.645 09:51:12 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:05:06.645 09:51:12 -- setup/common.sh@39 -- # local disk=nvme0n1 00:05:06.645 09:51:12 -- setup/common.sh@40 -- # local part_no=2 00:05:06.645 09:51:12 -- setup/common.sh@41 -- # local size=1073741824 00:05:06.645 09:51:12 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:05:06.645 09:51:12 -- setup/common.sh@44 -- # parts=() 00:05:06.645 09:51:12 -- setup/common.sh@44 -- # local parts 00:05:06.645 09:51:12 -- setup/common.sh@46 -- # (( part = 1 )) 00:05:06.645 09:51:12 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:06.645 09:51:12 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:05:06.645 09:51:12 -- setup/common.sh@46 -- # (( part++ )) 00:05:06.646 09:51:12 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:06.646 09:51:12 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:05:06.646 09:51:12 -- setup/common.sh@46 -- # (( part++ )) 00:05:06.646 09:51:12 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:06.646 09:51:12 -- setup/common.sh@51 -- # (( size /= 512 )) 00:05:06.646 09:51:12 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:05:06.646 09:51:12 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:05:07.580 Creating new GPT entries in memory. 00:05:07.580 GPT data structures destroyed! You may now partition the disk using fdisk or 00:05:07.580 other utilities. 00:05:07.580 09:51:13 -- setup/common.sh@57 -- # (( part = 1 )) 00:05:07.580 09:51:13 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:07.580 09:51:13 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:07.580 09:51:13 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:07.580 09:51:13 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:05:08.512 Creating new GPT entries in memory. 00:05:08.512 The operation has completed successfully. 00:05:08.512 09:51:14 -- setup/common.sh@57 -- # (( part++ )) 00:05:08.512 09:51:14 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:08.512 09:51:14 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:08.512 09:51:14 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:08.512 09:51:14 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:05:09.885 The operation has completed successfully. 00:05:09.885 09:51:15 -- setup/common.sh@57 -- # (( part++ )) 00:05:09.885 09:51:15 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:09.885 09:51:15 -- setup/common.sh@62 -- # wait 2681130 00:05:09.885 09:51:15 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:05:09.885 09:51:15 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:09.885 09:51:15 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:09.885 09:51:15 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:05:09.885 09:51:15 -- setup/devices.sh@160 -- # for t in {1..5} 00:05:09.885 09:51:15 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:09.885 09:51:15 -- setup/devices.sh@161 -- # break 00:05:09.885 09:51:15 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:09.885 09:51:15 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:05:09.885 09:51:15 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:05:09.885 09:51:15 -- setup/devices.sh@166 -- # dm=dm-0 00:05:09.885 09:51:15 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:05:09.885 09:51:15 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:05:09.885 09:51:15 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:09.885 09:51:15 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:05:09.885 09:51:15 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:09.885 09:51:15 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:09.885 09:51:15 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:05:09.885 09:51:15 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:09.885 09:51:15 -- setup/devices.sh@174 -- # verify 0000:88:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:09.885 09:51:15 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:09.885 09:51:15 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:05:09.885 09:51:15 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:09.885 09:51:15 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:09.885 09:51:15 -- setup/devices.sh@53 -- # local found=0 00:05:09.885 09:51:15 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:05:09.885 09:51:15 -- setup/devices.sh@56 -- # : 00:05:09.885 09:51:15 -- setup/devices.sh@59 -- # local pci status 00:05:09.885 09:51:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.885 09:51:15 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:09.885 09:51:15 -- setup/devices.sh@47 -- # setup output config 00:05:09.885 09:51:15 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:09.885 09:51:15 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:10.819 09:51:16 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.819 09:51:16 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:05:10.819 09:51:16 -- setup/devices.sh@63 -- # found=1 00:05:10.819 09:51:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.819 09:51:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.819 09:51:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.819 09:51:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.819 09:51:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.819 09:51:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.819 09:51:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.819 09:51:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.819 09:51:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.819 09:51:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.819 09:51:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.819 09:51:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.819 09:51:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.819 09:51:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.819 09:51:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.819 09:51:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.819 09:51:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.819 09:51:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.819 09:51:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.819 09:51:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.819 09:51:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.819 09:51:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.819 09:51:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.819 09:51:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.819 09:51:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.819 09:51:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.819 09:51:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.819 09:51:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.819 09:51:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.819 09:51:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.819 09:51:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.819 09:51:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.819 09:51:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.078 09:51:16 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:11.078 09:51:16 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:05:11.078 09:51:16 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:11.078 09:51:16 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:05:11.078 09:51:16 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:11.078 09:51:16 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:11.078 09:51:16 -- setup/devices.sh@184 -- # verify 0000:88:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:05:11.078 09:51:16 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:11.078 09:51:16 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:05:11.078 09:51:16 -- setup/devices.sh@50 -- # local mount_point= 00:05:11.078 09:51:16 -- setup/devices.sh@51 -- # local test_file= 00:05:11.078 09:51:16 -- setup/devices.sh@53 -- # local found=0 00:05:11.078 09:51:16 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:05:11.078 09:51:16 -- setup/devices.sh@59 -- # local pci status 00:05:11.078 09:51:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.078 09:51:16 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:11.078 09:51:16 -- setup/devices.sh@47 -- # setup output config 00:05:11.078 09:51:16 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:11.078 09:51:16 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:12.014 09:51:17 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.014 09:51:17 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:05:12.014 09:51:17 -- setup/devices.sh@63 -- # found=1 00:05:12.014 09:51:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.014 09:51:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.014 09:51:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.014 09:51:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.014 09:51:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.014 09:51:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.014 09:51:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.014 09:51:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.014 09:51:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.014 09:51:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.014 09:51:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.014 09:51:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.014 09:51:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.014 09:51:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.014 09:51:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.014 09:51:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.014 09:51:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.014 09:51:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.014 09:51:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.014 09:51:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.014 09:51:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.014 09:51:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.014 09:51:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.014 09:51:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.014 09:51:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.014 09:51:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.014 09:51:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.014 09:51:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.014 09:51:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.014 09:51:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.014 09:51:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.014 09:51:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:12.014 09:51:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:12.274 09:51:17 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:12.274 09:51:17 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:05:12.274 09:51:17 -- setup/devices.sh@68 -- # return 0 00:05:12.274 09:51:17 -- setup/devices.sh@187 -- # cleanup_dm 00:05:12.274 09:51:17 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:12.274 09:51:17 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:05:12.274 09:51:17 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:05:12.274 09:51:17 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:12.274 09:51:17 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:05:12.274 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:12.274 09:51:17 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:05:12.274 09:51:17 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:05:12.274 00:05:12.274 real 0m5.687s 00:05:12.274 user 0m0.990s 00:05:12.274 sys 0m1.575s 00:05:12.274 09:51:17 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:12.274 09:51:17 -- common/autotest_common.sh@10 -- # set +x 00:05:12.274 ************************************ 00:05:12.274 END TEST dm_mount 00:05:12.274 ************************************ 00:05:12.274 09:51:17 -- setup/devices.sh@1 -- # cleanup 00:05:12.274 09:51:17 -- setup/devices.sh@11 -- # cleanup_nvme 00:05:12.274 09:51:17 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:12.274 09:51:17 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:12.274 09:51:17 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:05:12.274 09:51:17 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:12.274 09:51:17 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:12.532 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:05:12.532 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:05:12.532 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:05:12.532 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:05:12.532 09:51:18 -- setup/devices.sh@12 -- # cleanup_dm 00:05:12.532 09:51:18 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:12.532 09:51:18 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:05:12.532 09:51:18 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:12.532 09:51:18 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:05:12.532 09:51:18 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:05:12.532 09:51:18 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:05:12.532 00:05:12.532 real 0m13.611s 00:05:12.532 user 0m2.997s 00:05:12.532 sys 0m4.863s 00:05:12.532 09:51:18 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:12.532 09:51:18 -- common/autotest_common.sh@10 -- # set +x 00:05:12.532 ************************************ 00:05:12.532 END TEST devices 00:05:12.532 ************************************ 00:05:12.532 00:05:12.532 real 0m42.893s 00:05:12.532 user 0m12.333s 00:05:12.532 sys 0m18.847s 00:05:12.532 09:51:18 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:12.532 09:51:18 -- common/autotest_common.sh@10 -- # set +x 00:05:12.532 ************************************ 00:05:12.532 END TEST setup.sh 00:05:12.532 ************************************ 00:05:12.532 09:51:18 -- spdk/autotest.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:05:13.904 Hugepages 00:05:13.904 node hugesize free / total 00:05:13.904 node0 1048576kB 0 / 0 00:05:13.904 node0 2048kB 2048 / 2048 00:05:13.904 node1 1048576kB 0 / 0 00:05:13.904 node1 2048kB 0 / 0 00:05:13.904 00:05:13.904 Type BDF Vendor Device NUMA Driver Device Block devices 00:05:13.904 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:05:13.904 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:05:13.904 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:05:13.904 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:05:13.904 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:05:13.904 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:05:13.904 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:05:13.904 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:05:13.904 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:05:13.904 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:05:13.904 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:05:13.904 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:05:13.904 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:05:13.904 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:05:13.904 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:05:13.904 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:05:13.904 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:05:13.904 09:51:19 -- spdk/autotest.sh@141 -- # uname -s 00:05:13.904 09:51:19 -- spdk/autotest.sh@141 -- # [[ Linux == Linux ]] 00:05:13.904 09:51:19 -- spdk/autotest.sh@143 -- # nvme_namespace_revert 00:05:13.904 09:51:19 -- common/autotest_common.sh@1516 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:14.870 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:14.870 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:14.870 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:14.870 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:14.870 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:15.128 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:15.128 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:15.128 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:15.128 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:15.128 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:15.128 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:15.128 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:15.128 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:15.128 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:15.128 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:15.128 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:16.063 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:05:16.063 09:51:21 -- common/autotest_common.sh@1517 -- # sleep 1 00:05:17.437 09:51:22 -- common/autotest_common.sh@1518 -- # bdfs=() 00:05:17.437 09:51:22 -- common/autotest_common.sh@1518 -- # local bdfs 00:05:17.437 09:51:22 -- common/autotest_common.sh@1519 -- # bdfs=($(get_nvme_bdfs)) 00:05:17.437 09:51:22 -- common/autotest_common.sh@1519 -- # get_nvme_bdfs 00:05:17.437 09:51:22 -- common/autotest_common.sh@1498 -- # bdfs=() 00:05:17.437 09:51:22 -- common/autotest_common.sh@1498 -- # local bdfs 00:05:17.437 09:51:22 -- common/autotest_common.sh@1499 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:17.437 09:51:22 -- common/autotest_common.sh@1499 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:17.437 09:51:22 -- common/autotest_common.sh@1499 -- # jq -r '.config[].params.traddr' 00:05:17.437 09:51:22 -- common/autotest_common.sh@1500 -- # (( 1 == 0 )) 00:05:17.437 09:51:22 -- common/autotest_common.sh@1504 -- # printf '%s\n' 0000:88:00.0 00:05:17.437 09:51:22 -- common/autotest_common.sh@1521 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:18.369 Waiting for block devices as requested 00:05:18.369 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:05:18.627 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:05:18.627 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:05:18.627 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:05:18.886 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:05:18.886 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:05:18.886 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:05:18.886 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:05:19.145 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:05:19.145 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:05:19.145 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:05:19.145 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:05:19.403 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:05:19.403 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:05:19.403 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:05:19.403 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:05:19.660 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:05:19.660 09:51:25 -- common/autotest_common.sh@1523 -- # for bdf in "${bdfs[@]}" 00:05:19.660 09:51:25 -- common/autotest_common.sh@1524 -- # get_nvme_ctrlr_from_bdf 0000:88:00.0 00:05:19.660 09:51:25 -- common/autotest_common.sh@1487 -- # readlink -f /sys/class/nvme/nvme0 00:05:19.660 09:51:25 -- common/autotest_common.sh@1487 -- # grep 0000:88:00.0/nvme/nvme 00:05:19.660 09:51:25 -- common/autotest_common.sh@1487 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:05:19.660 09:51:25 -- common/autotest_common.sh@1488 -- # [[ -z /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 ]] 00:05:19.660 09:51:25 -- common/autotest_common.sh@1492 -- # basename /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:05:19.660 09:51:25 -- common/autotest_common.sh@1492 -- # printf '%s\n' nvme0 00:05:19.660 09:51:25 -- common/autotest_common.sh@1524 -- # nvme_ctrlr=/dev/nvme0 00:05:19.660 09:51:25 -- common/autotest_common.sh@1525 -- # [[ -z /dev/nvme0 ]] 00:05:19.660 09:51:25 -- common/autotest_common.sh@1530 -- # nvme id-ctrl /dev/nvme0 00:05:19.660 09:51:25 -- common/autotest_common.sh@1530 -- # grep oacs 00:05:19.660 09:51:25 -- common/autotest_common.sh@1530 -- # cut -d: -f2 00:05:19.660 09:51:25 -- common/autotest_common.sh@1530 -- # oacs=' 0xf' 00:05:19.660 09:51:25 -- common/autotest_common.sh@1531 -- # oacs_ns_manage=8 00:05:19.660 09:51:25 -- common/autotest_common.sh@1533 -- # [[ 8 -ne 0 ]] 00:05:19.660 09:51:25 -- common/autotest_common.sh@1539 -- # nvme id-ctrl /dev/nvme0 00:05:19.660 09:51:25 -- common/autotest_common.sh@1539 -- # grep unvmcap 00:05:19.660 09:51:25 -- common/autotest_common.sh@1539 -- # cut -d: -f2 00:05:19.660 09:51:25 -- common/autotest_common.sh@1539 -- # unvmcap=' 0' 00:05:19.660 09:51:25 -- common/autotest_common.sh@1540 -- # [[ 0 -eq 0 ]] 00:05:19.660 09:51:25 -- common/autotest_common.sh@1542 -- # continue 00:05:19.660 09:51:25 -- spdk/autotest.sh@146 -- # timing_exit pre_cleanup 00:05:19.660 09:51:25 -- common/autotest_common.sh@718 -- # xtrace_disable 00:05:19.660 09:51:25 -- common/autotest_common.sh@10 -- # set +x 00:05:19.660 09:51:25 -- spdk/autotest.sh@149 -- # timing_enter afterboot 00:05:19.660 09:51:25 -- common/autotest_common.sh@712 -- # xtrace_disable 00:05:19.660 09:51:25 -- common/autotest_common.sh@10 -- # set +x 00:05:19.660 09:51:25 -- spdk/autotest.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:21.034 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:21.034 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:21.034 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:21.034 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:21.034 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:21.034 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:21.034 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:21.034 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:21.034 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:21.034 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:21.034 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:21.034 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:21.034 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:21.034 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:21.034 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:21.034 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:21.970 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:05:21.970 09:51:27 -- spdk/autotest.sh@151 -- # timing_exit afterboot 00:05:21.970 09:51:27 -- common/autotest_common.sh@718 -- # xtrace_disable 00:05:21.970 09:51:27 -- common/autotest_common.sh@10 -- # set +x 00:05:21.970 09:51:27 -- spdk/autotest.sh@155 -- # opal_revert_cleanup 00:05:21.970 09:51:27 -- common/autotest_common.sh@1576 -- # mapfile -t bdfs 00:05:21.970 09:51:27 -- common/autotest_common.sh@1576 -- # get_nvme_bdfs_by_id 0x0a54 00:05:21.970 09:51:27 -- common/autotest_common.sh@1562 -- # bdfs=() 00:05:21.970 09:51:27 -- common/autotest_common.sh@1562 -- # local bdfs 00:05:21.970 09:51:27 -- common/autotest_common.sh@1564 -- # get_nvme_bdfs 00:05:21.970 09:51:27 -- common/autotest_common.sh@1498 -- # bdfs=() 00:05:21.970 09:51:27 -- common/autotest_common.sh@1498 -- # local bdfs 00:05:21.970 09:51:27 -- common/autotest_common.sh@1499 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:21.970 09:51:27 -- common/autotest_common.sh@1499 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:21.970 09:51:27 -- common/autotest_common.sh@1499 -- # jq -r '.config[].params.traddr' 00:05:22.228 09:51:27 -- common/autotest_common.sh@1500 -- # (( 1 == 0 )) 00:05:22.228 09:51:27 -- common/autotest_common.sh@1504 -- # printf '%s\n' 0000:88:00.0 00:05:22.228 09:51:27 -- common/autotest_common.sh@1564 -- # for bdf in $(get_nvme_bdfs) 00:05:22.228 09:51:27 -- common/autotest_common.sh@1565 -- # cat /sys/bus/pci/devices/0000:88:00.0/device 00:05:22.228 09:51:27 -- common/autotest_common.sh@1565 -- # device=0x0a54 00:05:22.228 09:51:27 -- common/autotest_common.sh@1566 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:05:22.228 09:51:27 -- common/autotest_common.sh@1567 -- # bdfs+=($bdf) 00:05:22.228 09:51:27 -- common/autotest_common.sh@1571 -- # printf '%s\n' 0000:88:00.0 00:05:22.228 09:51:27 -- common/autotest_common.sh@1577 -- # [[ -z 0000:88:00.0 ]] 00:05:22.228 09:51:27 -- common/autotest_common.sh@1582 -- # spdk_tgt_pid=2686527 00:05:22.228 09:51:27 -- common/autotest_common.sh@1581 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:22.228 09:51:27 -- common/autotest_common.sh@1583 -- # waitforlisten 2686527 00:05:22.228 09:51:27 -- common/autotest_common.sh@819 -- # '[' -z 2686527 ']' 00:05:22.228 09:51:27 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:22.228 09:51:27 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:22.228 09:51:27 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:22.228 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:22.228 09:51:27 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:22.228 09:51:27 -- common/autotest_common.sh@10 -- # set +x 00:05:22.228 [2024-07-13 09:51:27.848614] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:05:22.228 [2024-07-13 09:51:27.848693] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2686527 ] 00:05:22.228 EAL: No free 2048 kB hugepages reported on node 1 00:05:22.228 [2024-07-13 09:51:27.913174] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:22.228 [2024-07-13 09:51:28.005860] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:22.228 [2024-07-13 09:51:28.006069] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:23.160 09:51:28 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:23.160 09:51:28 -- common/autotest_common.sh@852 -- # return 0 00:05:23.160 09:51:28 -- common/autotest_common.sh@1585 -- # bdf_id=0 00:05:23.160 09:51:28 -- common/autotest_common.sh@1586 -- # for bdf in "${bdfs[@]}" 00:05:23.160 09:51:28 -- common/autotest_common.sh@1587 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:88:00.0 00:05:26.444 nvme0n1 00:05:26.444 09:51:31 -- common/autotest_common.sh@1589 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:05:26.444 [2024-07-13 09:51:32.129903] nvme_opal.c:2059:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:05:26.444 [2024-07-13 09:51:32.129965] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:05:26.444 request: 00:05:26.444 { 00:05:26.444 "nvme_ctrlr_name": "nvme0", 00:05:26.444 "password": "test", 00:05:26.444 "method": "bdev_nvme_opal_revert", 00:05:26.444 "req_id": 1 00:05:26.444 } 00:05:26.444 Got JSON-RPC error response 00:05:26.444 response: 00:05:26.444 { 00:05:26.444 "code": -32603, 00:05:26.444 "message": "Internal error" 00:05:26.444 } 00:05:26.444 09:51:32 -- common/autotest_common.sh@1589 -- # true 00:05:26.444 09:51:32 -- common/autotest_common.sh@1590 -- # (( ++bdf_id )) 00:05:26.444 09:51:32 -- common/autotest_common.sh@1593 -- # killprocess 2686527 00:05:26.444 09:51:32 -- common/autotest_common.sh@926 -- # '[' -z 2686527 ']' 00:05:26.444 09:51:32 -- common/autotest_common.sh@930 -- # kill -0 2686527 00:05:26.444 09:51:32 -- common/autotest_common.sh@931 -- # uname 00:05:26.444 09:51:32 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:26.444 09:51:32 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2686527 00:05:26.444 09:51:32 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:26.444 09:51:32 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:26.444 09:51:32 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2686527' 00:05:26.444 killing process with pid 2686527 00:05:26.444 09:51:32 -- common/autotest_common.sh@945 -- # kill 2686527 00:05:26.444 09:51:32 -- common/autotest_common.sh@950 -- # wait 2686527 00:05:26.444 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.444 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.444 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.444 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.444 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.444 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.444 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.444 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.444 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.444 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.444 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.444 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.444 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.444 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.444 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.444 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.444 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.444 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.444 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.444 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.444 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.444 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.444 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.444 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.444 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.444 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.444 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.444 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.444 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.444 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.444 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.445 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:26.703 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:28.600 09:51:33 -- spdk/autotest.sh@161 -- # '[' 0 -eq 1 ']' 00:05:28.600 09:51:33 -- spdk/autotest.sh@165 -- # '[' 1 -eq 1 ']' 00:05:28.600 09:51:33 -- spdk/autotest.sh@166 -- # [[ 0 -eq 1 ]] 00:05:28.600 09:51:33 -- spdk/autotest.sh@166 -- # [[ 0 -eq 1 ]] 00:05:28.600 09:51:33 -- spdk/autotest.sh@173 -- # timing_enter lib 00:05:28.600 09:51:33 -- common/autotest_common.sh@712 -- # xtrace_disable 00:05:28.600 09:51:33 -- common/autotest_common.sh@10 -- # set +x 00:05:28.600 09:51:33 -- spdk/autotest.sh@175 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:05:28.600 09:51:33 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:28.600 09:51:33 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:28.600 09:51:33 -- common/autotest_common.sh@10 -- # set +x 00:05:28.601 ************************************ 00:05:28.601 START TEST env 00:05:28.601 ************************************ 00:05:28.601 09:51:33 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:05:28.601 * Looking for test storage... 00:05:28.601 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:05:28.601 09:51:34 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:05:28.601 09:51:34 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:28.601 09:51:34 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:28.601 09:51:34 -- common/autotest_common.sh@10 -- # set +x 00:05:28.601 ************************************ 00:05:28.601 START TEST env_memory 00:05:28.601 ************************************ 00:05:28.601 09:51:34 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:05:28.601 00:05:28.601 00:05:28.601 CUnit - A unit testing framework for C - Version 2.1-3 00:05:28.601 http://cunit.sourceforge.net/ 00:05:28.601 00:05:28.601 00:05:28.601 Suite: memory 00:05:28.601 Test: alloc and free memory map ...[2024-07-13 09:51:34.053380] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:05:28.601 passed 00:05:28.601 Test: mem map translation ...[2024-07-13 09:51:34.074437] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:05:28.601 [2024-07-13 09:51:34.074458] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:05:28.601 [2024-07-13 09:51:34.074514] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:05:28.601 [2024-07-13 09:51:34.074525] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:05:28.601 passed 00:05:28.601 Test: mem map registration ...[2024-07-13 09:51:34.115911] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:05:28.601 [2024-07-13 09:51:34.115929] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:05:28.601 passed 00:05:28.601 Test: mem map adjacent registrations ...passed 00:05:28.601 00:05:28.601 Run Summary: Type Total Ran Passed Failed Inactive 00:05:28.601 suites 1 1 n/a 0 0 00:05:28.601 tests 4 4 4 0 0 00:05:28.601 asserts 152 152 152 0 n/a 00:05:28.601 00:05:28.601 Elapsed time = 0.142 seconds 00:05:28.601 00:05:28.601 real 0m0.150s 00:05:28.601 user 0m0.142s 00:05:28.601 sys 0m0.008s 00:05:28.601 09:51:34 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:28.601 09:51:34 -- common/autotest_common.sh@10 -- # set +x 00:05:28.601 ************************************ 00:05:28.601 END TEST env_memory 00:05:28.601 ************************************ 00:05:28.601 09:51:34 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:28.601 09:51:34 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:28.601 09:51:34 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:28.601 09:51:34 -- common/autotest_common.sh@10 -- # set +x 00:05:28.601 ************************************ 00:05:28.601 START TEST env_vtophys 00:05:28.601 ************************************ 00:05:28.601 09:51:34 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:28.601 EAL: lib.eal log level changed from notice to debug 00:05:28.601 EAL: Detected lcore 0 as core 0 on socket 0 00:05:28.601 EAL: Detected lcore 1 as core 1 on socket 0 00:05:28.601 EAL: Detected lcore 2 as core 2 on socket 0 00:05:28.601 EAL: Detected lcore 3 as core 3 on socket 0 00:05:28.601 EAL: Detected lcore 4 as core 4 on socket 0 00:05:28.601 EAL: Detected lcore 5 as core 5 on socket 0 00:05:28.601 EAL: Detected lcore 6 as core 8 on socket 0 00:05:28.601 EAL: Detected lcore 7 as core 9 on socket 0 00:05:28.601 EAL: Detected lcore 8 as core 10 on socket 0 00:05:28.601 EAL: Detected lcore 9 as core 11 on socket 0 00:05:28.601 EAL: Detected lcore 10 as core 12 on socket 0 00:05:28.601 EAL: Detected lcore 11 as core 13 on socket 0 00:05:28.601 EAL: Detected lcore 12 as core 0 on socket 1 00:05:28.601 EAL: Detected lcore 13 as core 1 on socket 1 00:05:28.601 EAL: Detected lcore 14 as core 2 on socket 1 00:05:28.601 EAL: Detected lcore 15 as core 3 on socket 1 00:05:28.601 EAL: Detected lcore 16 as core 4 on socket 1 00:05:28.601 EAL: Detected lcore 17 as core 5 on socket 1 00:05:28.601 EAL: Detected lcore 18 as core 8 on socket 1 00:05:28.601 EAL: Detected lcore 19 as core 9 on socket 1 00:05:28.601 EAL: Detected lcore 20 as core 10 on socket 1 00:05:28.601 EAL: Detected lcore 21 as core 11 on socket 1 00:05:28.601 EAL: Detected lcore 22 as core 12 on socket 1 00:05:28.601 EAL: Detected lcore 23 as core 13 on socket 1 00:05:28.601 EAL: Detected lcore 24 as core 0 on socket 0 00:05:28.601 EAL: Detected lcore 25 as core 1 on socket 0 00:05:28.601 EAL: Detected lcore 26 as core 2 on socket 0 00:05:28.601 EAL: Detected lcore 27 as core 3 on socket 0 00:05:28.601 EAL: Detected lcore 28 as core 4 on socket 0 00:05:28.601 EAL: Detected lcore 29 as core 5 on socket 0 00:05:28.601 EAL: Detected lcore 30 as core 8 on socket 0 00:05:28.601 EAL: Detected lcore 31 as core 9 on socket 0 00:05:28.601 EAL: Detected lcore 32 as core 10 on socket 0 00:05:28.601 EAL: Detected lcore 33 as core 11 on socket 0 00:05:28.601 EAL: Detected lcore 34 as core 12 on socket 0 00:05:28.601 EAL: Detected lcore 35 as core 13 on socket 0 00:05:28.601 EAL: Detected lcore 36 as core 0 on socket 1 00:05:28.601 EAL: Detected lcore 37 as core 1 on socket 1 00:05:28.601 EAL: Detected lcore 38 as core 2 on socket 1 00:05:28.601 EAL: Detected lcore 39 as core 3 on socket 1 00:05:28.601 EAL: Detected lcore 40 as core 4 on socket 1 00:05:28.601 EAL: Detected lcore 41 as core 5 on socket 1 00:05:28.601 EAL: Detected lcore 42 as core 8 on socket 1 00:05:28.601 EAL: Detected lcore 43 as core 9 on socket 1 00:05:28.601 EAL: Detected lcore 44 as core 10 on socket 1 00:05:28.601 EAL: Detected lcore 45 as core 11 on socket 1 00:05:28.601 EAL: Detected lcore 46 as core 12 on socket 1 00:05:28.601 EAL: Detected lcore 47 as core 13 on socket 1 00:05:28.601 EAL: Maximum logical cores by configuration: 128 00:05:28.601 EAL: Detected CPU lcores: 48 00:05:28.601 EAL: Detected NUMA nodes: 2 00:05:28.601 EAL: Checking presence of .so 'librte_eal.so.23.0' 00:05:28.601 EAL: Detected shared linkage of DPDK 00:05:28.601 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_pci.so.23.0 00:05:28.601 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_vdev.so.23.0 00:05:28.601 EAL: Registered [vdev] bus. 00:05:28.601 EAL: bus.vdev log level changed from disabled to notice 00:05:28.601 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_mempool_ring.so.23.0 00:05:28.601 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_net_i40e.so.23.0 00:05:28.601 EAL: pmd.net.i40e.init log level changed from disabled to notice 00:05:28.601 EAL: pmd.net.i40e.driver log level changed from disabled to notice 00:05:28.601 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_pci.so 00:05:28.601 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_vdev.so 00:05:28.601 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_mempool_ring.so 00:05:28.601 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_net_i40e.so 00:05:28.601 EAL: No shared files mode enabled, IPC will be disabled 00:05:28.601 EAL: No shared files mode enabled, IPC is disabled 00:05:28.601 EAL: Bus pci wants IOVA as 'DC' 00:05:28.601 EAL: Bus vdev wants IOVA as 'DC' 00:05:28.601 EAL: Buses did not request a specific IOVA mode. 00:05:28.601 EAL: IOMMU is available, selecting IOVA as VA mode. 00:05:28.601 EAL: Selected IOVA mode 'VA' 00:05:28.601 EAL: No free 2048 kB hugepages reported on node 1 00:05:28.601 EAL: Probing VFIO support... 00:05:28.601 EAL: IOMMU type 1 (Type 1) is supported 00:05:28.601 EAL: IOMMU type 7 (sPAPR) is not supported 00:05:28.601 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:05:28.601 EAL: VFIO support initialized 00:05:28.601 EAL: Ask a virtual area of 0x2e000 bytes 00:05:28.601 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:05:28.601 EAL: Setting up physically contiguous memory... 00:05:28.601 EAL: Setting maximum number of open files to 524288 00:05:28.601 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:05:28.601 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:05:28.601 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:05:28.601 EAL: Ask a virtual area of 0x61000 bytes 00:05:28.601 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:05:28.601 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:28.601 EAL: Ask a virtual area of 0x400000000 bytes 00:05:28.601 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:05:28.601 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:05:28.601 EAL: Ask a virtual area of 0x61000 bytes 00:05:28.601 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:05:28.601 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:28.601 EAL: Ask a virtual area of 0x400000000 bytes 00:05:28.601 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:05:28.601 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:05:28.601 EAL: Ask a virtual area of 0x61000 bytes 00:05:28.601 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:05:28.601 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:28.601 EAL: Ask a virtual area of 0x400000000 bytes 00:05:28.601 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:05:28.601 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:05:28.601 EAL: Ask a virtual area of 0x61000 bytes 00:05:28.601 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:05:28.601 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:28.601 EAL: Ask a virtual area of 0x400000000 bytes 00:05:28.601 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:05:28.601 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:05:28.601 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:05:28.601 EAL: Ask a virtual area of 0x61000 bytes 00:05:28.601 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:05:28.601 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:28.601 EAL: Ask a virtual area of 0x400000000 bytes 00:05:28.601 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:05:28.602 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:05:28.602 EAL: Ask a virtual area of 0x61000 bytes 00:05:28.602 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:05:28.602 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:28.602 EAL: Ask a virtual area of 0x400000000 bytes 00:05:28.602 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:05:28.602 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:05:28.602 EAL: Ask a virtual area of 0x61000 bytes 00:05:28.602 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:05:28.602 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:28.602 EAL: Ask a virtual area of 0x400000000 bytes 00:05:28.602 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:05:28.602 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:05:28.602 EAL: Ask a virtual area of 0x61000 bytes 00:05:28.602 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:05:28.602 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:28.602 EAL: Ask a virtual area of 0x400000000 bytes 00:05:28.602 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:05:28.602 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:05:28.602 EAL: Hugepages will be freed exactly as allocated. 00:05:28.602 EAL: No shared files mode enabled, IPC is disabled 00:05:28.602 EAL: No shared files mode enabled, IPC is disabled 00:05:28.602 EAL: TSC frequency is ~2700000 KHz 00:05:28.602 EAL: Main lcore 0 is ready (tid=7f7ff9747a00;cpuset=[0]) 00:05:28.602 EAL: Trying to obtain current memory policy. 00:05:28.602 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:28.602 EAL: Restoring previous memory policy: 0 00:05:28.602 EAL: request: mp_malloc_sync 00:05:28.602 EAL: No shared files mode enabled, IPC is disabled 00:05:28.602 EAL: Heap on socket 0 was expanded by 2MB 00:05:28.602 EAL: No shared files mode enabled, IPC is disabled 00:05:28.602 EAL: No shared files mode enabled, IPC is disabled 00:05:28.602 EAL: No PCI address specified using 'addr=' in: bus=pci 00:05:28.602 EAL: Mem event callback 'spdk:(nil)' registered 00:05:28.602 00:05:28.602 00:05:28.602 CUnit - A unit testing framework for C - Version 2.1-3 00:05:28.602 http://cunit.sourceforge.net/ 00:05:28.602 00:05:28.602 00:05:28.602 Suite: components_suite 00:05:28.602 Test: vtophys_malloc_test ...passed 00:05:28.602 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:05:28.602 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:28.602 EAL: Restoring previous memory policy: 4 00:05:28.602 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.602 EAL: request: mp_malloc_sync 00:05:28.602 EAL: No shared files mode enabled, IPC is disabled 00:05:28.602 EAL: Heap on socket 0 was expanded by 4MB 00:05:28.602 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.602 EAL: request: mp_malloc_sync 00:05:28.602 EAL: No shared files mode enabled, IPC is disabled 00:05:28.602 EAL: Heap on socket 0 was shrunk by 4MB 00:05:28.602 EAL: Trying to obtain current memory policy. 00:05:28.602 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:28.602 EAL: Restoring previous memory policy: 4 00:05:28.602 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.602 EAL: request: mp_malloc_sync 00:05:28.602 EAL: No shared files mode enabled, IPC is disabled 00:05:28.602 EAL: Heap on socket 0 was expanded by 6MB 00:05:28.602 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.602 EAL: request: mp_malloc_sync 00:05:28.602 EAL: No shared files mode enabled, IPC is disabled 00:05:28.602 EAL: Heap on socket 0 was shrunk by 6MB 00:05:28.602 EAL: Trying to obtain current memory policy. 00:05:28.602 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:28.602 EAL: Restoring previous memory policy: 4 00:05:28.602 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.602 EAL: request: mp_malloc_sync 00:05:28.602 EAL: No shared files mode enabled, IPC is disabled 00:05:28.602 EAL: Heap on socket 0 was expanded by 10MB 00:05:28.602 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.602 EAL: request: mp_malloc_sync 00:05:28.602 EAL: No shared files mode enabled, IPC is disabled 00:05:28.602 EAL: Heap on socket 0 was shrunk by 10MB 00:05:28.602 EAL: Trying to obtain current memory policy. 00:05:28.602 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:28.602 EAL: Restoring previous memory policy: 4 00:05:28.602 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.602 EAL: request: mp_malloc_sync 00:05:28.602 EAL: No shared files mode enabled, IPC is disabled 00:05:28.602 EAL: Heap on socket 0 was expanded by 18MB 00:05:28.602 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.602 EAL: request: mp_malloc_sync 00:05:28.602 EAL: No shared files mode enabled, IPC is disabled 00:05:28.602 EAL: Heap on socket 0 was shrunk by 18MB 00:05:28.602 EAL: Trying to obtain current memory policy. 00:05:28.602 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:28.602 EAL: Restoring previous memory policy: 4 00:05:28.602 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.602 EAL: request: mp_malloc_sync 00:05:28.602 EAL: No shared files mode enabled, IPC is disabled 00:05:28.602 EAL: Heap on socket 0 was expanded by 34MB 00:05:28.602 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.602 EAL: request: mp_malloc_sync 00:05:28.602 EAL: No shared files mode enabled, IPC is disabled 00:05:28.602 EAL: Heap on socket 0 was shrunk by 34MB 00:05:28.602 EAL: Trying to obtain current memory policy. 00:05:28.602 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:28.602 EAL: Restoring previous memory policy: 4 00:05:28.602 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.602 EAL: request: mp_malloc_sync 00:05:28.602 EAL: No shared files mode enabled, IPC is disabled 00:05:28.602 EAL: Heap on socket 0 was expanded by 66MB 00:05:28.602 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.602 EAL: request: mp_malloc_sync 00:05:28.602 EAL: No shared files mode enabled, IPC is disabled 00:05:28.602 EAL: Heap on socket 0 was shrunk by 66MB 00:05:28.602 EAL: Trying to obtain current memory policy. 00:05:28.602 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:28.602 EAL: Restoring previous memory policy: 4 00:05:28.602 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.602 EAL: request: mp_malloc_sync 00:05:28.602 EAL: No shared files mode enabled, IPC is disabled 00:05:28.602 EAL: Heap on socket 0 was expanded by 130MB 00:05:28.602 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.602 EAL: request: mp_malloc_sync 00:05:28.602 EAL: No shared files mode enabled, IPC is disabled 00:05:28.602 EAL: Heap on socket 0 was shrunk by 130MB 00:05:28.602 EAL: Trying to obtain current memory policy. 00:05:28.602 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:28.861 EAL: Restoring previous memory policy: 4 00:05:28.861 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.861 EAL: request: mp_malloc_sync 00:05:28.861 EAL: No shared files mode enabled, IPC is disabled 00:05:28.861 EAL: Heap on socket 0 was expanded by 258MB 00:05:28.861 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.861 EAL: request: mp_malloc_sync 00:05:28.861 EAL: No shared files mode enabled, IPC is disabled 00:05:28.861 EAL: Heap on socket 0 was shrunk by 258MB 00:05:28.861 EAL: Trying to obtain current memory policy. 00:05:28.861 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:29.119 EAL: Restoring previous memory policy: 4 00:05:29.119 EAL: Calling mem event callback 'spdk:(nil)' 00:05:29.119 EAL: request: mp_malloc_sync 00:05:29.119 EAL: No shared files mode enabled, IPC is disabled 00:05:29.119 EAL: Heap on socket 0 was expanded by 514MB 00:05:29.119 EAL: Calling mem event callback 'spdk:(nil)' 00:05:29.379 EAL: request: mp_malloc_sync 00:05:29.379 EAL: No shared files mode enabled, IPC is disabled 00:05:29.379 EAL: Heap on socket 0 was shrunk by 514MB 00:05:29.379 EAL: Trying to obtain current memory policy. 00:05:29.379 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:29.637 EAL: Restoring previous memory policy: 4 00:05:29.637 EAL: Calling mem event callback 'spdk:(nil)' 00:05:29.637 EAL: request: mp_malloc_sync 00:05:29.637 EAL: No shared files mode enabled, IPC is disabled 00:05:29.637 EAL: Heap on socket 0 was expanded by 1026MB 00:05:29.896 EAL: Calling mem event callback 'spdk:(nil)' 00:05:29.896 EAL: request: mp_malloc_sync 00:05:29.896 EAL: No shared files mode enabled, IPC is disabled 00:05:29.896 EAL: Heap on socket 0 was shrunk by 1026MB 00:05:29.896 passed 00:05:29.896 00:05:29.896 Run Summary: Type Total Ran Passed Failed Inactive 00:05:29.896 suites 1 1 n/a 0 0 00:05:29.896 tests 2 2 2 0 0 00:05:29.896 asserts 497 497 497 0 n/a 00:05:29.896 00:05:29.896 Elapsed time = 1.377 seconds 00:05:29.896 EAL: Calling mem event callback 'spdk:(nil)' 00:05:29.896 EAL: request: mp_malloc_sync 00:05:29.896 EAL: No shared files mode enabled, IPC is disabled 00:05:29.896 EAL: Heap on socket 0 was shrunk by 2MB 00:05:29.896 EAL: No shared files mode enabled, IPC is disabled 00:05:29.896 EAL: No shared files mode enabled, IPC is disabled 00:05:29.896 EAL: No shared files mode enabled, IPC is disabled 00:05:29.896 00:05:29.896 real 0m1.489s 00:05:29.896 user 0m0.858s 00:05:29.896 sys 0m0.598s 00:05:29.896 09:51:35 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:29.896 09:51:35 -- common/autotest_common.sh@10 -- # set +x 00:05:29.896 ************************************ 00:05:29.896 END TEST env_vtophys 00:05:29.896 ************************************ 00:05:29.896 09:51:35 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:05:29.896 09:51:35 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:29.896 09:51:35 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:29.896 09:51:35 -- common/autotest_common.sh@10 -- # set +x 00:05:29.896 ************************************ 00:05:29.896 START TEST env_pci 00:05:29.896 ************************************ 00:05:29.896 09:51:35 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:05:29.896 00:05:29.896 00:05:29.896 CUnit - A unit testing framework for C - Version 2.1-3 00:05:29.896 http://cunit.sourceforge.net/ 00:05:29.896 00:05:29.896 00:05:29.896 Suite: pci 00:05:29.896 Test: pci_hook ...[2024-07-13 09:51:35.711994] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 2687562 has claimed it 00:05:30.155 EAL: Cannot find device (10000:00:01.0) 00:05:30.155 EAL: Failed to attach device on primary process 00:05:30.155 passed 00:05:30.155 00:05:30.155 Run Summary: Type Total Ran Passed Failed Inactive 00:05:30.155 suites 1 1 n/a 0 0 00:05:30.155 tests 1 1 1 0 0 00:05:30.155 asserts 25 25 25 0 n/a 00:05:30.155 00:05:30.155 Elapsed time = 0.018 seconds 00:05:30.155 00:05:30.156 real 0m0.028s 00:05:30.156 user 0m0.011s 00:05:30.156 sys 0m0.017s 00:05:30.156 09:51:35 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:30.156 09:51:35 -- common/autotest_common.sh@10 -- # set +x 00:05:30.156 ************************************ 00:05:30.156 END TEST env_pci 00:05:30.156 ************************************ 00:05:30.156 09:51:35 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:05:30.156 09:51:35 -- env/env.sh@15 -- # uname 00:05:30.156 09:51:35 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:05:30.156 09:51:35 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:05:30.156 09:51:35 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:30.156 09:51:35 -- common/autotest_common.sh@1077 -- # '[' 5 -le 1 ']' 00:05:30.156 09:51:35 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:30.156 09:51:35 -- common/autotest_common.sh@10 -- # set +x 00:05:30.156 ************************************ 00:05:30.156 START TEST env_dpdk_post_init 00:05:30.156 ************************************ 00:05:30.156 09:51:35 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:30.156 EAL: Detected CPU lcores: 48 00:05:30.156 EAL: Detected NUMA nodes: 2 00:05:30.156 EAL: Detected shared linkage of DPDK 00:05:30.156 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:30.156 EAL: Selected IOVA mode 'VA' 00:05:30.156 EAL: No free 2048 kB hugepages reported on node 1 00:05:30.156 EAL: VFIO support initialized 00:05:30.156 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:30.156 EAL: Using IOMMU type 1 (Type 1) 00:05:30.156 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:05:30.156 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:05:30.156 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:05:30.156 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:05:30.156 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:05:30.156 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:05:30.156 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:05:30.156 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:05:30.156 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:05:30.415 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:05:30.415 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:05:30.415 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:05:30.415 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:05:30.415 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:05:30.415 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:05:30.415 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:05:30.983 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:88:00.0 (socket 1) 00:05:34.262 EAL: Releasing PCI mapped resource for 0000:88:00.0 00:05:34.262 EAL: Calling pci_unmap_resource for 0000:88:00.0 at 0x202001040000 00:05:34.521 Starting DPDK initialization... 00:05:34.521 Starting SPDK post initialization... 00:05:34.521 SPDK NVMe probe 00:05:34.521 Attaching to 0000:88:00.0 00:05:34.521 Attached to 0000:88:00.0 00:05:34.521 Cleaning up... 00:05:34.521 00:05:34.521 real 0m4.386s 00:05:34.521 user 0m3.249s 00:05:34.521 sys 0m0.192s 00:05:34.521 09:51:40 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:34.521 09:51:40 -- common/autotest_common.sh@10 -- # set +x 00:05:34.521 ************************************ 00:05:34.521 END TEST env_dpdk_post_init 00:05:34.521 ************************************ 00:05:34.521 09:51:40 -- env/env.sh@26 -- # uname 00:05:34.521 09:51:40 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:05:34.521 09:51:40 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:34.521 09:51:40 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:34.521 09:51:40 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:34.521 09:51:40 -- common/autotest_common.sh@10 -- # set +x 00:05:34.521 ************************************ 00:05:34.521 START TEST env_mem_callbacks 00:05:34.521 ************************************ 00:05:34.521 09:51:40 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:34.521 EAL: Detected CPU lcores: 48 00:05:34.521 EAL: Detected NUMA nodes: 2 00:05:34.521 EAL: Detected shared linkage of DPDK 00:05:34.521 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:34.521 EAL: Selected IOVA mode 'VA' 00:05:34.522 EAL: No free 2048 kB hugepages reported on node 1 00:05:34.522 EAL: VFIO support initialized 00:05:34.522 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:34.522 00:05:34.522 00:05:34.522 CUnit - A unit testing framework for C - Version 2.1-3 00:05:34.522 http://cunit.sourceforge.net/ 00:05:34.522 00:05:34.522 00:05:34.522 Suite: memory 00:05:34.522 Test: test ... 00:05:34.522 register 0x200000200000 2097152 00:05:34.522 malloc 3145728 00:05:34.522 register 0x200000400000 4194304 00:05:34.522 buf 0x200000500000 len 3145728 PASSED 00:05:34.522 malloc 64 00:05:34.522 buf 0x2000004fff40 len 64 PASSED 00:05:34.522 malloc 4194304 00:05:34.522 register 0x200000800000 6291456 00:05:34.522 buf 0x200000a00000 len 4194304 PASSED 00:05:34.522 free 0x200000500000 3145728 00:05:34.522 free 0x2000004fff40 64 00:05:34.522 unregister 0x200000400000 4194304 PASSED 00:05:34.522 free 0x200000a00000 4194304 00:05:34.522 unregister 0x200000800000 6291456 PASSED 00:05:34.522 malloc 8388608 00:05:34.522 register 0x200000400000 10485760 00:05:34.522 buf 0x200000600000 len 8388608 PASSED 00:05:34.522 free 0x200000600000 8388608 00:05:34.522 unregister 0x200000400000 10485760 PASSED 00:05:34.522 passed 00:05:34.522 00:05:34.522 Run Summary: Type Total Ran Passed Failed Inactive 00:05:34.522 suites 1 1 n/a 0 0 00:05:34.522 tests 1 1 1 0 0 00:05:34.522 asserts 15 15 15 0 n/a 00:05:34.522 00:05:34.522 Elapsed time = 0.005 seconds 00:05:34.522 00:05:34.522 real 0m0.048s 00:05:34.522 user 0m0.012s 00:05:34.522 sys 0m0.036s 00:05:34.522 09:51:40 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:34.522 09:51:40 -- common/autotest_common.sh@10 -- # set +x 00:05:34.522 ************************************ 00:05:34.522 END TEST env_mem_callbacks 00:05:34.522 ************************************ 00:05:34.522 00:05:34.522 real 0m6.276s 00:05:34.522 user 0m4.337s 00:05:34.522 sys 0m0.985s 00:05:34.522 09:51:40 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:34.522 09:51:40 -- common/autotest_common.sh@10 -- # set +x 00:05:34.522 ************************************ 00:05:34.522 END TEST env 00:05:34.522 ************************************ 00:05:34.522 09:51:40 -- spdk/autotest.sh@176 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:05:34.522 09:51:40 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:34.522 09:51:40 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:34.522 09:51:40 -- common/autotest_common.sh@10 -- # set +x 00:05:34.522 ************************************ 00:05:34.522 START TEST rpc 00:05:34.522 ************************************ 00:05:34.522 09:51:40 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:05:34.522 * Looking for test storage... 00:05:34.522 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:34.522 09:51:40 -- rpc/rpc.sh@65 -- # spdk_pid=2688225 00:05:34.522 09:51:40 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:05:34.522 09:51:40 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:05:34.522 09:51:40 -- rpc/rpc.sh@67 -- # waitforlisten 2688225 00:05:34.522 09:51:40 -- common/autotest_common.sh@819 -- # '[' -z 2688225 ']' 00:05:34.522 09:51:40 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:34.522 09:51:40 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:34.522 09:51:40 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:34.522 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:34.522 09:51:40 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:34.522 09:51:40 -- common/autotest_common.sh@10 -- # set +x 00:05:34.781 [2024-07-13 09:51:40.362282] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:05:34.781 [2024-07-13 09:51:40.362360] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2688225 ] 00:05:34.781 EAL: No free 2048 kB hugepages reported on node 1 00:05:34.781 [2024-07-13 09:51:40.419393] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:34.781 [2024-07-13 09:51:40.502901] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:34.781 [2024-07-13 09:51:40.503076] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:05:34.781 [2024-07-13 09:51:40.503094] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 2688225' to capture a snapshot of events at runtime. 00:05:34.781 [2024-07-13 09:51:40.503106] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid2688225 for offline analysis/debug. 00:05:34.781 [2024-07-13 09:51:40.503133] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:35.712 09:51:41 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:35.712 09:51:41 -- common/autotest_common.sh@852 -- # return 0 00:05:35.712 09:51:41 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:35.712 09:51:41 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:35.712 09:51:41 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:05:35.712 09:51:41 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:05:35.712 09:51:41 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:35.712 09:51:41 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:35.712 09:51:41 -- common/autotest_common.sh@10 -- # set +x 00:05:35.712 ************************************ 00:05:35.712 START TEST rpc_integrity 00:05:35.712 ************************************ 00:05:35.712 09:51:41 -- common/autotest_common.sh@1104 -- # rpc_integrity 00:05:35.712 09:51:41 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:35.712 09:51:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:35.712 09:51:41 -- common/autotest_common.sh@10 -- # set +x 00:05:35.712 09:51:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:35.712 09:51:41 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:35.712 09:51:41 -- rpc/rpc.sh@13 -- # jq length 00:05:35.712 09:51:41 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:35.712 09:51:41 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:35.712 09:51:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:35.712 09:51:41 -- common/autotest_common.sh@10 -- # set +x 00:05:35.712 09:51:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:35.712 09:51:41 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:05:35.712 09:51:41 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:35.712 09:51:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:35.712 09:51:41 -- common/autotest_common.sh@10 -- # set +x 00:05:35.712 09:51:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:35.712 09:51:41 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:35.712 { 00:05:35.712 "name": "Malloc0", 00:05:35.712 "aliases": [ 00:05:35.712 "e93bc10b-e962-4609-bff6-fd47fae3a51a" 00:05:35.712 ], 00:05:35.712 "product_name": "Malloc disk", 00:05:35.712 "block_size": 512, 00:05:35.712 "num_blocks": 16384, 00:05:35.712 "uuid": "e93bc10b-e962-4609-bff6-fd47fae3a51a", 00:05:35.712 "assigned_rate_limits": { 00:05:35.712 "rw_ios_per_sec": 0, 00:05:35.712 "rw_mbytes_per_sec": 0, 00:05:35.712 "r_mbytes_per_sec": 0, 00:05:35.712 "w_mbytes_per_sec": 0 00:05:35.712 }, 00:05:35.712 "claimed": false, 00:05:35.712 "zoned": false, 00:05:35.712 "supported_io_types": { 00:05:35.712 "read": true, 00:05:35.712 "write": true, 00:05:35.712 "unmap": true, 00:05:35.712 "write_zeroes": true, 00:05:35.712 "flush": true, 00:05:35.712 "reset": true, 00:05:35.712 "compare": false, 00:05:35.712 "compare_and_write": false, 00:05:35.712 "abort": true, 00:05:35.712 "nvme_admin": false, 00:05:35.712 "nvme_io": false 00:05:35.712 }, 00:05:35.712 "memory_domains": [ 00:05:35.712 { 00:05:35.712 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:35.712 "dma_device_type": 2 00:05:35.712 } 00:05:35.712 ], 00:05:35.712 "driver_specific": {} 00:05:35.712 } 00:05:35.712 ]' 00:05:35.712 09:51:41 -- rpc/rpc.sh@17 -- # jq length 00:05:35.712 09:51:41 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:35.713 09:51:41 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:05:35.713 09:51:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:35.713 09:51:41 -- common/autotest_common.sh@10 -- # set +x 00:05:35.713 [2024-07-13 09:51:41.407399] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:05:35.713 [2024-07-13 09:51:41.407447] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:35.713 [2024-07-13 09:51:41.407472] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x14a45b0 00:05:35.713 [2024-07-13 09:51:41.407487] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:35.713 [2024-07-13 09:51:41.408938] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:35.713 [2024-07-13 09:51:41.408965] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:35.713 Passthru0 00:05:35.713 09:51:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:35.713 09:51:41 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:35.713 09:51:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:35.713 09:51:41 -- common/autotest_common.sh@10 -- # set +x 00:05:35.713 09:51:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:35.713 09:51:41 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:35.713 { 00:05:35.713 "name": "Malloc0", 00:05:35.713 "aliases": [ 00:05:35.713 "e93bc10b-e962-4609-bff6-fd47fae3a51a" 00:05:35.713 ], 00:05:35.713 "product_name": "Malloc disk", 00:05:35.713 "block_size": 512, 00:05:35.713 "num_blocks": 16384, 00:05:35.713 "uuid": "e93bc10b-e962-4609-bff6-fd47fae3a51a", 00:05:35.713 "assigned_rate_limits": { 00:05:35.713 "rw_ios_per_sec": 0, 00:05:35.713 "rw_mbytes_per_sec": 0, 00:05:35.713 "r_mbytes_per_sec": 0, 00:05:35.713 "w_mbytes_per_sec": 0 00:05:35.713 }, 00:05:35.713 "claimed": true, 00:05:35.713 "claim_type": "exclusive_write", 00:05:35.713 "zoned": false, 00:05:35.713 "supported_io_types": { 00:05:35.713 "read": true, 00:05:35.713 "write": true, 00:05:35.713 "unmap": true, 00:05:35.713 "write_zeroes": true, 00:05:35.713 "flush": true, 00:05:35.713 "reset": true, 00:05:35.713 "compare": false, 00:05:35.713 "compare_and_write": false, 00:05:35.713 "abort": true, 00:05:35.713 "nvme_admin": false, 00:05:35.713 "nvme_io": false 00:05:35.713 }, 00:05:35.713 "memory_domains": [ 00:05:35.713 { 00:05:35.713 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:35.713 "dma_device_type": 2 00:05:35.713 } 00:05:35.713 ], 00:05:35.713 "driver_specific": {} 00:05:35.713 }, 00:05:35.713 { 00:05:35.713 "name": "Passthru0", 00:05:35.713 "aliases": [ 00:05:35.713 "7ebec1d6-931b-54fb-a1ba-ae2b611be822" 00:05:35.713 ], 00:05:35.713 "product_name": "passthru", 00:05:35.713 "block_size": 512, 00:05:35.713 "num_blocks": 16384, 00:05:35.713 "uuid": "7ebec1d6-931b-54fb-a1ba-ae2b611be822", 00:05:35.713 "assigned_rate_limits": { 00:05:35.713 "rw_ios_per_sec": 0, 00:05:35.713 "rw_mbytes_per_sec": 0, 00:05:35.713 "r_mbytes_per_sec": 0, 00:05:35.713 "w_mbytes_per_sec": 0 00:05:35.713 }, 00:05:35.713 "claimed": false, 00:05:35.713 "zoned": false, 00:05:35.713 "supported_io_types": { 00:05:35.713 "read": true, 00:05:35.713 "write": true, 00:05:35.713 "unmap": true, 00:05:35.713 "write_zeroes": true, 00:05:35.713 "flush": true, 00:05:35.713 "reset": true, 00:05:35.713 "compare": false, 00:05:35.713 "compare_and_write": false, 00:05:35.713 "abort": true, 00:05:35.713 "nvme_admin": false, 00:05:35.713 "nvme_io": false 00:05:35.713 }, 00:05:35.713 "memory_domains": [ 00:05:35.713 { 00:05:35.713 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:35.713 "dma_device_type": 2 00:05:35.713 } 00:05:35.713 ], 00:05:35.713 "driver_specific": { 00:05:35.713 "passthru": { 00:05:35.713 "name": "Passthru0", 00:05:35.713 "base_bdev_name": "Malloc0" 00:05:35.713 } 00:05:35.713 } 00:05:35.713 } 00:05:35.713 ]' 00:05:35.713 09:51:41 -- rpc/rpc.sh@21 -- # jq length 00:05:35.713 09:51:41 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:35.713 09:51:41 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:35.713 09:51:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:35.713 09:51:41 -- common/autotest_common.sh@10 -- # set +x 00:05:35.713 09:51:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:35.713 09:51:41 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:05:35.713 09:51:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:35.713 09:51:41 -- common/autotest_common.sh@10 -- # set +x 00:05:35.713 09:51:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:35.713 09:51:41 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:35.713 09:51:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:35.713 09:51:41 -- common/autotest_common.sh@10 -- # set +x 00:05:35.713 09:51:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:35.713 09:51:41 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:35.713 09:51:41 -- rpc/rpc.sh@26 -- # jq length 00:05:35.713 09:51:41 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:35.713 00:05:35.713 real 0m0.228s 00:05:35.713 user 0m0.150s 00:05:35.713 sys 0m0.020s 00:05:35.713 09:51:41 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:35.713 09:51:41 -- common/autotest_common.sh@10 -- # set +x 00:05:35.713 ************************************ 00:05:35.713 END TEST rpc_integrity 00:05:35.713 ************************************ 00:05:35.970 09:51:41 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:05:35.970 09:51:41 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:35.970 09:51:41 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:35.970 09:51:41 -- common/autotest_common.sh@10 -- # set +x 00:05:35.970 ************************************ 00:05:35.970 START TEST rpc_plugins 00:05:35.970 ************************************ 00:05:35.970 09:51:41 -- common/autotest_common.sh@1104 -- # rpc_plugins 00:05:35.970 09:51:41 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:05:35.970 09:51:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:35.970 09:51:41 -- common/autotest_common.sh@10 -- # set +x 00:05:35.970 09:51:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:35.970 09:51:41 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:05:35.970 09:51:41 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:05:35.970 09:51:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:35.970 09:51:41 -- common/autotest_common.sh@10 -- # set +x 00:05:35.970 09:51:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:35.970 09:51:41 -- rpc/rpc.sh@31 -- # bdevs='[ 00:05:35.970 { 00:05:35.970 "name": "Malloc1", 00:05:35.970 "aliases": [ 00:05:35.970 "0fd364ca-28fe-416b-96d4-ae262966c423" 00:05:35.970 ], 00:05:35.970 "product_name": "Malloc disk", 00:05:35.970 "block_size": 4096, 00:05:35.970 "num_blocks": 256, 00:05:35.970 "uuid": "0fd364ca-28fe-416b-96d4-ae262966c423", 00:05:35.970 "assigned_rate_limits": { 00:05:35.970 "rw_ios_per_sec": 0, 00:05:35.970 "rw_mbytes_per_sec": 0, 00:05:35.970 "r_mbytes_per_sec": 0, 00:05:35.970 "w_mbytes_per_sec": 0 00:05:35.970 }, 00:05:35.970 "claimed": false, 00:05:35.970 "zoned": false, 00:05:35.970 "supported_io_types": { 00:05:35.970 "read": true, 00:05:35.970 "write": true, 00:05:35.970 "unmap": true, 00:05:35.970 "write_zeroes": true, 00:05:35.970 "flush": true, 00:05:35.970 "reset": true, 00:05:35.970 "compare": false, 00:05:35.970 "compare_and_write": false, 00:05:35.970 "abort": true, 00:05:35.970 "nvme_admin": false, 00:05:35.970 "nvme_io": false 00:05:35.970 }, 00:05:35.970 "memory_domains": [ 00:05:35.970 { 00:05:35.970 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:35.970 "dma_device_type": 2 00:05:35.970 } 00:05:35.970 ], 00:05:35.970 "driver_specific": {} 00:05:35.970 } 00:05:35.970 ]' 00:05:35.970 09:51:41 -- rpc/rpc.sh@32 -- # jq length 00:05:35.970 09:51:41 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:05:35.970 09:51:41 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:05:35.970 09:51:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:35.970 09:51:41 -- common/autotest_common.sh@10 -- # set +x 00:05:35.970 09:51:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:35.970 09:51:41 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:05:35.970 09:51:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:35.970 09:51:41 -- common/autotest_common.sh@10 -- # set +x 00:05:35.970 09:51:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:35.970 09:51:41 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:05:35.970 09:51:41 -- rpc/rpc.sh@36 -- # jq length 00:05:35.970 09:51:41 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:05:35.970 00:05:35.970 real 0m0.113s 00:05:35.970 user 0m0.078s 00:05:35.970 sys 0m0.008s 00:05:35.970 09:51:41 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:35.970 09:51:41 -- common/autotest_common.sh@10 -- # set +x 00:05:35.970 ************************************ 00:05:35.970 END TEST rpc_plugins 00:05:35.970 ************************************ 00:05:35.970 09:51:41 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:05:35.970 09:51:41 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:35.970 09:51:41 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:35.970 09:51:41 -- common/autotest_common.sh@10 -- # set +x 00:05:35.970 ************************************ 00:05:35.970 START TEST rpc_trace_cmd_test 00:05:35.970 ************************************ 00:05:35.970 09:51:41 -- common/autotest_common.sh@1104 -- # rpc_trace_cmd_test 00:05:35.970 09:51:41 -- rpc/rpc.sh@40 -- # local info 00:05:35.970 09:51:41 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:05:35.970 09:51:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:35.970 09:51:41 -- common/autotest_common.sh@10 -- # set +x 00:05:35.970 09:51:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:35.970 09:51:41 -- rpc/rpc.sh@42 -- # info='{ 00:05:35.970 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid2688225", 00:05:35.970 "tpoint_group_mask": "0x8", 00:05:35.970 "iscsi_conn": { 00:05:35.970 "mask": "0x2", 00:05:35.970 "tpoint_mask": "0x0" 00:05:35.970 }, 00:05:35.970 "scsi": { 00:05:35.970 "mask": "0x4", 00:05:35.970 "tpoint_mask": "0x0" 00:05:35.970 }, 00:05:35.970 "bdev": { 00:05:35.970 "mask": "0x8", 00:05:35.970 "tpoint_mask": "0xffffffffffffffff" 00:05:35.970 }, 00:05:35.970 "nvmf_rdma": { 00:05:35.970 "mask": "0x10", 00:05:35.970 "tpoint_mask": "0x0" 00:05:35.970 }, 00:05:35.970 "nvmf_tcp": { 00:05:35.970 "mask": "0x20", 00:05:35.970 "tpoint_mask": "0x0" 00:05:35.970 }, 00:05:35.970 "ftl": { 00:05:35.970 "mask": "0x40", 00:05:35.970 "tpoint_mask": "0x0" 00:05:35.970 }, 00:05:35.970 "blobfs": { 00:05:35.970 "mask": "0x80", 00:05:35.970 "tpoint_mask": "0x0" 00:05:35.970 }, 00:05:35.970 "dsa": { 00:05:35.970 "mask": "0x200", 00:05:35.970 "tpoint_mask": "0x0" 00:05:35.970 }, 00:05:35.970 "thread": { 00:05:35.970 "mask": "0x400", 00:05:35.970 "tpoint_mask": "0x0" 00:05:35.970 }, 00:05:35.970 "nvme_pcie": { 00:05:35.970 "mask": "0x800", 00:05:35.970 "tpoint_mask": "0x0" 00:05:35.970 }, 00:05:35.970 "iaa": { 00:05:35.970 "mask": "0x1000", 00:05:35.970 "tpoint_mask": "0x0" 00:05:35.970 }, 00:05:35.970 "nvme_tcp": { 00:05:35.970 "mask": "0x2000", 00:05:35.970 "tpoint_mask": "0x0" 00:05:35.970 }, 00:05:35.970 "bdev_nvme": { 00:05:35.970 "mask": "0x4000", 00:05:35.970 "tpoint_mask": "0x0" 00:05:35.970 } 00:05:35.970 }' 00:05:35.970 09:51:41 -- rpc/rpc.sh@43 -- # jq length 00:05:35.970 09:51:41 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:05:35.970 09:51:41 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:05:35.970 09:51:41 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:05:35.970 09:51:41 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:05:36.228 09:51:41 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:05:36.228 09:51:41 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:05:36.228 09:51:41 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:05:36.228 09:51:41 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:05:36.228 09:51:41 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:05:36.228 00:05:36.228 real 0m0.199s 00:05:36.228 user 0m0.169s 00:05:36.228 sys 0m0.022s 00:05:36.228 09:51:41 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:36.228 09:51:41 -- common/autotest_common.sh@10 -- # set +x 00:05:36.228 ************************************ 00:05:36.228 END TEST rpc_trace_cmd_test 00:05:36.228 ************************************ 00:05:36.228 09:51:41 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:05:36.228 09:51:41 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:05:36.228 09:51:41 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:05:36.228 09:51:41 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:36.228 09:51:41 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:36.228 09:51:41 -- common/autotest_common.sh@10 -- # set +x 00:05:36.228 ************************************ 00:05:36.228 START TEST rpc_daemon_integrity 00:05:36.228 ************************************ 00:05:36.228 09:51:41 -- common/autotest_common.sh@1104 -- # rpc_integrity 00:05:36.228 09:51:41 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:36.228 09:51:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:36.228 09:51:41 -- common/autotest_common.sh@10 -- # set +x 00:05:36.228 09:51:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:36.228 09:51:41 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:36.228 09:51:41 -- rpc/rpc.sh@13 -- # jq length 00:05:36.228 09:51:41 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:36.228 09:51:41 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:36.228 09:51:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:36.228 09:51:41 -- common/autotest_common.sh@10 -- # set +x 00:05:36.228 09:51:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:36.228 09:51:41 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:05:36.228 09:51:41 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:36.228 09:51:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:36.228 09:51:41 -- common/autotest_common.sh@10 -- # set +x 00:05:36.228 09:51:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:36.228 09:51:41 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:36.228 { 00:05:36.228 "name": "Malloc2", 00:05:36.228 "aliases": [ 00:05:36.228 "acbf70c2-da38-405e-8f34-a698c336684a" 00:05:36.228 ], 00:05:36.228 "product_name": "Malloc disk", 00:05:36.228 "block_size": 512, 00:05:36.228 "num_blocks": 16384, 00:05:36.228 "uuid": "acbf70c2-da38-405e-8f34-a698c336684a", 00:05:36.228 "assigned_rate_limits": { 00:05:36.228 "rw_ios_per_sec": 0, 00:05:36.228 "rw_mbytes_per_sec": 0, 00:05:36.228 "r_mbytes_per_sec": 0, 00:05:36.228 "w_mbytes_per_sec": 0 00:05:36.228 }, 00:05:36.228 "claimed": false, 00:05:36.228 "zoned": false, 00:05:36.228 "supported_io_types": { 00:05:36.228 "read": true, 00:05:36.228 "write": true, 00:05:36.228 "unmap": true, 00:05:36.228 "write_zeroes": true, 00:05:36.228 "flush": true, 00:05:36.228 "reset": true, 00:05:36.228 "compare": false, 00:05:36.228 "compare_and_write": false, 00:05:36.228 "abort": true, 00:05:36.228 "nvme_admin": false, 00:05:36.228 "nvme_io": false 00:05:36.228 }, 00:05:36.228 "memory_domains": [ 00:05:36.228 { 00:05:36.228 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:36.229 "dma_device_type": 2 00:05:36.229 } 00:05:36.229 ], 00:05:36.229 "driver_specific": {} 00:05:36.229 } 00:05:36.229 ]' 00:05:36.229 09:51:41 -- rpc/rpc.sh@17 -- # jq length 00:05:36.229 09:51:42 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:36.229 09:51:42 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:05:36.229 09:51:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:36.229 09:51:42 -- common/autotest_common.sh@10 -- # set +x 00:05:36.229 [2024-07-13 09:51:42.021136] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:05:36.229 [2024-07-13 09:51:42.021197] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:36.229 [2024-07-13 09:51:42.021222] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x15656f0 00:05:36.229 [2024-07-13 09:51:42.021237] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:36.229 [2024-07-13 09:51:42.022566] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:36.229 [2024-07-13 09:51:42.022595] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:36.229 Passthru0 00:05:36.229 09:51:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:36.229 09:51:42 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:36.229 09:51:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:36.229 09:51:42 -- common/autotest_common.sh@10 -- # set +x 00:05:36.229 09:51:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:36.229 09:51:42 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:36.229 { 00:05:36.229 "name": "Malloc2", 00:05:36.229 "aliases": [ 00:05:36.229 "acbf70c2-da38-405e-8f34-a698c336684a" 00:05:36.229 ], 00:05:36.229 "product_name": "Malloc disk", 00:05:36.229 "block_size": 512, 00:05:36.229 "num_blocks": 16384, 00:05:36.229 "uuid": "acbf70c2-da38-405e-8f34-a698c336684a", 00:05:36.229 "assigned_rate_limits": { 00:05:36.229 "rw_ios_per_sec": 0, 00:05:36.229 "rw_mbytes_per_sec": 0, 00:05:36.229 "r_mbytes_per_sec": 0, 00:05:36.229 "w_mbytes_per_sec": 0 00:05:36.229 }, 00:05:36.229 "claimed": true, 00:05:36.229 "claim_type": "exclusive_write", 00:05:36.229 "zoned": false, 00:05:36.229 "supported_io_types": { 00:05:36.229 "read": true, 00:05:36.229 "write": true, 00:05:36.229 "unmap": true, 00:05:36.229 "write_zeroes": true, 00:05:36.229 "flush": true, 00:05:36.229 "reset": true, 00:05:36.229 "compare": false, 00:05:36.229 "compare_and_write": false, 00:05:36.229 "abort": true, 00:05:36.229 "nvme_admin": false, 00:05:36.229 "nvme_io": false 00:05:36.229 }, 00:05:36.229 "memory_domains": [ 00:05:36.229 { 00:05:36.229 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:36.229 "dma_device_type": 2 00:05:36.229 } 00:05:36.229 ], 00:05:36.229 "driver_specific": {} 00:05:36.229 }, 00:05:36.229 { 00:05:36.229 "name": "Passthru0", 00:05:36.229 "aliases": [ 00:05:36.229 "c84e277a-9131-5e4a-b231-67d0711cff0e" 00:05:36.229 ], 00:05:36.229 "product_name": "passthru", 00:05:36.229 "block_size": 512, 00:05:36.229 "num_blocks": 16384, 00:05:36.229 "uuid": "c84e277a-9131-5e4a-b231-67d0711cff0e", 00:05:36.229 "assigned_rate_limits": { 00:05:36.229 "rw_ios_per_sec": 0, 00:05:36.229 "rw_mbytes_per_sec": 0, 00:05:36.229 "r_mbytes_per_sec": 0, 00:05:36.229 "w_mbytes_per_sec": 0 00:05:36.229 }, 00:05:36.229 "claimed": false, 00:05:36.229 "zoned": false, 00:05:36.229 "supported_io_types": { 00:05:36.229 "read": true, 00:05:36.229 "write": true, 00:05:36.229 "unmap": true, 00:05:36.229 "write_zeroes": true, 00:05:36.229 "flush": true, 00:05:36.229 "reset": true, 00:05:36.229 "compare": false, 00:05:36.229 "compare_and_write": false, 00:05:36.229 "abort": true, 00:05:36.229 "nvme_admin": false, 00:05:36.229 "nvme_io": false 00:05:36.229 }, 00:05:36.229 "memory_domains": [ 00:05:36.229 { 00:05:36.229 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:36.229 "dma_device_type": 2 00:05:36.229 } 00:05:36.229 ], 00:05:36.229 "driver_specific": { 00:05:36.229 "passthru": { 00:05:36.229 "name": "Passthru0", 00:05:36.229 "base_bdev_name": "Malloc2" 00:05:36.229 } 00:05:36.229 } 00:05:36.229 } 00:05:36.229 ]' 00:05:36.229 09:51:42 -- rpc/rpc.sh@21 -- # jq length 00:05:36.487 09:51:42 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:36.487 09:51:42 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:36.487 09:51:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:36.487 09:51:42 -- common/autotest_common.sh@10 -- # set +x 00:05:36.487 09:51:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:36.487 09:51:42 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:05:36.487 09:51:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:36.487 09:51:42 -- common/autotest_common.sh@10 -- # set +x 00:05:36.487 09:51:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:36.487 09:51:42 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:36.487 09:51:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:36.487 09:51:42 -- common/autotest_common.sh@10 -- # set +x 00:05:36.487 09:51:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:36.487 09:51:42 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:36.487 09:51:42 -- rpc/rpc.sh@26 -- # jq length 00:05:36.487 09:51:42 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:36.487 00:05:36.487 real 0m0.224s 00:05:36.487 user 0m0.147s 00:05:36.487 sys 0m0.020s 00:05:36.487 09:51:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:36.487 09:51:42 -- common/autotest_common.sh@10 -- # set +x 00:05:36.487 ************************************ 00:05:36.487 END TEST rpc_daemon_integrity 00:05:36.487 ************************************ 00:05:36.487 09:51:42 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:05:36.487 09:51:42 -- rpc/rpc.sh@84 -- # killprocess 2688225 00:05:36.487 09:51:42 -- common/autotest_common.sh@926 -- # '[' -z 2688225 ']' 00:05:36.487 09:51:42 -- common/autotest_common.sh@930 -- # kill -0 2688225 00:05:36.487 09:51:42 -- common/autotest_common.sh@931 -- # uname 00:05:36.487 09:51:42 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:36.487 09:51:42 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2688225 00:05:36.487 09:51:42 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:36.487 09:51:42 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:36.487 09:51:42 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2688225' 00:05:36.487 killing process with pid 2688225 00:05:36.487 09:51:42 -- common/autotest_common.sh@945 -- # kill 2688225 00:05:36.487 09:51:42 -- common/autotest_common.sh@950 -- # wait 2688225 00:05:37.052 00:05:37.052 real 0m2.339s 00:05:37.052 user 0m3.002s 00:05:37.052 sys 0m0.552s 00:05:37.052 09:51:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:37.052 09:51:42 -- common/autotest_common.sh@10 -- # set +x 00:05:37.052 ************************************ 00:05:37.052 END TEST rpc 00:05:37.052 ************************************ 00:05:37.052 09:51:42 -- spdk/autotest.sh@177 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:37.052 09:51:42 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:37.052 09:51:42 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:37.052 09:51:42 -- common/autotest_common.sh@10 -- # set +x 00:05:37.052 ************************************ 00:05:37.052 START TEST rpc_client 00:05:37.052 ************************************ 00:05:37.052 09:51:42 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:37.052 * Looking for test storage... 00:05:37.052 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:05:37.052 09:51:42 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:05:37.052 OK 00:05:37.052 09:51:42 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:05:37.052 00:05:37.052 real 0m0.064s 00:05:37.052 user 0m0.027s 00:05:37.052 sys 0m0.042s 00:05:37.052 09:51:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:37.052 09:51:42 -- common/autotest_common.sh@10 -- # set +x 00:05:37.052 ************************************ 00:05:37.052 END TEST rpc_client 00:05:37.052 ************************************ 00:05:37.052 09:51:42 -- spdk/autotest.sh@178 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:05:37.052 09:51:42 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:37.053 09:51:42 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:37.053 09:51:42 -- common/autotest_common.sh@10 -- # set +x 00:05:37.053 ************************************ 00:05:37.053 START TEST json_config 00:05:37.053 ************************************ 00:05:37.053 09:51:42 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:05:37.053 09:51:42 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:05:37.053 09:51:42 -- nvmf/common.sh@7 -- # uname -s 00:05:37.053 09:51:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:37.053 09:51:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:37.053 09:51:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:37.053 09:51:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:37.053 09:51:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:37.053 09:51:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:37.053 09:51:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:37.053 09:51:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:37.053 09:51:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:37.053 09:51:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:37.053 09:51:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:05:37.053 09:51:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:05:37.053 09:51:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:37.053 09:51:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:37.053 09:51:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:05:37.053 09:51:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:05:37.053 09:51:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:37.053 09:51:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:37.053 09:51:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:37.053 09:51:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:37.053 09:51:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:37.053 09:51:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:37.053 09:51:42 -- paths/export.sh@5 -- # export PATH 00:05:37.053 09:51:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:37.053 09:51:42 -- nvmf/common.sh@46 -- # : 0 00:05:37.053 09:51:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:05:37.053 09:51:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:05:37.053 09:51:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:05:37.053 09:51:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:37.053 09:51:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:37.053 09:51:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:05:37.053 09:51:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:05:37.053 09:51:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:05:37.053 09:51:42 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:05:37.053 09:51:42 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:05:37.053 09:51:42 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:05:37.053 09:51:42 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:05:37.053 09:51:42 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:05:37.053 09:51:42 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:05:37.053 09:51:42 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:05:37.053 09:51:42 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:05:37.053 09:51:42 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:05:37.053 09:51:42 -- json_config/json_config.sh@32 -- # declare -A app_params 00:05:37.053 09:51:42 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:05:37.053 09:51:42 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:05:37.053 09:51:42 -- json_config/json_config.sh@43 -- # last_event_id=0 00:05:37.053 09:51:42 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:05:37.053 09:51:42 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:05:37.053 INFO: JSON configuration test init 00:05:37.053 09:51:42 -- json_config/json_config.sh@420 -- # json_config_test_init 00:05:37.053 09:51:42 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:05:37.053 09:51:42 -- common/autotest_common.sh@712 -- # xtrace_disable 00:05:37.053 09:51:42 -- common/autotest_common.sh@10 -- # set +x 00:05:37.053 09:51:42 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:05:37.053 09:51:42 -- common/autotest_common.sh@712 -- # xtrace_disable 00:05:37.053 09:51:42 -- common/autotest_common.sh@10 -- # set +x 00:05:37.053 09:51:42 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:05:37.053 09:51:42 -- json_config/json_config.sh@98 -- # local app=target 00:05:37.053 09:51:42 -- json_config/json_config.sh@99 -- # shift 00:05:37.053 09:51:42 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:05:37.053 09:51:42 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:05:37.053 09:51:42 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:05:37.053 09:51:42 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:37.053 09:51:42 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:37.053 09:51:42 -- json_config/json_config.sh@111 -- # app_pid[$app]=2688710 00:05:37.053 09:51:42 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:05:37.053 09:51:42 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:05:37.053 Waiting for target to run... 00:05:37.053 09:51:42 -- json_config/json_config.sh@114 -- # waitforlisten 2688710 /var/tmp/spdk_tgt.sock 00:05:37.053 09:51:42 -- common/autotest_common.sh@819 -- # '[' -z 2688710 ']' 00:05:37.053 09:51:42 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:37.053 09:51:42 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:37.053 09:51:42 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:37.053 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:37.053 09:51:42 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:37.053 09:51:42 -- common/autotest_common.sh@10 -- # set +x 00:05:37.053 [2024-07-13 09:51:42.823914] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:05:37.053 [2024-07-13 09:51:42.824000] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2688710 ] 00:05:37.053 EAL: No free 2048 kB hugepages reported on node 1 00:05:37.618 [2024-07-13 09:51:43.179607] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:37.618 [2024-07-13 09:51:43.243035] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:37.618 [2024-07-13 09:51:43.243216] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:38.181 09:51:43 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:38.181 09:51:43 -- common/autotest_common.sh@852 -- # return 0 00:05:38.181 09:51:43 -- json_config/json_config.sh@115 -- # echo '' 00:05:38.181 00:05:38.181 09:51:43 -- json_config/json_config.sh@322 -- # create_accel_config 00:05:38.181 09:51:43 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:05:38.181 09:51:43 -- common/autotest_common.sh@712 -- # xtrace_disable 00:05:38.181 09:51:43 -- common/autotest_common.sh@10 -- # set +x 00:05:38.181 09:51:43 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:05:38.181 09:51:43 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:05:38.181 09:51:43 -- common/autotest_common.sh@718 -- # xtrace_disable 00:05:38.181 09:51:43 -- common/autotest_common.sh@10 -- # set +x 00:05:38.181 09:51:43 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:05:38.181 09:51:43 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:05:38.181 09:51:43 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:05:41.462 09:51:46 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:05:41.462 09:51:46 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:05:41.462 09:51:46 -- common/autotest_common.sh@712 -- # xtrace_disable 00:05:41.462 09:51:46 -- common/autotest_common.sh@10 -- # set +x 00:05:41.462 09:51:46 -- json_config/json_config.sh@48 -- # local ret=0 00:05:41.462 09:51:46 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:05:41.462 09:51:46 -- json_config/json_config.sh@49 -- # local enabled_types 00:05:41.462 09:51:46 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:05:41.462 09:51:46 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:05:41.462 09:51:46 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:05:41.462 09:51:47 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:05:41.462 09:51:47 -- json_config/json_config.sh@51 -- # local get_types 00:05:41.462 09:51:47 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:05:41.462 09:51:47 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:05:41.462 09:51:47 -- common/autotest_common.sh@718 -- # xtrace_disable 00:05:41.462 09:51:47 -- common/autotest_common.sh@10 -- # set +x 00:05:41.462 09:51:47 -- json_config/json_config.sh@58 -- # return 0 00:05:41.463 09:51:47 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:05:41.463 09:51:47 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:05:41.463 09:51:47 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:05:41.463 09:51:47 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:05:41.463 09:51:47 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:05:41.463 09:51:47 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:05:41.463 09:51:47 -- common/autotest_common.sh@712 -- # xtrace_disable 00:05:41.463 09:51:47 -- common/autotest_common.sh@10 -- # set +x 00:05:41.463 09:51:47 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:05:41.463 09:51:47 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:05:41.463 09:51:47 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:05:41.463 09:51:47 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:05:41.463 09:51:47 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:05:41.720 MallocForNvmf0 00:05:41.720 09:51:47 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:05:41.720 09:51:47 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:05:41.977 MallocForNvmf1 00:05:41.977 09:51:47 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:05:41.977 09:51:47 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:05:42.233 [2024-07-13 09:51:47.897354] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:05:42.233 09:51:47 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:05:42.233 09:51:47 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:05:42.490 09:51:48 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:05:42.490 09:51:48 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:05:42.748 09:51:48 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:05:42.748 09:51:48 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:05:43.005 09:51:48 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:05:43.005 09:51:48 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:05:43.263 [2024-07-13 09:51:48.836410] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:05:43.263 09:51:48 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:05:43.263 09:51:48 -- common/autotest_common.sh@718 -- # xtrace_disable 00:05:43.263 09:51:48 -- common/autotest_common.sh@10 -- # set +x 00:05:43.263 09:51:48 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:05:43.263 09:51:48 -- common/autotest_common.sh@718 -- # xtrace_disable 00:05:43.263 09:51:48 -- common/autotest_common.sh@10 -- # set +x 00:05:43.263 09:51:48 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:05:43.263 09:51:48 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:05:43.263 09:51:48 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:05:43.521 MallocBdevForConfigChangeCheck 00:05:43.521 09:51:49 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:05:43.521 09:51:49 -- common/autotest_common.sh@718 -- # xtrace_disable 00:05:43.521 09:51:49 -- common/autotest_common.sh@10 -- # set +x 00:05:43.521 09:51:49 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:05:43.521 09:51:49 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:43.779 09:51:49 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:05:43.779 INFO: shutting down applications... 00:05:43.779 09:51:49 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:05:43.779 09:51:49 -- json_config/json_config.sh@431 -- # json_config_clear target 00:05:43.779 09:51:49 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:05:43.779 09:51:49 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:05:45.680 Calling clear_iscsi_subsystem 00:05:45.680 Calling clear_nvmf_subsystem 00:05:45.680 Calling clear_nbd_subsystem 00:05:45.680 Calling clear_ublk_subsystem 00:05:45.680 Calling clear_vhost_blk_subsystem 00:05:45.680 Calling clear_vhost_scsi_subsystem 00:05:45.680 Calling clear_scheduler_subsystem 00:05:45.680 Calling clear_bdev_subsystem 00:05:45.680 Calling clear_accel_subsystem 00:05:45.680 Calling clear_vmd_subsystem 00:05:45.680 Calling clear_sock_subsystem 00:05:45.680 Calling clear_iobuf_subsystem 00:05:45.680 09:51:51 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:05:45.680 09:51:51 -- json_config/json_config.sh@396 -- # count=100 00:05:45.680 09:51:51 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:05:45.680 09:51:51 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:45.680 09:51:51 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:05:45.680 09:51:51 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:05:45.939 09:51:51 -- json_config/json_config.sh@398 -- # break 00:05:45.939 09:51:51 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:05:45.939 09:51:51 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:05:45.939 09:51:51 -- json_config/json_config.sh@120 -- # local app=target 00:05:45.939 09:51:51 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:05:45.939 09:51:51 -- json_config/json_config.sh@124 -- # [[ -n 2688710 ]] 00:05:45.939 09:51:51 -- json_config/json_config.sh@127 -- # kill -SIGINT 2688710 00:05:45.939 09:51:51 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:05:45.939 09:51:51 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:05:45.939 09:51:51 -- json_config/json_config.sh@130 -- # kill -0 2688710 00:05:45.939 09:51:51 -- json_config/json_config.sh@134 -- # sleep 0.5 00:05:46.507 09:51:52 -- json_config/json_config.sh@129 -- # (( i++ )) 00:05:46.507 09:51:52 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:05:46.507 09:51:52 -- json_config/json_config.sh@130 -- # kill -0 2688710 00:05:46.507 09:51:52 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:05:46.507 09:51:52 -- json_config/json_config.sh@132 -- # break 00:05:46.507 09:51:52 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:05:46.507 09:51:52 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:05:46.507 SPDK target shutdown done 00:05:46.507 09:51:52 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:05:46.507 INFO: relaunching applications... 00:05:46.507 09:51:52 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:46.507 09:51:52 -- json_config/json_config.sh@98 -- # local app=target 00:05:46.507 09:51:52 -- json_config/json_config.sh@99 -- # shift 00:05:46.507 09:51:52 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:05:46.507 09:51:52 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:05:46.507 09:51:52 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:05:46.507 09:51:52 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:46.507 09:51:52 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:46.507 09:51:52 -- json_config/json_config.sh@111 -- # app_pid[$app]=2689934 00:05:46.507 09:51:52 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:46.507 09:51:52 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:05:46.507 Waiting for target to run... 00:05:46.507 09:51:52 -- json_config/json_config.sh@114 -- # waitforlisten 2689934 /var/tmp/spdk_tgt.sock 00:05:46.507 09:51:52 -- common/autotest_common.sh@819 -- # '[' -z 2689934 ']' 00:05:46.507 09:51:52 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:46.507 09:51:52 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:46.507 09:51:52 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:46.507 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:46.507 09:51:52 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:46.507 09:51:52 -- common/autotest_common.sh@10 -- # set +x 00:05:46.507 [2024-07-13 09:51:52.074090] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:05:46.507 [2024-07-13 09:51:52.074184] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2689934 ] 00:05:46.507 EAL: No free 2048 kB hugepages reported on node 1 00:05:46.765 [2024-07-13 09:51:52.578576] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:47.024 [2024-07-13 09:51:52.657189] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:47.024 [2024-07-13 09:51:52.657391] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:50.308 [2024-07-13 09:51:55.682752] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:05:50.308 [2024-07-13 09:51:55.715302] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:05:50.308 09:51:55 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:50.308 09:51:55 -- common/autotest_common.sh@852 -- # return 0 00:05:50.308 09:51:55 -- json_config/json_config.sh@115 -- # echo '' 00:05:50.308 00:05:50.308 09:51:55 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:05:50.308 09:51:55 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:05:50.308 INFO: Checking if target configuration is the same... 00:05:50.308 09:51:55 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:50.308 09:51:55 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:05:50.308 09:51:55 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:50.308 + '[' 2 -ne 2 ']' 00:05:50.308 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:05:50.308 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:05:50.308 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:05:50.308 +++ basename /dev/fd/62 00:05:50.308 ++ mktemp /tmp/62.XXX 00:05:50.308 + tmp_file_1=/tmp/62.42z 00:05:50.308 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:50.308 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:05:50.308 + tmp_file_2=/tmp/spdk_tgt_config.json.q4k 00:05:50.308 + ret=0 00:05:50.308 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:50.566 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:50.566 + diff -u /tmp/62.42z /tmp/spdk_tgt_config.json.q4k 00:05:50.566 + echo 'INFO: JSON config files are the same' 00:05:50.566 INFO: JSON config files are the same 00:05:50.566 + rm /tmp/62.42z /tmp/spdk_tgt_config.json.q4k 00:05:50.566 + exit 0 00:05:50.566 09:51:56 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:05:50.566 09:51:56 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:05:50.566 INFO: changing configuration and checking if this can be detected... 00:05:50.566 09:51:56 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:05:50.566 09:51:56 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:05:50.824 09:51:56 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:50.824 09:51:56 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:05:50.824 09:51:56 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:50.824 + '[' 2 -ne 2 ']' 00:05:50.824 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:05:50.824 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:05:50.824 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:05:50.824 +++ basename /dev/fd/62 00:05:50.824 ++ mktemp /tmp/62.XXX 00:05:50.824 + tmp_file_1=/tmp/62.H3I 00:05:50.824 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:50.824 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:05:50.824 + tmp_file_2=/tmp/spdk_tgt_config.json.7Ik 00:05:50.824 + ret=0 00:05:50.824 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:51.390 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:51.390 + diff -u /tmp/62.H3I /tmp/spdk_tgt_config.json.7Ik 00:05:51.390 + ret=1 00:05:51.390 + echo '=== Start of file: /tmp/62.H3I ===' 00:05:51.390 + cat /tmp/62.H3I 00:05:51.390 + echo '=== End of file: /tmp/62.H3I ===' 00:05:51.390 + echo '' 00:05:51.390 + echo '=== Start of file: /tmp/spdk_tgt_config.json.7Ik ===' 00:05:51.390 + cat /tmp/spdk_tgt_config.json.7Ik 00:05:51.390 + echo '=== End of file: /tmp/spdk_tgt_config.json.7Ik ===' 00:05:51.390 + echo '' 00:05:51.390 + rm /tmp/62.H3I /tmp/spdk_tgt_config.json.7Ik 00:05:51.390 + exit 1 00:05:51.390 09:51:56 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:05:51.390 INFO: configuration change detected. 00:05:51.390 09:51:56 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:05:51.390 09:51:56 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:05:51.390 09:51:56 -- common/autotest_common.sh@712 -- # xtrace_disable 00:05:51.390 09:51:56 -- common/autotest_common.sh@10 -- # set +x 00:05:51.390 09:51:56 -- json_config/json_config.sh@360 -- # local ret=0 00:05:51.390 09:51:56 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:05:51.390 09:51:56 -- json_config/json_config.sh@370 -- # [[ -n 2689934 ]] 00:05:51.390 09:51:56 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:05:51.390 09:51:56 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:05:51.391 09:51:56 -- common/autotest_common.sh@712 -- # xtrace_disable 00:05:51.391 09:51:56 -- common/autotest_common.sh@10 -- # set +x 00:05:51.391 09:51:56 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:05:51.391 09:51:56 -- json_config/json_config.sh@246 -- # uname -s 00:05:51.391 09:51:57 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:05:51.391 09:51:57 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:05:51.391 09:51:57 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:05:51.391 09:51:57 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:05:51.391 09:51:57 -- common/autotest_common.sh@718 -- # xtrace_disable 00:05:51.391 09:51:57 -- common/autotest_common.sh@10 -- # set +x 00:05:51.391 09:51:57 -- json_config/json_config.sh@376 -- # killprocess 2689934 00:05:51.391 09:51:57 -- common/autotest_common.sh@926 -- # '[' -z 2689934 ']' 00:05:51.391 09:51:57 -- common/autotest_common.sh@930 -- # kill -0 2689934 00:05:51.391 09:51:57 -- common/autotest_common.sh@931 -- # uname 00:05:51.391 09:51:57 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:51.391 09:51:57 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2689934 00:05:51.391 09:51:57 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:51.391 09:51:57 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:51.391 09:51:57 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2689934' 00:05:51.391 killing process with pid 2689934 00:05:51.391 09:51:57 -- common/autotest_common.sh@945 -- # kill 2689934 00:05:51.391 09:51:57 -- common/autotest_common.sh@950 -- # wait 2689934 00:05:53.292 09:51:58 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:53.292 09:51:58 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:05:53.292 09:51:58 -- common/autotest_common.sh@718 -- # xtrace_disable 00:05:53.292 09:51:58 -- common/autotest_common.sh@10 -- # set +x 00:05:53.292 09:51:58 -- json_config/json_config.sh@381 -- # return 0 00:05:53.292 09:51:58 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:05:53.292 INFO: Success 00:05:53.292 00:05:53.292 real 0m15.971s 00:05:53.292 user 0m18.125s 00:05:53.292 sys 0m2.119s 00:05:53.292 09:51:58 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:53.292 09:51:58 -- common/autotest_common.sh@10 -- # set +x 00:05:53.292 ************************************ 00:05:53.292 END TEST json_config 00:05:53.292 ************************************ 00:05:53.292 09:51:58 -- spdk/autotest.sh@179 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:05:53.292 09:51:58 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:53.292 09:51:58 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:53.292 09:51:58 -- common/autotest_common.sh@10 -- # set +x 00:05:53.292 ************************************ 00:05:53.292 START TEST json_config_extra_key 00:05:53.292 ************************************ 00:05:53.292 09:51:58 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:05:53.292 09:51:58 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:05:53.292 09:51:58 -- nvmf/common.sh@7 -- # uname -s 00:05:53.292 09:51:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:53.292 09:51:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:53.292 09:51:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:53.292 09:51:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:53.292 09:51:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:53.292 09:51:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:53.292 09:51:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:53.292 09:51:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:53.292 09:51:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:53.292 09:51:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:53.292 09:51:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:05:53.292 09:51:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:05:53.292 09:51:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:53.292 09:51:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:53.292 09:51:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:05:53.292 09:51:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:05:53.292 09:51:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:53.292 09:51:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:53.292 09:51:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:53.292 09:51:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:53.292 09:51:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:53.292 09:51:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:53.292 09:51:58 -- paths/export.sh@5 -- # export PATH 00:05:53.292 09:51:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:53.292 09:51:58 -- nvmf/common.sh@46 -- # : 0 00:05:53.292 09:51:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:05:53.292 09:51:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:05:53.292 09:51:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:05:53.292 09:51:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:53.292 09:51:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:53.292 09:51:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:05:53.292 09:51:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:05:53.292 09:51:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:05:53.292 09:51:58 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:05:53.292 09:51:58 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:05:53.292 09:51:58 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:05:53.292 09:51:58 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:05:53.292 09:51:58 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:05:53.292 09:51:58 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:05:53.292 09:51:58 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:05:53.292 09:51:58 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:05:53.292 09:51:58 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:05:53.292 09:51:58 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:05:53.292 INFO: launching applications... 00:05:53.292 09:51:58 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:05:53.292 09:51:58 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:05:53.292 09:51:58 -- json_config/json_config_extra_key.sh@25 -- # shift 00:05:53.292 09:51:58 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:05:53.292 09:51:58 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:05:53.292 09:51:58 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=2690872 00:05:53.292 09:51:58 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:05:53.292 09:51:58 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:05:53.292 Waiting for target to run... 00:05:53.292 09:51:58 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 2690872 /var/tmp/spdk_tgt.sock 00:05:53.292 09:51:58 -- common/autotest_common.sh@819 -- # '[' -z 2690872 ']' 00:05:53.292 09:51:58 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:53.292 09:51:58 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:53.292 09:51:58 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:53.292 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:53.292 09:51:58 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:53.292 09:51:58 -- common/autotest_common.sh@10 -- # set +x 00:05:53.292 [2024-07-13 09:51:58.805695] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:05:53.292 [2024-07-13 09:51:58.805791] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2690872 ] 00:05:53.292 EAL: No free 2048 kB hugepages reported on node 1 00:05:53.551 [2024-07-13 09:51:59.137804] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:53.551 [2024-07-13 09:51:59.198827] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:53.551 [2024-07-13 09:51:59.199027] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:54.117 09:51:59 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:54.117 09:51:59 -- common/autotest_common.sh@852 -- # return 0 00:05:54.117 09:51:59 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:05:54.117 00:05:54.117 09:51:59 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:05:54.117 INFO: shutting down applications... 00:05:54.117 09:51:59 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:05:54.117 09:51:59 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:05:54.117 09:51:59 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:05:54.117 09:51:59 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 2690872 ]] 00:05:54.117 09:51:59 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 2690872 00:05:54.117 09:51:59 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:05:54.117 09:51:59 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:05:54.117 09:51:59 -- json_config/json_config_extra_key.sh@50 -- # kill -0 2690872 00:05:54.117 09:51:59 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:05:54.684 09:52:00 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:05:54.684 09:52:00 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:05:54.684 09:52:00 -- json_config/json_config_extra_key.sh@50 -- # kill -0 2690872 00:05:54.684 09:52:00 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:05:54.684 09:52:00 -- json_config/json_config_extra_key.sh@52 -- # break 00:05:54.684 09:52:00 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:05:54.684 09:52:00 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:05:54.684 SPDK target shutdown done 00:05:54.684 09:52:00 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:05:54.684 Success 00:05:54.684 00:05:54.684 real 0m1.507s 00:05:54.684 user 0m1.438s 00:05:54.684 sys 0m0.420s 00:05:54.684 09:52:00 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:54.684 09:52:00 -- common/autotest_common.sh@10 -- # set +x 00:05:54.684 ************************************ 00:05:54.684 END TEST json_config_extra_key 00:05:54.684 ************************************ 00:05:54.685 09:52:00 -- spdk/autotest.sh@180 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:05:54.685 09:52:00 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:54.685 09:52:00 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:54.685 09:52:00 -- common/autotest_common.sh@10 -- # set +x 00:05:54.685 ************************************ 00:05:54.685 START TEST alias_rpc 00:05:54.685 ************************************ 00:05:54.685 09:52:00 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:05:54.685 * Looking for test storage... 00:05:54.685 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:05:54.685 09:52:00 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:54.685 09:52:00 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=2691178 00:05:54.685 09:52:00 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:54.685 09:52:00 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 2691178 00:05:54.685 09:52:00 -- common/autotest_common.sh@819 -- # '[' -z 2691178 ']' 00:05:54.685 09:52:00 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:54.685 09:52:00 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:54.685 09:52:00 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:54.685 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:54.685 09:52:00 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:54.685 09:52:00 -- common/autotest_common.sh@10 -- # set +x 00:05:54.685 [2024-07-13 09:52:00.343281] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:05:54.685 [2024-07-13 09:52:00.343370] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2691178 ] 00:05:54.685 EAL: No free 2048 kB hugepages reported on node 1 00:05:54.685 [2024-07-13 09:52:00.399928] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:54.685 [2024-07-13 09:52:00.481468] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:54.685 [2024-07-13 09:52:00.481636] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:55.617 09:52:01 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:55.617 09:52:01 -- common/autotest_common.sh@852 -- # return 0 00:05:55.617 09:52:01 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:05:55.875 09:52:01 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 2691178 00:05:55.875 09:52:01 -- common/autotest_common.sh@926 -- # '[' -z 2691178 ']' 00:05:55.875 09:52:01 -- common/autotest_common.sh@930 -- # kill -0 2691178 00:05:55.875 09:52:01 -- common/autotest_common.sh@931 -- # uname 00:05:55.875 09:52:01 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:55.875 09:52:01 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2691178 00:05:55.875 09:52:01 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:55.875 09:52:01 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:55.875 09:52:01 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2691178' 00:05:55.875 killing process with pid 2691178 00:05:55.875 09:52:01 -- common/autotest_common.sh@945 -- # kill 2691178 00:05:55.875 09:52:01 -- common/autotest_common.sh@950 -- # wait 2691178 00:05:56.441 00:05:56.441 real 0m1.716s 00:05:56.441 user 0m1.978s 00:05:56.441 sys 0m0.436s 00:05:56.441 09:52:01 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:56.441 09:52:01 -- common/autotest_common.sh@10 -- # set +x 00:05:56.441 ************************************ 00:05:56.441 END TEST alias_rpc 00:05:56.441 ************************************ 00:05:56.441 09:52:01 -- spdk/autotest.sh@182 -- # [[ 0 -eq 0 ]] 00:05:56.441 09:52:01 -- spdk/autotest.sh@183 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:05:56.441 09:52:01 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:56.441 09:52:01 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:56.441 09:52:01 -- common/autotest_common.sh@10 -- # set +x 00:05:56.441 ************************************ 00:05:56.441 START TEST spdkcli_tcp 00:05:56.441 ************************************ 00:05:56.441 09:52:01 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:05:56.441 * Looking for test storage... 00:05:56.441 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:05:56.441 09:52:02 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:05:56.441 09:52:02 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:05:56.441 09:52:02 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:05:56.441 09:52:02 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:05:56.441 09:52:02 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:05:56.441 09:52:02 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:05:56.441 09:52:02 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:05:56.441 09:52:02 -- common/autotest_common.sh@712 -- # xtrace_disable 00:05:56.441 09:52:02 -- common/autotest_common.sh@10 -- # set +x 00:05:56.441 09:52:02 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=2691376 00:05:56.441 09:52:02 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:05:56.441 09:52:02 -- spdkcli/tcp.sh@27 -- # waitforlisten 2691376 00:05:56.441 09:52:02 -- common/autotest_common.sh@819 -- # '[' -z 2691376 ']' 00:05:56.441 09:52:02 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:56.441 09:52:02 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:56.441 09:52:02 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:56.441 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:56.441 09:52:02 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:56.441 09:52:02 -- common/autotest_common.sh@10 -- # set +x 00:05:56.441 [2024-07-13 09:52:02.078716] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:05:56.441 [2024-07-13 09:52:02.078811] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2691376 ] 00:05:56.441 EAL: No free 2048 kB hugepages reported on node 1 00:05:56.441 [2024-07-13 09:52:02.134779] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:56.441 [2024-07-13 09:52:02.217682] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:56.441 [2024-07-13 09:52:02.217908] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:56.441 [2024-07-13 09:52:02.217913] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:57.373 09:52:02 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:57.373 09:52:02 -- common/autotest_common.sh@852 -- # return 0 00:05:57.373 09:52:02 -- spdkcli/tcp.sh@31 -- # socat_pid=2691515 00:05:57.373 09:52:02 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:05:57.373 09:52:02 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:05:57.631 [ 00:05:57.631 "bdev_malloc_delete", 00:05:57.631 "bdev_malloc_create", 00:05:57.631 "bdev_null_resize", 00:05:57.631 "bdev_null_delete", 00:05:57.631 "bdev_null_create", 00:05:57.631 "bdev_nvme_cuse_unregister", 00:05:57.631 "bdev_nvme_cuse_register", 00:05:57.631 "bdev_opal_new_user", 00:05:57.631 "bdev_opal_set_lock_state", 00:05:57.631 "bdev_opal_delete", 00:05:57.631 "bdev_opal_get_info", 00:05:57.631 "bdev_opal_create", 00:05:57.631 "bdev_nvme_opal_revert", 00:05:57.631 "bdev_nvme_opal_init", 00:05:57.631 "bdev_nvme_send_cmd", 00:05:57.631 "bdev_nvme_get_path_iostat", 00:05:57.631 "bdev_nvme_get_mdns_discovery_info", 00:05:57.631 "bdev_nvme_stop_mdns_discovery", 00:05:57.631 "bdev_nvme_start_mdns_discovery", 00:05:57.631 "bdev_nvme_set_multipath_policy", 00:05:57.631 "bdev_nvme_set_preferred_path", 00:05:57.631 "bdev_nvme_get_io_paths", 00:05:57.631 "bdev_nvme_remove_error_injection", 00:05:57.631 "bdev_nvme_add_error_injection", 00:05:57.631 "bdev_nvme_get_discovery_info", 00:05:57.631 "bdev_nvme_stop_discovery", 00:05:57.631 "bdev_nvme_start_discovery", 00:05:57.631 "bdev_nvme_get_controller_health_info", 00:05:57.631 "bdev_nvme_disable_controller", 00:05:57.631 "bdev_nvme_enable_controller", 00:05:57.631 "bdev_nvme_reset_controller", 00:05:57.631 "bdev_nvme_get_transport_statistics", 00:05:57.631 "bdev_nvme_apply_firmware", 00:05:57.631 "bdev_nvme_detach_controller", 00:05:57.631 "bdev_nvme_get_controllers", 00:05:57.631 "bdev_nvme_attach_controller", 00:05:57.631 "bdev_nvme_set_hotplug", 00:05:57.631 "bdev_nvme_set_options", 00:05:57.631 "bdev_passthru_delete", 00:05:57.631 "bdev_passthru_create", 00:05:57.631 "bdev_lvol_grow_lvstore", 00:05:57.631 "bdev_lvol_get_lvols", 00:05:57.631 "bdev_lvol_get_lvstores", 00:05:57.631 "bdev_lvol_delete", 00:05:57.631 "bdev_lvol_set_read_only", 00:05:57.631 "bdev_lvol_resize", 00:05:57.631 "bdev_lvol_decouple_parent", 00:05:57.631 "bdev_lvol_inflate", 00:05:57.631 "bdev_lvol_rename", 00:05:57.631 "bdev_lvol_clone_bdev", 00:05:57.631 "bdev_lvol_clone", 00:05:57.631 "bdev_lvol_snapshot", 00:05:57.631 "bdev_lvol_create", 00:05:57.631 "bdev_lvol_delete_lvstore", 00:05:57.631 "bdev_lvol_rename_lvstore", 00:05:57.631 "bdev_lvol_create_lvstore", 00:05:57.631 "bdev_raid_set_options", 00:05:57.631 "bdev_raid_remove_base_bdev", 00:05:57.631 "bdev_raid_add_base_bdev", 00:05:57.631 "bdev_raid_delete", 00:05:57.631 "bdev_raid_create", 00:05:57.631 "bdev_raid_get_bdevs", 00:05:57.631 "bdev_error_inject_error", 00:05:57.631 "bdev_error_delete", 00:05:57.631 "bdev_error_create", 00:05:57.631 "bdev_split_delete", 00:05:57.631 "bdev_split_create", 00:05:57.631 "bdev_delay_delete", 00:05:57.631 "bdev_delay_create", 00:05:57.631 "bdev_delay_update_latency", 00:05:57.631 "bdev_zone_block_delete", 00:05:57.631 "bdev_zone_block_create", 00:05:57.631 "blobfs_create", 00:05:57.631 "blobfs_detect", 00:05:57.631 "blobfs_set_cache_size", 00:05:57.631 "bdev_aio_delete", 00:05:57.631 "bdev_aio_rescan", 00:05:57.631 "bdev_aio_create", 00:05:57.631 "bdev_ftl_set_property", 00:05:57.631 "bdev_ftl_get_properties", 00:05:57.631 "bdev_ftl_get_stats", 00:05:57.631 "bdev_ftl_unmap", 00:05:57.631 "bdev_ftl_unload", 00:05:57.631 "bdev_ftl_delete", 00:05:57.631 "bdev_ftl_load", 00:05:57.631 "bdev_ftl_create", 00:05:57.631 "bdev_virtio_attach_controller", 00:05:57.631 "bdev_virtio_scsi_get_devices", 00:05:57.631 "bdev_virtio_detach_controller", 00:05:57.631 "bdev_virtio_blk_set_hotplug", 00:05:57.631 "bdev_iscsi_delete", 00:05:57.631 "bdev_iscsi_create", 00:05:57.631 "bdev_iscsi_set_options", 00:05:57.631 "accel_error_inject_error", 00:05:57.631 "ioat_scan_accel_module", 00:05:57.631 "dsa_scan_accel_module", 00:05:57.631 "iaa_scan_accel_module", 00:05:57.631 "vfu_virtio_create_scsi_endpoint", 00:05:57.631 "vfu_virtio_scsi_remove_target", 00:05:57.631 "vfu_virtio_scsi_add_target", 00:05:57.631 "vfu_virtio_create_blk_endpoint", 00:05:57.631 "vfu_virtio_delete_endpoint", 00:05:57.631 "iscsi_set_options", 00:05:57.631 "iscsi_get_auth_groups", 00:05:57.631 "iscsi_auth_group_remove_secret", 00:05:57.631 "iscsi_auth_group_add_secret", 00:05:57.631 "iscsi_delete_auth_group", 00:05:57.631 "iscsi_create_auth_group", 00:05:57.631 "iscsi_set_discovery_auth", 00:05:57.631 "iscsi_get_options", 00:05:57.631 "iscsi_target_node_request_logout", 00:05:57.631 "iscsi_target_node_set_redirect", 00:05:57.631 "iscsi_target_node_set_auth", 00:05:57.631 "iscsi_target_node_add_lun", 00:05:57.631 "iscsi_get_connections", 00:05:57.631 "iscsi_portal_group_set_auth", 00:05:57.631 "iscsi_start_portal_group", 00:05:57.631 "iscsi_delete_portal_group", 00:05:57.631 "iscsi_create_portal_group", 00:05:57.631 "iscsi_get_portal_groups", 00:05:57.631 "iscsi_delete_target_node", 00:05:57.631 "iscsi_target_node_remove_pg_ig_maps", 00:05:57.631 "iscsi_target_node_add_pg_ig_maps", 00:05:57.631 "iscsi_create_target_node", 00:05:57.631 "iscsi_get_target_nodes", 00:05:57.631 "iscsi_delete_initiator_group", 00:05:57.631 "iscsi_initiator_group_remove_initiators", 00:05:57.631 "iscsi_initiator_group_add_initiators", 00:05:57.631 "iscsi_create_initiator_group", 00:05:57.631 "iscsi_get_initiator_groups", 00:05:57.631 "nvmf_set_crdt", 00:05:57.631 "nvmf_set_config", 00:05:57.631 "nvmf_set_max_subsystems", 00:05:57.631 "nvmf_subsystem_get_listeners", 00:05:57.631 "nvmf_subsystem_get_qpairs", 00:05:57.631 "nvmf_subsystem_get_controllers", 00:05:57.631 "nvmf_get_stats", 00:05:57.631 "nvmf_get_transports", 00:05:57.631 "nvmf_create_transport", 00:05:57.631 "nvmf_get_targets", 00:05:57.631 "nvmf_delete_target", 00:05:57.631 "nvmf_create_target", 00:05:57.631 "nvmf_subsystem_allow_any_host", 00:05:57.631 "nvmf_subsystem_remove_host", 00:05:57.631 "nvmf_subsystem_add_host", 00:05:57.631 "nvmf_subsystem_remove_ns", 00:05:57.631 "nvmf_subsystem_add_ns", 00:05:57.631 "nvmf_subsystem_listener_set_ana_state", 00:05:57.631 "nvmf_discovery_get_referrals", 00:05:57.631 "nvmf_discovery_remove_referral", 00:05:57.631 "nvmf_discovery_add_referral", 00:05:57.631 "nvmf_subsystem_remove_listener", 00:05:57.631 "nvmf_subsystem_add_listener", 00:05:57.631 "nvmf_delete_subsystem", 00:05:57.631 "nvmf_create_subsystem", 00:05:57.631 "nvmf_get_subsystems", 00:05:57.631 "env_dpdk_get_mem_stats", 00:05:57.631 "nbd_get_disks", 00:05:57.631 "nbd_stop_disk", 00:05:57.631 "nbd_start_disk", 00:05:57.631 "ublk_recover_disk", 00:05:57.631 "ublk_get_disks", 00:05:57.631 "ublk_stop_disk", 00:05:57.631 "ublk_start_disk", 00:05:57.631 "ublk_destroy_target", 00:05:57.632 "ublk_create_target", 00:05:57.632 "virtio_blk_create_transport", 00:05:57.632 "virtio_blk_get_transports", 00:05:57.632 "vhost_controller_set_coalescing", 00:05:57.632 "vhost_get_controllers", 00:05:57.632 "vhost_delete_controller", 00:05:57.632 "vhost_create_blk_controller", 00:05:57.632 "vhost_scsi_controller_remove_target", 00:05:57.632 "vhost_scsi_controller_add_target", 00:05:57.632 "vhost_start_scsi_controller", 00:05:57.632 "vhost_create_scsi_controller", 00:05:57.632 "thread_set_cpumask", 00:05:57.632 "framework_get_scheduler", 00:05:57.632 "framework_set_scheduler", 00:05:57.632 "framework_get_reactors", 00:05:57.632 "thread_get_io_channels", 00:05:57.632 "thread_get_pollers", 00:05:57.632 "thread_get_stats", 00:05:57.632 "framework_monitor_context_switch", 00:05:57.632 "spdk_kill_instance", 00:05:57.632 "log_enable_timestamps", 00:05:57.632 "log_get_flags", 00:05:57.632 "log_clear_flag", 00:05:57.632 "log_set_flag", 00:05:57.632 "log_get_level", 00:05:57.632 "log_set_level", 00:05:57.632 "log_get_print_level", 00:05:57.632 "log_set_print_level", 00:05:57.632 "framework_enable_cpumask_locks", 00:05:57.632 "framework_disable_cpumask_locks", 00:05:57.632 "framework_wait_init", 00:05:57.632 "framework_start_init", 00:05:57.632 "scsi_get_devices", 00:05:57.632 "bdev_get_histogram", 00:05:57.632 "bdev_enable_histogram", 00:05:57.632 "bdev_set_qos_limit", 00:05:57.632 "bdev_set_qd_sampling_period", 00:05:57.632 "bdev_get_bdevs", 00:05:57.632 "bdev_reset_iostat", 00:05:57.632 "bdev_get_iostat", 00:05:57.632 "bdev_examine", 00:05:57.632 "bdev_wait_for_examine", 00:05:57.632 "bdev_set_options", 00:05:57.632 "notify_get_notifications", 00:05:57.632 "notify_get_types", 00:05:57.632 "accel_get_stats", 00:05:57.632 "accel_set_options", 00:05:57.632 "accel_set_driver", 00:05:57.632 "accel_crypto_key_destroy", 00:05:57.632 "accel_crypto_keys_get", 00:05:57.632 "accel_crypto_key_create", 00:05:57.632 "accel_assign_opc", 00:05:57.632 "accel_get_module_info", 00:05:57.632 "accel_get_opc_assignments", 00:05:57.632 "vmd_rescan", 00:05:57.632 "vmd_remove_device", 00:05:57.632 "vmd_enable", 00:05:57.632 "sock_set_default_impl", 00:05:57.632 "sock_impl_set_options", 00:05:57.632 "sock_impl_get_options", 00:05:57.632 "iobuf_get_stats", 00:05:57.632 "iobuf_set_options", 00:05:57.632 "framework_get_pci_devices", 00:05:57.632 "framework_get_config", 00:05:57.632 "framework_get_subsystems", 00:05:57.632 "vfu_tgt_set_base_path", 00:05:57.632 "trace_get_info", 00:05:57.632 "trace_get_tpoint_group_mask", 00:05:57.632 "trace_disable_tpoint_group", 00:05:57.632 "trace_enable_tpoint_group", 00:05:57.632 "trace_clear_tpoint_mask", 00:05:57.632 "trace_set_tpoint_mask", 00:05:57.632 "spdk_get_version", 00:05:57.632 "rpc_get_methods" 00:05:57.632 ] 00:05:57.632 09:52:03 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:05:57.632 09:52:03 -- common/autotest_common.sh@718 -- # xtrace_disable 00:05:57.632 09:52:03 -- common/autotest_common.sh@10 -- # set +x 00:05:57.632 09:52:03 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:05:57.632 09:52:03 -- spdkcli/tcp.sh@38 -- # killprocess 2691376 00:05:57.632 09:52:03 -- common/autotest_common.sh@926 -- # '[' -z 2691376 ']' 00:05:57.632 09:52:03 -- common/autotest_common.sh@930 -- # kill -0 2691376 00:05:57.632 09:52:03 -- common/autotest_common.sh@931 -- # uname 00:05:57.632 09:52:03 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:57.632 09:52:03 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2691376 00:05:57.632 09:52:03 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:57.632 09:52:03 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:57.632 09:52:03 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2691376' 00:05:57.632 killing process with pid 2691376 00:05:57.632 09:52:03 -- common/autotest_common.sh@945 -- # kill 2691376 00:05:57.632 09:52:03 -- common/autotest_common.sh@950 -- # wait 2691376 00:05:57.891 00:05:57.891 real 0m1.682s 00:05:57.891 user 0m3.289s 00:05:57.891 sys 0m0.464s 00:05:57.891 09:52:03 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:57.891 09:52:03 -- common/autotest_common.sh@10 -- # set +x 00:05:57.891 ************************************ 00:05:57.891 END TEST spdkcli_tcp 00:05:57.891 ************************************ 00:05:57.891 09:52:03 -- spdk/autotest.sh@186 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:05:57.891 09:52:03 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:57.891 09:52:03 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:57.891 09:52:03 -- common/autotest_common.sh@10 -- # set +x 00:05:57.891 ************************************ 00:05:57.891 START TEST dpdk_mem_utility 00:05:57.891 ************************************ 00:05:57.891 09:52:03 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:05:58.148 * Looking for test storage... 00:05:58.148 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:05:58.148 09:52:03 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:05:58.148 09:52:03 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=2691712 00:05:58.148 09:52:03 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:58.148 09:52:03 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 2691712 00:05:58.148 09:52:03 -- common/autotest_common.sh@819 -- # '[' -z 2691712 ']' 00:05:58.148 09:52:03 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:58.148 09:52:03 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:58.148 09:52:03 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:58.148 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:58.148 09:52:03 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:58.148 09:52:03 -- common/autotest_common.sh@10 -- # set +x 00:05:58.148 [2024-07-13 09:52:03.793885] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:05:58.148 [2024-07-13 09:52:03.793979] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2691712 ] 00:05:58.148 EAL: No free 2048 kB hugepages reported on node 1 00:05:58.148 [2024-07-13 09:52:03.849679] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:58.148 [2024-07-13 09:52:03.931200] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:58.148 [2024-07-13 09:52:03.931367] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:59.083 09:52:04 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:59.083 09:52:04 -- common/autotest_common.sh@852 -- # return 0 00:05:59.083 09:52:04 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:05:59.083 09:52:04 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:05:59.083 09:52:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:59.083 09:52:04 -- common/autotest_common.sh@10 -- # set +x 00:05:59.083 { 00:05:59.083 "filename": "/tmp/spdk_mem_dump.txt" 00:05:59.083 } 00:05:59.083 09:52:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:59.083 09:52:04 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:05:59.083 DPDK memory size 814.000000 MiB in 1 heap(s) 00:05:59.083 1 heaps totaling size 814.000000 MiB 00:05:59.083 size: 814.000000 MiB heap id: 0 00:05:59.083 end heaps---------- 00:05:59.083 8 mempools totaling size 598.116089 MiB 00:05:59.083 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:05:59.083 size: 158.602051 MiB name: PDU_data_out_Pool 00:05:59.083 size: 84.521057 MiB name: bdev_io_2691712 00:05:59.083 size: 51.011292 MiB name: evtpool_2691712 00:05:59.083 size: 50.003479 MiB name: msgpool_2691712 00:05:59.083 size: 21.763794 MiB name: PDU_Pool 00:05:59.083 size: 19.513306 MiB name: SCSI_TASK_Pool 00:05:59.083 size: 0.026123 MiB name: Session_Pool 00:05:59.083 end mempools------- 00:05:59.083 6 memzones totaling size 4.142822 MiB 00:05:59.083 size: 1.000366 MiB name: RG_ring_0_2691712 00:05:59.083 size: 1.000366 MiB name: RG_ring_1_2691712 00:05:59.083 size: 1.000366 MiB name: RG_ring_4_2691712 00:05:59.083 size: 1.000366 MiB name: RG_ring_5_2691712 00:05:59.083 size: 0.125366 MiB name: RG_ring_2_2691712 00:05:59.083 size: 0.015991 MiB name: RG_ring_3_2691712 00:05:59.083 end memzones------- 00:05:59.083 09:52:04 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:05:59.083 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:05:59.083 list of free elements. size: 12.519348 MiB 00:05:59.083 element at address: 0x200000400000 with size: 1.999512 MiB 00:05:59.083 element at address: 0x200018e00000 with size: 0.999878 MiB 00:05:59.083 element at address: 0x200019000000 with size: 0.999878 MiB 00:05:59.083 element at address: 0x200003e00000 with size: 0.996277 MiB 00:05:59.083 element at address: 0x200031c00000 with size: 0.994446 MiB 00:05:59.083 element at address: 0x200013800000 with size: 0.978699 MiB 00:05:59.083 element at address: 0x200007000000 with size: 0.959839 MiB 00:05:59.083 element at address: 0x200019200000 with size: 0.936584 MiB 00:05:59.083 element at address: 0x200000200000 with size: 0.841614 MiB 00:05:59.083 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:05:59.083 element at address: 0x20000b200000 with size: 0.490723 MiB 00:05:59.083 element at address: 0x200000800000 with size: 0.487793 MiB 00:05:59.083 element at address: 0x200019400000 with size: 0.485657 MiB 00:05:59.083 element at address: 0x200027e00000 with size: 0.410034 MiB 00:05:59.083 element at address: 0x200003a00000 with size: 0.355530 MiB 00:05:59.083 list of standard malloc elements. size: 199.218079 MiB 00:05:59.083 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:05:59.083 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:05:59.083 element at address: 0x200018efff80 with size: 1.000122 MiB 00:05:59.084 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:05:59.084 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:05:59.084 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:05:59.084 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:05:59.084 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:05:59.084 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:05:59.084 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:05:59.084 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:05:59.084 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:05:59.084 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:05:59.084 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:05:59.084 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:05:59.084 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:05:59.084 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:05:59.084 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:05:59.084 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:05:59.084 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:05:59.084 element at address: 0x200003adb300 with size: 0.000183 MiB 00:05:59.084 element at address: 0x200003adb500 with size: 0.000183 MiB 00:05:59.084 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:05:59.084 element at address: 0x200003affa80 with size: 0.000183 MiB 00:05:59.084 element at address: 0x200003affb40 with size: 0.000183 MiB 00:05:59.084 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:05:59.084 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:05:59.084 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:05:59.084 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:05:59.084 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:05:59.084 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:05:59.084 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:05:59.084 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:05:59.084 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:05:59.084 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:05:59.084 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:05:59.084 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:05:59.084 element at address: 0x200027e69040 with size: 0.000183 MiB 00:05:59.084 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:05:59.084 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:05:59.084 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:05:59.084 list of memzone associated elements. size: 602.262573 MiB 00:05:59.084 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:05:59.084 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:05:59.084 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:05:59.084 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:05:59.084 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:05:59.084 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_2691712_0 00:05:59.084 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:05:59.084 associated memzone info: size: 48.002930 MiB name: MP_evtpool_2691712_0 00:05:59.084 element at address: 0x200003fff380 with size: 48.003052 MiB 00:05:59.084 associated memzone info: size: 48.002930 MiB name: MP_msgpool_2691712_0 00:05:59.084 element at address: 0x2000195be940 with size: 20.255554 MiB 00:05:59.084 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:05:59.084 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:05:59.084 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:05:59.084 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:05:59.084 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_2691712 00:05:59.084 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:05:59.084 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_2691712 00:05:59.084 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:05:59.084 associated memzone info: size: 1.007996 MiB name: MP_evtpool_2691712 00:05:59.084 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:05:59.084 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:05:59.084 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:05:59.084 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:05:59.084 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:05:59.084 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:05:59.084 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:05:59.084 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:05:59.084 element at address: 0x200003eff180 with size: 1.000488 MiB 00:05:59.084 associated memzone info: size: 1.000366 MiB name: RG_ring_0_2691712 00:05:59.084 element at address: 0x200003affc00 with size: 1.000488 MiB 00:05:59.084 associated memzone info: size: 1.000366 MiB name: RG_ring_1_2691712 00:05:59.084 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:05:59.084 associated memzone info: size: 1.000366 MiB name: RG_ring_4_2691712 00:05:59.084 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:05:59.084 associated memzone info: size: 1.000366 MiB name: RG_ring_5_2691712 00:05:59.084 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:05:59.084 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_2691712 00:05:59.084 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:05:59.084 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:05:59.084 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:05:59.084 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:05:59.084 element at address: 0x20001947c540 with size: 0.250488 MiB 00:05:59.084 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:05:59.084 element at address: 0x200003adf880 with size: 0.125488 MiB 00:05:59.084 associated memzone info: size: 0.125366 MiB name: RG_ring_2_2691712 00:05:59.084 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:05:59.084 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:05:59.084 element at address: 0x200027e69100 with size: 0.023743 MiB 00:05:59.084 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:05:59.084 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:05:59.084 associated memzone info: size: 0.015991 MiB name: RG_ring_3_2691712 00:05:59.084 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:05:59.084 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:05:59.084 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:05:59.084 associated memzone info: size: 0.000183 MiB name: MP_msgpool_2691712 00:05:59.084 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:05:59.084 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_2691712 00:05:59.084 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:05:59.084 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:05:59.084 09:52:04 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:05:59.084 09:52:04 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 2691712 00:05:59.084 09:52:04 -- common/autotest_common.sh@926 -- # '[' -z 2691712 ']' 00:05:59.084 09:52:04 -- common/autotest_common.sh@930 -- # kill -0 2691712 00:05:59.084 09:52:04 -- common/autotest_common.sh@931 -- # uname 00:05:59.084 09:52:04 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:59.084 09:52:04 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2691712 00:05:59.342 09:52:04 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:59.342 09:52:04 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:59.342 09:52:04 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2691712' 00:05:59.342 killing process with pid 2691712 00:05:59.342 09:52:04 -- common/autotest_common.sh@945 -- # kill 2691712 00:05:59.342 09:52:04 -- common/autotest_common.sh@950 -- # wait 2691712 00:05:59.599 00:05:59.599 real 0m1.629s 00:05:59.599 user 0m1.832s 00:05:59.599 sys 0m0.430s 00:05:59.599 09:52:05 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:59.599 09:52:05 -- common/autotest_common.sh@10 -- # set +x 00:05:59.599 ************************************ 00:05:59.599 END TEST dpdk_mem_utility 00:05:59.599 ************************************ 00:05:59.599 09:52:05 -- spdk/autotest.sh@187 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:05:59.599 09:52:05 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:59.599 09:52:05 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:59.599 09:52:05 -- common/autotest_common.sh@10 -- # set +x 00:05:59.599 ************************************ 00:05:59.599 START TEST event 00:05:59.599 ************************************ 00:05:59.599 09:52:05 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:05:59.599 * Looking for test storage... 00:05:59.600 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:05:59.600 09:52:05 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:05:59.600 09:52:05 -- bdev/nbd_common.sh@6 -- # set -e 00:05:59.600 09:52:05 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:05:59.600 09:52:05 -- common/autotest_common.sh@1077 -- # '[' 6 -le 1 ']' 00:05:59.600 09:52:05 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:59.600 09:52:05 -- common/autotest_common.sh@10 -- # set +x 00:05:59.600 ************************************ 00:05:59.600 START TEST event_perf 00:05:59.600 ************************************ 00:05:59.600 09:52:05 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:05:59.600 Running I/O for 1 seconds...[2024-07-13 09:52:05.405421] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:05:59.600 [2024-07-13 09:52:05.405500] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2691906 ] 00:05:59.856 EAL: No free 2048 kB hugepages reported on node 1 00:05:59.856 [2024-07-13 09:52:05.463187] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:59.856 [2024-07-13 09:52:05.552409] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:59.856 [2024-07-13 09:52:05.552467] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:59.856 [2024-07-13 09:52:05.552533] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:59.856 [2024-07-13 09:52:05.552536] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:01.229 Running I/O for 1 seconds... 00:06:01.229 lcore 0: 236707 00:06:01.229 lcore 1: 236706 00:06:01.229 lcore 2: 236707 00:06:01.229 lcore 3: 236706 00:06:01.229 done. 00:06:01.229 00:06:01.229 real 0m1.242s 00:06:01.229 user 0m4.148s 00:06:01.229 sys 0m0.090s 00:06:01.229 09:52:06 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:01.229 09:52:06 -- common/autotest_common.sh@10 -- # set +x 00:06:01.229 ************************************ 00:06:01.229 END TEST event_perf 00:06:01.229 ************************************ 00:06:01.229 09:52:06 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:06:01.229 09:52:06 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:06:01.229 09:52:06 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:01.229 09:52:06 -- common/autotest_common.sh@10 -- # set +x 00:06:01.229 ************************************ 00:06:01.229 START TEST event_reactor 00:06:01.229 ************************************ 00:06:01.229 09:52:06 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:06:01.229 [2024-07-13 09:52:06.671430] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:06:01.229 [2024-07-13 09:52:06.671510] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2692066 ] 00:06:01.229 EAL: No free 2048 kB hugepages reported on node 1 00:06:01.229 [2024-07-13 09:52:06.731526] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:01.229 [2024-07-13 09:52:06.823305] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:02.160 test_start 00:06:02.160 oneshot 00:06:02.160 tick 100 00:06:02.160 tick 100 00:06:02.160 tick 250 00:06:02.160 tick 100 00:06:02.160 tick 100 00:06:02.160 tick 250 00:06:02.160 tick 100 00:06:02.160 tick 500 00:06:02.160 tick 100 00:06:02.160 tick 100 00:06:02.160 tick 250 00:06:02.160 tick 100 00:06:02.160 tick 100 00:06:02.160 test_end 00:06:02.160 00:06:02.160 real 0m1.244s 00:06:02.160 user 0m1.151s 00:06:02.160 sys 0m0.087s 00:06:02.160 09:52:07 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:02.160 09:52:07 -- common/autotest_common.sh@10 -- # set +x 00:06:02.160 ************************************ 00:06:02.160 END TEST event_reactor 00:06:02.160 ************************************ 00:06:02.160 09:52:07 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:06:02.160 09:52:07 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:06:02.160 09:52:07 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:02.160 09:52:07 -- common/autotest_common.sh@10 -- # set +x 00:06:02.160 ************************************ 00:06:02.160 START TEST event_reactor_perf 00:06:02.160 ************************************ 00:06:02.160 09:52:07 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:06:02.160 [2024-07-13 09:52:07.941963] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:06:02.160 [2024-07-13 09:52:07.942040] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2692228 ] 00:06:02.160 EAL: No free 2048 kB hugepages reported on node 1 00:06:02.417 [2024-07-13 09:52:08.000353] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:02.417 [2024-07-13 09:52:08.083610] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:03.359 test_start 00:06:03.359 test_end 00:06:03.359 Performance: 385985 events per second 00:06:03.359 00:06:03.359 real 0m1.232s 00:06:03.359 user 0m1.140s 00:06:03.359 sys 0m0.087s 00:06:03.359 09:52:09 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:03.359 09:52:09 -- common/autotest_common.sh@10 -- # set +x 00:06:03.359 ************************************ 00:06:03.359 END TEST event_reactor_perf 00:06:03.359 ************************************ 00:06:03.616 09:52:09 -- event/event.sh@49 -- # uname -s 00:06:03.616 09:52:09 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:06:03.616 09:52:09 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:06:03.616 09:52:09 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:03.616 09:52:09 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:03.616 09:52:09 -- common/autotest_common.sh@10 -- # set +x 00:06:03.616 ************************************ 00:06:03.616 START TEST event_scheduler 00:06:03.616 ************************************ 00:06:03.616 09:52:09 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:06:03.616 * Looking for test storage... 00:06:03.616 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:06:03.616 09:52:09 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:06:03.616 09:52:09 -- scheduler/scheduler.sh@35 -- # scheduler_pid=2692477 00:06:03.616 09:52:09 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:06:03.616 09:52:09 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:06:03.616 09:52:09 -- scheduler/scheduler.sh@37 -- # waitforlisten 2692477 00:06:03.616 09:52:09 -- common/autotest_common.sh@819 -- # '[' -z 2692477 ']' 00:06:03.616 09:52:09 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:03.616 09:52:09 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:03.616 09:52:09 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:03.616 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:03.616 09:52:09 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:03.616 09:52:09 -- common/autotest_common.sh@10 -- # set +x 00:06:03.616 [2024-07-13 09:52:09.279669] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:06:03.616 [2024-07-13 09:52:09.279762] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2692477 ] 00:06:03.616 EAL: No free 2048 kB hugepages reported on node 1 00:06:03.616 [2024-07-13 09:52:09.338189] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:03.616 [2024-07-13 09:52:09.423080] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:03.616 [2024-07-13 09:52:09.423138] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:03.616 [2024-07-13 09:52:09.423203] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:03.616 [2024-07-13 09:52:09.423207] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:03.872 09:52:09 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:03.872 09:52:09 -- common/autotest_common.sh@852 -- # return 0 00:06:03.872 09:52:09 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:06:03.872 09:52:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:03.872 09:52:09 -- common/autotest_common.sh@10 -- # set +x 00:06:03.872 POWER: Env isn't set yet! 00:06:03.872 POWER: Attempting to initialise ACPI cpufreq power management... 00:06:03.872 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:06:03.872 POWER: Cannot get available frequencies of lcore 0 00:06:03.872 POWER: Attempting to initialise PSTAT power management... 00:06:03.872 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:06:03.872 POWER: Initialized successfully for lcore 0 power management 00:06:03.872 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:06:03.872 POWER: Initialized successfully for lcore 1 power management 00:06:03.872 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:06:03.872 POWER: Initialized successfully for lcore 2 power management 00:06:03.872 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:06:03.872 POWER: Initialized successfully for lcore 3 power management 00:06:03.872 [2024-07-13 09:52:09.518087] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:06:03.872 [2024-07-13 09:52:09.518106] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:06:03.872 [2024-07-13 09:52:09.518117] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:06:03.872 09:52:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:03.872 09:52:09 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:06:03.872 09:52:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:03.872 09:52:09 -- common/autotest_common.sh@10 -- # set +x 00:06:03.872 [2024-07-13 09:52:09.618905] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:06:03.872 09:52:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:03.872 09:52:09 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:06:03.872 09:52:09 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:03.872 09:52:09 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:03.872 09:52:09 -- common/autotest_common.sh@10 -- # set +x 00:06:03.872 ************************************ 00:06:03.872 START TEST scheduler_create_thread 00:06:03.872 ************************************ 00:06:03.872 09:52:09 -- common/autotest_common.sh@1104 -- # scheduler_create_thread 00:06:03.872 09:52:09 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:06:03.872 09:52:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:03.872 09:52:09 -- common/autotest_common.sh@10 -- # set +x 00:06:03.872 2 00:06:03.872 09:52:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:03.872 09:52:09 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:06:03.872 09:52:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:03.872 09:52:09 -- common/autotest_common.sh@10 -- # set +x 00:06:03.872 3 00:06:03.872 09:52:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:03.872 09:52:09 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:06:03.872 09:52:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:03.872 09:52:09 -- common/autotest_common.sh@10 -- # set +x 00:06:03.872 4 00:06:03.872 09:52:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:03.872 09:52:09 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:06:03.872 09:52:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:03.872 09:52:09 -- common/autotest_common.sh@10 -- # set +x 00:06:03.872 5 00:06:03.872 09:52:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:03.872 09:52:09 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:06:03.872 09:52:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:03.872 09:52:09 -- common/autotest_common.sh@10 -- # set +x 00:06:03.872 6 00:06:03.872 09:52:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:03.872 09:52:09 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:06:03.872 09:52:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:03.872 09:52:09 -- common/autotest_common.sh@10 -- # set +x 00:06:04.129 7 00:06:04.129 09:52:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:04.129 09:52:09 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:06:04.129 09:52:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:04.129 09:52:09 -- common/autotest_common.sh@10 -- # set +x 00:06:04.129 8 00:06:04.129 09:52:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:04.129 09:52:09 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:06:04.129 09:52:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:04.129 09:52:09 -- common/autotest_common.sh@10 -- # set +x 00:06:04.129 9 00:06:04.129 09:52:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:04.129 09:52:09 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:06:04.129 09:52:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:04.129 09:52:09 -- common/autotest_common.sh@10 -- # set +x 00:06:04.129 10 00:06:04.129 09:52:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:04.129 09:52:09 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:06:04.129 09:52:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:04.129 09:52:09 -- common/autotest_common.sh@10 -- # set +x 00:06:04.129 09:52:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:04.129 09:52:09 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:06:04.129 09:52:09 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:06:04.129 09:52:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:04.129 09:52:09 -- common/autotest_common.sh@10 -- # set +x 00:06:04.129 09:52:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:04.129 09:52:09 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:06:04.129 09:52:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:04.129 09:52:09 -- common/autotest_common.sh@10 -- # set +x 00:06:05.507 09:52:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:05.507 09:52:11 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:06:05.507 09:52:11 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:06:05.507 09:52:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:05.507 09:52:11 -- common/autotest_common.sh@10 -- # set +x 00:06:06.439 09:52:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:06.439 00:06:06.439 real 0m2.617s 00:06:06.439 user 0m0.013s 00:06:06.439 sys 0m0.001s 00:06:06.439 09:52:12 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:06.439 09:52:12 -- common/autotest_common.sh@10 -- # set +x 00:06:06.439 ************************************ 00:06:06.439 END TEST scheduler_create_thread 00:06:06.439 ************************************ 00:06:06.697 09:52:12 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:06:06.697 09:52:12 -- scheduler/scheduler.sh@46 -- # killprocess 2692477 00:06:06.697 09:52:12 -- common/autotest_common.sh@926 -- # '[' -z 2692477 ']' 00:06:06.697 09:52:12 -- common/autotest_common.sh@930 -- # kill -0 2692477 00:06:06.697 09:52:12 -- common/autotest_common.sh@931 -- # uname 00:06:06.697 09:52:12 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:06.697 09:52:12 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2692477 00:06:06.697 09:52:12 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:06:06.697 09:52:12 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:06:06.697 09:52:12 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2692477' 00:06:06.697 killing process with pid 2692477 00:06:06.697 09:52:12 -- common/autotest_common.sh@945 -- # kill 2692477 00:06:06.697 09:52:12 -- common/autotest_common.sh@950 -- # wait 2692477 00:06:06.954 [2024-07-13 09:52:12.721944] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:06:07.211 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:06:07.211 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:06:07.211 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:06:07.211 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:06:07.211 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:06:07.211 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:06:07.211 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:06:07.211 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:06:07.211 00:06:07.211 real 0m3.763s 00:06:07.211 user 0m5.728s 00:06:07.211 sys 0m0.306s 00:06:07.211 09:52:12 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:07.211 09:52:12 -- common/autotest_common.sh@10 -- # set +x 00:06:07.211 ************************************ 00:06:07.211 END TEST event_scheduler 00:06:07.211 ************************************ 00:06:07.211 09:52:12 -- event/event.sh@51 -- # modprobe -n nbd 00:06:07.211 09:52:12 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:06:07.211 09:52:12 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:07.211 09:52:12 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:07.211 09:52:12 -- common/autotest_common.sh@10 -- # set +x 00:06:07.211 ************************************ 00:06:07.211 START TEST app_repeat 00:06:07.211 ************************************ 00:06:07.211 09:52:12 -- common/autotest_common.sh@1104 -- # app_repeat_test 00:06:07.211 09:52:12 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:07.211 09:52:12 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:07.211 09:52:12 -- event/event.sh@13 -- # local nbd_list 00:06:07.211 09:52:12 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:07.211 09:52:12 -- event/event.sh@14 -- # local bdev_list 00:06:07.211 09:52:12 -- event/event.sh@15 -- # local repeat_times=4 00:06:07.211 09:52:12 -- event/event.sh@17 -- # modprobe nbd 00:06:07.211 09:52:12 -- event/event.sh@19 -- # repeat_pid=2692994 00:06:07.211 09:52:12 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:06:07.211 09:52:12 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:06:07.211 09:52:12 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 2692994' 00:06:07.211 Process app_repeat pid: 2692994 00:06:07.211 09:52:12 -- event/event.sh@23 -- # for i in {0..2} 00:06:07.211 09:52:12 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:06:07.211 spdk_app_start Round 0 00:06:07.211 09:52:12 -- event/event.sh@25 -- # waitforlisten 2692994 /var/tmp/spdk-nbd.sock 00:06:07.211 09:52:12 -- common/autotest_common.sh@819 -- # '[' -z 2692994 ']' 00:06:07.211 09:52:12 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:07.211 09:52:12 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:07.211 09:52:12 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:07.211 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:07.211 09:52:12 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:07.211 09:52:12 -- common/autotest_common.sh@10 -- # set +x 00:06:07.211 [2024-07-13 09:52:13.010784] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:06:07.211 [2024-07-13 09:52:13.010886] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2692994 ] 00:06:07.469 EAL: No free 2048 kB hugepages reported on node 1 00:06:07.469 [2024-07-13 09:52:13.073527] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:07.469 [2024-07-13 09:52:13.164508] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:07.469 [2024-07-13 09:52:13.164513] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:08.400 09:52:13 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:08.400 09:52:13 -- common/autotest_common.sh@852 -- # return 0 00:06:08.400 09:52:13 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:08.400 Malloc0 00:06:08.400 09:52:14 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:08.658 Malloc1 00:06:08.658 09:52:14 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:08.658 09:52:14 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:08.658 09:52:14 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:08.658 09:52:14 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:08.658 09:52:14 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:08.658 09:52:14 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:08.658 09:52:14 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:08.658 09:52:14 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:08.658 09:52:14 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:08.658 09:52:14 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:08.658 09:52:14 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:08.658 09:52:14 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:08.658 09:52:14 -- bdev/nbd_common.sh@12 -- # local i 00:06:08.658 09:52:14 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:08.658 09:52:14 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:08.658 09:52:14 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:08.916 /dev/nbd0 00:06:08.916 09:52:14 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:08.916 09:52:14 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:08.916 09:52:14 -- common/autotest_common.sh@856 -- # local nbd_name=nbd0 00:06:08.916 09:52:14 -- common/autotest_common.sh@857 -- # local i 00:06:08.916 09:52:14 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:06:08.916 09:52:14 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:06:08.916 09:52:14 -- common/autotest_common.sh@860 -- # grep -q -w nbd0 /proc/partitions 00:06:08.916 09:52:14 -- common/autotest_common.sh@861 -- # break 00:06:08.916 09:52:14 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:06:08.916 09:52:14 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:06:08.916 09:52:14 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:08.916 1+0 records in 00:06:08.916 1+0 records out 00:06:08.916 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000199218 s, 20.6 MB/s 00:06:08.916 09:52:14 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:08.916 09:52:14 -- common/autotest_common.sh@874 -- # size=4096 00:06:08.916 09:52:14 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:08.916 09:52:14 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:06:08.916 09:52:14 -- common/autotest_common.sh@877 -- # return 0 00:06:08.916 09:52:14 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:08.916 09:52:14 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:08.917 09:52:14 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:09.174 /dev/nbd1 00:06:09.433 09:52:14 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:09.433 09:52:14 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:09.433 09:52:14 -- common/autotest_common.sh@856 -- # local nbd_name=nbd1 00:06:09.433 09:52:14 -- common/autotest_common.sh@857 -- # local i 00:06:09.433 09:52:14 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:06:09.433 09:52:14 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:06:09.433 09:52:14 -- common/autotest_common.sh@860 -- # grep -q -w nbd1 /proc/partitions 00:06:09.433 09:52:14 -- common/autotest_common.sh@861 -- # break 00:06:09.433 09:52:14 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:06:09.433 09:52:14 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:06:09.433 09:52:15 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:09.433 1+0 records in 00:06:09.433 1+0 records out 00:06:09.433 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000200231 s, 20.5 MB/s 00:06:09.433 09:52:15 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:09.433 09:52:15 -- common/autotest_common.sh@874 -- # size=4096 00:06:09.433 09:52:15 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:09.433 09:52:15 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:06:09.433 09:52:15 -- common/autotest_common.sh@877 -- # return 0 00:06:09.433 09:52:15 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:09.433 09:52:15 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:09.433 09:52:15 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:09.433 09:52:15 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:09.433 09:52:15 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:09.692 09:52:15 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:09.692 { 00:06:09.692 "nbd_device": "/dev/nbd0", 00:06:09.692 "bdev_name": "Malloc0" 00:06:09.692 }, 00:06:09.692 { 00:06:09.692 "nbd_device": "/dev/nbd1", 00:06:09.692 "bdev_name": "Malloc1" 00:06:09.692 } 00:06:09.692 ]' 00:06:09.692 09:52:15 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:09.692 { 00:06:09.692 "nbd_device": "/dev/nbd0", 00:06:09.692 "bdev_name": "Malloc0" 00:06:09.692 }, 00:06:09.692 { 00:06:09.692 "nbd_device": "/dev/nbd1", 00:06:09.692 "bdev_name": "Malloc1" 00:06:09.692 } 00:06:09.692 ]' 00:06:09.692 09:52:15 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:09.692 09:52:15 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:09.692 /dev/nbd1' 00:06:09.692 09:52:15 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:09.692 /dev/nbd1' 00:06:09.692 09:52:15 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:09.692 09:52:15 -- bdev/nbd_common.sh@65 -- # count=2 00:06:09.692 09:52:15 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:09.692 09:52:15 -- bdev/nbd_common.sh@95 -- # count=2 00:06:09.692 09:52:15 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:09.692 09:52:15 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:09.692 09:52:15 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:09.692 09:52:15 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:09.692 09:52:15 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:09.692 09:52:15 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:09.692 09:52:15 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:09.692 09:52:15 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:09.692 256+0 records in 00:06:09.692 256+0 records out 00:06:09.692 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00506945 s, 207 MB/s 00:06:09.692 09:52:15 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:09.692 09:52:15 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:09.692 256+0 records in 00:06:09.692 256+0 records out 00:06:09.692 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195622 s, 53.6 MB/s 00:06:09.692 09:52:15 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:09.692 09:52:15 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:09.692 256+0 records in 00:06:09.692 256+0 records out 00:06:09.692 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224669 s, 46.7 MB/s 00:06:09.692 09:52:15 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:09.692 09:52:15 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:09.692 09:52:15 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:09.692 09:52:15 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:09.692 09:52:15 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:09.692 09:52:15 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:09.692 09:52:15 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:09.692 09:52:15 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:09.692 09:52:15 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:09.692 09:52:15 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:09.692 09:52:15 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:09.692 09:52:15 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:09.692 09:52:15 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:09.692 09:52:15 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:09.692 09:52:15 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:09.692 09:52:15 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:09.692 09:52:15 -- bdev/nbd_common.sh@51 -- # local i 00:06:09.692 09:52:15 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:09.692 09:52:15 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:09.950 09:52:15 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:09.950 09:52:15 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:09.950 09:52:15 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:09.950 09:52:15 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:09.950 09:52:15 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:09.950 09:52:15 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:09.950 09:52:15 -- bdev/nbd_common.sh@41 -- # break 00:06:09.950 09:52:15 -- bdev/nbd_common.sh@45 -- # return 0 00:06:09.950 09:52:15 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:09.950 09:52:15 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:10.207 09:52:15 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:10.207 09:52:15 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:10.208 09:52:15 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:10.208 09:52:15 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:10.208 09:52:15 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:10.208 09:52:15 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:10.208 09:52:15 -- bdev/nbd_common.sh@41 -- # break 00:06:10.208 09:52:15 -- bdev/nbd_common.sh@45 -- # return 0 00:06:10.208 09:52:15 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:10.208 09:52:15 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:10.208 09:52:15 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:10.465 09:52:16 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:10.465 09:52:16 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:10.465 09:52:16 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:10.465 09:52:16 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:10.465 09:52:16 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:10.465 09:52:16 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:10.465 09:52:16 -- bdev/nbd_common.sh@65 -- # true 00:06:10.465 09:52:16 -- bdev/nbd_common.sh@65 -- # count=0 00:06:10.465 09:52:16 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:10.465 09:52:16 -- bdev/nbd_common.sh@104 -- # count=0 00:06:10.465 09:52:16 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:10.465 09:52:16 -- bdev/nbd_common.sh@109 -- # return 0 00:06:10.465 09:52:16 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:10.724 09:52:16 -- event/event.sh@35 -- # sleep 3 00:06:10.982 [2024-07-13 09:52:16.643097] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:10.982 [2024-07-13 09:52:16.731067] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:10.982 [2024-07-13 09:52:16.731067] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:10.982 [2024-07-13 09:52:16.792487] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:10.982 [2024-07-13 09:52:16.792570] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:14.295 09:52:19 -- event/event.sh@23 -- # for i in {0..2} 00:06:14.295 09:52:19 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:06:14.295 spdk_app_start Round 1 00:06:14.295 09:52:19 -- event/event.sh@25 -- # waitforlisten 2692994 /var/tmp/spdk-nbd.sock 00:06:14.295 09:52:19 -- common/autotest_common.sh@819 -- # '[' -z 2692994 ']' 00:06:14.295 09:52:19 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:14.295 09:52:19 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:14.295 09:52:19 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:14.295 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:14.295 09:52:19 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:14.295 09:52:19 -- common/autotest_common.sh@10 -- # set +x 00:06:14.295 09:52:19 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:14.295 09:52:19 -- common/autotest_common.sh@852 -- # return 0 00:06:14.295 09:52:19 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:14.295 Malloc0 00:06:14.295 09:52:19 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:14.553 Malloc1 00:06:14.553 09:52:20 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:14.553 09:52:20 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:14.553 09:52:20 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:14.553 09:52:20 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:14.553 09:52:20 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:14.553 09:52:20 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:14.553 09:52:20 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:14.553 09:52:20 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:14.553 09:52:20 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:14.553 09:52:20 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:14.553 09:52:20 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:14.553 09:52:20 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:14.553 09:52:20 -- bdev/nbd_common.sh@12 -- # local i 00:06:14.553 09:52:20 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:14.553 09:52:20 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:14.553 09:52:20 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:14.811 /dev/nbd0 00:06:14.811 09:52:20 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:14.811 09:52:20 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:14.811 09:52:20 -- common/autotest_common.sh@856 -- # local nbd_name=nbd0 00:06:14.811 09:52:20 -- common/autotest_common.sh@857 -- # local i 00:06:14.811 09:52:20 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:06:14.811 09:52:20 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:06:14.811 09:52:20 -- common/autotest_common.sh@860 -- # grep -q -w nbd0 /proc/partitions 00:06:14.811 09:52:20 -- common/autotest_common.sh@861 -- # break 00:06:14.811 09:52:20 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:06:14.811 09:52:20 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:06:14.811 09:52:20 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:14.811 1+0 records in 00:06:14.811 1+0 records out 00:06:14.811 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000250636 s, 16.3 MB/s 00:06:14.811 09:52:20 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:14.811 09:52:20 -- common/autotest_common.sh@874 -- # size=4096 00:06:14.811 09:52:20 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:14.811 09:52:20 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:06:14.811 09:52:20 -- common/autotest_common.sh@877 -- # return 0 00:06:14.811 09:52:20 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:14.811 09:52:20 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:14.811 09:52:20 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:15.069 /dev/nbd1 00:06:15.069 09:52:20 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:15.069 09:52:20 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:15.069 09:52:20 -- common/autotest_common.sh@856 -- # local nbd_name=nbd1 00:06:15.069 09:52:20 -- common/autotest_common.sh@857 -- # local i 00:06:15.069 09:52:20 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:06:15.069 09:52:20 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:06:15.069 09:52:20 -- common/autotest_common.sh@860 -- # grep -q -w nbd1 /proc/partitions 00:06:15.069 09:52:20 -- common/autotest_common.sh@861 -- # break 00:06:15.069 09:52:20 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:06:15.069 09:52:20 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:06:15.069 09:52:20 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:15.069 1+0 records in 00:06:15.069 1+0 records out 00:06:15.069 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000205819 s, 19.9 MB/s 00:06:15.069 09:52:20 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:15.069 09:52:20 -- common/autotest_common.sh@874 -- # size=4096 00:06:15.069 09:52:20 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:15.069 09:52:20 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:06:15.069 09:52:20 -- common/autotest_common.sh@877 -- # return 0 00:06:15.069 09:52:20 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:15.069 09:52:20 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:15.069 09:52:20 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:15.069 09:52:20 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:15.069 09:52:20 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:15.327 09:52:20 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:15.327 { 00:06:15.327 "nbd_device": "/dev/nbd0", 00:06:15.327 "bdev_name": "Malloc0" 00:06:15.327 }, 00:06:15.327 { 00:06:15.327 "nbd_device": "/dev/nbd1", 00:06:15.327 "bdev_name": "Malloc1" 00:06:15.327 } 00:06:15.327 ]' 00:06:15.327 09:52:20 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:15.327 { 00:06:15.327 "nbd_device": "/dev/nbd0", 00:06:15.327 "bdev_name": "Malloc0" 00:06:15.327 }, 00:06:15.327 { 00:06:15.327 "nbd_device": "/dev/nbd1", 00:06:15.327 "bdev_name": "Malloc1" 00:06:15.327 } 00:06:15.327 ]' 00:06:15.327 09:52:20 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:15.327 09:52:20 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:15.327 /dev/nbd1' 00:06:15.327 09:52:21 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:15.327 /dev/nbd1' 00:06:15.327 09:52:21 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:15.327 09:52:21 -- bdev/nbd_common.sh@65 -- # count=2 00:06:15.327 09:52:21 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:15.327 09:52:21 -- bdev/nbd_common.sh@95 -- # count=2 00:06:15.327 09:52:21 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:15.327 09:52:21 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:15.327 09:52:21 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:15.327 09:52:21 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:15.327 09:52:21 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:15.327 09:52:21 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:15.327 09:52:21 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:15.327 09:52:21 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:15.327 256+0 records in 00:06:15.327 256+0 records out 00:06:15.327 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00378485 s, 277 MB/s 00:06:15.327 09:52:21 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:15.327 09:52:21 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:15.327 256+0 records in 00:06:15.327 256+0 records out 00:06:15.327 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228632 s, 45.9 MB/s 00:06:15.327 09:52:21 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:15.327 09:52:21 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:15.327 256+0 records in 00:06:15.327 256+0 records out 00:06:15.327 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234627 s, 44.7 MB/s 00:06:15.327 09:52:21 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:15.327 09:52:21 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:15.327 09:52:21 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:15.327 09:52:21 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:15.327 09:52:21 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:15.327 09:52:21 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:15.327 09:52:21 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:15.327 09:52:21 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:15.327 09:52:21 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:15.327 09:52:21 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:15.327 09:52:21 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:15.327 09:52:21 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:15.327 09:52:21 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:15.327 09:52:21 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:15.327 09:52:21 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:15.327 09:52:21 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:15.327 09:52:21 -- bdev/nbd_common.sh@51 -- # local i 00:06:15.327 09:52:21 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:15.327 09:52:21 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:15.585 09:52:21 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:15.585 09:52:21 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:15.585 09:52:21 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:15.585 09:52:21 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:15.585 09:52:21 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:15.585 09:52:21 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:15.585 09:52:21 -- bdev/nbd_common.sh@41 -- # break 00:06:15.585 09:52:21 -- bdev/nbd_common.sh@45 -- # return 0 00:06:15.585 09:52:21 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:15.585 09:52:21 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:15.843 09:52:21 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:15.843 09:52:21 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:15.843 09:52:21 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:15.843 09:52:21 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:15.843 09:52:21 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:15.843 09:52:21 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:15.843 09:52:21 -- bdev/nbd_common.sh@41 -- # break 00:06:15.843 09:52:21 -- bdev/nbd_common.sh@45 -- # return 0 00:06:15.843 09:52:21 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:15.843 09:52:21 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:15.843 09:52:21 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:16.101 09:52:21 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:16.101 09:52:21 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:16.101 09:52:21 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:16.101 09:52:21 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:16.101 09:52:21 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:16.101 09:52:21 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:16.101 09:52:21 -- bdev/nbd_common.sh@65 -- # true 00:06:16.101 09:52:21 -- bdev/nbd_common.sh@65 -- # count=0 00:06:16.101 09:52:21 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:16.101 09:52:21 -- bdev/nbd_common.sh@104 -- # count=0 00:06:16.101 09:52:21 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:16.101 09:52:21 -- bdev/nbd_common.sh@109 -- # return 0 00:06:16.101 09:52:21 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:16.359 09:52:22 -- event/event.sh@35 -- # sleep 3 00:06:16.617 [2024-07-13 09:52:22.371413] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:16.875 [2024-07-13 09:52:22.459948] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:16.875 [2024-07-13 09:52:22.459952] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:16.875 [2024-07-13 09:52:22.521306] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:16.875 [2024-07-13 09:52:22.521391] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:19.410 09:52:25 -- event/event.sh@23 -- # for i in {0..2} 00:06:19.410 09:52:25 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:06:19.410 spdk_app_start Round 2 00:06:19.410 09:52:25 -- event/event.sh@25 -- # waitforlisten 2692994 /var/tmp/spdk-nbd.sock 00:06:19.410 09:52:25 -- common/autotest_common.sh@819 -- # '[' -z 2692994 ']' 00:06:19.410 09:52:25 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:19.410 09:52:25 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:19.410 09:52:25 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:19.410 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:19.410 09:52:25 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:19.410 09:52:25 -- common/autotest_common.sh@10 -- # set +x 00:06:19.668 09:52:25 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:19.668 09:52:25 -- common/autotest_common.sh@852 -- # return 0 00:06:19.668 09:52:25 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:19.926 Malloc0 00:06:19.926 09:52:25 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:20.184 Malloc1 00:06:20.184 09:52:25 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:20.184 09:52:25 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:20.184 09:52:25 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:20.184 09:52:25 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:20.184 09:52:25 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:20.184 09:52:25 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:20.184 09:52:25 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:20.184 09:52:25 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:20.184 09:52:25 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:20.184 09:52:25 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:20.184 09:52:25 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:20.184 09:52:25 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:20.184 09:52:25 -- bdev/nbd_common.sh@12 -- # local i 00:06:20.184 09:52:25 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:20.184 09:52:25 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:20.184 09:52:25 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:20.442 /dev/nbd0 00:06:20.442 09:52:26 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:20.442 09:52:26 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:20.442 09:52:26 -- common/autotest_common.sh@856 -- # local nbd_name=nbd0 00:06:20.442 09:52:26 -- common/autotest_common.sh@857 -- # local i 00:06:20.442 09:52:26 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:06:20.442 09:52:26 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:06:20.442 09:52:26 -- common/autotest_common.sh@860 -- # grep -q -w nbd0 /proc/partitions 00:06:20.442 09:52:26 -- common/autotest_common.sh@861 -- # break 00:06:20.442 09:52:26 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:06:20.442 09:52:26 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:06:20.442 09:52:26 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:20.442 1+0 records in 00:06:20.442 1+0 records out 00:06:20.442 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000179531 s, 22.8 MB/s 00:06:20.442 09:52:26 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:20.442 09:52:26 -- common/autotest_common.sh@874 -- # size=4096 00:06:20.442 09:52:26 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:20.442 09:52:26 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:06:20.442 09:52:26 -- common/autotest_common.sh@877 -- # return 0 00:06:20.442 09:52:26 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:20.442 09:52:26 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:20.442 09:52:26 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:20.699 /dev/nbd1 00:06:20.699 09:52:26 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:20.699 09:52:26 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:20.699 09:52:26 -- common/autotest_common.sh@856 -- # local nbd_name=nbd1 00:06:20.699 09:52:26 -- common/autotest_common.sh@857 -- # local i 00:06:20.699 09:52:26 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:06:20.699 09:52:26 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:06:20.699 09:52:26 -- common/autotest_common.sh@860 -- # grep -q -w nbd1 /proc/partitions 00:06:20.699 09:52:26 -- common/autotest_common.sh@861 -- # break 00:06:20.699 09:52:26 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:06:20.699 09:52:26 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:06:20.699 09:52:26 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:20.699 1+0 records in 00:06:20.699 1+0 records out 00:06:20.699 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000171255 s, 23.9 MB/s 00:06:20.699 09:52:26 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:20.699 09:52:26 -- common/autotest_common.sh@874 -- # size=4096 00:06:20.699 09:52:26 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:20.699 09:52:26 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:06:20.699 09:52:26 -- common/autotest_common.sh@877 -- # return 0 00:06:20.699 09:52:26 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:20.699 09:52:26 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:20.699 09:52:26 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:20.699 09:52:26 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:20.699 09:52:26 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:20.957 09:52:26 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:20.957 { 00:06:20.957 "nbd_device": "/dev/nbd0", 00:06:20.957 "bdev_name": "Malloc0" 00:06:20.957 }, 00:06:20.957 { 00:06:20.957 "nbd_device": "/dev/nbd1", 00:06:20.957 "bdev_name": "Malloc1" 00:06:20.957 } 00:06:20.957 ]' 00:06:20.957 09:52:26 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:20.957 { 00:06:20.957 "nbd_device": "/dev/nbd0", 00:06:20.957 "bdev_name": "Malloc0" 00:06:20.957 }, 00:06:20.957 { 00:06:20.957 "nbd_device": "/dev/nbd1", 00:06:20.957 "bdev_name": "Malloc1" 00:06:20.957 } 00:06:20.958 ]' 00:06:20.958 09:52:26 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:20.958 09:52:26 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:20.958 /dev/nbd1' 00:06:20.958 09:52:26 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:20.958 /dev/nbd1' 00:06:20.958 09:52:26 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:20.958 09:52:26 -- bdev/nbd_common.sh@65 -- # count=2 00:06:20.958 09:52:26 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:20.958 09:52:26 -- bdev/nbd_common.sh@95 -- # count=2 00:06:20.958 09:52:26 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:20.958 09:52:26 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:20.958 09:52:26 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:20.958 09:52:26 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:20.958 09:52:26 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:20.958 09:52:26 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:20.958 09:52:26 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:20.958 09:52:26 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:20.958 256+0 records in 00:06:20.958 256+0 records out 00:06:20.958 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00508234 s, 206 MB/s 00:06:20.958 09:52:26 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:20.958 09:52:26 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:20.958 256+0 records in 00:06:20.958 256+0 records out 00:06:20.958 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198694 s, 52.8 MB/s 00:06:20.958 09:52:26 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:20.958 09:52:26 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:20.958 256+0 records in 00:06:20.958 256+0 records out 00:06:20.958 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222654 s, 47.1 MB/s 00:06:20.958 09:52:26 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:20.958 09:52:26 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:20.958 09:52:26 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:20.958 09:52:26 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:20.958 09:52:26 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:20.958 09:52:26 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:20.958 09:52:26 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:20.958 09:52:26 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:20.958 09:52:26 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:20.958 09:52:26 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:20.958 09:52:26 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:20.958 09:52:26 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:20.958 09:52:26 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:20.958 09:52:26 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:20.958 09:52:26 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:20.958 09:52:26 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:20.958 09:52:26 -- bdev/nbd_common.sh@51 -- # local i 00:06:20.958 09:52:26 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:20.958 09:52:26 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:21.216 09:52:27 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:21.216 09:52:27 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:21.216 09:52:27 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:21.216 09:52:27 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:21.216 09:52:27 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:21.216 09:52:27 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:21.216 09:52:27 -- bdev/nbd_common.sh@41 -- # break 00:06:21.216 09:52:27 -- bdev/nbd_common.sh@45 -- # return 0 00:06:21.216 09:52:27 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:21.216 09:52:27 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:21.474 09:52:27 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:21.474 09:52:27 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:21.474 09:52:27 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:21.474 09:52:27 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:21.474 09:52:27 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:21.474 09:52:27 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:21.474 09:52:27 -- bdev/nbd_common.sh@41 -- # break 00:06:21.474 09:52:27 -- bdev/nbd_common.sh@45 -- # return 0 00:06:21.474 09:52:27 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:21.474 09:52:27 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:21.474 09:52:27 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:21.732 09:52:27 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:21.732 09:52:27 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:21.732 09:52:27 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:21.989 09:52:27 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:21.989 09:52:27 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:21.989 09:52:27 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:21.989 09:52:27 -- bdev/nbd_common.sh@65 -- # true 00:06:21.989 09:52:27 -- bdev/nbd_common.sh@65 -- # count=0 00:06:21.989 09:52:27 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:21.989 09:52:27 -- bdev/nbd_common.sh@104 -- # count=0 00:06:21.989 09:52:27 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:21.989 09:52:27 -- bdev/nbd_common.sh@109 -- # return 0 00:06:21.989 09:52:27 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:22.245 09:52:27 -- event/event.sh@35 -- # sleep 3 00:06:22.503 [2024-07-13 09:52:28.063603] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:22.503 [2024-07-13 09:52:28.151360] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:22.503 [2024-07-13 09:52:28.151364] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:22.503 [2024-07-13 09:52:28.213049] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:22.503 [2024-07-13 09:52:28.213124] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:25.030 09:52:30 -- event/event.sh@38 -- # waitforlisten 2692994 /var/tmp/spdk-nbd.sock 00:06:25.030 09:52:30 -- common/autotest_common.sh@819 -- # '[' -z 2692994 ']' 00:06:25.030 09:52:30 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:25.030 09:52:30 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:25.030 09:52:30 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:25.030 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:25.030 09:52:30 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:25.030 09:52:30 -- common/autotest_common.sh@10 -- # set +x 00:06:25.288 09:52:31 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:25.288 09:52:31 -- common/autotest_common.sh@852 -- # return 0 00:06:25.288 09:52:31 -- event/event.sh@39 -- # killprocess 2692994 00:06:25.288 09:52:31 -- common/autotest_common.sh@926 -- # '[' -z 2692994 ']' 00:06:25.288 09:52:31 -- common/autotest_common.sh@930 -- # kill -0 2692994 00:06:25.288 09:52:31 -- common/autotest_common.sh@931 -- # uname 00:06:25.288 09:52:31 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:25.288 09:52:31 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2692994 00:06:25.546 09:52:31 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:25.546 09:52:31 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:25.546 09:52:31 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2692994' 00:06:25.546 killing process with pid 2692994 00:06:25.546 09:52:31 -- common/autotest_common.sh@945 -- # kill 2692994 00:06:25.546 09:52:31 -- common/autotest_common.sh@950 -- # wait 2692994 00:06:25.546 spdk_app_start is called in Round 0. 00:06:25.546 Shutdown signal received, stop current app iteration 00:06:25.546 Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 reinitialization... 00:06:25.546 spdk_app_start is called in Round 1. 00:06:25.546 Shutdown signal received, stop current app iteration 00:06:25.546 Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 reinitialization... 00:06:25.546 spdk_app_start is called in Round 2. 00:06:25.546 Shutdown signal received, stop current app iteration 00:06:25.546 Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 reinitialization... 00:06:25.546 spdk_app_start is called in Round 3. 00:06:25.546 Shutdown signal received, stop current app iteration 00:06:25.546 09:52:31 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:06:25.546 09:52:31 -- event/event.sh@42 -- # return 0 00:06:25.546 00:06:25.546 real 0m18.331s 00:06:25.546 user 0m39.840s 00:06:25.546 sys 0m3.176s 00:06:25.546 09:52:31 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:25.546 09:52:31 -- common/autotest_common.sh@10 -- # set +x 00:06:25.546 ************************************ 00:06:25.546 END TEST app_repeat 00:06:25.546 ************************************ 00:06:25.546 09:52:31 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:06:25.546 09:52:31 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:25.546 09:52:31 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:25.546 09:52:31 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:25.546 09:52:31 -- common/autotest_common.sh@10 -- # set +x 00:06:25.546 ************************************ 00:06:25.546 START TEST cpu_locks 00:06:25.546 ************************************ 00:06:25.546 09:52:31 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:25.804 * Looking for test storage... 00:06:25.804 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:06:25.804 09:52:31 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:06:25.804 09:52:31 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:06:25.804 09:52:31 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:06:25.804 09:52:31 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:06:25.804 09:52:31 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:25.804 09:52:31 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:25.804 09:52:31 -- common/autotest_common.sh@10 -- # set +x 00:06:25.804 ************************************ 00:06:25.804 START TEST default_locks 00:06:25.804 ************************************ 00:06:25.804 09:52:31 -- common/autotest_common.sh@1104 -- # default_locks 00:06:25.804 09:52:31 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=2695411 00:06:25.804 09:52:31 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:25.804 09:52:31 -- event/cpu_locks.sh@47 -- # waitforlisten 2695411 00:06:25.804 09:52:31 -- common/autotest_common.sh@819 -- # '[' -z 2695411 ']' 00:06:25.804 09:52:31 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:25.804 09:52:31 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:25.804 09:52:31 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:25.804 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:25.804 09:52:31 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:25.804 09:52:31 -- common/autotest_common.sh@10 -- # set +x 00:06:25.804 [2024-07-13 09:52:31.448860] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:06:25.804 [2024-07-13 09:52:31.448960] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2695411 ] 00:06:25.804 EAL: No free 2048 kB hugepages reported on node 1 00:06:25.804 [2024-07-13 09:52:31.505721] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:25.804 [2024-07-13 09:52:31.588321] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:25.804 [2024-07-13 09:52:31.588487] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:26.737 09:52:32 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:26.737 09:52:32 -- common/autotest_common.sh@852 -- # return 0 00:06:26.737 09:52:32 -- event/cpu_locks.sh@49 -- # locks_exist 2695411 00:06:26.737 09:52:32 -- event/cpu_locks.sh@22 -- # lslocks -p 2695411 00:06:26.737 09:52:32 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:27.302 lslocks: write error 00:06:27.302 09:52:32 -- event/cpu_locks.sh@50 -- # killprocess 2695411 00:06:27.302 09:52:32 -- common/autotest_common.sh@926 -- # '[' -z 2695411 ']' 00:06:27.302 09:52:32 -- common/autotest_common.sh@930 -- # kill -0 2695411 00:06:27.302 09:52:32 -- common/autotest_common.sh@931 -- # uname 00:06:27.302 09:52:32 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:27.302 09:52:32 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2695411 00:06:27.302 09:52:32 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:27.302 09:52:32 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:27.302 09:52:32 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2695411' 00:06:27.302 killing process with pid 2695411 00:06:27.302 09:52:32 -- common/autotest_common.sh@945 -- # kill 2695411 00:06:27.302 09:52:32 -- common/autotest_common.sh@950 -- # wait 2695411 00:06:27.560 09:52:33 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 2695411 00:06:27.560 09:52:33 -- common/autotest_common.sh@640 -- # local es=0 00:06:27.560 09:52:33 -- common/autotest_common.sh@642 -- # valid_exec_arg waitforlisten 2695411 00:06:27.560 09:52:33 -- common/autotest_common.sh@628 -- # local arg=waitforlisten 00:06:27.560 09:52:33 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:27.560 09:52:33 -- common/autotest_common.sh@632 -- # type -t waitforlisten 00:06:27.560 09:52:33 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:27.560 09:52:33 -- common/autotest_common.sh@643 -- # waitforlisten 2695411 00:06:27.560 09:52:33 -- common/autotest_common.sh@819 -- # '[' -z 2695411 ']' 00:06:27.560 09:52:33 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:27.560 09:52:33 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:27.560 09:52:33 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:27.560 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:27.560 09:52:33 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:27.560 09:52:33 -- common/autotest_common.sh@10 -- # set +x 00:06:27.560 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 834: kill: (2695411) - No such process 00:06:27.560 ERROR: process (pid: 2695411) is no longer running 00:06:27.560 09:52:33 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:27.560 09:52:33 -- common/autotest_common.sh@852 -- # return 1 00:06:27.560 09:52:33 -- common/autotest_common.sh@643 -- # es=1 00:06:27.560 09:52:33 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:06:27.560 09:52:33 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:06:27.560 09:52:33 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:06:27.560 09:52:33 -- event/cpu_locks.sh@54 -- # no_locks 00:06:27.560 09:52:33 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:27.560 09:52:33 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:27.560 09:52:33 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:27.560 00:06:27.560 real 0m1.848s 00:06:27.560 user 0m1.952s 00:06:27.560 sys 0m0.598s 00:06:27.560 09:52:33 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:27.560 09:52:33 -- common/autotest_common.sh@10 -- # set +x 00:06:27.560 ************************************ 00:06:27.560 END TEST default_locks 00:06:27.560 ************************************ 00:06:27.560 09:52:33 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:06:27.560 09:52:33 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:27.560 09:52:33 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:27.560 09:52:33 -- common/autotest_common.sh@10 -- # set +x 00:06:27.560 ************************************ 00:06:27.560 START TEST default_locks_via_rpc 00:06:27.560 ************************************ 00:06:27.560 09:52:33 -- common/autotest_common.sh@1104 -- # default_locks_via_rpc 00:06:27.560 09:52:33 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=2695712 00:06:27.560 09:52:33 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:27.560 09:52:33 -- event/cpu_locks.sh@63 -- # waitforlisten 2695712 00:06:27.560 09:52:33 -- common/autotest_common.sh@819 -- # '[' -z 2695712 ']' 00:06:27.560 09:52:33 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:27.560 09:52:33 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:27.560 09:52:33 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:27.560 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:27.560 09:52:33 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:27.560 09:52:33 -- common/autotest_common.sh@10 -- # set +x 00:06:27.560 [2024-07-13 09:52:33.319301] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:06:27.560 [2024-07-13 09:52:33.319374] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2695712 ] 00:06:27.560 EAL: No free 2048 kB hugepages reported on node 1 00:06:27.560 [2024-07-13 09:52:33.376385] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:27.818 [2024-07-13 09:52:33.464346] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:27.818 [2024-07-13 09:52:33.464523] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:28.751 09:52:34 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:28.751 09:52:34 -- common/autotest_common.sh@852 -- # return 0 00:06:28.751 09:52:34 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:06:28.751 09:52:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:28.751 09:52:34 -- common/autotest_common.sh@10 -- # set +x 00:06:28.751 09:52:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:28.751 09:52:34 -- event/cpu_locks.sh@67 -- # no_locks 00:06:28.751 09:52:34 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:28.751 09:52:34 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:28.751 09:52:34 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:28.751 09:52:34 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:06:28.751 09:52:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:28.751 09:52:34 -- common/autotest_common.sh@10 -- # set +x 00:06:28.751 09:52:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:28.751 09:52:34 -- event/cpu_locks.sh@71 -- # locks_exist 2695712 00:06:28.751 09:52:34 -- event/cpu_locks.sh@22 -- # lslocks -p 2695712 00:06:28.751 09:52:34 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:28.751 09:52:34 -- event/cpu_locks.sh@73 -- # killprocess 2695712 00:06:28.751 09:52:34 -- common/autotest_common.sh@926 -- # '[' -z 2695712 ']' 00:06:28.751 09:52:34 -- common/autotest_common.sh@930 -- # kill -0 2695712 00:06:28.751 09:52:34 -- common/autotest_common.sh@931 -- # uname 00:06:28.751 09:52:34 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:28.751 09:52:34 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2695712 00:06:28.751 09:52:34 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:28.751 09:52:34 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:28.751 09:52:34 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2695712' 00:06:28.751 killing process with pid 2695712 00:06:28.751 09:52:34 -- common/autotest_common.sh@945 -- # kill 2695712 00:06:28.751 09:52:34 -- common/autotest_common.sh@950 -- # wait 2695712 00:06:29.316 00:06:29.316 real 0m1.689s 00:06:29.316 user 0m1.798s 00:06:29.316 sys 0m0.554s 00:06:29.316 09:52:34 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:29.316 09:52:34 -- common/autotest_common.sh@10 -- # set +x 00:06:29.316 ************************************ 00:06:29.316 END TEST default_locks_via_rpc 00:06:29.316 ************************************ 00:06:29.316 09:52:34 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:06:29.316 09:52:34 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:29.316 09:52:34 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:29.316 09:52:34 -- common/autotest_common.sh@10 -- # set +x 00:06:29.316 ************************************ 00:06:29.316 START TEST non_locking_app_on_locked_coremask 00:06:29.316 ************************************ 00:06:29.316 09:52:34 -- common/autotest_common.sh@1104 -- # non_locking_app_on_locked_coremask 00:06:29.316 09:52:34 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=2695878 00:06:29.316 09:52:34 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:29.316 09:52:34 -- event/cpu_locks.sh@81 -- # waitforlisten 2695878 /var/tmp/spdk.sock 00:06:29.316 09:52:34 -- common/autotest_common.sh@819 -- # '[' -z 2695878 ']' 00:06:29.316 09:52:34 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:29.316 09:52:34 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:29.316 09:52:34 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:29.316 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:29.316 09:52:34 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:29.316 09:52:34 -- common/autotest_common.sh@10 -- # set +x 00:06:29.316 [2024-07-13 09:52:35.040115] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:06:29.316 [2024-07-13 09:52:35.040210] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2695878 ] 00:06:29.316 EAL: No free 2048 kB hugepages reported on node 1 00:06:29.316 [2024-07-13 09:52:35.101884] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:29.575 [2024-07-13 09:52:35.193635] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:29.575 [2024-07-13 09:52:35.193812] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:30.509 09:52:35 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:30.509 09:52:35 -- common/autotest_common.sh@852 -- # return 0 00:06:30.509 09:52:35 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=2696020 00:06:30.509 09:52:35 -- event/cpu_locks.sh@85 -- # waitforlisten 2696020 /var/tmp/spdk2.sock 00:06:30.509 09:52:35 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:06:30.509 09:52:35 -- common/autotest_common.sh@819 -- # '[' -z 2696020 ']' 00:06:30.509 09:52:35 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:30.509 09:52:35 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:30.509 09:52:35 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:30.509 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:30.509 09:52:35 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:30.509 09:52:35 -- common/autotest_common.sh@10 -- # set +x 00:06:30.509 [2024-07-13 09:52:36.007143] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:06:30.509 [2024-07-13 09:52:36.007222] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2696020 ] 00:06:30.509 EAL: No free 2048 kB hugepages reported on node 1 00:06:30.509 [2024-07-13 09:52:36.101185] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:30.509 [2024-07-13 09:52:36.101225] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:30.509 [2024-07-13 09:52:36.280390] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:30.509 [2024-07-13 09:52:36.280577] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:31.443 09:52:36 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:31.443 09:52:36 -- common/autotest_common.sh@852 -- # return 0 00:06:31.443 09:52:36 -- event/cpu_locks.sh@87 -- # locks_exist 2695878 00:06:31.443 09:52:36 -- event/cpu_locks.sh@22 -- # lslocks -p 2695878 00:06:31.443 09:52:36 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:31.701 lslocks: write error 00:06:31.701 09:52:37 -- event/cpu_locks.sh@89 -- # killprocess 2695878 00:06:31.701 09:52:37 -- common/autotest_common.sh@926 -- # '[' -z 2695878 ']' 00:06:31.701 09:52:37 -- common/autotest_common.sh@930 -- # kill -0 2695878 00:06:31.701 09:52:37 -- common/autotest_common.sh@931 -- # uname 00:06:31.701 09:52:37 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:31.701 09:52:37 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2695878 00:06:31.701 09:52:37 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:31.701 09:52:37 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:31.701 09:52:37 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2695878' 00:06:31.701 killing process with pid 2695878 00:06:31.701 09:52:37 -- common/autotest_common.sh@945 -- # kill 2695878 00:06:31.701 09:52:37 -- common/autotest_common.sh@950 -- # wait 2695878 00:06:32.636 09:52:38 -- event/cpu_locks.sh@90 -- # killprocess 2696020 00:06:32.636 09:52:38 -- common/autotest_common.sh@926 -- # '[' -z 2696020 ']' 00:06:32.636 09:52:38 -- common/autotest_common.sh@930 -- # kill -0 2696020 00:06:32.636 09:52:38 -- common/autotest_common.sh@931 -- # uname 00:06:32.636 09:52:38 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:32.636 09:52:38 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2696020 00:06:32.636 09:52:38 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:32.636 09:52:38 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:32.636 09:52:38 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2696020' 00:06:32.636 killing process with pid 2696020 00:06:32.636 09:52:38 -- common/autotest_common.sh@945 -- # kill 2696020 00:06:32.636 09:52:38 -- common/autotest_common.sh@950 -- # wait 2696020 00:06:32.894 00:06:32.894 real 0m3.599s 00:06:32.894 user 0m3.867s 00:06:32.895 sys 0m1.092s 00:06:32.895 09:52:38 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:32.895 09:52:38 -- common/autotest_common.sh@10 -- # set +x 00:06:32.895 ************************************ 00:06:32.895 END TEST non_locking_app_on_locked_coremask 00:06:32.895 ************************************ 00:06:32.895 09:52:38 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:06:32.895 09:52:38 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:32.895 09:52:38 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:32.895 09:52:38 -- common/autotest_common.sh@10 -- # set +x 00:06:32.895 ************************************ 00:06:32.895 START TEST locking_app_on_unlocked_coremask 00:06:32.895 ************************************ 00:06:32.895 09:52:38 -- common/autotest_common.sh@1104 -- # locking_app_on_unlocked_coremask 00:06:32.895 09:52:38 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=2696444 00:06:32.895 09:52:38 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:06:32.895 09:52:38 -- event/cpu_locks.sh@99 -- # waitforlisten 2696444 /var/tmp/spdk.sock 00:06:32.895 09:52:38 -- common/autotest_common.sh@819 -- # '[' -z 2696444 ']' 00:06:32.895 09:52:38 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:32.895 09:52:38 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:32.895 09:52:38 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:32.895 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:32.895 09:52:38 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:32.895 09:52:38 -- common/autotest_common.sh@10 -- # set +x 00:06:32.895 [2024-07-13 09:52:38.667507] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:06:32.895 [2024-07-13 09:52:38.667601] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2696444 ] 00:06:32.895 EAL: No free 2048 kB hugepages reported on node 1 00:06:33.153 [2024-07-13 09:52:38.730170] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:33.153 [2024-07-13 09:52:38.730214] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:33.153 [2024-07-13 09:52:38.817088] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:33.153 [2024-07-13 09:52:38.817277] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:34.088 09:52:39 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:34.088 09:52:39 -- common/autotest_common.sh@852 -- # return 0 00:06:34.088 09:52:39 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=2696472 00:06:34.088 09:52:39 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:34.088 09:52:39 -- event/cpu_locks.sh@103 -- # waitforlisten 2696472 /var/tmp/spdk2.sock 00:06:34.088 09:52:39 -- common/autotest_common.sh@819 -- # '[' -z 2696472 ']' 00:06:34.088 09:52:39 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:34.088 09:52:39 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:34.088 09:52:39 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:34.088 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:34.088 09:52:39 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:34.088 09:52:39 -- common/autotest_common.sh@10 -- # set +x 00:06:34.088 [2024-07-13 09:52:39.617860] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:06:34.088 [2024-07-13 09:52:39.617946] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2696472 ] 00:06:34.088 EAL: No free 2048 kB hugepages reported on node 1 00:06:34.088 [2024-07-13 09:52:39.714549] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:34.088 [2024-07-13 09:52:39.892517] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:34.088 [2024-07-13 09:52:39.892724] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:35.021 09:52:40 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:35.021 09:52:40 -- common/autotest_common.sh@852 -- # return 0 00:06:35.021 09:52:40 -- event/cpu_locks.sh@105 -- # locks_exist 2696472 00:06:35.021 09:52:40 -- event/cpu_locks.sh@22 -- # lslocks -p 2696472 00:06:35.021 09:52:40 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:35.278 lslocks: write error 00:06:35.278 09:52:41 -- event/cpu_locks.sh@107 -- # killprocess 2696444 00:06:35.278 09:52:41 -- common/autotest_common.sh@926 -- # '[' -z 2696444 ']' 00:06:35.278 09:52:41 -- common/autotest_common.sh@930 -- # kill -0 2696444 00:06:35.278 09:52:41 -- common/autotest_common.sh@931 -- # uname 00:06:35.278 09:52:41 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:35.278 09:52:41 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2696444 00:06:35.536 09:52:41 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:35.536 09:52:41 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:35.536 09:52:41 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2696444' 00:06:35.536 killing process with pid 2696444 00:06:35.536 09:52:41 -- common/autotest_common.sh@945 -- # kill 2696444 00:06:35.536 09:52:41 -- common/autotest_common.sh@950 -- # wait 2696444 00:06:36.471 09:52:41 -- event/cpu_locks.sh@108 -- # killprocess 2696472 00:06:36.471 09:52:41 -- common/autotest_common.sh@926 -- # '[' -z 2696472 ']' 00:06:36.471 09:52:41 -- common/autotest_common.sh@930 -- # kill -0 2696472 00:06:36.471 09:52:41 -- common/autotest_common.sh@931 -- # uname 00:06:36.471 09:52:41 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:36.471 09:52:41 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2696472 00:06:36.471 09:52:41 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:36.471 09:52:41 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:36.471 09:52:41 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2696472' 00:06:36.471 killing process with pid 2696472 00:06:36.471 09:52:41 -- common/autotest_common.sh@945 -- # kill 2696472 00:06:36.471 09:52:41 -- common/autotest_common.sh@950 -- # wait 2696472 00:06:36.732 00:06:36.732 real 0m3.743s 00:06:36.732 user 0m4.032s 00:06:36.732 sys 0m1.096s 00:06:36.732 09:52:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:36.732 09:52:42 -- common/autotest_common.sh@10 -- # set +x 00:06:36.732 ************************************ 00:06:36.732 END TEST locking_app_on_unlocked_coremask 00:06:36.732 ************************************ 00:06:36.732 09:52:42 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:06:36.732 09:52:42 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:36.732 09:52:42 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:36.732 09:52:42 -- common/autotest_common.sh@10 -- # set +x 00:06:36.732 ************************************ 00:06:36.732 START TEST locking_app_on_locked_coremask 00:06:36.732 ************************************ 00:06:36.732 09:52:42 -- common/autotest_common.sh@1104 -- # locking_app_on_locked_coremask 00:06:36.732 09:52:42 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=2696909 00:06:36.732 09:52:42 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:36.732 09:52:42 -- event/cpu_locks.sh@116 -- # waitforlisten 2696909 /var/tmp/spdk.sock 00:06:36.732 09:52:42 -- common/autotest_common.sh@819 -- # '[' -z 2696909 ']' 00:06:36.732 09:52:42 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:36.732 09:52:42 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:36.732 09:52:42 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:36.732 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:36.732 09:52:42 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:36.732 09:52:42 -- common/autotest_common.sh@10 -- # set +x 00:06:36.732 [2024-07-13 09:52:42.434771] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:06:36.732 [2024-07-13 09:52:42.434863] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2696909 ] 00:06:36.732 EAL: No free 2048 kB hugepages reported on node 1 00:06:36.732 [2024-07-13 09:52:42.491970] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:36.991 [2024-07-13 09:52:42.581591] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:36.991 [2024-07-13 09:52:42.581764] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:37.565 09:52:43 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:37.565 09:52:43 -- common/autotest_common.sh@852 -- # return 0 00:06:37.565 09:52:43 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=2697043 00:06:37.565 09:52:43 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:37.565 09:52:43 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 2697043 /var/tmp/spdk2.sock 00:06:37.565 09:52:43 -- common/autotest_common.sh@640 -- # local es=0 00:06:37.565 09:52:43 -- common/autotest_common.sh@642 -- # valid_exec_arg waitforlisten 2697043 /var/tmp/spdk2.sock 00:06:37.565 09:52:43 -- common/autotest_common.sh@628 -- # local arg=waitforlisten 00:06:37.565 09:52:43 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:37.565 09:52:43 -- common/autotest_common.sh@632 -- # type -t waitforlisten 00:06:37.565 09:52:43 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:37.565 09:52:43 -- common/autotest_common.sh@643 -- # waitforlisten 2697043 /var/tmp/spdk2.sock 00:06:37.565 09:52:43 -- common/autotest_common.sh@819 -- # '[' -z 2697043 ']' 00:06:37.565 09:52:43 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:37.565 09:52:43 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:37.565 09:52:43 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:37.565 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:37.565 09:52:43 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:37.565 09:52:43 -- common/autotest_common.sh@10 -- # set +x 00:06:37.821 [2024-07-13 09:52:43.420661] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:06:37.821 [2024-07-13 09:52:43.420746] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2697043 ] 00:06:37.821 EAL: No free 2048 kB hugepages reported on node 1 00:06:37.821 [2024-07-13 09:52:43.517358] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 2696909 has claimed it. 00:06:37.821 [2024-07-13 09:52:43.517405] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:06:38.385 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 834: kill: (2697043) - No such process 00:06:38.385 ERROR: process (pid: 2697043) is no longer running 00:06:38.385 09:52:44 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:38.385 09:52:44 -- common/autotest_common.sh@852 -- # return 1 00:06:38.385 09:52:44 -- common/autotest_common.sh@643 -- # es=1 00:06:38.385 09:52:44 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:06:38.385 09:52:44 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:06:38.385 09:52:44 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:06:38.385 09:52:44 -- event/cpu_locks.sh@122 -- # locks_exist 2696909 00:06:38.385 09:52:44 -- event/cpu_locks.sh@22 -- # lslocks -p 2696909 00:06:38.385 09:52:44 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:38.949 lslocks: write error 00:06:38.949 09:52:44 -- event/cpu_locks.sh@124 -- # killprocess 2696909 00:06:38.949 09:52:44 -- common/autotest_common.sh@926 -- # '[' -z 2696909 ']' 00:06:38.949 09:52:44 -- common/autotest_common.sh@930 -- # kill -0 2696909 00:06:38.949 09:52:44 -- common/autotest_common.sh@931 -- # uname 00:06:38.950 09:52:44 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:38.950 09:52:44 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2696909 00:06:38.950 09:52:44 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:38.950 09:52:44 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:38.950 09:52:44 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2696909' 00:06:38.950 killing process with pid 2696909 00:06:38.950 09:52:44 -- common/autotest_common.sh@945 -- # kill 2696909 00:06:38.950 09:52:44 -- common/autotest_common.sh@950 -- # wait 2696909 00:06:39.208 00:06:39.208 real 0m2.567s 00:06:39.208 user 0m2.903s 00:06:39.208 sys 0m0.703s 00:06:39.208 09:52:44 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:39.208 09:52:44 -- common/autotest_common.sh@10 -- # set +x 00:06:39.208 ************************************ 00:06:39.208 END TEST locking_app_on_locked_coremask 00:06:39.208 ************************************ 00:06:39.208 09:52:44 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:06:39.208 09:52:44 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:39.208 09:52:44 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:39.208 09:52:44 -- common/autotest_common.sh@10 -- # set +x 00:06:39.208 ************************************ 00:06:39.208 START TEST locking_overlapped_coremask 00:06:39.208 ************************************ 00:06:39.208 09:52:44 -- common/autotest_common.sh@1104 -- # locking_overlapped_coremask 00:06:39.208 09:52:44 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=2697219 00:06:39.208 09:52:44 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:06:39.208 09:52:44 -- event/cpu_locks.sh@133 -- # waitforlisten 2697219 /var/tmp/spdk.sock 00:06:39.208 09:52:44 -- common/autotest_common.sh@819 -- # '[' -z 2697219 ']' 00:06:39.208 09:52:44 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:39.208 09:52:44 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:39.208 09:52:44 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:39.208 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:39.208 09:52:44 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:39.208 09:52:44 -- common/autotest_common.sh@10 -- # set +x 00:06:39.480 [2024-07-13 09:52:45.028151] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:06:39.480 [2024-07-13 09:52:45.028226] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2697219 ] 00:06:39.480 EAL: No free 2048 kB hugepages reported on node 1 00:06:39.480 [2024-07-13 09:52:45.091649] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:39.480 [2024-07-13 09:52:45.186546] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:39.480 [2024-07-13 09:52:45.189889] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:39.480 [2024-07-13 09:52:45.189912] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:39.480 [2024-07-13 09:52:45.189915] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:40.413 09:52:45 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:40.413 09:52:45 -- common/autotest_common.sh@852 -- # return 0 00:06:40.413 09:52:45 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=2697362 00:06:40.413 09:52:45 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:06:40.413 09:52:45 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 2697362 /var/tmp/spdk2.sock 00:06:40.413 09:52:45 -- common/autotest_common.sh@640 -- # local es=0 00:06:40.413 09:52:45 -- common/autotest_common.sh@642 -- # valid_exec_arg waitforlisten 2697362 /var/tmp/spdk2.sock 00:06:40.413 09:52:45 -- common/autotest_common.sh@628 -- # local arg=waitforlisten 00:06:40.413 09:52:45 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:40.413 09:52:45 -- common/autotest_common.sh@632 -- # type -t waitforlisten 00:06:40.413 09:52:45 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:40.413 09:52:45 -- common/autotest_common.sh@643 -- # waitforlisten 2697362 /var/tmp/spdk2.sock 00:06:40.413 09:52:45 -- common/autotest_common.sh@819 -- # '[' -z 2697362 ']' 00:06:40.413 09:52:45 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:40.413 09:52:45 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:40.413 09:52:45 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:40.413 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:40.413 09:52:45 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:40.413 09:52:45 -- common/autotest_common.sh@10 -- # set +x 00:06:40.413 [2024-07-13 09:52:46.041763] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:06:40.413 [2024-07-13 09:52:46.041838] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2697362 ] 00:06:40.413 EAL: No free 2048 kB hugepages reported on node 1 00:06:40.413 [2024-07-13 09:52:46.129132] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 2697219 has claimed it. 00:06:40.413 [2024-07-13 09:52:46.129201] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:06:40.979 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 834: kill: (2697362) - No such process 00:06:40.979 ERROR: process (pid: 2697362) is no longer running 00:06:40.979 09:52:46 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:40.979 09:52:46 -- common/autotest_common.sh@852 -- # return 1 00:06:40.979 09:52:46 -- common/autotest_common.sh@643 -- # es=1 00:06:40.979 09:52:46 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:06:40.979 09:52:46 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:06:40.979 09:52:46 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:06:40.979 09:52:46 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:06:40.979 09:52:46 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:06:40.979 09:52:46 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:06:40.979 09:52:46 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:06:40.979 09:52:46 -- event/cpu_locks.sh@141 -- # killprocess 2697219 00:06:40.979 09:52:46 -- common/autotest_common.sh@926 -- # '[' -z 2697219 ']' 00:06:40.979 09:52:46 -- common/autotest_common.sh@930 -- # kill -0 2697219 00:06:40.979 09:52:46 -- common/autotest_common.sh@931 -- # uname 00:06:40.979 09:52:46 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:40.979 09:52:46 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2697219 00:06:40.979 09:52:46 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:40.979 09:52:46 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:40.979 09:52:46 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2697219' 00:06:40.979 killing process with pid 2697219 00:06:40.979 09:52:46 -- common/autotest_common.sh@945 -- # kill 2697219 00:06:40.979 09:52:46 -- common/autotest_common.sh@950 -- # wait 2697219 00:06:41.545 00:06:41.545 real 0m2.160s 00:06:41.545 user 0m6.162s 00:06:41.545 sys 0m0.484s 00:06:41.545 09:52:47 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:41.545 09:52:47 -- common/autotest_common.sh@10 -- # set +x 00:06:41.545 ************************************ 00:06:41.545 END TEST locking_overlapped_coremask 00:06:41.545 ************************************ 00:06:41.545 09:52:47 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:06:41.545 09:52:47 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:41.545 09:52:47 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:41.545 09:52:47 -- common/autotest_common.sh@10 -- # set +x 00:06:41.545 ************************************ 00:06:41.545 START TEST locking_overlapped_coremask_via_rpc 00:06:41.545 ************************************ 00:06:41.545 09:52:47 -- common/autotest_common.sh@1104 -- # locking_overlapped_coremask_via_rpc 00:06:41.545 09:52:47 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=2697526 00:06:41.545 09:52:47 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:06:41.545 09:52:47 -- event/cpu_locks.sh@149 -- # waitforlisten 2697526 /var/tmp/spdk.sock 00:06:41.545 09:52:47 -- common/autotest_common.sh@819 -- # '[' -z 2697526 ']' 00:06:41.545 09:52:47 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:41.545 09:52:47 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:41.545 09:52:47 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:41.545 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:41.545 09:52:47 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:41.545 09:52:47 -- common/autotest_common.sh@10 -- # set +x 00:06:41.545 [2024-07-13 09:52:47.220257] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:06:41.545 [2024-07-13 09:52:47.220343] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2697526 ] 00:06:41.545 EAL: No free 2048 kB hugepages reported on node 1 00:06:41.545 [2024-07-13 09:52:47.283019] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:41.545 [2024-07-13 09:52:47.283059] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:41.803 [2024-07-13 09:52:47.370953] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:41.803 [2024-07-13 09:52:47.371174] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:41.803 [2024-07-13 09:52:47.371229] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:41.803 [2024-07-13 09:52:47.371246] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:42.366 09:52:48 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:42.366 09:52:48 -- common/autotest_common.sh@852 -- # return 0 00:06:42.366 09:52:48 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=2697669 00:06:42.366 09:52:48 -- event/cpu_locks.sh@153 -- # waitforlisten 2697669 /var/tmp/spdk2.sock 00:06:42.366 09:52:48 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:06:42.366 09:52:48 -- common/autotest_common.sh@819 -- # '[' -z 2697669 ']' 00:06:42.366 09:52:48 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:42.366 09:52:48 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:42.366 09:52:48 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:42.366 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:42.366 09:52:48 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:42.366 09:52:48 -- common/autotest_common.sh@10 -- # set +x 00:06:42.366 [2024-07-13 09:52:48.181385] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:06:42.366 [2024-07-13 09:52:48.181481] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2697669 ] 00:06:42.623 EAL: No free 2048 kB hugepages reported on node 1 00:06:42.623 [2024-07-13 09:52:48.271362] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:42.623 [2024-07-13 09:52:48.271400] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:42.879 [2024-07-13 09:52:48.445231] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:42.879 [2024-07-13 09:52:48.445462] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:42.879 [2024-07-13 09:52:48.445513] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:06:42.879 [2024-07-13 09:52:48.445514] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:43.443 09:52:49 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:43.443 09:52:49 -- common/autotest_common.sh@852 -- # return 0 00:06:43.443 09:52:49 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:06:43.443 09:52:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:43.443 09:52:49 -- common/autotest_common.sh@10 -- # set +x 00:06:43.443 09:52:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:43.443 09:52:49 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:43.443 09:52:49 -- common/autotest_common.sh@640 -- # local es=0 00:06:43.443 09:52:49 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:43.443 09:52:49 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:06:43.443 09:52:49 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:43.443 09:52:49 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:06:43.443 09:52:49 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:43.443 09:52:49 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:43.443 09:52:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:43.443 09:52:49 -- common/autotest_common.sh@10 -- # set +x 00:06:43.443 [2024-07-13 09:52:49.110960] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 2697526 has claimed it. 00:06:43.443 request: 00:06:43.443 { 00:06:43.443 "method": "framework_enable_cpumask_locks", 00:06:43.443 "req_id": 1 00:06:43.443 } 00:06:43.443 Got JSON-RPC error response 00:06:43.443 response: 00:06:43.443 { 00:06:43.443 "code": -32603, 00:06:43.443 "message": "Failed to claim CPU core: 2" 00:06:43.443 } 00:06:43.443 09:52:49 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:06:43.443 09:52:49 -- common/autotest_common.sh@643 -- # es=1 00:06:43.443 09:52:49 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:06:43.443 09:52:49 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:06:43.443 09:52:49 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:06:43.443 09:52:49 -- event/cpu_locks.sh@158 -- # waitforlisten 2697526 /var/tmp/spdk.sock 00:06:43.443 09:52:49 -- common/autotest_common.sh@819 -- # '[' -z 2697526 ']' 00:06:43.443 09:52:49 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:43.443 09:52:49 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:43.443 09:52:49 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:43.443 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:43.443 09:52:49 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:43.443 09:52:49 -- common/autotest_common.sh@10 -- # set +x 00:06:43.730 09:52:49 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:43.730 09:52:49 -- common/autotest_common.sh@852 -- # return 0 00:06:43.730 09:52:49 -- event/cpu_locks.sh@159 -- # waitforlisten 2697669 /var/tmp/spdk2.sock 00:06:43.730 09:52:49 -- common/autotest_common.sh@819 -- # '[' -z 2697669 ']' 00:06:43.730 09:52:49 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:43.730 09:52:49 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:43.730 09:52:49 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:43.730 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:43.730 09:52:49 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:43.730 09:52:49 -- common/autotest_common.sh@10 -- # set +x 00:06:43.987 09:52:49 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:43.987 09:52:49 -- common/autotest_common.sh@852 -- # return 0 00:06:43.987 09:52:49 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:06:43.987 09:52:49 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:06:43.987 09:52:49 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:06:43.987 09:52:49 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:06:43.987 00:06:43.987 real 0m2.416s 00:06:43.987 user 0m1.164s 00:06:43.987 sys 0m0.187s 00:06:43.987 09:52:49 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:43.987 09:52:49 -- common/autotest_common.sh@10 -- # set +x 00:06:43.987 ************************************ 00:06:43.987 END TEST locking_overlapped_coremask_via_rpc 00:06:43.987 ************************************ 00:06:43.987 09:52:49 -- event/cpu_locks.sh@174 -- # cleanup 00:06:43.987 09:52:49 -- event/cpu_locks.sh@15 -- # [[ -z 2697526 ]] 00:06:43.987 09:52:49 -- event/cpu_locks.sh@15 -- # killprocess 2697526 00:06:43.987 09:52:49 -- common/autotest_common.sh@926 -- # '[' -z 2697526 ']' 00:06:43.987 09:52:49 -- common/autotest_common.sh@930 -- # kill -0 2697526 00:06:43.987 09:52:49 -- common/autotest_common.sh@931 -- # uname 00:06:43.987 09:52:49 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:43.987 09:52:49 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2697526 00:06:43.987 09:52:49 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:43.987 09:52:49 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:43.987 09:52:49 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2697526' 00:06:43.987 killing process with pid 2697526 00:06:43.987 09:52:49 -- common/autotest_common.sh@945 -- # kill 2697526 00:06:43.987 09:52:49 -- common/autotest_common.sh@950 -- # wait 2697526 00:06:44.245 09:52:50 -- event/cpu_locks.sh@16 -- # [[ -z 2697669 ]] 00:06:44.245 09:52:50 -- event/cpu_locks.sh@16 -- # killprocess 2697669 00:06:44.245 09:52:50 -- common/autotest_common.sh@926 -- # '[' -z 2697669 ']' 00:06:44.245 09:52:50 -- common/autotest_common.sh@930 -- # kill -0 2697669 00:06:44.245 09:52:50 -- common/autotest_common.sh@931 -- # uname 00:06:44.245 09:52:50 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:44.245 09:52:50 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2697669 00:06:44.502 09:52:50 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:06:44.502 09:52:50 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:06:44.502 09:52:50 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2697669' 00:06:44.502 killing process with pid 2697669 00:06:44.502 09:52:50 -- common/autotest_common.sh@945 -- # kill 2697669 00:06:44.502 09:52:50 -- common/autotest_common.sh@950 -- # wait 2697669 00:06:44.759 09:52:50 -- event/cpu_locks.sh@18 -- # rm -f 00:06:44.759 09:52:50 -- event/cpu_locks.sh@1 -- # cleanup 00:06:44.759 09:52:50 -- event/cpu_locks.sh@15 -- # [[ -z 2697526 ]] 00:06:44.759 09:52:50 -- event/cpu_locks.sh@15 -- # killprocess 2697526 00:06:44.759 09:52:50 -- common/autotest_common.sh@926 -- # '[' -z 2697526 ']' 00:06:44.759 09:52:50 -- common/autotest_common.sh@930 -- # kill -0 2697526 00:06:44.759 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (2697526) - No such process 00:06:44.759 09:52:50 -- common/autotest_common.sh@953 -- # echo 'Process with pid 2697526 is not found' 00:06:44.759 Process with pid 2697526 is not found 00:06:44.759 09:52:50 -- event/cpu_locks.sh@16 -- # [[ -z 2697669 ]] 00:06:44.759 09:52:50 -- event/cpu_locks.sh@16 -- # killprocess 2697669 00:06:44.760 09:52:50 -- common/autotest_common.sh@926 -- # '[' -z 2697669 ']' 00:06:44.760 09:52:50 -- common/autotest_common.sh@930 -- # kill -0 2697669 00:06:44.760 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (2697669) - No such process 00:06:44.760 09:52:50 -- common/autotest_common.sh@953 -- # echo 'Process with pid 2697669 is not found' 00:06:44.760 Process with pid 2697669 is not found 00:06:44.760 09:52:50 -- event/cpu_locks.sh@18 -- # rm -f 00:06:44.760 00:06:44.760 real 0m19.121s 00:06:44.760 user 0m33.803s 00:06:44.760 sys 0m5.521s 00:06:44.760 09:52:50 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:44.760 09:52:50 -- common/autotest_common.sh@10 -- # set +x 00:06:44.760 ************************************ 00:06:44.760 END TEST cpu_locks 00:06:44.760 ************************************ 00:06:44.760 00:06:44.760 real 0m45.143s 00:06:44.760 user 1m25.892s 00:06:44.760 sys 0m9.425s 00:06:44.760 09:52:50 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:44.760 09:52:50 -- common/autotest_common.sh@10 -- # set +x 00:06:44.760 ************************************ 00:06:44.760 END TEST event 00:06:44.760 ************************************ 00:06:44.760 09:52:50 -- spdk/autotest.sh@188 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:06:44.760 09:52:50 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:44.760 09:52:50 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:44.760 09:52:50 -- common/autotest_common.sh@10 -- # set +x 00:06:44.760 ************************************ 00:06:44.760 START TEST thread 00:06:44.760 ************************************ 00:06:44.760 09:52:50 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:06:44.760 * Looking for test storage... 00:06:44.760 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:06:44.760 09:52:50 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:06:44.760 09:52:50 -- common/autotest_common.sh@1077 -- # '[' 8 -le 1 ']' 00:06:44.760 09:52:50 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:44.760 09:52:50 -- common/autotest_common.sh@10 -- # set +x 00:06:44.760 ************************************ 00:06:44.760 START TEST thread_poller_perf 00:06:44.760 ************************************ 00:06:44.760 09:52:50 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:06:45.017 [2024-07-13 09:52:50.582286] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:06:45.017 [2024-07-13 09:52:50.582365] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2698040 ] 00:06:45.017 EAL: No free 2048 kB hugepages reported on node 1 00:06:45.017 [2024-07-13 09:52:50.644316] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:45.017 [2024-07-13 09:52:50.733085] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:45.017 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:06:46.390 ====================================== 00:06:46.390 busy:2709734668 (cyc) 00:06:46.390 total_run_count: 279000 00:06:46.390 tsc_hz: 2700000000 (cyc) 00:06:46.390 ====================================== 00:06:46.390 poller_cost: 9712 (cyc), 3597 (nsec) 00:06:46.390 00:06:46.390 real 0m1.254s 00:06:46.390 user 0m1.165s 00:06:46.390 sys 0m0.082s 00:06:46.390 09:52:51 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:46.390 09:52:51 -- common/autotest_common.sh@10 -- # set +x 00:06:46.390 ************************************ 00:06:46.390 END TEST thread_poller_perf 00:06:46.390 ************************************ 00:06:46.390 09:52:51 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:06:46.390 09:52:51 -- common/autotest_common.sh@1077 -- # '[' 8 -le 1 ']' 00:06:46.390 09:52:51 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:46.390 09:52:51 -- common/autotest_common.sh@10 -- # set +x 00:06:46.390 ************************************ 00:06:46.390 START TEST thread_poller_perf 00:06:46.390 ************************************ 00:06:46.390 09:52:51 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:06:46.390 [2024-07-13 09:52:51.869444] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:06:46.390 [2024-07-13 09:52:51.869528] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2698196 ] 00:06:46.390 EAL: No free 2048 kB hugepages reported on node 1 00:06:46.390 [2024-07-13 09:52:51.932659] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:46.390 [2024-07-13 09:52:52.021114] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:46.390 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:06:47.322 ====================================== 00:06:47.322 busy:2703459734 (cyc) 00:06:47.322 total_run_count: 3828000 00:06:47.322 tsc_hz: 2700000000 (cyc) 00:06:47.322 ====================================== 00:06:47.322 poller_cost: 706 (cyc), 261 (nsec) 00:06:47.322 00:06:47.322 real 0m1.251s 00:06:47.322 user 0m1.159s 00:06:47.322 sys 0m0.085s 00:06:47.322 09:52:53 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:47.322 09:52:53 -- common/autotest_common.sh@10 -- # set +x 00:06:47.322 ************************************ 00:06:47.322 END TEST thread_poller_perf 00:06:47.322 ************************************ 00:06:47.322 09:52:53 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:06:47.322 00:06:47.322 real 0m2.616s 00:06:47.322 user 0m2.363s 00:06:47.322 sys 0m0.254s 00:06:47.322 09:52:53 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:47.322 09:52:53 -- common/autotest_common.sh@10 -- # set +x 00:06:47.322 ************************************ 00:06:47.322 END TEST thread 00:06:47.322 ************************************ 00:06:47.579 09:52:53 -- spdk/autotest.sh@189 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:06:47.579 09:52:53 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:47.579 09:52:53 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:47.579 09:52:53 -- common/autotest_common.sh@10 -- # set +x 00:06:47.579 ************************************ 00:06:47.579 START TEST accel 00:06:47.579 ************************************ 00:06:47.579 09:52:53 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:06:47.579 * Looking for test storage... 00:06:47.579 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:06:47.579 09:52:53 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:06:47.579 09:52:53 -- accel/accel.sh@74 -- # get_expected_opcs 00:06:47.579 09:52:53 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:47.579 09:52:53 -- accel/accel.sh@59 -- # spdk_tgt_pid=2698388 00:06:47.579 09:52:53 -- accel/accel.sh@60 -- # waitforlisten 2698388 00:06:47.579 09:52:53 -- common/autotest_common.sh@819 -- # '[' -z 2698388 ']' 00:06:47.579 09:52:53 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:06:47.579 09:52:53 -- accel/accel.sh@58 -- # build_accel_config 00:06:47.579 09:52:53 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:47.579 09:52:53 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:47.579 09:52:53 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:47.579 09:52:53 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:47.579 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:47.579 09:52:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:47.579 09:52:53 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:47.579 09:52:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:47.579 09:52:53 -- common/autotest_common.sh@10 -- # set +x 00:06:47.579 09:52:53 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:47.579 09:52:53 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:47.579 09:52:53 -- accel/accel.sh@41 -- # local IFS=, 00:06:47.579 09:52:53 -- accel/accel.sh@42 -- # jq -r . 00:06:47.579 [2024-07-13 09:52:53.254193] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:06:47.579 [2024-07-13 09:52:53.254295] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2698388 ] 00:06:47.579 EAL: No free 2048 kB hugepages reported on node 1 00:06:47.579 [2024-07-13 09:52:53.318411] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:47.836 [2024-07-13 09:52:53.410580] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:47.836 [2024-07-13 09:52:53.410743] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:48.770 09:52:54 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:48.770 09:52:54 -- common/autotest_common.sh@852 -- # return 0 00:06:48.770 09:52:54 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:06:48.770 09:52:54 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:06:48.770 09:52:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:48.770 09:52:54 -- common/autotest_common.sh@10 -- # set +x 00:06:48.770 09:52:54 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:06:48.770 09:52:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:48.770 09:52:54 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:48.770 09:52:54 -- accel/accel.sh@64 -- # IFS== 00:06:48.770 09:52:54 -- accel/accel.sh@64 -- # read -r opc module 00:06:48.770 09:52:54 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:48.770 09:52:54 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:48.770 09:52:54 -- accel/accel.sh@64 -- # IFS== 00:06:48.770 09:52:54 -- accel/accel.sh@64 -- # read -r opc module 00:06:48.770 09:52:54 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:48.770 09:52:54 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:48.770 09:52:54 -- accel/accel.sh@64 -- # IFS== 00:06:48.770 09:52:54 -- accel/accel.sh@64 -- # read -r opc module 00:06:48.770 09:52:54 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:48.770 09:52:54 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:48.770 09:52:54 -- accel/accel.sh@64 -- # IFS== 00:06:48.770 09:52:54 -- accel/accel.sh@64 -- # read -r opc module 00:06:48.770 09:52:54 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:48.770 09:52:54 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:48.770 09:52:54 -- accel/accel.sh@64 -- # IFS== 00:06:48.770 09:52:54 -- accel/accel.sh@64 -- # read -r opc module 00:06:48.770 09:52:54 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:48.770 09:52:54 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:48.770 09:52:54 -- accel/accel.sh@64 -- # IFS== 00:06:48.770 09:52:54 -- accel/accel.sh@64 -- # read -r opc module 00:06:48.770 09:52:54 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:48.770 09:52:54 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:48.770 09:52:54 -- accel/accel.sh@64 -- # IFS== 00:06:48.770 09:52:54 -- accel/accel.sh@64 -- # read -r opc module 00:06:48.770 09:52:54 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:48.770 09:52:54 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:48.770 09:52:54 -- accel/accel.sh@64 -- # IFS== 00:06:48.770 09:52:54 -- accel/accel.sh@64 -- # read -r opc module 00:06:48.770 09:52:54 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:48.770 09:52:54 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:48.770 09:52:54 -- accel/accel.sh@64 -- # IFS== 00:06:48.770 09:52:54 -- accel/accel.sh@64 -- # read -r opc module 00:06:48.770 09:52:54 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:48.770 09:52:54 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:48.770 09:52:54 -- accel/accel.sh@64 -- # IFS== 00:06:48.770 09:52:54 -- accel/accel.sh@64 -- # read -r opc module 00:06:48.770 09:52:54 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:48.770 09:52:54 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:48.770 09:52:54 -- accel/accel.sh@64 -- # IFS== 00:06:48.770 09:52:54 -- accel/accel.sh@64 -- # read -r opc module 00:06:48.770 09:52:54 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:48.770 09:52:54 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:48.770 09:52:54 -- accel/accel.sh@64 -- # IFS== 00:06:48.770 09:52:54 -- accel/accel.sh@64 -- # read -r opc module 00:06:48.770 09:52:54 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:48.770 09:52:54 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:48.770 09:52:54 -- accel/accel.sh@64 -- # IFS== 00:06:48.770 09:52:54 -- accel/accel.sh@64 -- # read -r opc module 00:06:48.770 09:52:54 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:48.770 09:52:54 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:48.770 09:52:54 -- accel/accel.sh@64 -- # IFS== 00:06:48.770 09:52:54 -- accel/accel.sh@64 -- # read -r opc module 00:06:48.770 09:52:54 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:48.770 09:52:54 -- accel/accel.sh@67 -- # killprocess 2698388 00:06:48.770 09:52:54 -- common/autotest_common.sh@926 -- # '[' -z 2698388 ']' 00:06:48.770 09:52:54 -- common/autotest_common.sh@930 -- # kill -0 2698388 00:06:48.770 09:52:54 -- common/autotest_common.sh@931 -- # uname 00:06:48.770 09:52:54 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:48.770 09:52:54 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2698388 00:06:48.770 09:52:54 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:48.770 09:52:54 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:48.770 09:52:54 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2698388' 00:06:48.770 killing process with pid 2698388 00:06:48.770 09:52:54 -- common/autotest_common.sh@945 -- # kill 2698388 00:06:48.770 09:52:54 -- common/autotest_common.sh@950 -- # wait 2698388 00:06:49.029 09:52:54 -- accel/accel.sh@68 -- # trap - ERR 00:06:49.029 09:52:54 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:06:49.029 09:52:54 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:06:49.029 09:52:54 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:49.029 09:52:54 -- common/autotest_common.sh@10 -- # set +x 00:06:49.029 09:52:54 -- common/autotest_common.sh@1104 -- # accel_perf -h 00:06:49.029 09:52:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:06:49.029 09:52:54 -- accel/accel.sh@12 -- # build_accel_config 00:06:49.029 09:52:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:49.029 09:52:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:49.029 09:52:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:49.029 09:52:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:49.029 09:52:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:49.029 09:52:54 -- accel/accel.sh@41 -- # local IFS=, 00:06:49.029 09:52:54 -- accel/accel.sh@42 -- # jq -r . 00:06:49.029 09:52:54 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:49.029 09:52:54 -- common/autotest_common.sh@10 -- # set +x 00:06:49.029 09:52:54 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:06:49.029 09:52:54 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:06:49.029 09:52:54 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:49.029 09:52:54 -- common/autotest_common.sh@10 -- # set +x 00:06:49.029 ************************************ 00:06:49.029 START TEST accel_missing_filename 00:06:49.029 ************************************ 00:06:49.029 09:52:54 -- common/autotest_common.sh@1104 -- # NOT accel_perf -t 1 -w compress 00:06:49.029 09:52:54 -- common/autotest_common.sh@640 -- # local es=0 00:06:49.029 09:52:54 -- common/autotest_common.sh@642 -- # valid_exec_arg accel_perf -t 1 -w compress 00:06:49.029 09:52:54 -- common/autotest_common.sh@628 -- # local arg=accel_perf 00:06:49.029 09:52:54 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:49.029 09:52:54 -- common/autotest_common.sh@632 -- # type -t accel_perf 00:06:49.029 09:52:54 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:49.029 09:52:54 -- common/autotest_common.sh@643 -- # accel_perf -t 1 -w compress 00:06:49.029 09:52:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:06:49.029 09:52:54 -- accel/accel.sh@12 -- # build_accel_config 00:06:49.029 09:52:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:49.029 09:52:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:49.029 09:52:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:49.029 09:52:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:49.029 09:52:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:49.029 09:52:54 -- accel/accel.sh@41 -- # local IFS=, 00:06:49.029 09:52:54 -- accel/accel.sh@42 -- # jq -r . 00:06:49.029 [2024-07-13 09:52:54.774087] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:06:49.029 [2024-07-13 09:52:54.774167] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2698685 ] 00:06:49.029 EAL: No free 2048 kB hugepages reported on node 1 00:06:49.029 [2024-07-13 09:52:54.834811] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:49.287 [2024-07-13 09:52:54.923913] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:49.287 [2024-07-13 09:52:54.982837] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:06:49.287 [2024-07-13 09:52:55.070188] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:06:49.545 A filename is required. 00:06:49.545 09:52:55 -- common/autotest_common.sh@643 -- # es=234 00:06:49.545 09:52:55 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:06:49.545 09:52:55 -- common/autotest_common.sh@652 -- # es=106 00:06:49.545 09:52:55 -- common/autotest_common.sh@653 -- # case "$es" in 00:06:49.545 09:52:55 -- common/autotest_common.sh@660 -- # es=1 00:06:49.545 09:52:55 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:06:49.545 00:06:49.545 real 0m0.396s 00:06:49.545 user 0m0.290s 00:06:49.545 sys 0m0.140s 00:06:49.545 09:52:55 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:49.545 09:52:55 -- common/autotest_common.sh@10 -- # set +x 00:06:49.545 ************************************ 00:06:49.545 END TEST accel_missing_filename 00:06:49.545 ************************************ 00:06:49.545 09:52:55 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:49.545 09:52:55 -- common/autotest_common.sh@1077 -- # '[' 10 -le 1 ']' 00:06:49.545 09:52:55 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:49.546 09:52:55 -- common/autotest_common.sh@10 -- # set +x 00:06:49.546 ************************************ 00:06:49.546 START TEST accel_compress_verify 00:06:49.546 ************************************ 00:06:49.546 09:52:55 -- common/autotest_common.sh@1104 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:49.546 09:52:55 -- common/autotest_common.sh@640 -- # local es=0 00:06:49.546 09:52:55 -- common/autotest_common.sh@642 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:49.546 09:52:55 -- common/autotest_common.sh@628 -- # local arg=accel_perf 00:06:49.546 09:52:55 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:49.546 09:52:55 -- common/autotest_common.sh@632 -- # type -t accel_perf 00:06:49.546 09:52:55 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:49.546 09:52:55 -- common/autotest_common.sh@643 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:49.546 09:52:55 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:49.546 09:52:55 -- accel/accel.sh@12 -- # build_accel_config 00:06:49.546 09:52:55 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:49.546 09:52:55 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:49.546 09:52:55 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:49.546 09:52:55 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:49.546 09:52:55 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:49.546 09:52:55 -- accel/accel.sh@41 -- # local IFS=, 00:06:49.546 09:52:55 -- accel/accel.sh@42 -- # jq -r . 00:06:49.546 [2024-07-13 09:52:55.191509] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:06:49.546 [2024-07-13 09:52:55.191593] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2698714 ] 00:06:49.546 EAL: No free 2048 kB hugepages reported on node 1 00:06:49.546 [2024-07-13 09:52:55.252622] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:49.546 [2024-07-13 09:52:55.344258] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:49.804 [2024-07-13 09:52:55.406159] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:06:49.804 [2024-07-13 09:52:55.486287] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:06:49.804 00:06:49.804 Compression does not support the verify option, aborting. 00:06:49.804 09:52:55 -- common/autotest_common.sh@643 -- # es=161 00:06:49.804 09:52:55 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:06:49.804 09:52:55 -- common/autotest_common.sh@652 -- # es=33 00:06:49.804 09:52:55 -- common/autotest_common.sh@653 -- # case "$es" in 00:06:49.804 09:52:55 -- common/autotest_common.sh@660 -- # es=1 00:06:49.804 09:52:55 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:06:49.804 00:06:49.804 real 0m0.390s 00:06:49.804 user 0m0.277s 00:06:49.804 sys 0m0.148s 00:06:49.804 09:52:55 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:49.804 09:52:55 -- common/autotest_common.sh@10 -- # set +x 00:06:49.804 ************************************ 00:06:49.804 END TEST accel_compress_verify 00:06:49.804 ************************************ 00:06:49.804 09:52:55 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:06:49.804 09:52:55 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:06:49.804 09:52:55 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:49.804 09:52:55 -- common/autotest_common.sh@10 -- # set +x 00:06:49.804 ************************************ 00:06:49.804 START TEST accel_wrong_workload 00:06:49.804 ************************************ 00:06:49.804 09:52:55 -- common/autotest_common.sh@1104 -- # NOT accel_perf -t 1 -w foobar 00:06:49.804 09:52:55 -- common/autotest_common.sh@640 -- # local es=0 00:06:49.804 09:52:55 -- common/autotest_common.sh@642 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:06:49.804 09:52:55 -- common/autotest_common.sh@628 -- # local arg=accel_perf 00:06:49.804 09:52:55 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:49.804 09:52:55 -- common/autotest_common.sh@632 -- # type -t accel_perf 00:06:49.804 09:52:55 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:49.804 09:52:55 -- common/autotest_common.sh@643 -- # accel_perf -t 1 -w foobar 00:06:49.804 09:52:55 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:06:49.804 09:52:55 -- accel/accel.sh@12 -- # build_accel_config 00:06:49.804 09:52:55 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:49.804 09:52:55 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:49.804 09:52:55 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:49.804 09:52:55 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:49.804 09:52:55 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:49.804 09:52:55 -- accel/accel.sh@41 -- # local IFS=, 00:06:49.804 09:52:55 -- accel/accel.sh@42 -- # jq -r . 00:06:49.804 Unsupported workload type: foobar 00:06:49.804 [2024-07-13 09:52:55.604990] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:06:49.804 accel_perf options: 00:06:49.804 [-h help message] 00:06:49.804 [-q queue depth per core] 00:06:49.804 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:06:49.804 [-T number of threads per core 00:06:49.804 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:06:49.804 [-t time in seconds] 00:06:49.804 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:06:49.804 [ dif_verify, , dif_generate, dif_generate_copy 00:06:49.804 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:06:49.804 [-l for compress/decompress workloads, name of uncompressed input file 00:06:49.804 [-S for crc32c workload, use this seed value (default 0) 00:06:49.804 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:06:49.804 [-f for fill workload, use this BYTE value (default 255) 00:06:49.804 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:06:49.804 [-y verify result if this switch is on] 00:06:49.804 [-a tasks to allocate per core (default: same value as -q)] 00:06:49.804 Can be used to spread operations across a wider range of memory. 00:06:49.804 09:52:55 -- common/autotest_common.sh@643 -- # es=1 00:06:49.804 09:52:55 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:06:49.804 09:52:55 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:06:49.804 09:52:55 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:06:49.804 00:06:49.804 real 0m0.021s 00:06:49.804 user 0m0.011s 00:06:49.804 sys 0m0.011s 00:06:49.804 09:52:55 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:49.804 09:52:55 -- common/autotest_common.sh@10 -- # set +x 00:06:49.804 ************************************ 00:06:49.804 END TEST accel_wrong_workload 00:06:49.804 ************************************ 00:06:50.063 Error: writing output failed: Broken pipe 00:06:50.063 09:52:55 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:06:50.063 09:52:55 -- common/autotest_common.sh@1077 -- # '[' 10 -le 1 ']' 00:06:50.063 09:52:55 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:50.063 09:52:55 -- common/autotest_common.sh@10 -- # set +x 00:06:50.063 ************************************ 00:06:50.063 START TEST accel_negative_buffers 00:06:50.063 ************************************ 00:06:50.063 09:52:55 -- common/autotest_common.sh@1104 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:06:50.063 09:52:55 -- common/autotest_common.sh@640 -- # local es=0 00:06:50.063 09:52:55 -- common/autotest_common.sh@642 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:06:50.063 09:52:55 -- common/autotest_common.sh@628 -- # local arg=accel_perf 00:06:50.063 09:52:55 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:50.063 09:52:55 -- common/autotest_common.sh@632 -- # type -t accel_perf 00:06:50.063 09:52:55 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:50.063 09:52:55 -- common/autotest_common.sh@643 -- # accel_perf -t 1 -w xor -y -x -1 00:06:50.063 09:52:55 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:06:50.063 09:52:55 -- accel/accel.sh@12 -- # build_accel_config 00:06:50.063 09:52:55 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:50.063 09:52:55 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:50.063 09:52:55 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:50.063 09:52:55 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:50.063 09:52:55 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:50.063 09:52:55 -- accel/accel.sh@41 -- # local IFS=, 00:06:50.063 09:52:55 -- accel/accel.sh@42 -- # jq -r . 00:06:50.063 -x option must be non-negative. 00:06:50.063 [2024-07-13 09:52:55.651267] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:06:50.063 accel_perf options: 00:06:50.063 [-h help message] 00:06:50.063 [-q queue depth per core] 00:06:50.063 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:06:50.063 [-T number of threads per core 00:06:50.063 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:06:50.063 [-t time in seconds] 00:06:50.063 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:06:50.063 [ dif_verify, , dif_generate, dif_generate_copy 00:06:50.063 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:06:50.063 [-l for compress/decompress workloads, name of uncompressed input file 00:06:50.063 [-S for crc32c workload, use this seed value (default 0) 00:06:50.063 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:06:50.063 [-f for fill workload, use this BYTE value (default 255) 00:06:50.063 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:06:50.063 [-y verify result if this switch is on] 00:06:50.063 [-a tasks to allocate per core (default: same value as -q)] 00:06:50.063 Can be used to spread operations across a wider range of memory. 00:06:50.063 09:52:55 -- common/autotest_common.sh@643 -- # es=1 00:06:50.063 09:52:55 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:06:50.063 09:52:55 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:06:50.063 09:52:55 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:06:50.063 00:06:50.063 real 0m0.023s 00:06:50.063 user 0m0.008s 00:06:50.063 sys 0m0.014s 00:06:50.063 09:52:55 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:50.063 09:52:55 -- common/autotest_common.sh@10 -- # set +x 00:06:50.063 ************************************ 00:06:50.063 END TEST accel_negative_buffers 00:06:50.063 ************************************ 00:06:50.063 Error: writing output failed: Broken pipe 00:06:50.063 09:52:55 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:06:50.063 09:52:55 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:06:50.063 09:52:55 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:50.063 09:52:55 -- common/autotest_common.sh@10 -- # set +x 00:06:50.063 ************************************ 00:06:50.063 START TEST accel_crc32c 00:06:50.063 ************************************ 00:06:50.063 09:52:55 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w crc32c -S 32 -y 00:06:50.063 09:52:55 -- accel/accel.sh@16 -- # local accel_opc 00:06:50.063 09:52:55 -- accel/accel.sh@17 -- # local accel_module 00:06:50.063 09:52:55 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:06:50.063 09:52:55 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:06:50.063 09:52:55 -- accel/accel.sh@12 -- # build_accel_config 00:06:50.063 09:52:55 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:50.063 09:52:55 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:50.063 09:52:55 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:50.063 09:52:55 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:50.063 09:52:55 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:50.063 09:52:55 -- accel/accel.sh@41 -- # local IFS=, 00:06:50.063 09:52:55 -- accel/accel.sh@42 -- # jq -r . 00:06:50.063 [2024-07-13 09:52:55.693848] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:06:50.063 [2024-07-13 09:52:55.693945] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2698892 ] 00:06:50.063 EAL: No free 2048 kB hugepages reported on node 1 00:06:50.063 [2024-07-13 09:52:55.756140] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:50.063 [2024-07-13 09:52:55.846961] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:51.437 09:52:57 -- accel/accel.sh@18 -- # out=' 00:06:51.437 SPDK Configuration: 00:06:51.437 Core mask: 0x1 00:06:51.437 00:06:51.437 Accel Perf Configuration: 00:06:51.437 Workload Type: crc32c 00:06:51.437 CRC-32C seed: 32 00:06:51.437 Transfer size: 4096 bytes 00:06:51.437 Vector count 1 00:06:51.437 Module: software 00:06:51.437 Queue depth: 32 00:06:51.437 Allocate depth: 32 00:06:51.437 # threads/core: 1 00:06:51.437 Run time: 1 seconds 00:06:51.437 Verify: Yes 00:06:51.437 00:06:51.437 Running for 1 seconds... 00:06:51.437 00:06:51.437 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:51.437 ------------------------------------------------------------------------------------ 00:06:51.437 0,0 406464/s 1587 MiB/s 0 0 00:06:51.437 ==================================================================================== 00:06:51.437 Total 406464/s 1587 MiB/s 0 0' 00:06:51.437 09:52:57 -- accel/accel.sh@20 -- # IFS=: 00:06:51.437 09:52:57 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:06:51.437 09:52:57 -- accel/accel.sh@20 -- # read -r var val 00:06:51.437 09:52:57 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:06:51.437 09:52:57 -- accel/accel.sh@12 -- # build_accel_config 00:06:51.437 09:52:57 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:51.437 09:52:57 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:51.437 09:52:57 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:51.437 09:52:57 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:51.437 09:52:57 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:51.437 09:52:57 -- accel/accel.sh@41 -- # local IFS=, 00:06:51.437 09:52:57 -- accel/accel.sh@42 -- # jq -r . 00:06:51.437 [2024-07-13 09:52:57.093582] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:06:51.437 [2024-07-13 09:52:57.093664] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2699036 ] 00:06:51.437 EAL: No free 2048 kB hugepages reported on node 1 00:06:51.437 [2024-07-13 09:52:57.153496] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:51.437 [2024-07-13 09:52:57.240962] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:51.695 09:52:57 -- accel/accel.sh@21 -- # val= 00:06:51.695 09:52:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.695 09:52:57 -- accel/accel.sh@20 -- # IFS=: 00:06:51.695 09:52:57 -- accel/accel.sh@20 -- # read -r var val 00:06:51.695 09:52:57 -- accel/accel.sh@21 -- # val= 00:06:51.695 09:52:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.695 09:52:57 -- accel/accel.sh@20 -- # IFS=: 00:06:51.695 09:52:57 -- accel/accel.sh@20 -- # read -r var val 00:06:51.695 09:52:57 -- accel/accel.sh@21 -- # val=0x1 00:06:51.696 09:52:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.696 09:52:57 -- accel/accel.sh@20 -- # IFS=: 00:06:51.696 09:52:57 -- accel/accel.sh@20 -- # read -r var val 00:06:51.696 09:52:57 -- accel/accel.sh@21 -- # val= 00:06:51.696 09:52:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.696 09:52:57 -- accel/accel.sh@20 -- # IFS=: 00:06:51.696 09:52:57 -- accel/accel.sh@20 -- # read -r var val 00:06:51.696 09:52:57 -- accel/accel.sh@21 -- # val= 00:06:51.696 09:52:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.696 09:52:57 -- accel/accel.sh@20 -- # IFS=: 00:06:51.696 09:52:57 -- accel/accel.sh@20 -- # read -r var val 00:06:51.696 09:52:57 -- accel/accel.sh@21 -- # val=crc32c 00:06:51.696 09:52:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.696 09:52:57 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:06:51.696 09:52:57 -- accel/accel.sh@20 -- # IFS=: 00:06:51.696 09:52:57 -- accel/accel.sh@20 -- # read -r var val 00:06:51.696 09:52:57 -- accel/accel.sh@21 -- # val=32 00:06:51.696 09:52:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.696 09:52:57 -- accel/accel.sh@20 -- # IFS=: 00:06:51.696 09:52:57 -- accel/accel.sh@20 -- # read -r var val 00:06:51.696 09:52:57 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:51.696 09:52:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.696 09:52:57 -- accel/accel.sh@20 -- # IFS=: 00:06:51.696 09:52:57 -- accel/accel.sh@20 -- # read -r var val 00:06:51.696 09:52:57 -- accel/accel.sh@21 -- # val= 00:06:51.696 09:52:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.696 09:52:57 -- accel/accel.sh@20 -- # IFS=: 00:06:51.696 09:52:57 -- accel/accel.sh@20 -- # read -r var val 00:06:51.696 09:52:57 -- accel/accel.sh@21 -- # val=software 00:06:51.696 09:52:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.696 09:52:57 -- accel/accel.sh@23 -- # accel_module=software 00:06:51.696 09:52:57 -- accel/accel.sh@20 -- # IFS=: 00:06:51.696 09:52:57 -- accel/accel.sh@20 -- # read -r var val 00:06:51.696 09:52:57 -- accel/accel.sh@21 -- # val=32 00:06:51.696 09:52:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.696 09:52:57 -- accel/accel.sh@20 -- # IFS=: 00:06:51.696 09:52:57 -- accel/accel.sh@20 -- # read -r var val 00:06:51.696 09:52:57 -- accel/accel.sh@21 -- # val=32 00:06:51.696 09:52:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.696 09:52:57 -- accel/accel.sh@20 -- # IFS=: 00:06:51.696 09:52:57 -- accel/accel.sh@20 -- # read -r var val 00:06:51.696 09:52:57 -- accel/accel.sh@21 -- # val=1 00:06:51.696 09:52:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.696 09:52:57 -- accel/accel.sh@20 -- # IFS=: 00:06:51.696 09:52:57 -- accel/accel.sh@20 -- # read -r var val 00:06:51.696 09:52:57 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:51.696 09:52:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.696 09:52:57 -- accel/accel.sh@20 -- # IFS=: 00:06:51.696 09:52:57 -- accel/accel.sh@20 -- # read -r var val 00:06:51.696 09:52:57 -- accel/accel.sh@21 -- # val=Yes 00:06:51.696 09:52:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.696 09:52:57 -- accel/accel.sh@20 -- # IFS=: 00:06:51.696 09:52:57 -- accel/accel.sh@20 -- # read -r var val 00:06:51.696 09:52:57 -- accel/accel.sh@21 -- # val= 00:06:51.696 09:52:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.696 09:52:57 -- accel/accel.sh@20 -- # IFS=: 00:06:51.696 09:52:57 -- accel/accel.sh@20 -- # read -r var val 00:06:51.696 09:52:57 -- accel/accel.sh@21 -- # val= 00:06:51.696 09:52:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.696 09:52:57 -- accel/accel.sh@20 -- # IFS=: 00:06:51.696 09:52:57 -- accel/accel.sh@20 -- # read -r var val 00:06:53.070 09:52:58 -- accel/accel.sh@21 -- # val= 00:06:53.070 09:52:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.070 09:52:58 -- accel/accel.sh@20 -- # IFS=: 00:06:53.070 09:52:58 -- accel/accel.sh@20 -- # read -r var val 00:06:53.070 09:52:58 -- accel/accel.sh@21 -- # val= 00:06:53.070 09:52:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.070 09:52:58 -- accel/accel.sh@20 -- # IFS=: 00:06:53.070 09:52:58 -- accel/accel.sh@20 -- # read -r var val 00:06:53.070 09:52:58 -- accel/accel.sh@21 -- # val= 00:06:53.070 09:52:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.070 09:52:58 -- accel/accel.sh@20 -- # IFS=: 00:06:53.070 09:52:58 -- accel/accel.sh@20 -- # read -r var val 00:06:53.070 09:52:58 -- accel/accel.sh@21 -- # val= 00:06:53.070 09:52:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.070 09:52:58 -- accel/accel.sh@20 -- # IFS=: 00:06:53.070 09:52:58 -- accel/accel.sh@20 -- # read -r var val 00:06:53.070 09:52:58 -- accel/accel.sh@21 -- # val= 00:06:53.070 09:52:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.070 09:52:58 -- accel/accel.sh@20 -- # IFS=: 00:06:53.070 09:52:58 -- accel/accel.sh@20 -- # read -r var val 00:06:53.070 09:52:58 -- accel/accel.sh@21 -- # val= 00:06:53.070 09:52:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.070 09:52:58 -- accel/accel.sh@20 -- # IFS=: 00:06:53.070 09:52:58 -- accel/accel.sh@20 -- # read -r var val 00:06:53.070 09:52:58 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:53.070 09:52:58 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:06:53.070 09:52:58 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:53.070 00:06:53.070 real 0m2.784s 00:06:53.070 user 0m2.497s 00:06:53.070 sys 0m0.282s 00:06:53.070 09:52:58 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:53.071 09:52:58 -- common/autotest_common.sh@10 -- # set +x 00:06:53.071 ************************************ 00:06:53.071 END TEST accel_crc32c 00:06:53.071 ************************************ 00:06:53.071 09:52:58 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:06:53.071 09:52:58 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:06:53.071 09:52:58 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:53.071 09:52:58 -- common/autotest_common.sh@10 -- # set +x 00:06:53.071 ************************************ 00:06:53.071 START TEST accel_crc32c_C2 00:06:53.071 ************************************ 00:06:53.071 09:52:58 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w crc32c -y -C 2 00:06:53.071 09:52:58 -- accel/accel.sh@16 -- # local accel_opc 00:06:53.071 09:52:58 -- accel/accel.sh@17 -- # local accel_module 00:06:53.071 09:52:58 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:06:53.071 09:52:58 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:06:53.071 09:52:58 -- accel/accel.sh@12 -- # build_accel_config 00:06:53.071 09:52:58 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:53.071 09:52:58 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:53.071 09:52:58 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:53.071 09:52:58 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:53.071 09:52:58 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:53.071 09:52:58 -- accel/accel.sh@41 -- # local IFS=, 00:06:53.071 09:52:58 -- accel/accel.sh@42 -- # jq -r . 00:06:53.071 [2024-07-13 09:52:58.501140] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:06:53.071 [2024-07-13 09:52:58.501232] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2699202 ] 00:06:53.071 EAL: No free 2048 kB hugepages reported on node 1 00:06:53.071 [2024-07-13 09:52:58.563462] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:53.071 [2024-07-13 09:52:58.654395] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:54.445 09:52:59 -- accel/accel.sh@18 -- # out=' 00:06:54.445 SPDK Configuration: 00:06:54.445 Core mask: 0x1 00:06:54.445 00:06:54.445 Accel Perf Configuration: 00:06:54.445 Workload Type: crc32c 00:06:54.445 CRC-32C seed: 0 00:06:54.445 Transfer size: 4096 bytes 00:06:54.445 Vector count 2 00:06:54.445 Module: software 00:06:54.445 Queue depth: 32 00:06:54.445 Allocate depth: 32 00:06:54.445 # threads/core: 1 00:06:54.445 Run time: 1 seconds 00:06:54.445 Verify: Yes 00:06:54.445 00:06:54.445 Running for 1 seconds... 00:06:54.445 00:06:54.445 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:54.445 ------------------------------------------------------------------------------------ 00:06:54.445 0,0 313952/s 2452 MiB/s 0 0 00:06:54.445 ==================================================================================== 00:06:54.445 Total 313952/s 1226 MiB/s 0 0' 00:06:54.445 09:52:59 -- accel/accel.sh@20 -- # IFS=: 00:06:54.445 09:52:59 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:06:54.445 09:52:59 -- accel/accel.sh@20 -- # read -r var val 00:06:54.445 09:52:59 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:06:54.445 09:52:59 -- accel/accel.sh@12 -- # build_accel_config 00:06:54.445 09:52:59 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:54.445 09:52:59 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:54.445 09:52:59 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:54.445 09:52:59 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:54.445 09:52:59 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:54.445 09:52:59 -- accel/accel.sh@41 -- # local IFS=, 00:06:54.445 09:52:59 -- accel/accel.sh@42 -- # jq -r . 00:06:54.445 [2024-07-13 09:52:59.905669] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:06:54.445 [2024-07-13 09:52:59.905753] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2699342 ] 00:06:54.445 EAL: No free 2048 kB hugepages reported on node 1 00:06:54.445 [2024-07-13 09:52:59.965253] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:54.445 [2024-07-13 09:53:00.063152] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:54.445 09:53:00 -- accel/accel.sh@21 -- # val= 00:06:54.445 09:53:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.445 09:53:00 -- accel/accel.sh@20 -- # IFS=: 00:06:54.445 09:53:00 -- accel/accel.sh@20 -- # read -r var val 00:06:54.445 09:53:00 -- accel/accel.sh@21 -- # val= 00:06:54.445 09:53:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.445 09:53:00 -- accel/accel.sh@20 -- # IFS=: 00:06:54.445 09:53:00 -- accel/accel.sh@20 -- # read -r var val 00:06:54.445 09:53:00 -- accel/accel.sh@21 -- # val=0x1 00:06:54.445 09:53:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.445 09:53:00 -- accel/accel.sh@20 -- # IFS=: 00:06:54.446 09:53:00 -- accel/accel.sh@20 -- # read -r var val 00:06:54.446 09:53:00 -- accel/accel.sh@21 -- # val= 00:06:54.446 09:53:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.446 09:53:00 -- accel/accel.sh@20 -- # IFS=: 00:06:54.446 09:53:00 -- accel/accel.sh@20 -- # read -r var val 00:06:54.446 09:53:00 -- accel/accel.sh@21 -- # val= 00:06:54.446 09:53:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.446 09:53:00 -- accel/accel.sh@20 -- # IFS=: 00:06:54.446 09:53:00 -- accel/accel.sh@20 -- # read -r var val 00:06:54.446 09:53:00 -- accel/accel.sh@21 -- # val=crc32c 00:06:54.446 09:53:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.446 09:53:00 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:06:54.446 09:53:00 -- accel/accel.sh@20 -- # IFS=: 00:06:54.446 09:53:00 -- accel/accel.sh@20 -- # read -r var val 00:06:54.446 09:53:00 -- accel/accel.sh@21 -- # val=0 00:06:54.446 09:53:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.446 09:53:00 -- accel/accel.sh@20 -- # IFS=: 00:06:54.446 09:53:00 -- accel/accel.sh@20 -- # read -r var val 00:06:54.446 09:53:00 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:54.446 09:53:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.446 09:53:00 -- accel/accel.sh@20 -- # IFS=: 00:06:54.446 09:53:00 -- accel/accel.sh@20 -- # read -r var val 00:06:54.446 09:53:00 -- accel/accel.sh@21 -- # val= 00:06:54.446 09:53:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.446 09:53:00 -- accel/accel.sh@20 -- # IFS=: 00:06:54.446 09:53:00 -- accel/accel.sh@20 -- # read -r var val 00:06:54.446 09:53:00 -- accel/accel.sh@21 -- # val=software 00:06:54.446 09:53:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.446 09:53:00 -- accel/accel.sh@23 -- # accel_module=software 00:06:54.446 09:53:00 -- accel/accel.sh@20 -- # IFS=: 00:06:54.446 09:53:00 -- accel/accel.sh@20 -- # read -r var val 00:06:54.446 09:53:00 -- accel/accel.sh@21 -- # val=32 00:06:54.446 09:53:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.446 09:53:00 -- accel/accel.sh@20 -- # IFS=: 00:06:54.446 09:53:00 -- accel/accel.sh@20 -- # read -r var val 00:06:54.446 09:53:00 -- accel/accel.sh@21 -- # val=32 00:06:54.446 09:53:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.446 09:53:00 -- accel/accel.sh@20 -- # IFS=: 00:06:54.446 09:53:00 -- accel/accel.sh@20 -- # read -r var val 00:06:54.446 09:53:00 -- accel/accel.sh@21 -- # val=1 00:06:54.446 09:53:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.446 09:53:00 -- accel/accel.sh@20 -- # IFS=: 00:06:54.446 09:53:00 -- accel/accel.sh@20 -- # read -r var val 00:06:54.446 09:53:00 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:54.446 09:53:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.446 09:53:00 -- accel/accel.sh@20 -- # IFS=: 00:06:54.446 09:53:00 -- accel/accel.sh@20 -- # read -r var val 00:06:54.446 09:53:00 -- accel/accel.sh@21 -- # val=Yes 00:06:54.446 09:53:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.446 09:53:00 -- accel/accel.sh@20 -- # IFS=: 00:06:54.446 09:53:00 -- accel/accel.sh@20 -- # read -r var val 00:06:54.446 09:53:00 -- accel/accel.sh@21 -- # val= 00:06:54.446 09:53:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.446 09:53:00 -- accel/accel.sh@20 -- # IFS=: 00:06:54.446 09:53:00 -- accel/accel.sh@20 -- # read -r var val 00:06:54.446 09:53:00 -- accel/accel.sh@21 -- # val= 00:06:54.446 09:53:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.446 09:53:00 -- accel/accel.sh@20 -- # IFS=: 00:06:54.446 09:53:00 -- accel/accel.sh@20 -- # read -r var val 00:06:55.820 09:53:01 -- accel/accel.sh@21 -- # val= 00:06:55.820 09:53:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.820 09:53:01 -- accel/accel.sh@20 -- # IFS=: 00:06:55.820 09:53:01 -- accel/accel.sh@20 -- # read -r var val 00:06:55.820 09:53:01 -- accel/accel.sh@21 -- # val= 00:06:55.820 09:53:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.820 09:53:01 -- accel/accel.sh@20 -- # IFS=: 00:06:55.820 09:53:01 -- accel/accel.sh@20 -- # read -r var val 00:06:55.820 09:53:01 -- accel/accel.sh@21 -- # val= 00:06:55.820 09:53:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.820 09:53:01 -- accel/accel.sh@20 -- # IFS=: 00:06:55.820 09:53:01 -- accel/accel.sh@20 -- # read -r var val 00:06:55.820 09:53:01 -- accel/accel.sh@21 -- # val= 00:06:55.820 09:53:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.820 09:53:01 -- accel/accel.sh@20 -- # IFS=: 00:06:55.820 09:53:01 -- accel/accel.sh@20 -- # read -r var val 00:06:55.820 09:53:01 -- accel/accel.sh@21 -- # val= 00:06:55.820 09:53:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.820 09:53:01 -- accel/accel.sh@20 -- # IFS=: 00:06:55.820 09:53:01 -- accel/accel.sh@20 -- # read -r var val 00:06:55.820 09:53:01 -- accel/accel.sh@21 -- # val= 00:06:55.820 09:53:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.820 09:53:01 -- accel/accel.sh@20 -- # IFS=: 00:06:55.820 09:53:01 -- accel/accel.sh@20 -- # read -r var val 00:06:55.820 09:53:01 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:55.820 09:53:01 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:06:55.820 09:53:01 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:55.820 00:06:55.820 real 0m2.806s 00:06:55.820 user 0m2.509s 00:06:55.820 sys 0m0.289s 00:06:55.820 09:53:01 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:55.820 09:53:01 -- common/autotest_common.sh@10 -- # set +x 00:06:55.820 ************************************ 00:06:55.820 END TEST accel_crc32c_C2 00:06:55.820 ************************************ 00:06:55.820 09:53:01 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:06:55.820 09:53:01 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:06:55.820 09:53:01 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:55.820 09:53:01 -- common/autotest_common.sh@10 -- # set +x 00:06:55.820 ************************************ 00:06:55.820 START TEST accel_copy 00:06:55.820 ************************************ 00:06:55.820 09:53:01 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w copy -y 00:06:55.820 09:53:01 -- accel/accel.sh@16 -- # local accel_opc 00:06:55.820 09:53:01 -- accel/accel.sh@17 -- # local accel_module 00:06:55.820 09:53:01 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:06:55.820 09:53:01 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:06:55.820 09:53:01 -- accel/accel.sh@12 -- # build_accel_config 00:06:55.820 09:53:01 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:55.820 09:53:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:55.820 09:53:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:55.820 09:53:01 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:55.820 09:53:01 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:55.820 09:53:01 -- accel/accel.sh@41 -- # local IFS=, 00:06:55.820 09:53:01 -- accel/accel.sh@42 -- # jq -r . 00:06:55.820 [2024-07-13 09:53:01.330589] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:06:55.820 [2024-07-13 09:53:01.330667] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2699614 ] 00:06:55.820 EAL: No free 2048 kB hugepages reported on node 1 00:06:55.820 [2024-07-13 09:53:01.391951] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:55.820 [2024-07-13 09:53:01.483126] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:57.194 09:53:02 -- accel/accel.sh@18 -- # out=' 00:06:57.194 SPDK Configuration: 00:06:57.194 Core mask: 0x1 00:06:57.194 00:06:57.194 Accel Perf Configuration: 00:06:57.194 Workload Type: copy 00:06:57.194 Transfer size: 4096 bytes 00:06:57.194 Vector count 1 00:06:57.194 Module: software 00:06:57.194 Queue depth: 32 00:06:57.194 Allocate depth: 32 00:06:57.194 # threads/core: 1 00:06:57.194 Run time: 1 seconds 00:06:57.194 Verify: Yes 00:06:57.194 00:06:57.194 Running for 1 seconds... 00:06:57.194 00:06:57.194 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:57.194 ------------------------------------------------------------------------------------ 00:06:57.194 0,0 277696/s 1084 MiB/s 0 0 00:06:57.194 ==================================================================================== 00:06:57.194 Total 277696/s 1084 MiB/s 0 0' 00:06:57.194 09:53:02 -- accel/accel.sh@20 -- # IFS=: 00:06:57.194 09:53:02 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:06:57.194 09:53:02 -- accel/accel.sh@20 -- # read -r var val 00:06:57.194 09:53:02 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:06:57.194 09:53:02 -- accel/accel.sh@12 -- # build_accel_config 00:06:57.194 09:53:02 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:57.194 09:53:02 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:57.194 09:53:02 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:57.194 09:53:02 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:57.194 09:53:02 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:57.194 09:53:02 -- accel/accel.sh@41 -- # local IFS=, 00:06:57.194 09:53:02 -- accel/accel.sh@42 -- # jq -r . 00:06:57.194 [2024-07-13 09:53:02.731067] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:06:57.194 [2024-07-13 09:53:02.731137] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2699764 ] 00:06:57.194 EAL: No free 2048 kB hugepages reported on node 1 00:06:57.194 [2024-07-13 09:53:02.791092] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:57.194 [2024-07-13 09:53:02.879811] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:57.194 09:53:02 -- accel/accel.sh@21 -- # val= 00:06:57.194 09:53:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.194 09:53:02 -- accel/accel.sh@20 -- # IFS=: 00:06:57.194 09:53:02 -- accel/accel.sh@20 -- # read -r var val 00:06:57.194 09:53:02 -- accel/accel.sh@21 -- # val= 00:06:57.194 09:53:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.194 09:53:02 -- accel/accel.sh@20 -- # IFS=: 00:06:57.194 09:53:02 -- accel/accel.sh@20 -- # read -r var val 00:06:57.194 09:53:02 -- accel/accel.sh@21 -- # val=0x1 00:06:57.194 09:53:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.194 09:53:02 -- accel/accel.sh@20 -- # IFS=: 00:06:57.194 09:53:02 -- accel/accel.sh@20 -- # read -r var val 00:06:57.194 09:53:02 -- accel/accel.sh@21 -- # val= 00:06:57.194 09:53:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.194 09:53:02 -- accel/accel.sh@20 -- # IFS=: 00:06:57.194 09:53:02 -- accel/accel.sh@20 -- # read -r var val 00:06:57.194 09:53:02 -- accel/accel.sh@21 -- # val= 00:06:57.194 09:53:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.194 09:53:02 -- accel/accel.sh@20 -- # IFS=: 00:06:57.194 09:53:02 -- accel/accel.sh@20 -- # read -r var val 00:06:57.194 09:53:02 -- accel/accel.sh@21 -- # val=copy 00:06:57.194 09:53:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.194 09:53:02 -- accel/accel.sh@24 -- # accel_opc=copy 00:06:57.194 09:53:02 -- accel/accel.sh@20 -- # IFS=: 00:06:57.194 09:53:02 -- accel/accel.sh@20 -- # read -r var val 00:06:57.194 09:53:02 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:57.194 09:53:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.194 09:53:02 -- accel/accel.sh@20 -- # IFS=: 00:06:57.194 09:53:02 -- accel/accel.sh@20 -- # read -r var val 00:06:57.194 09:53:02 -- accel/accel.sh@21 -- # val= 00:06:57.194 09:53:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.194 09:53:02 -- accel/accel.sh@20 -- # IFS=: 00:06:57.194 09:53:02 -- accel/accel.sh@20 -- # read -r var val 00:06:57.194 09:53:02 -- accel/accel.sh@21 -- # val=software 00:06:57.194 09:53:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.194 09:53:02 -- accel/accel.sh@23 -- # accel_module=software 00:06:57.194 09:53:02 -- accel/accel.sh@20 -- # IFS=: 00:06:57.194 09:53:02 -- accel/accel.sh@20 -- # read -r var val 00:06:57.194 09:53:02 -- accel/accel.sh@21 -- # val=32 00:06:57.194 09:53:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.194 09:53:02 -- accel/accel.sh@20 -- # IFS=: 00:06:57.194 09:53:02 -- accel/accel.sh@20 -- # read -r var val 00:06:57.194 09:53:02 -- accel/accel.sh@21 -- # val=32 00:06:57.194 09:53:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.194 09:53:02 -- accel/accel.sh@20 -- # IFS=: 00:06:57.194 09:53:02 -- accel/accel.sh@20 -- # read -r var val 00:06:57.194 09:53:02 -- accel/accel.sh@21 -- # val=1 00:06:57.194 09:53:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.194 09:53:02 -- accel/accel.sh@20 -- # IFS=: 00:06:57.194 09:53:02 -- accel/accel.sh@20 -- # read -r var val 00:06:57.194 09:53:02 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:57.194 09:53:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.194 09:53:02 -- accel/accel.sh@20 -- # IFS=: 00:06:57.194 09:53:02 -- accel/accel.sh@20 -- # read -r var val 00:06:57.194 09:53:02 -- accel/accel.sh@21 -- # val=Yes 00:06:57.194 09:53:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.194 09:53:02 -- accel/accel.sh@20 -- # IFS=: 00:06:57.194 09:53:02 -- accel/accel.sh@20 -- # read -r var val 00:06:57.194 09:53:02 -- accel/accel.sh@21 -- # val= 00:06:57.194 09:53:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.194 09:53:02 -- accel/accel.sh@20 -- # IFS=: 00:06:57.194 09:53:02 -- accel/accel.sh@20 -- # read -r var val 00:06:57.194 09:53:02 -- accel/accel.sh@21 -- # val= 00:06:57.194 09:53:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.194 09:53:02 -- accel/accel.sh@20 -- # IFS=: 00:06:57.194 09:53:02 -- accel/accel.sh@20 -- # read -r var val 00:06:58.579 09:53:04 -- accel/accel.sh@21 -- # val= 00:06:58.579 09:53:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.579 09:53:04 -- accel/accel.sh@20 -- # IFS=: 00:06:58.579 09:53:04 -- accel/accel.sh@20 -- # read -r var val 00:06:58.579 09:53:04 -- accel/accel.sh@21 -- # val= 00:06:58.579 09:53:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.579 09:53:04 -- accel/accel.sh@20 -- # IFS=: 00:06:58.579 09:53:04 -- accel/accel.sh@20 -- # read -r var val 00:06:58.579 09:53:04 -- accel/accel.sh@21 -- # val= 00:06:58.579 09:53:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.579 09:53:04 -- accel/accel.sh@20 -- # IFS=: 00:06:58.579 09:53:04 -- accel/accel.sh@20 -- # read -r var val 00:06:58.579 09:53:04 -- accel/accel.sh@21 -- # val= 00:06:58.579 09:53:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.579 09:53:04 -- accel/accel.sh@20 -- # IFS=: 00:06:58.579 09:53:04 -- accel/accel.sh@20 -- # read -r var val 00:06:58.579 09:53:04 -- accel/accel.sh@21 -- # val= 00:06:58.579 09:53:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.579 09:53:04 -- accel/accel.sh@20 -- # IFS=: 00:06:58.579 09:53:04 -- accel/accel.sh@20 -- # read -r var val 00:06:58.579 09:53:04 -- accel/accel.sh@21 -- # val= 00:06:58.579 09:53:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.579 09:53:04 -- accel/accel.sh@20 -- # IFS=: 00:06:58.579 09:53:04 -- accel/accel.sh@20 -- # read -r var val 00:06:58.579 09:53:04 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:58.579 09:53:04 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:06:58.579 09:53:04 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:58.579 00:06:58.579 real 0m2.799s 00:06:58.579 user 0m2.510s 00:06:58.579 sys 0m0.281s 00:06:58.579 09:53:04 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:58.579 09:53:04 -- common/autotest_common.sh@10 -- # set +x 00:06:58.579 ************************************ 00:06:58.579 END TEST accel_copy 00:06:58.579 ************************************ 00:06:58.579 09:53:04 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:58.579 09:53:04 -- common/autotest_common.sh@1077 -- # '[' 13 -le 1 ']' 00:06:58.579 09:53:04 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:58.579 09:53:04 -- common/autotest_common.sh@10 -- # set +x 00:06:58.579 ************************************ 00:06:58.579 START TEST accel_fill 00:06:58.579 ************************************ 00:06:58.579 09:53:04 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:58.579 09:53:04 -- accel/accel.sh@16 -- # local accel_opc 00:06:58.579 09:53:04 -- accel/accel.sh@17 -- # local accel_module 00:06:58.579 09:53:04 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:58.579 09:53:04 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:58.579 09:53:04 -- accel/accel.sh@12 -- # build_accel_config 00:06:58.579 09:53:04 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:58.579 09:53:04 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:58.579 09:53:04 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:58.579 09:53:04 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:58.579 09:53:04 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:58.579 09:53:04 -- accel/accel.sh@41 -- # local IFS=, 00:06:58.579 09:53:04 -- accel/accel.sh@42 -- # jq -r . 00:06:58.579 [2024-07-13 09:53:04.155785] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:06:58.579 [2024-07-13 09:53:04.155875] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2699920 ] 00:06:58.579 EAL: No free 2048 kB hugepages reported on node 1 00:06:58.579 [2024-07-13 09:53:04.218728] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:58.579 [2024-07-13 09:53:04.308895] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:59.952 09:53:05 -- accel/accel.sh@18 -- # out=' 00:06:59.952 SPDK Configuration: 00:06:59.952 Core mask: 0x1 00:06:59.952 00:06:59.952 Accel Perf Configuration: 00:06:59.952 Workload Type: fill 00:06:59.952 Fill pattern: 0x80 00:06:59.952 Transfer size: 4096 bytes 00:06:59.952 Vector count 1 00:06:59.952 Module: software 00:06:59.952 Queue depth: 64 00:06:59.952 Allocate depth: 64 00:06:59.952 # threads/core: 1 00:06:59.952 Run time: 1 seconds 00:06:59.952 Verify: Yes 00:06:59.952 00:06:59.952 Running for 1 seconds... 00:06:59.952 00:06:59.952 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:59.952 ------------------------------------------------------------------------------------ 00:06:59.952 0,0 401408/s 1568 MiB/s 0 0 00:06:59.952 ==================================================================================== 00:06:59.952 Total 401408/s 1568 MiB/s 0 0' 00:06:59.952 09:53:05 -- accel/accel.sh@20 -- # IFS=: 00:06:59.952 09:53:05 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:59.952 09:53:05 -- accel/accel.sh@20 -- # read -r var val 00:06:59.952 09:53:05 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:59.952 09:53:05 -- accel/accel.sh@12 -- # build_accel_config 00:06:59.952 09:53:05 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:59.952 09:53:05 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:59.952 09:53:05 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:59.952 09:53:05 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:59.952 09:53:05 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:59.952 09:53:05 -- accel/accel.sh@41 -- # local IFS=, 00:06:59.952 09:53:05 -- accel/accel.sh@42 -- # jq -r . 00:06:59.952 [2024-07-13 09:53:05.557698] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:06:59.952 [2024-07-13 09:53:05.557781] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2700067 ] 00:06:59.952 EAL: No free 2048 kB hugepages reported on node 1 00:06:59.952 [2024-07-13 09:53:05.617137] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:59.952 [2024-07-13 09:53:05.708288] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:00.210 09:53:05 -- accel/accel.sh@21 -- # val= 00:07:00.210 09:53:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.210 09:53:05 -- accel/accel.sh@20 -- # IFS=: 00:07:00.210 09:53:05 -- accel/accel.sh@20 -- # read -r var val 00:07:00.210 09:53:05 -- accel/accel.sh@21 -- # val= 00:07:00.210 09:53:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.210 09:53:05 -- accel/accel.sh@20 -- # IFS=: 00:07:00.210 09:53:05 -- accel/accel.sh@20 -- # read -r var val 00:07:00.210 09:53:05 -- accel/accel.sh@21 -- # val=0x1 00:07:00.210 09:53:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.210 09:53:05 -- accel/accel.sh@20 -- # IFS=: 00:07:00.210 09:53:05 -- accel/accel.sh@20 -- # read -r var val 00:07:00.210 09:53:05 -- accel/accel.sh@21 -- # val= 00:07:00.210 09:53:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.210 09:53:05 -- accel/accel.sh@20 -- # IFS=: 00:07:00.210 09:53:05 -- accel/accel.sh@20 -- # read -r var val 00:07:00.210 09:53:05 -- accel/accel.sh@21 -- # val= 00:07:00.210 09:53:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.210 09:53:05 -- accel/accel.sh@20 -- # IFS=: 00:07:00.210 09:53:05 -- accel/accel.sh@20 -- # read -r var val 00:07:00.210 09:53:05 -- accel/accel.sh@21 -- # val=fill 00:07:00.210 09:53:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.210 09:53:05 -- accel/accel.sh@24 -- # accel_opc=fill 00:07:00.210 09:53:05 -- accel/accel.sh@20 -- # IFS=: 00:07:00.210 09:53:05 -- accel/accel.sh@20 -- # read -r var val 00:07:00.210 09:53:05 -- accel/accel.sh@21 -- # val=0x80 00:07:00.210 09:53:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.210 09:53:05 -- accel/accel.sh@20 -- # IFS=: 00:07:00.210 09:53:05 -- accel/accel.sh@20 -- # read -r var val 00:07:00.210 09:53:05 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:00.210 09:53:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.210 09:53:05 -- accel/accel.sh@20 -- # IFS=: 00:07:00.210 09:53:05 -- accel/accel.sh@20 -- # read -r var val 00:07:00.210 09:53:05 -- accel/accel.sh@21 -- # val= 00:07:00.210 09:53:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.210 09:53:05 -- accel/accel.sh@20 -- # IFS=: 00:07:00.210 09:53:05 -- accel/accel.sh@20 -- # read -r var val 00:07:00.210 09:53:05 -- accel/accel.sh@21 -- # val=software 00:07:00.210 09:53:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.210 09:53:05 -- accel/accel.sh@23 -- # accel_module=software 00:07:00.210 09:53:05 -- accel/accel.sh@20 -- # IFS=: 00:07:00.210 09:53:05 -- accel/accel.sh@20 -- # read -r var val 00:07:00.210 09:53:05 -- accel/accel.sh@21 -- # val=64 00:07:00.210 09:53:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.210 09:53:05 -- accel/accel.sh@20 -- # IFS=: 00:07:00.210 09:53:05 -- accel/accel.sh@20 -- # read -r var val 00:07:00.210 09:53:05 -- accel/accel.sh@21 -- # val=64 00:07:00.210 09:53:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.210 09:53:05 -- accel/accel.sh@20 -- # IFS=: 00:07:00.210 09:53:05 -- accel/accel.sh@20 -- # read -r var val 00:07:00.210 09:53:05 -- accel/accel.sh@21 -- # val=1 00:07:00.210 09:53:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.210 09:53:05 -- accel/accel.sh@20 -- # IFS=: 00:07:00.210 09:53:05 -- accel/accel.sh@20 -- # read -r var val 00:07:00.210 09:53:05 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:00.210 09:53:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.210 09:53:05 -- accel/accel.sh@20 -- # IFS=: 00:07:00.210 09:53:05 -- accel/accel.sh@20 -- # read -r var val 00:07:00.210 09:53:05 -- accel/accel.sh@21 -- # val=Yes 00:07:00.210 09:53:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.210 09:53:05 -- accel/accel.sh@20 -- # IFS=: 00:07:00.210 09:53:05 -- accel/accel.sh@20 -- # read -r var val 00:07:00.210 09:53:05 -- accel/accel.sh@21 -- # val= 00:07:00.210 09:53:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.210 09:53:05 -- accel/accel.sh@20 -- # IFS=: 00:07:00.210 09:53:05 -- accel/accel.sh@20 -- # read -r var val 00:07:00.210 09:53:05 -- accel/accel.sh@21 -- # val= 00:07:00.210 09:53:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.210 09:53:05 -- accel/accel.sh@20 -- # IFS=: 00:07:00.210 09:53:05 -- accel/accel.sh@20 -- # read -r var val 00:07:01.159 09:53:06 -- accel/accel.sh@21 -- # val= 00:07:01.159 09:53:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.159 09:53:06 -- accel/accel.sh@20 -- # IFS=: 00:07:01.159 09:53:06 -- accel/accel.sh@20 -- # read -r var val 00:07:01.159 09:53:06 -- accel/accel.sh@21 -- # val= 00:07:01.159 09:53:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.159 09:53:06 -- accel/accel.sh@20 -- # IFS=: 00:07:01.159 09:53:06 -- accel/accel.sh@20 -- # read -r var val 00:07:01.159 09:53:06 -- accel/accel.sh@21 -- # val= 00:07:01.159 09:53:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.159 09:53:06 -- accel/accel.sh@20 -- # IFS=: 00:07:01.159 09:53:06 -- accel/accel.sh@20 -- # read -r var val 00:07:01.159 09:53:06 -- accel/accel.sh@21 -- # val= 00:07:01.159 09:53:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.159 09:53:06 -- accel/accel.sh@20 -- # IFS=: 00:07:01.159 09:53:06 -- accel/accel.sh@20 -- # read -r var val 00:07:01.159 09:53:06 -- accel/accel.sh@21 -- # val= 00:07:01.159 09:53:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.159 09:53:06 -- accel/accel.sh@20 -- # IFS=: 00:07:01.159 09:53:06 -- accel/accel.sh@20 -- # read -r var val 00:07:01.159 09:53:06 -- accel/accel.sh@21 -- # val= 00:07:01.159 09:53:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.159 09:53:06 -- accel/accel.sh@20 -- # IFS=: 00:07:01.159 09:53:06 -- accel/accel.sh@20 -- # read -r var val 00:07:01.159 09:53:06 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:01.159 09:53:06 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:07:01.159 09:53:06 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:01.159 00:07:01.159 real 0m2.805s 00:07:01.159 user 0m2.509s 00:07:01.159 sys 0m0.289s 00:07:01.159 09:53:06 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:01.159 09:53:06 -- common/autotest_common.sh@10 -- # set +x 00:07:01.159 ************************************ 00:07:01.159 END TEST accel_fill 00:07:01.159 ************************************ 00:07:01.159 09:53:06 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:07:01.159 09:53:06 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:07:01.159 09:53:06 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:01.159 09:53:06 -- common/autotest_common.sh@10 -- # set +x 00:07:01.159 ************************************ 00:07:01.159 START TEST accel_copy_crc32c 00:07:01.159 ************************************ 00:07:01.159 09:53:06 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w copy_crc32c -y 00:07:01.159 09:53:06 -- accel/accel.sh@16 -- # local accel_opc 00:07:01.159 09:53:06 -- accel/accel.sh@17 -- # local accel_module 00:07:01.159 09:53:06 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:07:01.159 09:53:06 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:07:01.159 09:53:06 -- accel/accel.sh@12 -- # build_accel_config 00:07:01.159 09:53:06 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:01.159 09:53:06 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:01.159 09:53:06 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:01.159 09:53:06 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:01.159 09:53:06 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:01.159 09:53:06 -- accel/accel.sh@41 -- # local IFS=, 00:07:01.159 09:53:06 -- accel/accel.sh@42 -- # jq -r . 00:07:01.418 [2024-07-13 09:53:06.981028] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:07:01.418 [2024-07-13 09:53:06.981099] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2700319 ] 00:07:01.418 EAL: No free 2048 kB hugepages reported on node 1 00:07:01.418 [2024-07-13 09:53:07.041374] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:01.418 [2024-07-13 09:53:07.134044] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:02.793 09:53:08 -- accel/accel.sh@18 -- # out=' 00:07:02.793 SPDK Configuration: 00:07:02.793 Core mask: 0x1 00:07:02.793 00:07:02.793 Accel Perf Configuration: 00:07:02.793 Workload Type: copy_crc32c 00:07:02.793 CRC-32C seed: 0 00:07:02.793 Vector size: 4096 bytes 00:07:02.793 Transfer size: 4096 bytes 00:07:02.793 Vector count 1 00:07:02.793 Module: software 00:07:02.793 Queue depth: 32 00:07:02.793 Allocate depth: 32 00:07:02.793 # threads/core: 1 00:07:02.793 Run time: 1 seconds 00:07:02.793 Verify: Yes 00:07:02.793 00:07:02.793 Running for 1 seconds... 00:07:02.793 00:07:02.793 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:02.793 ------------------------------------------------------------------------------------ 00:07:02.793 0,0 216000/s 843 MiB/s 0 0 00:07:02.793 ==================================================================================== 00:07:02.793 Total 216000/s 843 MiB/s 0 0' 00:07:02.793 09:53:08 -- accel/accel.sh@20 -- # IFS=: 00:07:02.793 09:53:08 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:07:02.793 09:53:08 -- accel/accel.sh@20 -- # read -r var val 00:07:02.793 09:53:08 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:07:02.793 09:53:08 -- accel/accel.sh@12 -- # build_accel_config 00:07:02.793 09:53:08 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:02.793 09:53:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:02.793 09:53:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:02.793 09:53:08 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:02.793 09:53:08 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:02.793 09:53:08 -- accel/accel.sh@41 -- # local IFS=, 00:07:02.793 09:53:08 -- accel/accel.sh@42 -- # jq -r . 00:07:02.793 [2024-07-13 09:53:08.385336] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:07:02.793 [2024-07-13 09:53:08.385410] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2700483 ] 00:07:02.793 EAL: No free 2048 kB hugepages reported on node 1 00:07:02.793 [2024-07-13 09:53:08.444801] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:02.793 [2024-07-13 09:53:08.534381] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:02.793 09:53:08 -- accel/accel.sh@21 -- # val= 00:07:02.793 09:53:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.793 09:53:08 -- accel/accel.sh@20 -- # IFS=: 00:07:02.793 09:53:08 -- accel/accel.sh@20 -- # read -r var val 00:07:02.793 09:53:08 -- accel/accel.sh@21 -- # val= 00:07:02.793 09:53:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.793 09:53:08 -- accel/accel.sh@20 -- # IFS=: 00:07:02.793 09:53:08 -- accel/accel.sh@20 -- # read -r var val 00:07:02.793 09:53:08 -- accel/accel.sh@21 -- # val=0x1 00:07:02.793 09:53:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.793 09:53:08 -- accel/accel.sh@20 -- # IFS=: 00:07:02.793 09:53:08 -- accel/accel.sh@20 -- # read -r var val 00:07:02.793 09:53:08 -- accel/accel.sh@21 -- # val= 00:07:02.793 09:53:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.793 09:53:08 -- accel/accel.sh@20 -- # IFS=: 00:07:02.793 09:53:08 -- accel/accel.sh@20 -- # read -r var val 00:07:02.793 09:53:08 -- accel/accel.sh@21 -- # val= 00:07:02.793 09:53:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.793 09:53:08 -- accel/accel.sh@20 -- # IFS=: 00:07:02.793 09:53:08 -- accel/accel.sh@20 -- # read -r var val 00:07:02.793 09:53:08 -- accel/accel.sh@21 -- # val=copy_crc32c 00:07:02.793 09:53:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.793 09:53:08 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:07:02.793 09:53:08 -- accel/accel.sh@20 -- # IFS=: 00:07:02.793 09:53:08 -- accel/accel.sh@20 -- # read -r var val 00:07:02.793 09:53:08 -- accel/accel.sh@21 -- # val=0 00:07:02.793 09:53:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.793 09:53:08 -- accel/accel.sh@20 -- # IFS=: 00:07:02.793 09:53:08 -- accel/accel.sh@20 -- # read -r var val 00:07:02.793 09:53:08 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:02.793 09:53:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.793 09:53:08 -- accel/accel.sh@20 -- # IFS=: 00:07:02.793 09:53:08 -- accel/accel.sh@20 -- # read -r var val 00:07:02.793 09:53:08 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:02.793 09:53:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.793 09:53:08 -- accel/accel.sh@20 -- # IFS=: 00:07:02.793 09:53:08 -- accel/accel.sh@20 -- # read -r var val 00:07:02.793 09:53:08 -- accel/accel.sh@21 -- # val= 00:07:02.793 09:53:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.793 09:53:08 -- accel/accel.sh@20 -- # IFS=: 00:07:02.793 09:53:08 -- accel/accel.sh@20 -- # read -r var val 00:07:02.793 09:53:08 -- accel/accel.sh@21 -- # val=software 00:07:02.793 09:53:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.793 09:53:08 -- accel/accel.sh@23 -- # accel_module=software 00:07:02.793 09:53:08 -- accel/accel.sh@20 -- # IFS=: 00:07:02.793 09:53:08 -- accel/accel.sh@20 -- # read -r var val 00:07:02.793 09:53:08 -- accel/accel.sh@21 -- # val=32 00:07:02.794 09:53:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.794 09:53:08 -- accel/accel.sh@20 -- # IFS=: 00:07:02.794 09:53:08 -- accel/accel.sh@20 -- # read -r var val 00:07:02.794 09:53:08 -- accel/accel.sh@21 -- # val=32 00:07:02.794 09:53:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.794 09:53:08 -- accel/accel.sh@20 -- # IFS=: 00:07:02.794 09:53:08 -- accel/accel.sh@20 -- # read -r var val 00:07:02.794 09:53:08 -- accel/accel.sh@21 -- # val=1 00:07:02.794 09:53:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.794 09:53:08 -- accel/accel.sh@20 -- # IFS=: 00:07:02.794 09:53:08 -- accel/accel.sh@20 -- # read -r var val 00:07:02.794 09:53:08 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:02.794 09:53:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.794 09:53:08 -- accel/accel.sh@20 -- # IFS=: 00:07:02.794 09:53:08 -- accel/accel.sh@20 -- # read -r var val 00:07:02.794 09:53:08 -- accel/accel.sh@21 -- # val=Yes 00:07:02.794 09:53:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.794 09:53:08 -- accel/accel.sh@20 -- # IFS=: 00:07:02.794 09:53:08 -- accel/accel.sh@20 -- # read -r var val 00:07:02.794 09:53:08 -- accel/accel.sh@21 -- # val= 00:07:02.794 09:53:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.794 09:53:08 -- accel/accel.sh@20 -- # IFS=: 00:07:02.794 09:53:08 -- accel/accel.sh@20 -- # read -r var val 00:07:02.794 09:53:08 -- accel/accel.sh@21 -- # val= 00:07:02.794 09:53:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.794 09:53:08 -- accel/accel.sh@20 -- # IFS=: 00:07:02.794 09:53:08 -- accel/accel.sh@20 -- # read -r var val 00:07:04.167 09:53:09 -- accel/accel.sh@21 -- # val= 00:07:04.167 09:53:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.167 09:53:09 -- accel/accel.sh@20 -- # IFS=: 00:07:04.167 09:53:09 -- accel/accel.sh@20 -- # read -r var val 00:07:04.167 09:53:09 -- accel/accel.sh@21 -- # val= 00:07:04.167 09:53:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.167 09:53:09 -- accel/accel.sh@20 -- # IFS=: 00:07:04.167 09:53:09 -- accel/accel.sh@20 -- # read -r var val 00:07:04.167 09:53:09 -- accel/accel.sh@21 -- # val= 00:07:04.167 09:53:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.167 09:53:09 -- accel/accel.sh@20 -- # IFS=: 00:07:04.167 09:53:09 -- accel/accel.sh@20 -- # read -r var val 00:07:04.167 09:53:09 -- accel/accel.sh@21 -- # val= 00:07:04.167 09:53:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.167 09:53:09 -- accel/accel.sh@20 -- # IFS=: 00:07:04.167 09:53:09 -- accel/accel.sh@20 -- # read -r var val 00:07:04.167 09:53:09 -- accel/accel.sh@21 -- # val= 00:07:04.167 09:53:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.167 09:53:09 -- accel/accel.sh@20 -- # IFS=: 00:07:04.167 09:53:09 -- accel/accel.sh@20 -- # read -r var val 00:07:04.167 09:53:09 -- accel/accel.sh@21 -- # val= 00:07:04.167 09:53:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.167 09:53:09 -- accel/accel.sh@20 -- # IFS=: 00:07:04.167 09:53:09 -- accel/accel.sh@20 -- # read -r var val 00:07:04.167 09:53:09 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:04.167 09:53:09 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:07:04.167 09:53:09 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:04.167 00:07:04.167 real 0m2.803s 00:07:04.167 user 0m2.516s 00:07:04.167 sys 0m0.280s 00:07:04.167 09:53:09 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:04.167 09:53:09 -- common/autotest_common.sh@10 -- # set +x 00:07:04.167 ************************************ 00:07:04.167 END TEST accel_copy_crc32c 00:07:04.167 ************************************ 00:07:04.167 09:53:09 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:07:04.167 09:53:09 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:07:04.167 09:53:09 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:04.167 09:53:09 -- common/autotest_common.sh@10 -- # set +x 00:07:04.167 ************************************ 00:07:04.167 START TEST accel_copy_crc32c_C2 00:07:04.167 ************************************ 00:07:04.167 09:53:09 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:07:04.167 09:53:09 -- accel/accel.sh@16 -- # local accel_opc 00:07:04.167 09:53:09 -- accel/accel.sh@17 -- # local accel_module 00:07:04.167 09:53:09 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:07:04.168 09:53:09 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:07:04.168 09:53:09 -- accel/accel.sh@12 -- # build_accel_config 00:07:04.168 09:53:09 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:04.168 09:53:09 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:04.168 09:53:09 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:04.168 09:53:09 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:04.168 09:53:09 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:04.168 09:53:09 -- accel/accel.sh@41 -- # local IFS=, 00:07:04.168 09:53:09 -- accel/accel.sh@42 -- # jq -r . 00:07:04.168 [2024-07-13 09:53:09.815742] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:07:04.168 [2024-07-13 09:53:09.815831] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2700646 ] 00:07:04.168 EAL: No free 2048 kB hugepages reported on node 1 00:07:04.168 [2024-07-13 09:53:09.878830] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:04.168 [2024-07-13 09:53:09.965188] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:05.541 09:53:11 -- accel/accel.sh@18 -- # out=' 00:07:05.541 SPDK Configuration: 00:07:05.541 Core mask: 0x1 00:07:05.541 00:07:05.541 Accel Perf Configuration: 00:07:05.541 Workload Type: copy_crc32c 00:07:05.541 CRC-32C seed: 0 00:07:05.541 Vector size: 4096 bytes 00:07:05.541 Transfer size: 8192 bytes 00:07:05.541 Vector count 2 00:07:05.541 Module: software 00:07:05.541 Queue depth: 32 00:07:05.541 Allocate depth: 32 00:07:05.541 # threads/core: 1 00:07:05.541 Run time: 1 seconds 00:07:05.541 Verify: Yes 00:07:05.541 00:07:05.541 Running for 1 seconds... 00:07:05.541 00:07:05.541 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:05.541 ------------------------------------------------------------------------------------ 00:07:05.541 0,0 154688/s 1208 MiB/s 0 0 00:07:05.541 ==================================================================================== 00:07:05.541 Total 154688/s 604 MiB/s 0 0' 00:07:05.541 09:53:11 -- accel/accel.sh@20 -- # IFS=: 00:07:05.541 09:53:11 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:07:05.541 09:53:11 -- accel/accel.sh@20 -- # read -r var val 00:07:05.541 09:53:11 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:07:05.541 09:53:11 -- accel/accel.sh@12 -- # build_accel_config 00:07:05.541 09:53:11 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:05.541 09:53:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:05.541 09:53:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:05.541 09:53:11 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:05.541 09:53:11 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:05.541 09:53:11 -- accel/accel.sh@41 -- # local IFS=, 00:07:05.541 09:53:11 -- accel/accel.sh@42 -- # jq -r . 00:07:05.541 [2024-07-13 09:53:11.210818] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:07:05.541 [2024-07-13 09:53:11.210926] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2700789 ] 00:07:05.541 EAL: No free 2048 kB hugepages reported on node 1 00:07:05.541 [2024-07-13 09:53:11.271109] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:05.800 [2024-07-13 09:53:11.362808] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:05.800 09:53:11 -- accel/accel.sh@21 -- # val= 00:07:05.800 09:53:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.800 09:53:11 -- accel/accel.sh@20 -- # IFS=: 00:07:05.800 09:53:11 -- accel/accel.sh@20 -- # read -r var val 00:07:05.800 09:53:11 -- accel/accel.sh@21 -- # val= 00:07:05.800 09:53:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.800 09:53:11 -- accel/accel.sh@20 -- # IFS=: 00:07:05.800 09:53:11 -- accel/accel.sh@20 -- # read -r var val 00:07:05.800 09:53:11 -- accel/accel.sh@21 -- # val=0x1 00:07:05.800 09:53:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.800 09:53:11 -- accel/accel.sh@20 -- # IFS=: 00:07:05.800 09:53:11 -- accel/accel.sh@20 -- # read -r var val 00:07:05.800 09:53:11 -- accel/accel.sh@21 -- # val= 00:07:05.800 09:53:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.800 09:53:11 -- accel/accel.sh@20 -- # IFS=: 00:07:05.800 09:53:11 -- accel/accel.sh@20 -- # read -r var val 00:07:05.800 09:53:11 -- accel/accel.sh@21 -- # val= 00:07:05.800 09:53:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.800 09:53:11 -- accel/accel.sh@20 -- # IFS=: 00:07:05.800 09:53:11 -- accel/accel.sh@20 -- # read -r var val 00:07:05.800 09:53:11 -- accel/accel.sh@21 -- # val=copy_crc32c 00:07:05.800 09:53:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.800 09:53:11 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:07:05.800 09:53:11 -- accel/accel.sh@20 -- # IFS=: 00:07:05.800 09:53:11 -- accel/accel.sh@20 -- # read -r var val 00:07:05.800 09:53:11 -- accel/accel.sh@21 -- # val=0 00:07:05.800 09:53:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.800 09:53:11 -- accel/accel.sh@20 -- # IFS=: 00:07:05.800 09:53:11 -- accel/accel.sh@20 -- # read -r var val 00:07:05.800 09:53:11 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:05.800 09:53:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.800 09:53:11 -- accel/accel.sh@20 -- # IFS=: 00:07:05.800 09:53:11 -- accel/accel.sh@20 -- # read -r var val 00:07:05.800 09:53:11 -- accel/accel.sh@21 -- # val='8192 bytes' 00:07:05.800 09:53:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.800 09:53:11 -- accel/accel.sh@20 -- # IFS=: 00:07:05.800 09:53:11 -- accel/accel.sh@20 -- # read -r var val 00:07:05.800 09:53:11 -- accel/accel.sh@21 -- # val= 00:07:05.800 09:53:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.800 09:53:11 -- accel/accel.sh@20 -- # IFS=: 00:07:05.800 09:53:11 -- accel/accel.sh@20 -- # read -r var val 00:07:05.800 09:53:11 -- accel/accel.sh@21 -- # val=software 00:07:05.800 09:53:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.800 09:53:11 -- accel/accel.sh@23 -- # accel_module=software 00:07:05.800 09:53:11 -- accel/accel.sh@20 -- # IFS=: 00:07:05.800 09:53:11 -- accel/accel.sh@20 -- # read -r var val 00:07:05.800 09:53:11 -- accel/accel.sh@21 -- # val=32 00:07:05.800 09:53:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.800 09:53:11 -- accel/accel.sh@20 -- # IFS=: 00:07:05.800 09:53:11 -- accel/accel.sh@20 -- # read -r var val 00:07:05.800 09:53:11 -- accel/accel.sh@21 -- # val=32 00:07:05.800 09:53:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.800 09:53:11 -- accel/accel.sh@20 -- # IFS=: 00:07:05.800 09:53:11 -- accel/accel.sh@20 -- # read -r var val 00:07:05.800 09:53:11 -- accel/accel.sh@21 -- # val=1 00:07:05.800 09:53:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.800 09:53:11 -- accel/accel.sh@20 -- # IFS=: 00:07:05.800 09:53:11 -- accel/accel.sh@20 -- # read -r var val 00:07:05.800 09:53:11 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:05.800 09:53:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.800 09:53:11 -- accel/accel.sh@20 -- # IFS=: 00:07:05.800 09:53:11 -- accel/accel.sh@20 -- # read -r var val 00:07:05.800 09:53:11 -- accel/accel.sh@21 -- # val=Yes 00:07:05.800 09:53:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.800 09:53:11 -- accel/accel.sh@20 -- # IFS=: 00:07:05.800 09:53:11 -- accel/accel.sh@20 -- # read -r var val 00:07:05.800 09:53:11 -- accel/accel.sh@21 -- # val= 00:07:05.800 09:53:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.800 09:53:11 -- accel/accel.sh@20 -- # IFS=: 00:07:05.800 09:53:11 -- accel/accel.sh@20 -- # read -r var val 00:07:05.800 09:53:11 -- accel/accel.sh@21 -- # val= 00:07:05.800 09:53:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.800 09:53:11 -- accel/accel.sh@20 -- # IFS=: 00:07:05.800 09:53:11 -- accel/accel.sh@20 -- # read -r var val 00:07:07.183 09:53:12 -- accel/accel.sh@21 -- # val= 00:07:07.183 09:53:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.183 09:53:12 -- accel/accel.sh@20 -- # IFS=: 00:07:07.183 09:53:12 -- accel/accel.sh@20 -- # read -r var val 00:07:07.183 09:53:12 -- accel/accel.sh@21 -- # val= 00:07:07.183 09:53:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.183 09:53:12 -- accel/accel.sh@20 -- # IFS=: 00:07:07.183 09:53:12 -- accel/accel.sh@20 -- # read -r var val 00:07:07.183 09:53:12 -- accel/accel.sh@21 -- # val= 00:07:07.183 09:53:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.183 09:53:12 -- accel/accel.sh@20 -- # IFS=: 00:07:07.183 09:53:12 -- accel/accel.sh@20 -- # read -r var val 00:07:07.183 09:53:12 -- accel/accel.sh@21 -- # val= 00:07:07.183 09:53:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.183 09:53:12 -- accel/accel.sh@20 -- # IFS=: 00:07:07.183 09:53:12 -- accel/accel.sh@20 -- # read -r var val 00:07:07.183 09:53:12 -- accel/accel.sh@21 -- # val= 00:07:07.183 09:53:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.183 09:53:12 -- accel/accel.sh@20 -- # IFS=: 00:07:07.183 09:53:12 -- accel/accel.sh@20 -- # read -r var val 00:07:07.183 09:53:12 -- accel/accel.sh@21 -- # val= 00:07:07.183 09:53:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.183 09:53:12 -- accel/accel.sh@20 -- # IFS=: 00:07:07.183 09:53:12 -- accel/accel.sh@20 -- # read -r var val 00:07:07.183 09:53:12 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:07.183 09:53:12 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:07:07.183 09:53:12 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:07.183 00:07:07.183 real 0m2.799s 00:07:07.183 user 0m2.511s 00:07:07.183 sys 0m0.281s 00:07:07.183 09:53:12 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:07.183 09:53:12 -- common/autotest_common.sh@10 -- # set +x 00:07:07.183 ************************************ 00:07:07.183 END TEST accel_copy_crc32c_C2 00:07:07.183 ************************************ 00:07:07.183 09:53:12 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:07:07.183 09:53:12 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:07:07.183 09:53:12 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:07.183 09:53:12 -- common/autotest_common.sh@10 -- # set +x 00:07:07.183 ************************************ 00:07:07.183 START TEST accel_dualcast 00:07:07.183 ************************************ 00:07:07.183 09:53:12 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w dualcast -y 00:07:07.183 09:53:12 -- accel/accel.sh@16 -- # local accel_opc 00:07:07.183 09:53:12 -- accel/accel.sh@17 -- # local accel_module 00:07:07.183 09:53:12 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:07:07.183 09:53:12 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:07:07.183 09:53:12 -- accel/accel.sh@12 -- # build_accel_config 00:07:07.183 09:53:12 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:07.183 09:53:12 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:07.183 09:53:12 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:07.183 09:53:12 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:07.183 09:53:12 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:07.183 09:53:12 -- accel/accel.sh@41 -- # local IFS=, 00:07:07.183 09:53:12 -- accel/accel.sh@42 -- # jq -r . 00:07:07.183 [2024-07-13 09:53:12.635469] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:07:07.183 [2024-07-13 09:53:12.635548] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2701013 ] 00:07:07.183 EAL: No free 2048 kB hugepages reported on node 1 00:07:07.183 [2024-07-13 09:53:12.700099] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:07.183 [2024-07-13 09:53:12.790930] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:08.588 09:53:14 -- accel/accel.sh@18 -- # out=' 00:07:08.588 SPDK Configuration: 00:07:08.588 Core mask: 0x1 00:07:08.588 00:07:08.588 Accel Perf Configuration: 00:07:08.588 Workload Type: dualcast 00:07:08.588 Transfer size: 4096 bytes 00:07:08.588 Vector count 1 00:07:08.588 Module: software 00:07:08.588 Queue depth: 32 00:07:08.588 Allocate depth: 32 00:07:08.588 # threads/core: 1 00:07:08.588 Run time: 1 seconds 00:07:08.588 Verify: Yes 00:07:08.588 00:07:08.588 Running for 1 seconds... 00:07:08.588 00:07:08.588 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:08.588 ------------------------------------------------------------------------------------ 00:07:08.588 0,0 295616/s 1154 MiB/s 0 0 00:07:08.588 ==================================================================================== 00:07:08.588 Total 295616/s 1154 MiB/s 0 0' 00:07:08.588 09:53:14 -- accel/accel.sh@20 -- # IFS=: 00:07:08.588 09:53:14 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:07:08.588 09:53:14 -- accel/accel.sh@20 -- # read -r var val 00:07:08.588 09:53:14 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:07:08.588 09:53:14 -- accel/accel.sh@12 -- # build_accel_config 00:07:08.588 09:53:14 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:08.588 09:53:14 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:08.588 09:53:14 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:08.588 09:53:14 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:08.588 09:53:14 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:08.588 09:53:14 -- accel/accel.sh@41 -- # local IFS=, 00:07:08.588 09:53:14 -- accel/accel.sh@42 -- # jq -r . 00:07:08.588 [2024-07-13 09:53:14.042615] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:07:08.588 [2024-07-13 09:53:14.042695] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2701212 ] 00:07:08.588 EAL: No free 2048 kB hugepages reported on node 1 00:07:08.588 [2024-07-13 09:53:14.102743] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:08.588 [2024-07-13 09:53:14.191167] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:08.588 09:53:14 -- accel/accel.sh@21 -- # val= 00:07:08.588 09:53:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.588 09:53:14 -- accel/accel.sh@20 -- # IFS=: 00:07:08.588 09:53:14 -- accel/accel.sh@20 -- # read -r var val 00:07:08.588 09:53:14 -- accel/accel.sh@21 -- # val= 00:07:08.588 09:53:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.588 09:53:14 -- accel/accel.sh@20 -- # IFS=: 00:07:08.588 09:53:14 -- accel/accel.sh@20 -- # read -r var val 00:07:08.588 09:53:14 -- accel/accel.sh@21 -- # val=0x1 00:07:08.588 09:53:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.588 09:53:14 -- accel/accel.sh@20 -- # IFS=: 00:07:08.588 09:53:14 -- accel/accel.sh@20 -- # read -r var val 00:07:08.588 09:53:14 -- accel/accel.sh@21 -- # val= 00:07:08.588 09:53:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.588 09:53:14 -- accel/accel.sh@20 -- # IFS=: 00:07:08.588 09:53:14 -- accel/accel.sh@20 -- # read -r var val 00:07:08.588 09:53:14 -- accel/accel.sh@21 -- # val= 00:07:08.588 09:53:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.588 09:53:14 -- accel/accel.sh@20 -- # IFS=: 00:07:08.588 09:53:14 -- accel/accel.sh@20 -- # read -r var val 00:07:08.588 09:53:14 -- accel/accel.sh@21 -- # val=dualcast 00:07:08.588 09:53:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.588 09:53:14 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:07:08.588 09:53:14 -- accel/accel.sh@20 -- # IFS=: 00:07:08.588 09:53:14 -- accel/accel.sh@20 -- # read -r var val 00:07:08.588 09:53:14 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:08.588 09:53:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.588 09:53:14 -- accel/accel.sh@20 -- # IFS=: 00:07:08.588 09:53:14 -- accel/accel.sh@20 -- # read -r var val 00:07:08.588 09:53:14 -- accel/accel.sh@21 -- # val= 00:07:08.588 09:53:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.588 09:53:14 -- accel/accel.sh@20 -- # IFS=: 00:07:08.588 09:53:14 -- accel/accel.sh@20 -- # read -r var val 00:07:08.588 09:53:14 -- accel/accel.sh@21 -- # val=software 00:07:08.588 09:53:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.588 09:53:14 -- accel/accel.sh@23 -- # accel_module=software 00:07:08.588 09:53:14 -- accel/accel.sh@20 -- # IFS=: 00:07:08.588 09:53:14 -- accel/accel.sh@20 -- # read -r var val 00:07:08.588 09:53:14 -- accel/accel.sh@21 -- # val=32 00:07:08.588 09:53:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.588 09:53:14 -- accel/accel.sh@20 -- # IFS=: 00:07:08.588 09:53:14 -- accel/accel.sh@20 -- # read -r var val 00:07:08.588 09:53:14 -- accel/accel.sh@21 -- # val=32 00:07:08.588 09:53:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.588 09:53:14 -- accel/accel.sh@20 -- # IFS=: 00:07:08.588 09:53:14 -- accel/accel.sh@20 -- # read -r var val 00:07:08.588 09:53:14 -- accel/accel.sh@21 -- # val=1 00:07:08.588 09:53:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.588 09:53:14 -- accel/accel.sh@20 -- # IFS=: 00:07:08.588 09:53:14 -- accel/accel.sh@20 -- # read -r var val 00:07:08.588 09:53:14 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:08.588 09:53:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.588 09:53:14 -- accel/accel.sh@20 -- # IFS=: 00:07:08.588 09:53:14 -- accel/accel.sh@20 -- # read -r var val 00:07:08.588 09:53:14 -- accel/accel.sh@21 -- # val=Yes 00:07:08.588 09:53:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.588 09:53:14 -- accel/accel.sh@20 -- # IFS=: 00:07:08.588 09:53:14 -- accel/accel.sh@20 -- # read -r var val 00:07:08.588 09:53:14 -- accel/accel.sh@21 -- # val= 00:07:08.588 09:53:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.588 09:53:14 -- accel/accel.sh@20 -- # IFS=: 00:07:08.588 09:53:14 -- accel/accel.sh@20 -- # read -r var val 00:07:08.588 09:53:14 -- accel/accel.sh@21 -- # val= 00:07:08.588 09:53:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.588 09:53:14 -- accel/accel.sh@20 -- # IFS=: 00:07:08.588 09:53:14 -- accel/accel.sh@20 -- # read -r var val 00:07:09.962 09:53:15 -- accel/accel.sh@21 -- # val= 00:07:09.962 09:53:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.962 09:53:15 -- accel/accel.sh@20 -- # IFS=: 00:07:09.962 09:53:15 -- accel/accel.sh@20 -- # read -r var val 00:07:09.962 09:53:15 -- accel/accel.sh@21 -- # val= 00:07:09.962 09:53:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.962 09:53:15 -- accel/accel.sh@20 -- # IFS=: 00:07:09.962 09:53:15 -- accel/accel.sh@20 -- # read -r var val 00:07:09.962 09:53:15 -- accel/accel.sh@21 -- # val= 00:07:09.962 09:53:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.962 09:53:15 -- accel/accel.sh@20 -- # IFS=: 00:07:09.962 09:53:15 -- accel/accel.sh@20 -- # read -r var val 00:07:09.962 09:53:15 -- accel/accel.sh@21 -- # val= 00:07:09.962 09:53:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.962 09:53:15 -- accel/accel.sh@20 -- # IFS=: 00:07:09.962 09:53:15 -- accel/accel.sh@20 -- # read -r var val 00:07:09.962 09:53:15 -- accel/accel.sh@21 -- # val= 00:07:09.962 09:53:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.962 09:53:15 -- accel/accel.sh@20 -- # IFS=: 00:07:09.962 09:53:15 -- accel/accel.sh@20 -- # read -r var val 00:07:09.962 09:53:15 -- accel/accel.sh@21 -- # val= 00:07:09.962 09:53:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.962 09:53:15 -- accel/accel.sh@20 -- # IFS=: 00:07:09.962 09:53:15 -- accel/accel.sh@20 -- # read -r var val 00:07:09.962 09:53:15 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:09.962 09:53:15 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:07:09.962 09:53:15 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:09.962 00:07:09.962 real 0m2.807s 00:07:09.962 user 0m2.512s 00:07:09.962 sys 0m0.286s 00:07:09.962 09:53:15 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:09.962 09:53:15 -- common/autotest_common.sh@10 -- # set +x 00:07:09.962 ************************************ 00:07:09.962 END TEST accel_dualcast 00:07:09.962 ************************************ 00:07:09.962 09:53:15 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:07:09.962 09:53:15 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:07:09.962 09:53:15 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:09.962 09:53:15 -- common/autotest_common.sh@10 -- # set +x 00:07:09.962 ************************************ 00:07:09.962 START TEST accel_compare 00:07:09.962 ************************************ 00:07:09.962 09:53:15 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w compare -y 00:07:09.962 09:53:15 -- accel/accel.sh@16 -- # local accel_opc 00:07:09.962 09:53:15 -- accel/accel.sh@17 -- # local accel_module 00:07:09.962 09:53:15 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:07:09.962 09:53:15 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:07:09.962 09:53:15 -- accel/accel.sh@12 -- # build_accel_config 00:07:09.962 09:53:15 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:09.962 09:53:15 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:09.962 09:53:15 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:09.962 09:53:15 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:09.962 09:53:15 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:09.962 09:53:15 -- accel/accel.sh@41 -- # local IFS=, 00:07:09.962 09:53:15 -- accel/accel.sh@42 -- # jq -r . 00:07:09.962 [2024-07-13 09:53:15.464736] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:07:09.962 [2024-07-13 09:53:15.464820] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2701368 ] 00:07:09.962 EAL: No free 2048 kB hugepages reported on node 1 00:07:09.962 [2024-07-13 09:53:15.525748] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:09.962 [2024-07-13 09:53:15.620593] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:11.334 09:53:16 -- accel/accel.sh@18 -- # out=' 00:07:11.334 SPDK Configuration: 00:07:11.334 Core mask: 0x1 00:07:11.334 00:07:11.334 Accel Perf Configuration: 00:07:11.334 Workload Type: compare 00:07:11.334 Transfer size: 4096 bytes 00:07:11.334 Vector count 1 00:07:11.334 Module: software 00:07:11.334 Queue depth: 32 00:07:11.334 Allocate depth: 32 00:07:11.334 # threads/core: 1 00:07:11.334 Run time: 1 seconds 00:07:11.334 Verify: Yes 00:07:11.334 00:07:11.334 Running for 1 seconds... 00:07:11.334 00:07:11.334 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:11.334 ------------------------------------------------------------------------------------ 00:07:11.334 0,0 398496/s 1556 MiB/s 0 0 00:07:11.334 ==================================================================================== 00:07:11.334 Total 398496/s 1556 MiB/s 0 0' 00:07:11.334 09:53:16 -- accel/accel.sh@20 -- # IFS=: 00:07:11.334 09:53:16 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:07:11.334 09:53:16 -- accel/accel.sh@20 -- # read -r var val 00:07:11.334 09:53:16 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:07:11.334 09:53:16 -- accel/accel.sh@12 -- # build_accel_config 00:07:11.334 09:53:16 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:11.334 09:53:16 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:11.334 09:53:16 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:11.334 09:53:16 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:11.334 09:53:16 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:11.334 09:53:16 -- accel/accel.sh@41 -- # local IFS=, 00:07:11.334 09:53:16 -- accel/accel.sh@42 -- # jq -r . 00:07:11.334 [2024-07-13 09:53:16.861039] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:07:11.334 [2024-07-13 09:53:16.861112] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2701516 ] 00:07:11.334 EAL: No free 2048 kB hugepages reported on node 1 00:07:11.334 [2024-07-13 09:53:16.923248] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:11.334 [2024-07-13 09:53:17.013556] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:11.334 09:53:17 -- accel/accel.sh@21 -- # val= 00:07:11.334 09:53:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.334 09:53:17 -- accel/accel.sh@20 -- # IFS=: 00:07:11.334 09:53:17 -- accel/accel.sh@20 -- # read -r var val 00:07:11.334 09:53:17 -- accel/accel.sh@21 -- # val= 00:07:11.334 09:53:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.334 09:53:17 -- accel/accel.sh@20 -- # IFS=: 00:07:11.334 09:53:17 -- accel/accel.sh@20 -- # read -r var val 00:07:11.334 09:53:17 -- accel/accel.sh@21 -- # val=0x1 00:07:11.334 09:53:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.334 09:53:17 -- accel/accel.sh@20 -- # IFS=: 00:07:11.334 09:53:17 -- accel/accel.sh@20 -- # read -r var val 00:07:11.334 09:53:17 -- accel/accel.sh@21 -- # val= 00:07:11.334 09:53:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.334 09:53:17 -- accel/accel.sh@20 -- # IFS=: 00:07:11.334 09:53:17 -- accel/accel.sh@20 -- # read -r var val 00:07:11.334 09:53:17 -- accel/accel.sh@21 -- # val= 00:07:11.334 09:53:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.334 09:53:17 -- accel/accel.sh@20 -- # IFS=: 00:07:11.334 09:53:17 -- accel/accel.sh@20 -- # read -r var val 00:07:11.334 09:53:17 -- accel/accel.sh@21 -- # val=compare 00:07:11.334 09:53:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.334 09:53:17 -- accel/accel.sh@24 -- # accel_opc=compare 00:07:11.334 09:53:17 -- accel/accel.sh@20 -- # IFS=: 00:07:11.334 09:53:17 -- accel/accel.sh@20 -- # read -r var val 00:07:11.334 09:53:17 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:11.334 09:53:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.334 09:53:17 -- accel/accel.sh@20 -- # IFS=: 00:07:11.334 09:53:17 -- accel/accel.sh@20 -- # read -r var val 00:07:11.334 09:53:17 -- accel/accel.sh@21 -- # val= 00:07:11.334 09:53:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.334 09:53:17 -- accel/accel.sh@20 -- # IFS=: 00:07:11.334 09:53:17 -- accel/accel.sh@20 -- # read -r var val 00:07:11.334 09:53:17 -- accel/accel.sh@21 -- # val=software 00:07:11.334 09:53:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.334 09:53:17 -- accel/accel.sh@23 -- # accel_module=software 00:07:11.334 09:53:17 -- accel/accel.sh@20 -- # IFS=: 00:07:11.334 09:53:17 -- accel/accel.sh@20 -- # read -r var val 00:07:11.334 09:53:17 -- accel/accel.sh@21 -- # val=32 00:07:11.335 09:53:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.335 09:53:17 -- accel/accel.sh@20 -- # IFS=: 00:07:11.335 09:53:17 -- accel/accel.sh@20 -- # read -r var val 00:07:11.335 09:53:17 -- accel/accel.sh@21 -- # val=32 00:07:11.335 09:53:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.335 09:53:17 -- accel/accel.sh@20 -- # IFS=: 00:07:11.335 09:53:17 -- accel/accel.sh@20 -- # read -r var val 00:07:11.335 09:53:17 -- accel/accel.sh@21 -- # val=1 00:07:11.335 09:53:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.335 09:53:17 -- accel/accel.sh@20 -- # IFS=: 00:07:11.335 09:53:17 -- accel/accel.sh@20 -- # read -r var val 00:07:11.335 09:53:17 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:11.335 09:53:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.335 09:53:17 -- accel/accel.sh@20 -- # IFS=: 00:07:11.335 09:53:17 -- accel/accel.sh@20 -- # read -r var val 00:07:11.335 09:53:17 -- accel/accel.sh@21 -- # val=Yes 00:07:11.335 09:53:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.335 09:53:17 -- accel/accel.sh@20 -- # IFS=: 00:07:11.335 09:53:17 -- accel/accel.sh@20 -- # read -r var val 00:07:11.335 09:53:17 -- accel/accel.sh@21 -- # val= 00:07:11.335 09:53:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.335 09:53:17 -- accel/accel.sh@20 -- # IFS=: 00:07:11.335 09:53:17 -- accel/accel.sh@20 -- # read -r var val 00:07:11.335 09:53:17 -- accel/accel.sh@21 -- # val= 00:07:11.335 09:53:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.335 09:53:17 -- accel/accel.sh@20 -- # IFS=: 00:07:11.335 09:53:17 -- accel/accel.sh@20 -- # read -r var val 00:07:12.705 09:53:18 -- accel/accel.sh@21 -- # val= 00:07:12.705 09:53:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.705 09:53:18 -- accel/accel.sh@20 -- # IFS=: 00:07:12.705 09:53:18 -- accel/accel.sh@20 -- # read -r var val 00:07:12.705 09:53:18 -- accel/accel.sh@21 -- # val= 00:07:12.705 09:53:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.705 09:53:18 -- accel/accel.sh@20 -- # IFS=: 00:07:12.705 09:53:18 -- accel/accel.sh@20 -- # read -r var val 00:07:12.705 09:53:18 -- accel/accel.sh@21 -- # val= 00:07:12.705 09:53:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.705 09:53:18 -- accel/accel.sh@20 -- # IFS=: 00:07:12.705 09:53:18 -- accel/accel.sh@20 -- # read -r var val 00:07:12.705 09:53:18 -- accel/accel.sh@21 -- # val= 00:07:12.705 09:53:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.705 09:53:18 -- accel/accel.sh@20 -- # IFS=: 00:07:12.705 09:53:18 -- accel/accel.sh@20 -- # read -r var val 00:07:12.705 09:53:18 -- accel/accel.sh@21 -- # val= 00:07:12.705 09:53:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.705 09:53:18 -- accel/accel.sh@20 -- # IFS=: 00:07:12.705 09:53:18 -- accel/accel.sh@20 -- # read -r var val 00:07:12.705 09:53:18 -- accel/accel.sh@21 -- # val= 00:07:12.705 09:53:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.705 09:53:18 -- accel/accel.sh@20 -- # IFS=: 00:07:12.705 09:53:18 -- accel/accel.sh@20 -- # read -r var val 00:07:12.705 09:53:18 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:12.705 09:53:18 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:07:12.705 09:53:18 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:12.705 00:07:12.705 real 0m2.801s 00:07:12.705 user 0m2.509s 00:07:12.705 sys 0m0.284s 00:07:12.705 09:53:18 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:12.705 09:53:18 -- common/autotest_common.sh@10 -- # set +x 00:07:12.705 ************************************ 00:07:12.705 END TEST accel_compare 00:07:12.705 ************************************ 00:07:12.705 09:53:18 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:07:12.705 09:53:18 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:07:12.705 09:53:18 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:12.705 09:53:18 -- common/autotest_common.sh@10 -- # set +x 00:07:12.705 ************************************ 00:07:12.705 START TEST accel_xor 00:07:12.705 ************************************ 00:07:12.705 09:53:18 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w xor -y 00:07:12.705 09:53:18 -- accel/accel.sh@16 -- # local accel_opc 00:07:12.705 09:53:18 -- accel/accel.sh@17 -- # local accel_module 00:07:12.705 09:53:18 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:07:12.705 09:53:18 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:07:12.705 09:53:18 -- accel/accel.sh@12 -- # build_accel_config 00:07:12.705 09:53:18 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:12.705 09:53:18 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:12.705 09:53:18 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:12.705 09:53:18 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:12.705 09:53:18 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:12.705 09:53:18 -- accel/accel.sh@41 -- # local IFS=, 00:07:12.705 09:53:18 -- accel/accel.sh@42 -- # jq -r . 00:07:12.705 [2024-07-13 09:53:18.288859] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:07:12.705 [2024-07-13 09:53:18.288961] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2701708 ] 00:07:12.705 EAL: No free 2048 kB hugepages reported on node 1 00:07:12.705 [2024-07-13 09:53:18.352031] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:12.705 [2024-07-13 09:53:18.442644] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:14.077 09:53:19 -- accel/accel.sh@18 -- # out=' 00:07:14.077 SPDK Configuration: 00:07:14.077 Core mask: 0x1 00:07:14.077 00:07:14.077 Accel Perf Configuration: 00:07:14.077 Workload Type: xor 00:07:14.077 Source buffers: 2 00:07:14.077 Transfer size: 4096 bytes 00:07:14.077 Vector count 1 00:07:14.077 Module: software 00:07:14.077 Queue depth: 32 00:07:14.077 Allocate depth: 32 00:07:14.077 # threads/core: 1 00:07:14.077 Run time: 1 seconds 00:07:14.077 Verify: Yes 00:07:14.077 00:07:14.077 Running for 1 seconds... 00:07:14.077 00:07:14.077 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:14.077 ------------------------------------------------------------------------------------ 00:07:14.077 0,0 191328/s 747 MiB/s 0 0 00:07:14.078 ==================================================================================== 00:07:14.078 Total 191328/s 747 MiB/s 0 0' 00:07:14.078 09:53:19 -- accel/accel.sh@20 -- # IFS=: 00:07:14.078 09:53:19 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:07:14.078 09:53:19 -- accel/accel.sh@20 -- # read -r var val 00:07:14.078 09:53:19 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:07:14.078 09:53:19 -- accel/accel.sh@12 -- # build_accel_config 00:07:14.078 09:53:19 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:14.078 09:53:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:14.078 09:53:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:14.078 09:53:19 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:14.078 09:53:19 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:14.078 09:53:19 -- accel/accel.sh@41 -- # local IFS=, 00:07:14.078 09:53:19 -- accel/accel.sh@42 -- # jq -r . 00:07:14.078 [2024-07-13 09:53:19.693657] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:07:14.078 [2024-07-13 09:53:19.693743] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2701935 ] 00:07:14.078 EAL: No free 2048 kB hugepages reported on node 1 00:07:14.078 [2024-07-13 09:53:19.754057] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:14.078 [2024-07-13 09:53:19.841423] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:14.336 09:53:19 -- accel/accel.sh@21 -- # val= 00:07:14.336 09:53:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.336 09:53:19 -- accel/accel.sh@20 -- # IFS=: 00:07:14.336 09:53:19 -- accel/accel.sh@20 -- # read -r var val 00:07:14.336 09:53:19 -- accel/accel.sh@21 -- # val= 00:07:14.336 09:53:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.336 09:53:19 -- accel/accel.sh@20 -- # IFS=: 00:07:14.336 09:53:19 -- accel/accel.sh@20 -- # read -r var val 00:07:14.336 09:53:19 -- accel/accel.sh@21 -- # val=0x1 00:07:14.336 09:53:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.336 09:53:19 -- accel/accel.sh@20 -- # IFS=: 00:07:14.336 09:53:19 -- accel/accel.sh@20 -- # read -r var val 00:07:14.336 09:53:19 -- accel/accel.sh@21 -- # val= 00:07:14.336 09:53:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.336 09:53:19 -- accel/accel.sh@20 -- # IFS=: 00:07:14.336 09:53:19 -- accel/accel.sh@20 -- # read -r var val 00:07:14.336 09:53:19 -- accel/accel.sh@21 -- # val= 00:07:14.336 09:53:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.336 09:53:19 -- accel/accel.sh@20 -- # IFS=: 00:07:14.336 09:53:19 -- accel/accel.sh@20 -- # read -r var val 00:07:14.336 09:53:19 -- accel/accel.sh@21 -- # val=xor 00:07:14.336 09:53:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.336 09:53:19 -- accel/accel.sh@24 -- # accel_opc=xor 00:07:14.336 09:53:19 -- accel/accel.sh@20 -- # IFS=: 00:07:14.336 09:53:19 -- accel/accel.sh@20 -- # read -r var val 00:07:14.336 09:53:19 -- accel/accel.sh@21 -- # val=2 00:07:14.336 09:53:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.336 09:53:19 -- accel/accel.sh@20 -- # IFS=: 00:07:14.336 09:53:19 -- accel/accel.sh@20 -- # read -r var val 00:07:14.336 09:53:19 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:14.336 09:53:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.336 09:53:19 -- accel/accel.sh@20 -- # IFS=: 00:07:14.336 09:53:19 -- accel/accel.sh@20 -- # read -r var val 00:07:14.336 09:53:19 -- accel/accel.sh@21 -- # val= 00:07:14.336 09:53:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.336 09:53:19 -- accel/accel.sh@20 -- # IFS=: 00:07:14.336 09:53:19 -- accel/accel.sh@20 -- # read -r var val 00:07:14.336 09:53:19 -- accel/accel.sh@21 -- # val=software 00:07:14.336 09:53:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.336 09:53:19 -- accel/accel.sh@23 -- # accel_module=software 00:07:14.336 09:53:19 -- accel/accel.sh@20 -- # IFS=: 00:07:14.336 09:53:19 -- accel/accel.sh@20 -- # read -r var val 00:07:14.336 09:53:19 -- accel/accel.sh@21 -- # val=32 00:07:14.336 09:53:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.336 09:53:19 -- accel/accel.sh@20 -- # IFS=: 00:07:14.336 09:53:19 -- accel/accel.sh@20 -- # read -r var val 00:07:14.336 09:53:19 -- accel/accel.sh@21 -- # val=32 00:07:14.336 09:53:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.336 09:53:19 -- accel/accel.sh@20 -- # IFS=: 00:07:14.336 09:53:19 -- accel/accel.sh@20 -- # read -r var val 00:07:14.336 09:53:19 -- accel/accel.sh@21 -- # val=1 00:07:14.336 09:53:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.336 09:53:19 -- accel/accel.sh@20 -- # IFS=: 00:07:14.336 09:53:19 -- accel/accel.sh@20 -- # read -r var val 00:07:14.336 09:53:19 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:14.336 09:53:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.336 09:53:19 -- accel/accel.sh@20 -- # IFS=: 00:07:14.336 09:53:19 -- accel/accel.sh@20 -- # read -r var val 00:07:14.336 09:53:19 -- accel/accel.sh@21 -- # val=Yes 00:07:14.336 09:53:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.336 09:53:19 -- accel/accel.sh@20 -- # IFS=: 00:07:14.336 09:53:19 -- accel/accel.sh@20 -- # read -r var val 00:07:14.336 09:53:19 -- accel/accel.sh@21 -- # val= 00:07:14.336 09:53:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.336 09:53:19 -- accel/accel.sh@20 -- # IFS=: 00:07:14.336 09:53:19 -- accel/accel.sh@20 -- # read -r var val 00:07:14.336 09:53:19 -- accel/accel.sh@21 -- # val= 00:07:14.336 09:53:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.336 09:53:19 -- accel/accel.sh@20 -- # IFS=: 00:07:14.336 09:53:19 -- accel/accel.sh@20 -- # read -r var val 00:07:15.270 09:53:21 -- accel/accel.sh@21 -- # val= 00:07:15.270 09:53:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.270 09:53:21 -- accel/accel.sh@20 -- # IFS=: 00:07:15.270 09:53:21 -- accel/accel.sh@20 -- # read -r var val 00:07:15.270 09:53:21 -- accel/accel.sh@21 -- # val= 00:07:15.270 09:53:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.270 09:53:21 -- accel/accel.sh@20 -- # IFS=: 00:07:15.270 09:53:21 -- accel/accel.sh@20 -- # read -r var val 00:07:15.270 09:53:21 -- accel/accel.sh@21 -- # val= 00:07:15.270 09:53:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.270 09:53:21 -- accel/accel.sh@20 -- # IFS=: 00:07:15.270 09:53:21 -- accel/accel.sh@20 -- # read -r var val 00:07:15.270 09:53:21 -- accel/accel.sh@21 -- # val= 00:07:15.271 09:53:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.271 09:53:21 -- accel/accel.sh@20 -- # IFS=: 00:07:15.271 09:53:21 -- accel/accel.sh@20 -- # read -r var val 00:07:15.271 09:53:21 -- accel/accel.sh@21 -- # val= 00:07:15.271 09:53:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.271 09:53:21 -- accel/accel.sh@20 -- # IFS=: 00:07:15.271 09:53:21 -- accel/accel.sh@20 -- # read -r var val 00:07:15.271 09:53:21 -- accel/accel.sh@21 -- # val= 00:07:15.271 09:53:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.271 09:53:21 -- accel/accel.sh@20 -- # IFS=: 00:07:15.271 09:53:21 -- accel/accel.sh@20 -- # read -r var val 00:07:15.271 09:53:21 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:15.271 09:53:21 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:07:15.271 09:53:21 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:15.271 00:07:15.271 real 0m2.801s 00:07:15.271 user 0m2.500s 00:07:15.271 sys 0m0.293s 00:07:15.271 09:53:21 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:15.271 09:53:21 -- common/autotest_common.sh@10 -- # set +x 00:07:15.271 ************************************ 00:07:15.271 END TEST accel_xor 00:07:15.271 ************************************ 00:07:15.529 09:53:21 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:07:15.529 09:53:21 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:07:15.529 09:53:21 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:15.529 09:53:21 -- common/autotest_common.sh@10 -- # set +x 00:07:15.529 ************************************ 00:07:15.529 START TEST accel_xor 00:07:15.529 ************************************ 00:07:15.529 09:53:21 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w xor -y -x 3 00:07:15.529 09:53:21 -- accel/accel.sh@16 -- # local accel_opc 00:07:15.529 09:53:21 -- accel/accel.sh@17 -- # local accel_module 00:07:15.529 09:53:21 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:07:15.529 09:53:21 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:07:15.529 09:53:21 -- accel/accel.sh@12 -- # build_accel_config 00:07:15.529 09:53:21 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:15.529 09:53:21 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:15.529 09:53:21 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:15.529 09:53:21 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:15.529 09:53:21 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:15.529 09:53:21 -- accel/accel.sh@41 -- # local IFS=, 00:07:15.529 09:53:21 -- accel/accel.sh@42 -- # jq -r . 00:07:15.529 [2024-07-13 09:53:21.119533] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:07:15.529 [2024-07-13 09:53:21.119624] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2702095 ] 00:07:15.529 EAL: No free 2048 kB hugepages reported on node 1 00:07:15.529 [2024-07-13 09:53:21.182774] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:15.529 [2024-07-13 09:53:21.271804] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:16.904 09:53:22 -- accel/accel.sh@18 -- # out=' 00:07:16.904 SPDK Configuration: 00:07:16.904 Core mask: 0x1 00:07:16.904 00:07:16.904 Accel Perf Configuration: 00:07:16.904 Workload Type: xor 00:07:16.904 Source buffers: 3 00:07:16.904 Transfer size: 4096 bytes 00:07:16.904 Vector count 1 00:07:16.904 Module: software 00:07:16.904 Queue depth: 32 00:07:16.904 Allocate depth: 32 00:07:16.904 # threads/core: 1 00:07:16.904 Run time: 1 seconds 00:07:16.904 Verify: Yes 00:07:16.904 00:07:16.904 Running for 1 seconds... 00:07:16.904 00:07:16.904 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:16.904 ------------------------------------------------------------------------------------ 00:07:16.904 0,0 183776/s 717 MiB/s 0 0 00:07:16.904 ==================================================================================== 00:07:16.904 Total 183776/s 717 MiB/s 0 0' 00:07:16.904 09:53:22 -- accel/accel.sh@20 -- # IFS=: 00:07:16.904 09:53:22 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:07:16.904 09:53:22 -- accel/accel.sh@20 -- # read -r var val 00:07:16.904 09:53:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:07:16.904 09:53:22 -- accel/accel.sh@12 -- # build_accel_config 00:07:16.904 09:53:22 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:16.904 09:53:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:16.904 09:53:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:16.904 09:53:22 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:16.904 09:53:22 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:16.904 09:53:22 -- accel/accel.sh@41 -- # local IFS=, 00:07:16.904 09:53:22 -- accel/accel.sh@42 -- # jq -r . 00:07:16.904 [2024-07-13 09:53:22.527715] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:07:16.904 [2024-07-13 09:53:22.527795] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2702233 ] 00:07:16.904 EAL: No free 2048 kB hugepages reported on node 1 00:07:16.904 [2024-07-13 09:53:22.587845] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:16.904 [2024-07-13 09:53:22.681269] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:17.161 09:53:22 -- accel/accel.sh@21 -- # val= 00:07:17.161 09:53:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.161 09:53:22 -- accel/accel.sh@20 -- # IFS=: 00:07:17.161 09:53:22 -- accel/accel.sh@20 -- # read -r var val 00:07:17.161 09:53:22 -- accel/accel.sh@21 -- # val= 00:07:17.161 09:53:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.161 09:53:22 -- accel/accel.sh@20 -- # IFS=: 00:07:17.161 09:53:22 -- accel/accel.sh@20 -- # read -r var val 00:07:17.161 09:53:22 -- accel/accel.sh@21 -- # val=0x1 00:07:17.161 09:53:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.161 09:53:22 -- accel/accel.sh@20 -- # IFS=: 00:07:17.161 09:53:22 -- accel/accel.sh@20 -- # read -r var val 00:07:17.161 09:53:22 -- accel/accel.sh@21 -- # val= 00:07:17.161 09:53:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.161 09:53:22 -- accel/accel.sh@20 -- # IFS=: 00:07:17.161 09:53:22 -- accel/accel.sh@20 -- # read -r var val 00:07:17.161 09:53:22 -- accel/accel.sh@21 -- # val= 00:07:17.161 09:53:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.161 09:53:22 -- accel/accel.sh@20 -- # IFS=: 00:07:17.161 09:53:22 -- accel/accel.sh@20 -- # read -r var val 00:07:17.161 09:53:22 -- accel/accel.sh@21 -- # val=xor 00:07:17.161 09:53:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.161 09:53:22 -- accel/accel.sh@24 -- # accel_opc=xor 00:07:17.161 09:53:22 -- accel/accel.sh@20 -- # IFS=: 00:07:17.161 09:53:22 -- accel/accel.sh@20 -- # read -r var val 00:07:17.161 09:53:22 -- accel/accel.sh@21 -- # val=3 00:07:17.161 09:53:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.161 09:53:22 -- accel/accel.sh@20 -- # IFS=: 00:07:17.161 09:53:22 -- accel/accel.sh@20 -- # read -r var val 00:07:17.161 09:53:22 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:17.161 09:53:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.161 09:53:22 -- accel/accel.sh@20 -- # IFS=: 00:07:17.161 09:53:22 -- accel/accel.sh@20 -- # read -r var val 00:07:17.161 09:53:22 -- accel/accel.sh@21 -- # val= 00:07:17.161 09:53:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.161 09:53:22 -- accel/accel.sh@20 -- # IFS=: 00:07:17.161 09:53:22 -- accel/accel.sh@20 -- # read -r var val 00:07:17.161 09:53:22 -- accel/accel.sh@21 -- # val=software 00:07:17.161 09:53:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.161 09:53:22 -- accel/accel.sh@23 -- # accel_module=software 00:07:17.161 09:53:22 -- accel/accel.sh@20 -- # IFS=: 00:07:17.161 09:53:22 -- accel/accel.sh@20 -- # read -r var val 00:07:17.161 09:53:22 -- accel/accel.sh@21 -- # val=32 00:07:17.161 09:53:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.161 09:53:22 -- accel/accel.sh@20 -- # IFS=: 00:07:17.161 09:53:22 -- accel/accel.sh@20 -- # read -r var val 00:07:17.161 09:53:22 -- accel/accel.sh@21 -- # val=32 00:07:17.161 09:53:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.161 09:53:22 -- accel/accel.sh@20 -- # IFS=: 00:07:17.161 09:53:22 -- accel/accel.sh@20 -- # read -r var val 00:07:17.161 09:53:22 -- accel/accel.sh@21 -- # val=1 00:07:17.161 09:53:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.161 09:53:22 -- accel/accel.sh@20 -- # IFS=: 00:07:17.161 09:53:22 -- accel/accel.sh@20 -- # read -r var val 00:07:17.161 09:53:22 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:17.161 09:53:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.161 09:53:22 -- accel/accel.sh@20 -- # IFS=: 00:07:17.161 09:53:22 -- accel/accel.sh@20 -- # read -r var val 00:07:17.161 09:53:22 -- accel/accel.sh@21 -- # val=Yes 00:07:17.161 09:53:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.161 09:53:22 -- accel/accel.sh@20 -- # IFS=: 00:07:17.161 09:53:22 -- accel/accel.sh@20 -- # read -r var val 00:07:17.161 09:53:22 -- accel/accel.sh@21 -- # val= 00:07:17.161 09:53:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.161 09:53:22 -- accel/accel.sh@20 -- # IFS=: 00:07:17.161 09:53:22 -- accel/accel.sh@20 -- # read -r var val 00:07:17.161 09:53:22 -- accel/accel.sh@21 -- # val= 00:07:17.161 09:53:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.161 09:53:22 -- accel/accel.sh@20 -- # IFS=: 00:07:17.161 09:53:22 -- accel/accel.sh@20 -- # read -r var val 00:07:18.536 09:53:23 -- accel/accel.sh@21 -- # val= 00:07:18.536 09:53:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.536 09:53:23 -- accel/accel.sh@20 -- # IFS=: 00:07:18.536 09:53:23 -- accel/accel.sh@20 -- # read -r var val 00:07:18.536 09:53:23 -- accel/accel.sh@21 -- # val= 00:07:18.536 09:53:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.536 09:53:23 -- accel/accel.sh@20 -- # IFS=: 00:07:18.536 09:53:23 -- accel/accel.sh@20 -- # read -r var val 00:07:18.536 09:53:23 -- accel/accel.sh@21 -- # val= 00:07:18.536 09:53:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.536 09:53:23 -- accel/accel.sh@20 -- # IFS=: 00:07:18.536 09:53:23 -- accel/accel.sh@20 -- # read -r var val 00:07:18.536 09:53:23 -- accel/accel.sh@21 -- # val= 00:07:18.536 09:53:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.536 09:53:23 -- accel/accel.sh@20 -- # IFS=: 00:07:18.536 09:53:23 -- accel/accel.sh@20 -- # read -r var val 00:07:18.536 09:53:23 -- accel/accel.sh@21 -- # val= 00:07:18.536 09:53:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.536 09:53:23 -- accel/accel.sh@20 -- # IFS=: 00:07:18.536 09:53:23 -- accel/accel.sh@20 -- # read -r var val 00:07:18.536 09:53:23 -- accel/accel.sh@21 -- # val= 00:07:18.536 09:53:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.536 09:53:23 -- accel/accel.sh@20 -- # IFS=: 00:07:18.536 09:53:23 -- accel/accel.sh@20 -- # read -r var val 00:07:18.536 09:53:23 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:18.536 09:53:23 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:07:18.536 09:53:23 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:18.536 00:07:18.536 real 0m2.814s 00:07:18.536 user 0m2.519s 00:07:18.536 sys 0m0.287s 00:07:18.536 09:53:23 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:18.536 09:53:23 -- common/autotest_common.sh@10 -- # set +x 00:07:18.536 ************************************ 00:07:18.536 END TEST accel_xor 00:07:18.536 ************************************ 00:07:18.536 09:53:23 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:07:18.536 09:53:23 -- common/autotest_common.sh@1077 -- # '[' 6 -le 1 ']' 00:07:18.536 09:53:23 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:18.536 09:53:23 -- common/autotest_common.sh@10 -- # set +x 00:07:18.536 ************************************ 00:07:18.536 START TEST accel_dif_verify 00:07:18.536 ************************************ 00:07:18.536 09:53:23 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w dif_verify 00:07:18.536 09:53:23 -- accel/accel.sh@16 -- # local accel_opc 00:07:18.536 09:53:23 -- accel/accel.sh@17 -- # local accel_module 00:07:18.536 09:53:23 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:07:18.536 09:53:23 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:07:18.536 09:53:23 -- accel/accel.sh@12 -- # build_accel_config 00:07:18.536 09:53:23 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:18.536 09:53:23 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:18.536 09:53:23 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:18.536 09:53:23 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:18.536 09:53:23 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:18.536 09:53:23 -- accel/accel.sh@41 -- # local IFS=, 00:07:18.536 09:53:23 -- accel/accel.sh@42 -- # jq -r . 00:07:18.536 [2024-07-13 09:53:23.955026] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:07:18.536 [2024-07-13 09:53:23.955104] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2702442 ] 00:07:18.536 EAL: No free 2048 kB hugepages reported on node 1 00:07:18.536 [2024-07-13 09:53:24.020483] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:18.536 [2024-07-13 09:53:24.114427] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:19.908 09:53:25 -- accel/accel.sh@18 -- # out=' 00:07:19.908 SPDK Configuration: 00:07:19.908 Core mask: 0x1 00:07:19.908 00:07:19.908 Accel Perf Configuration: 00:07:19.908 Workload Type: dif_verify 00:07:19.908 Vector size: 4096 bytes 00:07:19.908 Transfer size: 4096 bytes 00:07:19.908 Block size: 512 bytes 00:07:19.908 Metadata size: 8 bytes 00:07:19.908 Vector count 1 00:07:19.908 Module: software 00:07:19.908 Queue depth: 32 00:07:19.908 Allocate depth: 32 00:07:19.908 # threads/core: 1 00:07:19.908 Run time: 1 seconds 00:07:19.908 Verify: No 00:07:19.908 00:07:19.908 Running for 1 seconds... 00:07:19.908 00:07:19.908 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:19.908 ------------------------------------------------------------------------------------ 00:07:19.908 0,0 81824/s 324 MiB/s 0 0 00:07:19.908 ==================================================================================== 00:07:19.908 Total 81824/s 319 MiB/s 0 0' 00:07:19.908 09:53:25 -- accel/accel.sh@20 -- # IFS=: 00:07:19.908 09:53:25 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:07:19.908 09:53:25 -- accel/accel.sh@20 -- # read -r var val 00:07:19.908 09:53:25 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:07:19.908 09:53:25 -- accel/accel.sh@12 -- # build_accel_config 00:07:19.908 09:53:25 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:19.908 09:53:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:19.908 09:53:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:19.908 09:53:25 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:19.908 09:53:25 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:19.908 09:53:25 -- accel/accel.sh@41 -- # local IFS=, 00:07:19.908 09:53:25 -- accel/accel.sh@42 -- # jq -r . 00:07:19.908 [2024-07-13 09:53:25.370278] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:07:19.908 [2024-07-13 09:53:25.370360] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2702656 ] 00:07:19.908 EAL: No free 2048 kB hugepages reported on node 1 00:07:19.908 [2024-07-13 09:53:25.435084] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:19.908 [2024-07-13 09:53:25.525498] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:19.908 09:53:25 -- accel/accel.sh@21 -- # val= 00:07:19.908 09:53:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.908 09:53:25 -- accel/accel.sh@20 -- # IFS=: 00:07:19.908 09:53:25 -- accel/accel.sh@20 -- # read -r var val 00:07:19.908 09:53:25 -- accel/accel.sh@21 -- # val= 00:07:19.908 09:53:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.908 09:53:25 -- accel/accel.sh@20 -- # IFS=: 00:07:19.908 09:53:25 -- accel/accel.sh@20 -- # read -r var val 00:07:19.908 09:53:25 -- accel/accel.sh@21 -- # val=0x1 00:07:19.908 09:53:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.908 09:53:25 -- accel/accel.sh@20 -- # IFS=: 00:07:19.908 09:53:25 -- accel/accel.sh@20 -- # read -r var val 00:07:19.908 09:53:25 -- accel/accel.sh@21 -- # val= 00:07:19.908 09:53:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.908 09:53:25 -- accel/accel.sh@20 -- # IFS=: 00:07:19.908 09:53:25 -- accel/accel.sh@20 -- # read -r var val 00:07:19.908 09:53:25 -- accel/accel.sh@21 -- # val= 00:07:19.908 09:53:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.908 09:53:25 -- accel/accel.sh@20 -- # IFS=: 00:07:19.908 09:53:25 -- accel/accel.sh@20 -- # read -r var val 00:07:19.908 09:53:25 -- accel/accel.sh@21 -- # val=dif_verify 00:07:19.908 09:53:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.908 09:53:25 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:07:19.908 09:53:25 -- accel/accel.sh@20 -- # IFS=: 00:07:19.908 09:53:25 -- accel/accel.sh@20 -- # read -r var val 00:07:19.908 09:53:25 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:19.908 09:53:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.908 09:53:25 -- accel/accel.sh@20 -- # IFS=: 00:07:19.908 09:53:25 -- accel/accel.sh@20 -- # read -r var val 00:07:19.908 09:53:25 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:19.908 09:53:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.908 09:53:25 -- accel/accel.sh@20 -- # IFS=: 00:07:19.908 09:53:25 -- accel/accel.sh@20 -- # read -r var val 00:07:19.908 09:53:25 -- accel/accel.sh@21 -- # val='512 bytes' 00:07:19.908 09:53:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.908 09:53:25 -- accel/accel.sh@20 -- # IFS=: 00:07:19.908 09:53:25 -- accel/accel.sh@20 -- # read -r var val 00:07:19.908 09:53:25 -- accel/accel.sh@21 -- # val='8 bytes' 00:07:19.908 09:53:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.908 09:53:25 -- accel/accel.sh@20 -- # IFS=: 00:07:19.908 09:53:25 -- accel/accel.sh@20 -- # read -r var val 00:07:19.908 09:53:25 -- accel/accel.sh@21 -- # val= 00:07:19.908 09:53:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.908 09:53:25 -- accel/accel.sh@20 -- # IFS=: 00:07:19.908 09:53:25 -- accel/accel.sh@20 -- # read -r var val 00:07:19.908 09:53:25 -- accel/accel.sh@21 -- # val=software 00:07:19.908 09:53:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.908 09:53:25 -- accel/accel.sh@23 -- # accel_module=software 00:07:19.908 09:53:25 -- accel/accel.sh@20 -- # IFS=: 00:07:19.908 09:53:25 -- accel/accel.sh@20 -- # read -r var val 00:07:19.908 09:53:25 -- accel/accel.sh@21 -- # val=32 00:07:19.908 09:53:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.908 09:53:25 -- accel/accel.sh@20 -- # IFS=: 00:07:19.908 09:53:25 -- accel/accel.sh@20 -- # read -r var val 00:07:19.908 09:53:25 -- accel/accel.sh@21 -- # val=32 00:07:19.908 09:53:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.908 09:53:25 -- accel/accel.sh@20 -- # IFS=: 00:07:19.908 09:53:25 -- accel/accel.sh@20 -- # read -r var val 00:07:19.908 09:53:25 -- accel/accel.sh@21 -- # val=1 00:07:19.908 09:53:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.908 09:53:25 -- accel/accel.sh@20 -- # IFS=: 00:07:19.908 09:53:25 -- accel/accel.sh@20 -- # read -r var val 00:07:19.908 09:53:25 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:19.908 09:53:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.908 09:53:25 -- accel/accel.sh@20 -- # IFS=: 00:07:19.908 09:53:25 -- accel/accel.sh@20 -- # read -r var val 00:07:19.908 09:53:25 -- accel/accel.sh@21 -- # val=No 00:07:19.908 09:53:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.908 09:53:25 -- accel/accel.sh@20 -- # IFS=: 00:07:19.908 09:53:25 -- accel/accel.sh@20 -- # read -r var val 00:07:19.908 09:53:25 -- accel/accel.sh@21 -- # val= 00:07:19.908 09:53:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.908 09:53:25 -- accel/accel.sh@20 -- # IFS=: 00:07:19.908 09:53:25 -- accel/accel.sh@20 -- # read -r var val 00:07:19.908 09:53:25 -- accel/accel.sh@21 -- # val= 00:07:19.908 09:53:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.908 09:53:25 -- accel/accel.sh@20 -- # IFS=: 00:07:19.908 09:53:25 -- accel/accel.sh@20 -- # read -r var val 00:07:21.280 09:53:26 -- accel/accel.sh@21 -- # val= 00:07:21.281 09:53:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.281 09:53:26 -- accel/accel.sh@20 -- # IFS=: 00:07:21.281 09:53:26 -- accel/accel.sh@20 -- # read -r var val 00:07:21.281 09:53:26 -- accel/accel.sh@21 -- # val= 00:07:21.281 09:53:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.281 09:53:26 -- accel/accel.sh@20 -- # IFS=: 00:07:21.281 09:53:26 -- accel/accel.sh@20 -- # read -r var val 00:07:21.281 09:53:26 -- accel/accel.sh@21 -- # val= 00:07:21.281 09:53:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.281 09:53:26 -- accel/accel.sh@20 -- # IFS=: 00:07:21.281 09:53:26 -- accel/accel.sh@20 -- # read -r var val 00:07:21.281 09:53:26 -- accel/accel.sh@21 -- # val= 00:07:21.281 09:53:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.281 09:53:26 -- accel/accel.sh@20 -- # IFS=: 00:07:21.281 09:53:26 -- accel/accel.sh@20 -- # read -r var val 00:07:21.281 09:53:26 -- accel/accel.sh@21 -- # val= 00:07:21.281 09:53:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.281 09:53:26 -- accel/accel.sh@20 -- # IFS=: 00:07:21.281 09:53:26 -- accel/accel.sh@20 -- # read -r var val 00:07:21.281 09:53:26 -- accel/accel.sh@21 -- # val= 00:07:21.281 09:53:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.281 09:53:26 -- accel/accel.sh@20 -- # IFS=: 00:07:21.281 09:53:26 -- accel/accel.sh@20 -- # read -r var val 00:07:21.281 09:53:26 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:21.281 09:53:26 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:07:21.281 09:53:26 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:21.281 00:07:21.281 real 0m2.819s 00:07:21.281 user 0m2.519s 00:07:21.281 sys 0m0.295s 00:07:21.281 09:53:26 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:21.281 09:53:26 -- common/autotest_common.sh@10 -- # set +x 00:07:21.281 ************************************ 00:07:21.281 END TEST accel_dif_verify 00:07:21.281 ************************************ 00:07:21.281 09:53:26 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:07:21.281 09:53:26 -- common/autotest_common.sh@1077 -- # '[' 6 -le 1 ']' 00:07:21.281 09:53:26 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:21.281 09:53:26 -- common/autotest_common.sh@10 -- # set +x 00:07:21.281 ************************************ 00:07:21.281 START TEST accel_dif_generate 00:07:21.281 ************************************ 00:07:21.281 09:53:26 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w dif_generate 00:07:21.281 09:53:26 -- accel/accel.sh@16 -- # local accel_opc 00:07:21.281 09:53:26 -- accel/accel.sh@17 -- # local accel_module 00:07:21.281 09:53:26 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:07:21.281 09:53:26 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:07:21.281 09:53:26 -- accel/accel.sh@12 -- # build_accel_config 00:07:21.281 09:53:26 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:21.281 09:53:26 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:21.281 09:53:26 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:21.281 09:53:26 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:21.281 09:53:26 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:21.281 09:53:26 -- accel/accel.sh@41 -- # local IFS=, 00:07:21.281 09:53:26 -- accel/accel.sh@42 -- # jq -r . 00:07:21.281 [2024-07-13 09:53:26.797366] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:07:21.281 [2024-07-13 09:53:26.797446] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2702822 ] 00:07:21.281 EAL: No free 2048 kB hugepages reported on node 1 00:07:21.281 [2024-07-13 09:53:26.857579] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:21.281 [2024-07-13 09:53:26.951259] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:22.663 09:53:28 -- accel/accel.sh@18 -- # out=' 00:07:22.663 SPDK Configuration: 00:07:22.663 Core mask: 0x1 00:07:22.663 00:07:22.663 Accel Perf Configuration: 00:07:22.663 Workload Type: dif_generate 00:07:22.663 Vector size: 4096 bytes 00:07:22.663 Transfer size: 4096 bytes 00:07:22.663 Block size: 512 bytes 00:07:22.663 Metadata size: 8 bytes 00:07:22.663 Vector count 1 00:07:22.663 Module: software 00:07:22.663 Queue depth: 32 00:07:22.663 Allocate depth: 32 00:07:22.663 # threads/core: 1 00:07:22.663 Run time: 1 seconds 00:07:22.663 Verify: No 00:07:22.663 00:07:22.663 Running for 1 seconds... 00:07:22.663 00:07:22.663 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:22.663 ------------------------------------------------------------------------------------ 00:07:22.663 0,0 96224/s 381 MiB/s 0 0 00:07:22.663 ==================================================================================== 00:07:22.663 Total 96224/s 375 MiB/s 0 0' 00:07:22.663 09:53:28 -- accel/accel.sh@20 -- # IFS=: 00:07:22.663 09:53:28 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:07:22.663 09:53:28 -- accel/accel.sh@20 -- # read -r var val 00:07:22.663 09:53:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:07:22.663 09:53:28 -- accel/accel.sh@12 -- # build_accel_config 00:07:22.663 09:53:28 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:22.663 09:53:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:22.663 09:53:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:22.663 09:53:28 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:22.663 09:53:28 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:22.663 09:53:28 -- accel/accel.sh@41 -- # local IFS=, 00:07:22.663 09:53:28 -- accel/accel.sh@42 -- # jq -r . 00:07:22.663 [2024-07-13 09:53:28.207837] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:07:22.663 [2024-07-13 09:53:28.207928] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2702961 ] 00:07:22.663 EAL: No free 2048 kB hugepages reported on node 1 00:07:22.663 [2024-07-13 09:53:28.272393] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:22.663 [2024-07-13 09:53:28.365085] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:22.663 09:53:28 -- accel/accel.sh@21 -- # val= 00:07:22.663 09:53:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.663 09:53:28 -- accel/accel.sh@20 -- # IFS=: 00:07:22.663 09:53:28 -- accel/accel.sh@20 -- # read -r var val 00:07:22.663 09:53:28 -- accel/accel.sh@21 -- # val= 00:07:22.663 09:53:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.663 09:53:28 -- accel/accel.sh@20 -- # IFS=: 00:07:22.663 09:53:28 -- accel/accel.sh@20 -- # read -r var val 00:07:22.663 09:53:28 -- accel/accel.sh@21 -- # val=0x1 00:07:22.663 09:53:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.663 09:53:28 -- accel/accel.sh@20 -- # IFS=: 00:07:22.663 09:53:28 -- accel/accel.sh@20 -- # read -r var val 00:07:22.663 09:53:28 -- accel/accel.sh@21 -- # val= 00:07:22.663 09:53:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.663 09:53:28 -- accel/accel.sh@20 -- # IFS=: 00:07:22.663 09:53:28 -- accel/accel.sh@20 -- # read -r var val 00:07:22.663 09:53:28 -- accel/accel.sh@21 -- # val= 00:07:22.664 09:53:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.664 09:53:28 -- accel/accel.sh@20 -- # IFS=: 00:07:22.664 09:53:28 -- accel/accel.sh@20 -- # read -r var val 00:07:22.664 09:53:28 -- accel/accel.sh@21 -- # val=dif_generate 00:07:22.664 09:53:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.664 09:53:28 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:07:22.664 09:53:28 -- accel/accel.sh@20 -- # IFS=: 00:07:22.664 09:53:28 -- accel/accel.sh@20 -- # read -r var val 00:07:22.664 09:53:28 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:22.664 09:53:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.664 09:53:28 -- accel/accel.sh@20 -- # IFS=: 00:07:22.664 09:53:28 -- accel/accel.sh@20 -- # read -r var val 00:07:22.664 09:53:28 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:22.664 09:53:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.664 09:53:28 -- accel/accel.sh@20 -- # IFS=: 00:07:22.664 09:53:28 -- accel/accel.sh@20 -- # read -r var val 00:07:22.664 09:53:28 -- accel/accel.sh@21 -- # val='512 bytes' 00:07:22.664 09:53:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.664 09:53:28 -- accel/accel.sh@20 -- # IFS=: 00:07:22.664 09:53:28 -- accel/accel.sh@20 -- # read -r var val 00:07:22.664 09:53:28 -- accel/accel.sh@21 -- # val='8 bytes' 00:07:22.664 09:53:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.664 09:53:28 -- accel/accel.sh@20 -- # IFS=: 00:07:22.664 09:53:28 -- accel/accel.sh@20 -- # read -r var val 00:07:22.664 09:53:28 -- accel/accel.sh@21 -- # val= 00:07:22.664 09:53:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.664 09:53:28 -- accel/accel.sh@20 -- # IFS=: 00:07:22.664 09:53:28 -- accel/accel.sh@20 -- # read -r var val 00:07:22.664 09:53:28 -- accel/accel.sh@21 -- # val=software 00:07:22.664 09:53:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.664 09:53:28 -- accel/accel.sh@23 -- # accel_module=software 00:07:22.664 09:53:28 -- accel/accel.sh@20 -- # IFS=: 00:07:22.664 09:53:28 -- accel/accel.sh@20 -- # read -r var val 00:07:22.664 09:53:28 -- accel/accel.sh@21 -- # val=32 00:07:22.664 09:53:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.664 09:53:28 -- accel/accel.sh@20 -- # IFS=: 00:07:22.664 09:53:28 -- accel/accel.sh@20 -- # read -r var val 00:07:22.664 09:53:28 -- accel/accel.sh@21 -- # val=32 00:07:22.664 09:53:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.664 09:53:28 -- accel/accel.sh@20 -- # IFS=: 00:07:22.664 09:53:28 -- accel/accel.sh@20 -- # read -r var val 00:07:22.664 09:53:28 -- accel/accel.sh@21 -- # val=1 00:07:22.664 09:53:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.664 09:53:28 -- accel/accel.sh@20 -- # IFS=: 00:07:22.664 09:53:28 -- accel/accel.sh@20 -- # read -r var val 00:07:22.664 09:53:28 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:22.664 09:53:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.664 09:53:28 -- accel/accel.sh@20 -- # IFS=: 00:07:22.664 09:53:28 -- accel/accel.sh@20 -- # read -r var val 00:07:22.664 09:53:28 -- accel/accel.sh@21 -- # val=No 00:07:22.664 09:53:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.664 09:53:28 -- accel/accel.sh@20 -- # IFS=: 00:07:22.664 09:53:28 -- accel/accel.sh@20 -- # read -r var val 00:07:22.664 09:53:28 -- accel/accel.sh@21 -- # val= 00:07:22.664 09:53:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.664 09:53:28 -- accel/accel.sh@20 -- # IFS=: 00:07:22.664 09:53:28 -- accel/accel.sh@20 -- # read -r var val 00:07:22.664 09:53:28 -- accel/accel.sh@21 -- # val= 00:07:22.664 09:53:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.664 09:53:28 -- accel/accel.sh@20 -- # IFS=: 00:07:22.664 09:53:28 -- accel/accel.sh@20 -- # read -r var val 00:07:24.039 09:53:29 -- accel/accel.sh@21 -- # val= 00:07:24.039 09:53:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.039 09:53:29 -- accel/accel.sh@20 -- # IFS=: 00:07:24.039 09:53:29 -- accel/accel.sh@20 -- # read -r var val 00:07:24.039 09:53:29 -- accel/accel.sh@21 -- # val= 00:07:24.039 09:53:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.039 09:53:29 -- accel/accel.sh@20 -- # IFS=: 00:07:24.039 09:53:29 -- accel/accel.sh@20 -- # read -r var val 00:07:24.039 09:53:29 -- accel/accel.sh@21 -- # val= 00:07:24.039 09:53:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.039 09:53:29 -- accel/accel.sh@20 -- # IFS=: 00:07:24.039 09:53:29 -- accel/accel.sh@20 -- # read -r var val 00:07:24.039 09:53:29 -- accel/accel.sh@21 -- # val= 00:07:24.039 09:53:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.039 09:53:29 -- accel/accel.sh@20 -- # IFS=: 00:07:24.039 09:53:29 -- accel/accel.sh@20 -- # read -r var val 00:07:24.039 09:53:29 -- accel/accel.sh@21 -- # val= 00:07:24.039 09:53:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.039 09:53:29 -- accel/accel.sh@20 -- # IFS=: 00:07:24.039 09:53:29 -- accel/accel.sh@20 -- # read -r var val 00:07:24.039 09:53:29 -- accel/accel.sh@21 -- # val= 00:07:24.039 09:53:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.039 09:53:29 -- accel/accel.sh@20 -- # IFS=: 00:07:24.039 09:53:29 -- accel/accel.sh@20 -- # read -r var val 00:07:24.039 09:53:29 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:24.039 09:53:29 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:07:24.039 09:53:29 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:24.039 00:07:24.039 real 0m2.809s 00:07:24.039 user 0m2.523s 00:07:24.039 sys 0m0.281s 00:07:24.039 09:53:29 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:24.039 09:53:29 -- common/autotest_common.sh@10 -- # set +x 00:07:24.039 ************************************ 00:07:24.039 END TEST accel_dif_generate 00:07:24.039 ************************************ 00:07:24.039 09:53:29 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:07:24.039 09:53:29 -- common/autotest_common.sh@1077 -- # '[' 6 -le 1 ']' 00:07:24.039 09:53:29 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:24.039 09:53:29 -- common/autotest_common.sh@10 -- # set +x 00:07:24.039 ************************************ 00:07:24.039 START TEST accel_dif_generate_copy 00:07:24.039 ************************************ 00:07:24.039 09:53:29 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w dif_generate_copy 00:07:24.039 09:53:29 -- accel/accel.sh@16 -- # local accel_opc 00:07:24.039 09:53:29 -- accel/accel.sh@17 -- # local accel_module 00:07:24.039 09:53:29 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:07:24.039 09:53:29 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:07:24.039 09:53:29 -- accel/accel.sh@12 -- # build_accel_config 00:07:24.039 09:53:29 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:24.039 09:53:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:24.039 09:53:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:24.039 09:53:29 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:24.039 09:53:29 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:24.039 09:53:29 -- accel/accel.sh@41 -- # local IFS=, 00:07:24.039 09:53:29 -- accel/accel.sh@42 -- # jq -r . 00:07:24.039 [2024-07-13 09:53:29.630945] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:07:24.039 [2024-07-13 09:53:29.631026] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2703193 ] 00:07:24.039 EAL: No free 2048 kB hugepages reported on node 1 00:07:24.039 [2024-07-13 09:53:29.693810] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:24.039 [2024-07-13 09:53:29.786973] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:25.413 09:53:31 -- accel/accel.sh@18 -- # out=' 00:07:25.413 SPDK Configuration: 00:07:25.413 Core mask: 0x1 00:07:25.413 00:07:25.413 Accel Perf Configuration: 00:07:25.413 Workload Type: dif_generate_copy 00:07:25.413 Vector size: 4096 bytes 00:07:25.413 Transfer size: 4096 bytes 00:07:25.413 Vector count 1 00:07:25.413 Module: software 00:07:25.413 Queue depth: 32 00:07:25.413 Allocate depth: 32 00:07:25.413 # threads/core: 1 00:07:25.413 Run time: 1 seconds 00:07:25.413 Verify: No 00:07:25.413 00:07:25.413 Running for 1 seconds... 00:07:25.413 00:07:25.413 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:25.413 ------------------------------------------------------------------------------------ 00:07:25.413 0,0 75808/s 300 MiB/s 0 0 00:07:25.413 ==================================================================================== 00:07:25.413 Total 75808/s 296 MiB/s 0 0' 00:07:25.413 09:53:31 -- accel/accel.sh@20 -- # IFS=: 00:07:25.413 09:53:31 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:07:25.413 09:53:31 -- accel/accel.sh@20 -- # read -r var val 00:07:25.413 09:53:31 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:07:25.413 09:53:31 -- accel/accel.sh@12 -- # build_accel_config 00:07:25.413 09:53:31 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:25.413 09:53:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:25.413 09:53:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:25.413 09:53:31 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:25.413 09:53:31 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:25.413 09:53:31 -- accel/accel.sh@41 -- # local IFS=, 00:07:25.413 09:53:31 -- accel/accel.sh@42 -- # jq -r . 00:07:25.413 [2024-07-13 09:53:31.042889] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:07:25.413 [2024-07-13 09:53:31.042971] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2703385 ] 00:07:25.413 EAL: No free 2048 kB hugepages reported on node 1 00:07:25.413 [2024-07-13 09:53:31.103054] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:25.413 [2024-07-13 09:53:31.193788] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:25.672 09:53:31 -- accel/accel.sh@21 -- # val= 00:07:25.672 09:53:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.672 09:53:31 -- accel/accel.sh@20 -- # IFS=: 00:07:25.672 09:53:31 -- accel/accel.sh@20 -- # read -r var val 00:07:25.672 09:53:31 -- accel/accel.sh@21 -- # val= 00:07:25.672 09:53:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.672 09:53:31 -- accel/accel.sh@20 -- # IFS=: 00:07:25.672 09:53:31 -- accel/accel.sh@20 -- # read -r var val 00:07:25.672 09:53:31 -- accel/accel.sh@21 -- # val=0x1 00:07:25.672 09:53:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.672 09:53:31 -- accel/accel.sh@20 -- # IFS=: 00:07:25.672 09:53:31 -- accel/accel.sh@20 -- # read -r var val 00:07:25.672 09:53:31 -- accel/accel.sh@21 -- # val= 00:07:25.672 09:53:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.672 09:53:31 -- accel/accel.sh@20 -- # IFS=: 00:07:25.672 09:53:31 -- accel/accel.sh@20 -- # read -r var val 00:07:25.672 09:53:31 -- accel/accel.sh@21 -- # val= 00:07:25.672 09:53:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.672 09:53:31 -- accel/accel.sh@20 -- # IFS=: 00:07:25.672 09:53:31 -- accel/accel.sh@20 -- # read -r var val 00:07:25.672 09:53:31 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:07:25.672 09:53:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.672 09:53:31 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:07:25.672 09:53:31 -- accel/accel.sh@20 -- # IFS=: 00:07:25.672 09:53:31 -- accel/accel.sh@20 -- # read -r var val 00:07:25.672 09:53:31 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:25.672 09:53:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.672 09:53:31 -- accel/accel.sh@20 -- # IFS=: 00:07:25.672 09:53:31 -- accel/accel.sh@20 -- # read -r var val 00:07:25.672 09:53:31 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:25.672 09:53:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.672 09:53:31 -- accel/accel.sh@20 -- # IFS=: 00:07:25.672 09:53:31 -- accel/accel.sh@20 -- # read -r var val 00:07:25.672 09:53:31 -- accel/accel.sh@21 -- # val= 00:07:25.672 09:53:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.672 09:53:31 -- accel/accel.sh@20 -- # IFS=: 00:07:25.672 09:53:31 -- accel/accel.sh@20 -- # read -r var val 00:07:25.672 09:53:31 -- accel/accel.sh@21 -- # val=software 00:07:25.672 09:53:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.672 09:53:31 -- accel/accel.sh@23 -- # accel_module=software 00:07:25.672 09:53:31 -- accel/accel.sh@20 -- # IFS=: 00:07:25.672 09:53:31 -- accel/accel.sh@20 -- # read -r var val 00:07:25.672 09:53:31 -- accel/accel.sh@21 -- # val=32 00:07:25.672 09:53:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.672 09:53:31 -- accel/accel.sh@20 -- # IFS=: 00:07:25.672 09:53:31 -- accel/accel.sh@20 -- # read -r var val 00:07:25.672 09:53:31 -- accel/accel.sh@21 -- # val=32 00:07:25.672 09:53:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.672 09:53:31 -- accel/accel.sh@20 -- # IFS=: 00:07:25.672 09:53:31 -- accel/accel.sh@20 -- # read -r var val 00:07:25.672 09:53:31 -- accel/accel.sh@21 -- # val=1 00:07:25.672 09:53:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.672 09:53:31 -- accel/accel.sh@20 -- # IFS=: 00:07:25.672 09:53:31 -- accel/accel.sh@20 -- # read -r var val 00:07:25.672 09:53:31 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:25.672 09:53:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.672 09:53:31 -- accel/accel.sh@20 -- # IFS=: 00:07:25.672 09:53:31 -- accel/accel.sh@20 -- # read -r var val 00:07:25.672 09:53:31 -- accel/accel.sh@21 -- # val=No 00:07:25.672 09:53:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.672 09:53:31 -- accel/accel.sh@20 -- # IFS=: 00:07:25.672 09:53:31 -- accel/accel.sh@20 -- # read -r var val 00:07:25.672 09:53:31 -- accel/accel.sh@21 -- # val= 00:07:25.672 09:53:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.672 09:53:31 -- accel/accel.sh@20 -- # IFS=: 00:07:25.672 09:53:31 -- accel/accel.sh@20 -- # read -r var val 00:07:25.672 09:53:31 -- accel/accel.sh@21 -- # val= 00:07:25.672 09:53:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.672 09:53:31 -- accel/accel.sh@20 -- # IFS=: 00:07:25.672 09:53:31 -- accel/accel.sh@20 -- # read -r var val 00:07:26.605 09:53:32 -- accel/accel.sh@21 -- # val= 00:07:26.605 09:53:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.605 09:53:32 -- accel/accel.sh@20 -- # IFS=: 00:07:26.605 09:53:32 -- accel/accel.sh@20 -- # read -r var val 00:07:26.605 09:53:32 -- accel/accel.sh@21 -- # val= 00:07:26.605 09:53:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.605 09:53:32 -- accel/accel.sh@20 -- # IFS=: 00:07:26.605 09:53:32 -- accel/accel.sh@20 -- # read -r var val 00:07:26.605 09:53:32 -- accel/accel.sh@21 -- # val= 00:07:26.605 09:53:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.605 09:53:32 -- accel/accel.sh@20 -- # IFS=: 00:07:26.605 09:53:32 -- accel/accel.sh@20 -- # read -r var val 00:07:26.605 09:53:32 -- accel/accel.sh@21 -- # val= 00:07:26.605 09:53:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.605 09:53:32 -- accel/accel.sh@20 -- # IFS=: 00:07:26.605 09:53:32 -- accel/accel.sh@20 -- # read -r var val 00:07:26.605 09:53:32 -- accel/accel.sh@21 -- # val= 00:07:26.605 09:53:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.605 09:53:32 -- accel/accel.sh@20 -- # IFS=: 00:07:26.605 09:53:32 -- accel/accel.sh@20 -- # read -r var val 00:07:26.605 09:53:32 -- accel/accel.sh@21 -- # val= 00:07:26.605 09:53:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.605 09:53:32 -- accel/accel.sh@20 -- # IFS=: 00:07:26.605 09:53:32 -- accel/accel.sh@20 -- # read -r var val 00:07:26.605 09:53:32 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:26.605 09:53:32 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:07:26.605 09:53:32 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:26.605 00:07:26.605 real 0m2.804s 00:07:26.605 user 0m2.517s 00:07:26.605 sys 0m0.280s 00:07:26.605 09:53:32 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:26.605 09:53:32 -- common/autotest_common.sh@10 -- # set +x 00:07:26.605 ************************************ 00:07:26.605 END TEST accel_dif_generate_copy 00:07:26.605 ************************************ 00:07:26.864 09:53:32 -- accel/accel.sh@107 -- # [[ y == y ]] 00:07:26.864 09:53:32 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:26.864 09:53:32 -- common/autotest_common.sh@1077 -- # '[' 8 -le 1 ']' 00:07:26.864 09:53:32 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:26.864 09:53:32 -- common/autotest_common.sh@10 -- # set +x 00:07:26.864 ************************************ 00:07:26.864 START TEST accel_comp 00:07:26.864 ************************************ 00:07:26.864 09:53:32 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:26.864 09:53:32 -- accel/accel.sh@16 -- # local accel_opc 00:07:26.864 09:53:32 -- accel/accel.sh@17 -- # local accel_module 00:07:26.864 09:53:32 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:26.864 09:53:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:26.864 09:53:32 -- accel/accel.sh@12 -- # build_accel_config 00:07:26.864 09:53:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:26.864 09:53:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:26.864 09:53:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:26.864 09:53:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:26.864 09:53:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:26.864 09:53:32 -- accel/accel.sh@41 -- # local IFS=, 00:07:26.864 09:53:32 -- accel/accel.sh@42 -- # jq -r . 00:07:26.864 [2024-07-13 09:53:32.458874] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:07:26.864 [2024-07-13 09:53:32.458959] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2703557 ] 00:07:26.864 EAL: No free 2048 kB hugepages reported on node 1 00:07:26.864 [2024-07-13 09:53:32.523423] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:26.864 [2024-07-13 09:53:32.617419] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:28.235 09:53:33 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:28.235 00:07:28.235 SPDK Configuration: 00:07:28.235 Core mask: 0x1 00:07:28.235 00:07:28.235 Accel Perf Configuration: 00:07:28.235 Workload Type: compress 00:07:28.235 Transfer size: 4096 bytes 00:07:28.235 Vector count 1 00:07:28.235 Module: software 00:07:28.235 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:28.235 Queue depth: 32 00:07:28.235 Allocate depth: 32 00:07:28.235 # threads/core: 1 00:07:28.235 Run time: 1 seconds 00:07:28.235 Verify: No 00:07:28.235 00:07:28.235 Running for 1 seconds... 00:07:28.235 00:07:28.235 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:28.235 ------------------------------------------------------------------------------------ 00:07:28.235 0,0 32416/s 135 MiB/s 0 0 00:07:28.235 ==================================================================================== 00:07:28.235 Total 32416/s 126 MiB/s 0 0' 00:07:28.235 09:53:33 -- accel/accel.sh@20 -- # IFS=: 00:07:28.235 09:53:33 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:28.235 09:53:33 -- accel/accel.sh@20 -- # read -r var val 00:07:28.235 09:53:33 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:28.235 09:53:33 -- accel/accel.sh@12 -- # build_accel_config 00:07:28.235 09:53:33 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:28.235 09:53:33 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:28.235 09:53:33 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:28.235 09:53:33 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:28.235 09:53:33 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:28.235 09:53:33 -- accel/accel.sh@41 -- # local IFS=, 00:07:28.235 09:53:33 -- accel/accel.sh@42 -- # jq -r . 00:07:28.235 [2024-07-13 09:53:33.876363] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:07:28.235 [2024-07-13 09:53:33.876445] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2703703 ] 00:07:28.235 EAL: No free 2048 kB hugepages reported on node 1 00:07:28.235 [2024-07-13 09:53:33.941506] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:28.235 [2024-07-13 09:53:34.035003] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:28.494 09:53:34 -- accel/accel.sh@21 -- # val= 00:07:28.494 09:53:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.494 09:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:28.494 09:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:28.494 09:53:34 -- accel/accel.sh@21 -- # val= 00:07:28.494 09:53:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.494 09:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:28.494 09:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:28.494 09:53:34 -- accel/accel.sh@21 -- # val= 00:07:28.494 09:53:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.494 09:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:28.494 09:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:28.494 09:53:34 -- accel/accel.sh@21 -- # val=0x1 00:07:28.494 09:53:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.494 09:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:28.494 09:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:28.494 09:53:34 -- accel/accel.sh@21 -- # val= 00:07:28.494 09:53:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.494 09:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:28.494 09:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:28.494 09:53:34 -- accel/accel.sh@21 -- # val= 00:07:28.494 09:53:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.494 09:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:28.494 09:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:28.494 09:53:34 -- accel/accel.sh@21 -- # val=compress 00:07:28.494 09:53:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.494 09:53:34 -- accel/accel.sh@24 -- # accel_opc=compress 00:07:28.494 09:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:28.494 09:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:28.494 09:53:34 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:28.494 09:53:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.494 09:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:28.494 09:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:28.494 09:53:34 -- accel/accel.sh@21 -- # val= 00:07:28.494 09:53:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.494 09:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:28.494 09:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:28.494 09:53:34 -- accel/accel.sh@21 -- # val=software 00:07:28.494 09:53:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.494 09:53:34 -- accel/accel.sh@23 -- # accel_module=software 00:07:28.494 09:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:28.494 09:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:28.494 09:53:34 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:28.494 09:53:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.494 09:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:28.494 09:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:28.494 09:53:34 -- accel/accel.sh@21 -- # val=32 00:07:28.494 09:53:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.494 09:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:28.494 09:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:28.494 09:53:34 -- accel/accel.sh@21 -- # val=32 00:07:28.494 09:53:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.494 09:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:28.494 09:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:28.494 09:53:34 -- accel/accel.sh@21 -- # val=1 00:07:28.494 09:53:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.494 09:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:28.494 09:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:28.494 09:53:34 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:28.494 09:53:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.494 09:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:28.494 09:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:28.494 09:53:34 -- accel/accel.sh@21 -- # val=No 00:07:28.494 09:53:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.494 09:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:28.494 09:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:28.494 09:53:34 -- accel/accel.sh@21 -- # val= 00:07:28.494 09:53:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.494 09:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:28.494 09:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:28.494 09:53:34 -- accel/accel.sh@21 -- # val= 00:07:28.494 09:53:34 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.494 09:53:34 -- accel/accel.sh@20 -- # IFS=: 00:07:28.494 09:53:34 -- accel/accel.sh@20 -- # read -r var val 00:07:29.867 09:53:35 -- accel/accel.sh@21 -- # val= 00:07:29.867 09:53:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.867 09:53:35 -- accel/accel.sh@20 -- # IFS=: 00:07:29.867 09:53:35 -- accel/accel.sh@20 -- # read -r var val 00:07:29.867 09:53:35 -- accel/accel.sh@21 -- # val= 00:07:29.867 09:53:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.867 09:53:35 -- accel/accel.sh@20 -- # IFS=: 00:07:29.867 09:53:35 -- accel/accel.sh@20 -- # read -r var val 00:07:29.867 09:53:35 -- accel/accel.sh@21 -- # val= 00:07:29.868 09:53:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.868 09:53:35 -- accel/accel.sh@20 -- # IFS=: 00:07:29.868 09:53:35 -- accel/accel.sh@20 -- # read -r var val 00:07:29.868 09:53:35 -- accel/accel.sh@21 -- # val= 00:07:29.868 09:53:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.868 09:53:35 -- accel/accel.sh@20 -- # IFS=: 00:07:29.868 09:53:35 -- accel/accel.sh@20 -- # read -r var val 00:07:29.868 09:53:35 -- accel/accel.sh@21 -- # val= 00:07:29.868 09:53:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.868 09:53:35 -- accel/accel.sh@20 -- # IFS=: 00:07:29.868 09:53:35 -- accel/accel.sh@20 -- # read -r var val 00:07:29.868 09:53:35 -- accel/accel.sh@21 -- # val= 00:07:29.868 09:53:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.868 09:53:35 -- accel/accel.sh@20 -- # IFS=: 00:07:29.868 09:53:35 -- accel/accel.sh@20 -- # read -r var val 00:07:29.868 09:53:35 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:29.868 09:53:35 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:07:29.868 09:53:35 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:29.868 00:07:29.868 real 0m2.829s 00:07:29.868 user 0m2.515s 00:07:29.868 sys 0m0.307s 00:07:29.868 09:53:35 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:29.868 09:53:35 -- common/autotest_common.sh@10 -- # set +x 00:07:29.868 ************************************ 00:07:29.868 END TEST accel_comp 00:07:29.868 ************************************ 00:07:29.868 09:53:35 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:29.868 09:53:35 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:07:29.868 09:53:35 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:29.868 09:53:35 -- common/autotest_common.sh@10 -- # set +x 00:07:29.868 ************************************ 00:07:29.868 START TEST accel_decomp 00:07:29.868 ************************************ 00:07:29.868 09:53:35 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:29.868 09:53:35 -- accel/accel.sh@16 -- # local accel_opc 00:07:29.868 09:53:35 -- accel/accel.sh@17 -- # local accel_module 00:07:29.868 09:53:35 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:29.868 09:53:35 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:29.868 09:53:35 -- accel/accel.sh@12 -- # build_accel_config 00:07:29.868 09:53:35 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:29.868 09:53:35 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:29.868 09:53:35 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:29.868 09:53:35 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:29.868 09:53:35 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:29.868 09:53:35 -- accel/accel.sh@41 -- # local IFS=, 00:07:29.868 09:53:35 -- accel/accel.sh@42 -- # jq -r . 00:07:29.868 [2024-07-13 09:53:35.312048] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:07:29.868 [2024-07-13 09:53:35.312128] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2703979 ] 00:07:29.868 EAL: No free 2048 kB hugepages reported on node 1 00:07:29.868 [2024-07-13 09:53:35.375481] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:29.868 [2024-07-13 09:53:35.469256] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:31.241 09:53:36 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:31.241 00:07:31.241 SPDK Configuration: 00:07:31.241 Core mask: 0x1 00:07:31.241 00:07:31.241 Accel Perf Configuration: 00:07:31.241 Workload Type: decompress 00:07:31.241 Transfer size: 4096 bytes 00:07:31.241 Vector count 1 00:07:31.241 Module: software 00:07:31.241 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:31.241 Queue depth: 32 00:07:31.241 Allocate depth: 32 00:07:31.241 # threads/core: 1 00:07:31.241 Run time: 1 seconds 00:07:31.241 Verify: Yes 00:07:31.241 00:07:31.241 Running for 1 seconds... 00:07:31.241 00:07:31.241 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:31.241 ------------------------------------------------------------------------------------ 00:07:31.241 0,0 55456/s 102 MiB/s 0 0 00:07:31.241 ==================================================================================== 00:07:31.241 Total 55456/s 216 MiB/s 0 0' 00:07:31.241 09:53:36 -- accel/accel.sh@20 -- # IFS=: 00:07:31.241 09:53:36 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:31.241 09:53:36 -- accel/accel.sh@20 -- # read -r var val 00:07:31.241 09:53:36 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:31.241 09:53:36 -- accel/accel.sh@12 -- # build_accel_config 00:07:31.241 09:53:36 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:31.241 09:53:36 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:31.241 09:53:36 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:31.241 09:53:36 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:31.241 09:53:36 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:31.241 09:53:36 -- accel/accel.sh@41 -- # local IFS=, 00:07:31.241 09:53:36 -- accel/accel.sh@42 -- # jq -r . 00:07:31.241 [2024-07-13 09:53:36.726951] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:07:31.241 [2024-07-13 09:53:36.727033] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2704120 ] 00:07:31.241 EAL: No free 2048 kB hugepages reported on node 1 00:07:31.241 [2024-07-13 09:53:36.791444] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:31.241 [2024-07-13 09:53:36.889252] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:31.241 09:53:36 -- accel/accel.sh@21 -- # val= 00:07:31.241 09:53:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.241 09:53:36 -- accel/accel.sh@20 -- # IFS=: 00:07:31.241 09:53:36 -- accel/accel.sh@20 -- # read -r var val 00:07:31.241 09:53:36 -- accel/accel.sh@21 -- # val= 00:07:31.241 09:53:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.241 09:53:36 -- accel/accel.sh@20 -- # IFS=: 00:07:31.241 09:53:36 -- accel/accel.sh@20 -- # read -r var val 00:07:31.241 09:53:36 -- accel/accel.sh@21 -- # val= 00:07:31.241 09:53:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.241 09:53:36 -- accel/accel.sh@20 -- # IFS=: 00:07:31.241 09:53:36 -- accel/accel.sh@20 -- # read -r var val 00:07:31.241 09:53:36 -- accel/accel.sh@21 -- # val=0x1 00:07:31.241 09:53:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.241 09:53:36 -- accel/accel.sh@20 -- # IFS=: 00:07:31.241 09:53:36 -- accel/accel.sh@20 -- # read -r var val 00:07:31.241 09:53:36 -- accel/accel.sh@21 -- # val= 00:07:31.241 09:53:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.241 09:53:36 -- accel/accel.sh@20 -- # IFS=: 00:07:31.241 09:53:36 -- accel/accel.sh@20 -- # read -r var val 00:07:31.241 09:53:36 -- accel/accel.sh@21 -- # val= 00:07:31.241 09:53:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.241 09:53:36 -- accel/accel.sh@20 -- # IFS=: 00:07:31.241 09:53:36 -- accel/accel.sh@20 -- # read -r var val 00:07:31.241 09:53:36 -- accel/accel.sh@21 -- # val=decompress 00:07:31.241 09:53:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.241 09:53:36 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:31.241 09:53:36 -- accel/accel.sh@20 -- # IFS=: 00:07:31.241 09:53:36 -- accel/accel.sh@20 -- # read -r var val 00:07:31.241 09:53:36 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:31.241 09:53:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.241 09:53:36 -- accel/accel.sh@20 -- # IFS=: 00:07:31.241 09:53:36 -- accel/accel.sh@20 -- # read -r var val 00:07:31.241 09:53:36 -- accel/accel.sh@21 -- # val= 00:07:31.241 09:53:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.241 09:53:36 -- accel/accel.sh@20 -- # IFS=: 00:07:31.241 09:53:36 -- accel/accel.sh@20 -- # read -r var val 00:07:31.241 09:53:36 -- accel/accel.sh@21 -- # val=software 00:07:31.241 09:53:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.241 09:53:36 -- accel/accel.sh@23 -- # accel_module=software 00:07:31.241 09:53:36 -- accel/accel.sh@20 -- # IFS=: 00:07:31.241 09:53:36 -- accel/accel.sh@20 -- # read -r var val 00:07:31.241 09:53:36 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:31.241 09:53:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.241 09:53:36 -- accel/accel.sh@20 -- # IFS=: 00:07:31.241 09:53:36 -- accel/accel.sh@20 -- # read -r var val 00:07:31.241 09:53:36 -- accel/accel.sh@21 -- # val=32 00:07:31.241 09:53:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.241 09:53:36 -- accel/accel.sh@20 -- # IFS=: 00:07:31.241 09:53:36 -- accel/accel.sh@20 -- # read -r var val 00:07:31.241 09:53:36 -- accel/accel.sh@21 -- # val=32 00:07:31.241 09:53:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.241 09:53:36 -- accel/accel.sh@20 -- # IFS=: 00:07:31.241 09:53:36 -- accel/accel.sh@20 -- # read -r var val 00:07:31.241 09:53:36 -- accel/accel.sh@21 -- # val=1 00:07:31.241 09:53:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.241 09:53:36 -- accel/accel.sh@20 -- # IFS=: 00:07:31.241 09:53:36 -- accel/accel.sh@20 -- # read -r var val 00:07:31.241 09:53:36 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:31.241 09:53:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.241 09:53:36 -- accel/accel.sh@20 -- # IFS=: 00:07:31.241 09:53:36 -- accel/accel.sh@20 -- # read -r var val 00:07:31.241 09:53:36 -- accel/accel.sh@21 -- # val=Yes 00:07:31.241 09:53:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.241 09:53:36 -- accel/accel.sh@20 -- # IFS=: 00:07:31.241 09:53:36 -- accel/accel.sh@20 -- # read -r var val 00:07:31.241 09:53:36 -- accel/accel.sh@21 -- # val= 00:07:31.241 09:53:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.241 09:53:36 -- accel/accel.sh@20 -- # IFS=: 00:07:31.241 09:53:36 -- accel/accel.sh@20 -- # read -r var val 00:07:31.241 09:53:36 -- accel/accel.sh@21 -- # val= 00:07:31.241 09:53:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.241 09:53:36 -- accel/accel.sh@20 -- # IFS=: 00:07:31.242 09:53:36 -- accel/accel.sh@20 -- # read -r var val 00:07:32.612 09:53:38 -- accel/accel.sh@21 -- # val= 00:07:32.612 09:53:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.612 09:53:38 -- accel/accel.sh@20 -- # IFS=: 00:07:32.612 09:53:38 -- accel/accel.sh@20 -- # read -r var val 00:07:32.612 09:53:38 -- accel/accel.sh@21 -- # val= 00:07:32.612 09:53:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.612 09:53:38 -- accel/accel.sh@20 -- # IFS=: 00:07:32.612 09:53:38 -- accel/accel.sh@20 -- # read -r var val 00:07:32.612 09:53:38 -- accel/accel.sh@21 -- # val= 00:07:32.612 09:53:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.612 09:53:38 -- accel/accel.sh@20 -- # IFS=: 00:07:32.612 09:53:38 -- accel/accel.sh@20 -- # read -r var val 00:07:32.612 09:53:38 -- accel/accel.sh@21 -- # val= 00:07:32.612 09:53:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.612 09:53:38 -- accel/accel.sh@20 -- # IFS=: 00:07:32.612 09:53:38 -- accel/accel.sh@20 -- # read -r var val 00:07:32.612 09:53:38 -- accel/accel.sh@21 -- # val= 00:07:32.612 09:53:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.612 09:53:38 -- accel/accel.sh@20 -- # IFS=: 00:07:32.612 09:53:38 -- accel/accel.sh@20 -- # read -r var val 00:07:32.612 09:53:38 -- accel/accel.sh@21 -- # val= 00:07:32.612 09:53:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.612 09:53:38 -- accel/accel.sh@20 -- # IFS=: 00:07:32.612 09:53:38 -- accel/accel.sh@20 -- # read -r var val 00:07:32.613 09:53:38 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:32.613 09:53:38 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:32.613 09:53:38 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:32.613 00:07:32.613 real 0m2.822s 00:07:32.613 user 0m2.520s 00:07:32.613 sys 0m0.295s 00:07:32.613 09:53:38 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:32.613 09:53:38 -- common/autotest_common.sh@10 -- # set +x 00:07:32.613 ************************************ 00:07:32.613 END TEST accel_decomp 00:07:32.613 ************************************ 00:07:32.613 09:53:38 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:32.613 09:53:38 -- common/autotest_common.sh@1077 -- # '[' 11 -le 1 ']' 00:07:32.613 09:53:38 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:32.613 09:53:38 -- common/autotest_common.sh@10 -- # set +x 00:07:32.613 ************************************ 00:07:32.613 START TEST accel_decmop_full 00:07:32.613 ************************************ 00:07:32.613 09:53:38 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:32.613 09:53:38 -- accel/accel.sh@16 -- # local accel_opc 00:07:32.613 09:53:38 -- accel/accel.sh@17 -- # local accel_module 00:07:32.613 09:53:38 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:32.613 09:53:38 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:32.613 09:53:38 -- accel/accel.sh@12 -- # build_accel_config 00:07:32.613 09:53:38 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:32.613 09:53:38 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:32.613 09:53:38 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:32.613 09:53:38 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:32.613 09:53:38 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:32.613 09:53:38 -- accel/accel.sh@41 -- # local IFS=, 00:07:32.613 09:53:38 -- accel/accel.sh@42 -- # jq -r . 00:07:32.613 [2024-07-13 09:53:38.158473] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:07:32.613 [2024-07-13 09:53:38.158554] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2704284 ] 00:07:32.613 EAL: No free 2048 kB hugepages reported on node 1 00:07:32.613 [2024-07-13 09:53:38.221191] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:32.613 [2024-07-13 09:53:38.314981] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:33.983 09:53:39 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:33.983 00:07:33.983 SPDK Configuration: 00:07:33.983 Core mask: 0x1 00:07:33.983 00:07:33.983 Accel Perf Configuration: 00:07:33.983 Workload Type: decompress 00:07:33.983 Transfer size: 111250 bytes 00:07:33.983 Vector count 1 00:07:33.983 Module: software 00:07:33.983 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:33.983 Queue depth: 32 00:07:33.983 Allocate depth: 32 00:07:33.983 # threads/core: 1 00:07:33.983 Run time: 1 seconds 00:07:33.983 Verify: Yes 00:07:33.983 00:07:33.983 Running for 1 seconds... 00:07:33.983 00:07:33.983 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:33.983 ------------------------------------------------------------------------------------ 00:07:33.983 0,0 3776/s 155 MiB/s 0 0 00:07:33.983 ==================================================================================== 00:07:33.983 Total 3776/s 400 MiB/s 0 0' 00:07:33.983 09:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:33.983 09:53:39 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:33.983 09:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:33.983 09:53:39 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:33.983 09:53:39 -- accel/accel.sh@12 -- # build_accel_config 00:07:33.983 09:53:39 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:33.983 09:53:39 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:33.983 09:53:39 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:33.983 09:53:39 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:33.983 09:53:39 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:33.983 09:53:39 -- accel/accel.sh@41 -- # local IFS=, 00:07:33.983 09:53:39 -- accel/accel.sh@42 -- # jq -r . 00:07:33.983 [2024-07-13 09:53:39.581965] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:07:33.983 [2024-07-13 09:53:39.582050] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2704424 ] 00:07:33.983 EAL: No free 2048 kB hugepages reported on node 1 00:07:33.983 [2024-07-13 09:53:39.644644] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:33.983 [2024-07-13 09:53:39.739938] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:34.241 09:53:39 -- accel/accel.sh@21 -- # val= 00:07:34.241 09:53:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.241 09:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:34.241 09:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:34.241 09:53:39 -- accel/accel.sh@21 -- # val= 00:07:34.241 09:53:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.241 09:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:34.241 09:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:34.241 09:53:39 -- accel/accel.sh@21 -- # val= 00:07:34.241 09:53:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.241 09:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:34.241 09:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:34.241 09:53:39 -- accel/accel.sh@21 -- # val=0x1 00:07:34.241 09:53:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.241 09:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:34.241 09:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:34.241 09:53:39 -- accel/accel.sh@21 -- # val= 00:07:34.241 09:53:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.241 09:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:34.241 09:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:34.241 09:53:39 -- accel/accel.sh@21 -- # val= 00:07:34.241 09:53:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.241 09:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:34.241 09:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:34.241 09:53:39 -- accel/accel.sh@21 -- # val=decompress 00:07:34.241 09:53:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.241 09:53:39 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:34.241 09:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:34.241 09:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:34.241 09:53:39 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:34.241 09:53:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.241 09:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:34.241 09:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:34.241 09:53:39 -- accel/accel.sh@21 -- # val= 00:07:34.241 09:53:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.241 09:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:34.241 09:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:34.241 09:53:39 -- accel/accel.sh@21 -- # val=software 00:07:34.241 09:53:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.241 09:53:39 -- accel/accel.sh@23 -- # accel_module=software 00:07:34.241 09:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:34.241 09:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:34.241 09:53:39 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:34.241 09:53:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.241 09:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:34.241 09:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:34.241 09:53:39 -- accel/accel.sh@21 -- # val=32 00:07:34.241 09:53:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.241 09:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:34.241 09:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:34.241 09:53:39 -- accel/accel.sh@21 -- # val=32 00:07:34.241 09:53:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.241 09:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:34.241 09:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:34.241 09:53:39 -- accel/accel.sh@21 -- # val=1 00:07:34.241 09:53:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.241 09:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:34.241 09:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:34.241 09:53:39 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:34.241 09:53:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.241 09:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:34.241 09:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:34.241 09:53:39 -- accel/accel.sh@21 -- # val=Yes 00:07:34.241 09:53:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.241 09:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:34.241 09:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:34.241 09:53:39 -- accel/accel.sh@21 -- # val= 00:07:34.241 09:53:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.241 09:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:34.241 09:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:34.241 09:53:39 -- accel/accel.sh@21 -- # val= 00:07:34.241 09:53:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.241 09:53:39 -- accel/accel.sh@20 -- # IFS=: 00:07:34.242 09:53:39 -- accel/accel.sh@20 -- # read -r var val 00:07:35.174 09:53:40 -- accel/accel.sh@21 -- # val= 00:07:35.175 09:53:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.175 09:53:40 -- accel/accel.sh@20 -- # IFS=: 00:07:35.175 09:53:40 -- accel/accel.sh@20 -- # read -r var val 00:07:35.175 09:53:40 -- accel/accel.sh@21 -- # val= 00:07:35.175 09:53:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.175 09:53:40 -- accel/accel.sh@20 -- # IFS=: 00:07:35.175 09:53:40 -- accel/accel.sh@20 -- # read -r var val 00:07:35.175 09:53:40 -- accel/accel.sh@21 -- # val= 00:07:35.175 09:53:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.175 09:53:40 -- accel/accel.sh@20 -- # IFS=: 00:07:35.175 09:53:40 -- accel/accel.sh@20 -- # read -r var val 00:07:35.175 09:53:40 -- accel/accel.sh@21 -- # val= 00:07:35.175 09:53:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.175 09:53:40 -- accel/accel.sh@20 -- # IFS=: 00:07:35.175 09:53:40 -- accel/accel.sh@20 -- # read -r var val 00:07:35.175 09:53:40 -- accel/accel.sh@21 -- # val= 00:07:35.175 09:53:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.175 09:53:40 -- accel/accel.sh@20 -- # IFS=: 00:07:35.175 09:53:40 -- accel/accel.sh@20 -- # read -r var val 00:07:35.175 09:53:40 -- accel/accel.sh@21 -- # val= 00:07:35.175 09:53:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.175 09:53:40 -- accel/accel.sh@20 -- # IFS=: 00:07:35.175 09:53:40 -- accel/accel.sh@20 -- # read -r var val 00:07:35.175 09:53:40 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:35.175 09:53:40 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:35.175 09:53:40 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:35.175 00:07:35.175 real 0m2.841s 00:07:35.175 user 0m2.545s 00:07:35.175 sys 0m0.289s 00:07:35.175 09:53:40 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:35.175 09:53:40 -- common/autotest_common.sh@10 -- # set +x 00:07:35.175 ************************************ 00:07:35.175 END TEST accel_decmop_full 00:07:35.175 ************************************ 00:07:35.433 09:53:41 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:35.433 09:53:41 -- common/autotest_common.sh@1077 -- # '[' 11 -le 1 ']' 00:07:35.433 09:53:41 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:35.433 09:53:41 -- common/autotest_common.sh@10 -- # set +x 00:07:35.433 ************************************ 00:07:35.433 START TEST accel_decomp_mcore 00:07:35.433 ************************************ 00:07:35.433 09:53:41 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:35.433 09:53:41 -- accel/accel.sh@16 -- # local accel_opc 00:07:35.433 09:53:41 -- accel/accel.sh@17 -- # local accel_module 00:07:35.433 09:53:41 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:35.433 09:53:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:35.433 09:53:41 -- accel/accel.sh@12 -- # build_accel_config 00:07:35.433 09:53:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:35.433 09:53:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:35.433 09:53:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:35.433 09:53:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:35.433 09:53:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:35.433 09:53:41 -- accel/accel.sh@41 -- # local IFS=, 00:07:35.433 09:53:41 -- accel/accel.sh@42 -- # jq -r . 00:07:35.433 [2024-07-13 09:53:41.027177] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:07:35.433 [2024-07-13 09:53:41.027268] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2704702 ] 00:07:35.433 EAL: No free 2048 kB hugepages reported on node 1 00:07:35.433 [2024-07-13 09:53:41.091439] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:35.433 [2024-07-13 09:53:41.185283] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:35.433 [2024-07-13 09:53:41.185342] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:35.433 [2024-07-13 09:53:41.185396] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:35.433 [2024-07-13 09:53:41.185399] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:36.805 09:53:42 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:36.805 00:07:36.805 SPDK Configuration: 00:07:36.805 Core mask: 0xf 00:07:36.805 00:07:36.805 Accel Perf Configuration: 00:07:36.805 Workload Type: decompress 00:07:36.805 Transfer size: 4096 bytes 00:07:36.805 Vector count 1 00:07:36.805 Module: software 00:07:36.805 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:36.805 Queue depth: 32 00:07:36.805 Allocate depth: 32 00:07:36.805 # threads/core: 1 00:07:36.805 Run time: 1 seconds 00:07:36.805 Verify: Yes 00:07:36.805 00:07:36.805 Running for 1 seconds... 00:07:36.805 00:07:36.805 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:36.805 ------------------------------------------------------------------------------------ 00:07:36.805 0,0 50400/s 92 MiB/s 0 0 00:07:36.805 3,0 51008/s 94 MiB/s 0 0 00:07:36.805 2,0 50944/s 93 MiB/s 0 0 00:07:36.805 1,0 50912/s 93 MiB/s 0 0 00:07:36.805 ==================================================================================== 00:07:36.805 Total 203264/s 794 MiB/s 0 0' 00:07:36.805 09:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:36.805 09:53:42 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:36.805 09:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:36.805 09:53:42 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:36.805 09:53:42 -- accel/accel.sh@12 -- # build_accel_config 00:07:36.805 09:53:42 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:36.805 09:53:42 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:36.805 09:53:42 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:36.805 09:53:42 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:36.805 09:53:42 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:36.805 09:53:42 -- accel/accel.sh@41 -- # local IFS=, 00:07:36.805 09:53:42 -- accel/accel.sh@42 -- # jq -r . 00:07:36.805 [2024-07-13 09:53:42.447643] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:07:36.805 [2024-07-13 09:53:42.447726] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2704850 ] 00:07:36.805 EAL: No free 2048 kB hugepages reported on node 1 00:07:36.805 [2024-07-13 09:53:42.509204] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:36.805 [2024-07-13 09:53:42.604329] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:36.805 [2024-07-13 09:53:42.604382] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:36.805 [2024-07-13 09:53:42.604435] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:36.805 [2024-07-13 09:53:42.604438] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:37.108 09:53:42 -- accel/accel.sh@21 -- # val= 00:07:37.108 09:53:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.108 09:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:37.108 09:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:37.108 09:53:42 -- accel/accel.sh@21 -- # val= 00:07:37.108 09:53:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.108 09:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:37.108 09:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:37.108 09:53:42 -- accel/accel.sh@21 -- # val= 00:07:37.108 09:53:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.108 09:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:37.108 09:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:37.108 09:53:42 -- accel/accel.sh@21 -- # val=0xf 00:07:37.108 09:53:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.108 09:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:37.108 09:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:37.108 09:53:42 -- accel/accel.sh@21 -- # val= 00:07:37.108 09:53:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.108 09:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:37.108 09:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:37.108 09:53:42 -- accel/accel.sh@21 -- # val= 00:07:37.108 09:53:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.108 09:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:37.108 09:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:37.108 09:53:42 -- accel/accel.sh@21 -- # val=decompress 00:07:37.108 09:53:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.108 09:53:42 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:37.108 09:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:37.108 09:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:37.108 09:53:42 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:37.108 09:53:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.108 09:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:37.108 09:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:37.108 09:53:42 -- accel/accel.sh@21 -- # val= 00:07:37.108 09:53:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.108 09:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:37.108 09:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:37.108 09:53:42 -- accel/accel.sh@21 -- # val=software 00:07:37.108 09:53:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.108 09:53:42 -- accel/accel.sh@23 -- # accel_module=software 00:07:37.108 09:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:37.108 09:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:37.108 09:53:42 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:37.108 09:53:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.108 09:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:37.108 09:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:37.108 09:53:42 -- accel/accel.sh@21 -- # val=32 00:07:37.108 09:53:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.108 09:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:37.108 09:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:37.108 09:53:42 -- accel/accel.sh@21 -- # val=32 00:07:37.108 09:53:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.108 09:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:37.108 09:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:37.108 09:53:42 -- accel/accel.sh@21 -- # val=1 00:07:37.108 09:53:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.108 09:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:37.108 09:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:37.108 09:53:42 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:37.108 09:53:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.108 09:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:37.108 09:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:37.108 09:53:42 -- accel/accel.sh@21 -- # val=Yes 00:07:37.108 09:53:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.108 09:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:37.108 09:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:37.108 09:53:42 -- accel/accel.sh@21 -- # val= 00:07:37.108 09:53:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.108 09:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:37.108 09:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:37.108 09:53:42 -- accel/accel.sh@21 -- # val= 00:07:37.108 09:53:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.108 09:53:42 -- accel/accel.sh@20 -- # IFS=: 00:07:37.108 09:53:42 -- accel/accel.sh@20 -- # read -r var val 00:07:38.040 09:53:43 -- accel/accel.sh@21 -- # val= 00:07:38.040 09:53:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.040 09:53:43 -- accel/accel.sh@20 -- # IFS=: 00:07:38.040 09:53:43 -- accel/accel.sh@20 -- # read -r var val 00:07:38.040 09:53:43 -- accel/accel.sh@21 -- # val= 00:07:38.040 09:53:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.040 09:53:43 -- accel/accel.sh@20 -- # IFS=: 00:07:38.040 09:53:43 -- accel/accel.sh@20 -- # read -r var val 00:07:38.040 09:53:43 -- accel/accel.sh@21 -- # val= 00:07:38.040 09:53:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.040 09:53:43 -- accel/accel.sh@20 -- # IFS=: 00:07:38.040 09:53:43 -- accel/accel.sh@20 -- # read -r var val 00:07:38.040 09:53:43 -- accel/accel.sh@21 -- # val= 00:07:38.040 09:53:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.040 09:53:43 -- accel/accel.sh@20 -- # IFS=: 00:07:38.040 09:53:43 -- accel/accel.sh@20 -- # read -r var val 00:07:38.040 09:53:43 -- accel/accel.sh@21 -- # val= 00:07:38.040 09:53:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.040 09:53:43 -- accel/accel.sh@20 -- # IFS=: 00:07:38.040 09:53:43 -- accel/accel.sh@20 -- # read -r var val 00:07:38.040 09:53:43 -- accel/accel.sh@21 -- # val= 00:07:38.040 09:53:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.040 09:53:43 -- accel/accel.sh@20 -- # IFS=: 00:07:38.040 09:53:43 -- accel/accel.sh@20 -- # read -r var val 00:07:38.040 09:53:43 -- accel/accel.sh@21 -- # val= 00:07:38.040 09:53:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.040 09:53:43 -- accel/accel.sh@20 -- # IFS=: 00:07:38.040 09:53:43 -- accel/accel.sh@20 -- # read -r var val 00:07:38.040 09:53:43 -- accel/accel.sh@21 -- # val= 00:07:38.040 09:53:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.040 09:53:43 -- accel/accel.sh@20 -- # IFS=: 00:07:38.040 09:53:43 -- accel/accel.sh@20 -- # read -r var val 00:07:38.040 09:53:43 -- accel/accel.sh@21 -- # val= 00:07:38.040 09:53:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.040 09:53:43 -- accel/accel.sh@20 -- # IFS=: 00:07:38.040 09:53:43 -- accel/accel.sh@20 -- # read -r var val 00:07:38.040 09:53:43 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:38.040 09:53:43 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:38.040 09:53:43 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:38.040 00:07:38.040 real 0m2.829s 00:07:38.040 user 0m9.414s 00:07:38.040 sys 0m0.304s 00:07:38.040 09:53:43 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:38.040 09:53:43 -- common/autotest_common.sh@10 -- # set +x 00:07:38.040 ************************************ 00:07:38.040 END TEST accel_decomp_mcore 00:07:38.040 ************************************ 00:07:38.298 09:53:43 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:38.299 09:53:43 -- common/autotest_common.sh@1077 -- # '[' 13 -le 1 ']' 00:07:38.299 09:53:43 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:38.299 09:53:43 -- common/autotest_common.sh@10 -- # set +x 00:07:38.299 ************************************ 00:07:38.299 START TEST accel_decomp_full_mcore 00:07:38.299 ************************************ 00:07:38.299 09:53:43 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:38.299 09:53:43 -- accel/accel.sh@16 -- # local accel_opc 00:07:38.299 09:53:43 -- accel/accel.sh@17 -- # local accel_module 00:07:38.299 09:53:43 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:38.299 09:53:43 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:38.299 09:53:43 -- accel/accel.sh@12 -- # build_accel_config 00:07:38.299 09:53:43 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:38.299 09:53:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:38.299 09:53:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:38.299 09:53:43 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:38.299 09:53:43 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:38.299 09:53:43 -- accel/accel.sh@41 -- # local IFS=, 00:07:38.299 09:53:43 -- accel/accel.sh@42 -- # jq -r . 00:07:38.299 [2024-07-13 09:53:43.882863] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:07:38.299 [2024-07-13 09:53:43.883062] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2705012 ] 00:07:38.299 EAL: No free 2048 kB hugepages reported on node 1 00:07:38.299 [2024-07-13 09:53:43.948528] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:38.299 [2024-07-13 09:53:44.047243] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:38.299 [2024-07-13 09:53:44.047299] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:38.299 [2024-07-13 09:53:44.047351] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:38.299 [2024-07-13 09:53:44.047354] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:39.673 09:53:45 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:39.673 00:07:39.673 SPDK Configuration: 00:07:39.673 Core mask: 0xf 00:07:39.673 00:07:39.673 Accel Perf Configuration: 00:07:39.673 Workload Type: decompress 00:07:39.673 Transfer size: 111250 bytes 00:07:39.673 Vector count 1 00:07:39.673 Module: software 00:07:39.673 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:39.673 Queue depth: 32 00:07:39.673 Allocate depth: 32 00:07:39.673 # threads/core: 1 00:07:39.673 Run time: 1 seconds 00:07:39.673 Verify: Yes 00:07:39.673 00:07:39.673 Running for 1 seconds... 00:07:39.673 00:07:39.673 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:39.673 ------------------------------------------------------------------------------------ 00:07:39.673 0,0 3776/s 155 MiB/s 0 0 00:07:39.673 3,0 3776/s 155 MiB/s 0 0 00:07:39.673 2,0 3776/s 155 MiB/s 0 0 00:07:39.673 1,0 3776/s 155 MiB/s 0 0 00:07:39.673 ==================================================================================== 00:07:39.673 Total 15104/s 1602 MiB/s 0 0' 00:07:39.673 09:53:45 -- accel/accel.sh@20 -- # IFS=: 00:07:39.673 09:53:45 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:39.673 09:53:45 -- accel/accel.sh@20 -- # read -r var val 00:07:39.673 09:53:45 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:39.673 09:53:45 -- accel/accel.sh@12 -- # build_accel_config 00:07:39.673 09:53:45 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:39.673 09:53:45 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:39.673 09:53:45 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:39.673 09:53:45 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:39.673 09:53:45 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:39.673 09:53:45 -- accel/accel.sh@41 -- # local IFS=, 00:07:39.673 09:53:45 -- accel/accel.sh@42 -- # jq -r . 00:07:39.673 [2024-07-13 09:53:45.324304] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:07:39.673 [2024-07-13 09:53:45.324388] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2705160 ] 00:07:39.673 EAL: No free 2048 kB hugepages reported on node 1 00:07:39.673 [2024-07-13 09:53:45.386320] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:39.673 [2024-07-13 09:53:45.481719] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:39.673 [2024-07-13 09:53:45.481776] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:39.673 [2024-07-13 09:53:45.481829] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:39.673 [2024-07-13 09:53:45.481832] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:39.931 09:53:45 -- accel/accel.sh@21 -- # val= 00:07:39.931 09:53:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.931 09:53:45 -- accel/accel.sh@20 -- # IFS=: 00:07:39.931 09:53:45 -- accel/accel.sh@20 -- # read -r var val 00:07:39.931 09:53:45 -- accel/accel.sh@21 -- # val= 00:07:39.931 09:53:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.931 09:53:45 -- accel/accel.sh@20 -- # IFS=: 00:07:39.931 09:53:45 -- accel/accel.sh@20 -- # read -r var val 00:07:39.931 09:53:45 -- accel/accel.sh@21 -- # val= 00:07:39.931 09:53:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.931 09:53:45 -- accel/accel.sh@20 -- # IFS=: 00:07:39.931 09:53:45 -- accel/accel.sh@20 -- # read -r var val 00:07:39.931 09:53:45 -- accel/accel.sh@21 -- # val=0xf 00:07:39.931 09:53:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.931 09:53:45 -- accel/accel.sh@20 -- # IFS=: 00:07:39.931 09:53:45 -- accel/accel.sh@20 -- # read -r var val 00:07:39.931 09:53:45 -- accel/accel.sh@21 -- # val= 00:07:39.931 09:53:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.931 09:53:45 -- accel/accel.sh@20 -- # IFS=: 00:07:39.932 09:53:45 -- accel/accel.sh@20 -- # read -r var val 00:07:39.932 09:53:45 -- accel/accel.sh@21 -- # val= 00:07:39.932 09:53:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.932 09:53:45 -- accel/accel.sh@20 -- # IFS=: 00:07:39.932 09:53:45 -- accel/accel.sh@20 -- # read -r var val 00:07:39.932 09:53:45 -- accel/accel.sh@21 -- # val=decompress 00:07:39.932 09:53:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.932 09:53:45 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:39.932 09:53:45 -- accel/accel.sh@20 -- # IFS=: 00:07:39.932 09:53:45 -- accel/accel.sh@20 -- # read -r var val 00:07:39.932 09:53:45 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:39.932 09:53:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.932 09:53:45 -- accel/accel.sh@20 -- # IFS=: 00:07:39.932 09:53:45 -- accel/accel.sh@20 -- # read -r var val 00:07:39.932 09:53:45 -- accel/accel.sh@21 -- # val= 00:07:39.932 09:53:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.932 09:53:45 -- accel/accel.sh@20 -- # IFS=: 00:07:39.932 09:53:45 -- accel/accel.sh@20 -- # read -r var val 00:07:39.932 09:53:45 -- accel/accel.sh@21 -- # val=software 00:07:39.932 09:53:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.932 09:53:45 -- accel/accel.sh@23 -- # accel_module=software 00:07:39.932 09:53:45 -- accel/accel.sh@20 -- # IFS=: 00:07:39.932 09:53:45 -- accel/accel.sh@20 -- # read -r var val 00:07:39.932 09:53:45 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:39.932 09:53:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.932 09:53:45 -- accel/accel.sh@20 -- # IFS=: 00:07:39.932 09:53:45 -- accel/accel.sh@20 -- # read -r var val 00:07:39.932 09:53:45 -- accel/accel.sh@21 -- # val=32 00:07:39.932 09:53:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.932 09:53:45 -- accel/accel.sh@20 -- # IFS=: 00:07:39.932 09:53:45 -- accel/accel.sh@20 -- # read -r var val 00:07:39.932 09:53:45 -- accel/accel.sh@21 -- # val=32 00:07:39.932 09:53:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.932 09:53:45 -- accel/accel.sh@20 -- # IFS=: 00:07:39.932 09:53:45 -- accel/accel.sh@20 -- # read -r var val 00:07:39.932 09:53:45 -- accel/accel.sh@21 -- # val=1 00:07:39.932 09:53:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.932 09:53:45 -- accel/accel.sh@20 -- # IFS=: 00:07:39.932 09:53:45 -- accel/accel.sh@20 -- # read -r var val 00:07:39.932 09:53:45 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:39.932 09:53:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.932 09:53:45 -- accel/accel.sh@20 -- # IFS=: 00:07:39.932 09:53:45 -- accel/accel.sh@20 -- # read -r var val 00:07:39.932 09:53:45 -- accel/accel.sh@21 -- # val=Yes 00:07:39.932 09:53:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.932 09:53:45 -- accel/accel.sh@20 -- # IFS=: 00:07:39.932 09:53:45 -- accel/accel.sh@20 -- # read -r var val 00:07:39.932 09:53:45 -- accel/accel.sh@21 -- # val= 00:07:39.932 09:53:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.932 09:53:45 -- accel/accel.sh@20 -- # IFS=: 00:07:39.932 09:53:45 -- accel/accel.sh@20 -- # read -r var val 00:07:39.932 09:53:45 -- accel/accel.sh@21 -- # val= 00:07:39.932 09:53:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.932 09:53:45 -- accel/accel.sh@20 -- # IFS=: 00:07:39.932 09:53:45 -- accel/accel.sh@20 -- # read -r var val 00:07:41.306 09:53:46 -- accel/accel.sh@21 -- # val= 00:07:41.306 09:53:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.306 09:53:46 -- accel/accel.sh@20 -- # IFS=: 00:07:41.306 09:53:46 -- accel/accel.sh@20 -- # read -r var val 00:07:41.306 09:53:46 -- accel/accel.sh@21 -- # val= 00:07:41.306 09:53:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.306 09:53:46 -- accel/accel.sh@20 -- # IFS=: 00:07:41.306 09:53:46 -- accel/accel.sh@20 -- # read -r var val 00:07:41.306 09:53:46 -- accel/accel.sh@21 -- # val= 00:07:41.306 09:53:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.306 09:53:46 -- accel/accel.sh@20 -- # IFS=: 00:07:41.306 09:53:46 -- accel/accel.sh@20 -- # read -r var val 00:07:41.306 09:53:46 -- accel/accel.sh@21 -- # val= 00:07:41.306 09:53:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.306 09:53:46 -- accel/accel.sh@20 -- # IFS=: 00:07:41.306 09:53:46 -- accel/accel.sh@20 -- # read -r var val 00:07:41.306 09:53:46 -- accel/accel.sh@21 -- # val= 00:07:41.306 09:53:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.306 09:53:46 -- accel/accel.sh@20 -- # IFS=: 00:07:41.306 09:53:46 -- accel/accel.sh@20 -- # read -r var val 00:07:41.306 09:53:46 -- accel/accel.sh@21 -- # val= 00:07:41.306 09:53:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.306 09:53:46 -- accel/accel.sh@20 -- # IFS=: 00:07:41.306 09:53:46 -- accel/accel.sh@20 -- # read -r var val 00:07:41.306 09:53:46 -- accel/accel.sh@21 -- # val= 00:07:41.306 09:53:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.306 09:53:46 -- accel/accel.sh@20 -- # IFS=: 00:07:41.306 09:53:46 -- accel/accel.sh@20 -- # read -r var val 00:07:41.306 09:53:46 -- accel/accel.sh@21 -- # val= 00:07:41.306 09:53:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.306 09:53:46 -- accel/accel.sh@20 -- # IFS=: 00:07:41.306 09:53:46 -- accel/accel.sh@20 -- # read -r var val 00:07:41.306 09:53:46 -- accel/accel.sh@21 -- # val= 00:07:41.306 09:53:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.306 09:53:46 -- accel/accel.sh@20 -- # IFS=: 00:07:41.306 09:53:46 -- accel/accel.sh@20 -- # read -r var val 00:07:41.306 09:53:46 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:41.306 09:53:46 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:41.306 09:53:46 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:41.307 00:07:41.307 real 0m2.870s 00:07:41.307 user 0m9.525s 00:07:41.307 sys 0m0.321s 00:07:41.307 09:53:46 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:41.307 09:53:46 -- common/autotest_common.sh@10 -- # set +x 00:07:41.307 ************************************ 00:07:41.307 END TEST accel_decomp_full_mcore 00:07:41.307 ************************************ 00:07:41.307 09:53:46 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:41.307 09:53:46 -- common/autotest_common.sh@1077 -- # '[' 11 -le 1 ']' 00:07:41.307 09:53:46 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:41.307 09:53:46 -- common/autotest_common.sh@10 -- # set +x 00:07:41.307 ************************************ 00:07:41.307 START TEST accel_decomp_mthread 00:07:41.307 ************************************ 00:07:41.307 09:53:46 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:41.307 09:53:46 -- accel/accel.sh@16 -- # local accel_opc 00:07:41.307 09:53:46 -- accel/accel.sh@17 -- # local accel_module 00:07:41.307 09:53:46 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:41.307 09:53:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:41.307 09:53:46 -- accel/accel.sh@12 -- # build_accel_config 00:07:41.307 09:53:46 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:41.307 09:53:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:41.307 09:53:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:41.307 09:53:46 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:41.307 09:53:46 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:41.307 09:53:46 -- accel/accel.sh@41 -- # local IFS=, 00:07:41.307 09:53:46 -- accel/accel.sh@42 -- # jq -r . 00:07:41.307 [2024-07-13 09:53:46.779540] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:07:41.307 [2024-07-13 09:53:46.779621] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2705435 ] 00:07:41.307 EAL: No free 2048 kB hugepages reported on node 1 00:07:41.307 [2024-07-13 09:53:46.840469] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:41.307 [2024-07-13 09:53:46.933447] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:42.681 09:53:48 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:42.681 00:07:42.681 SPDK Configuration: 00:07:42.681 Core mask: 0x1 00:07:42.681 00:07:42.681 Accel Perf Configuration: 00:07:42.681 Workload Type: decompress 00:07:42.681 Transfer size: 4096 bytes 00:07:42.681 Vector count 1 00:07:42.681 Module: software 00:07:42.681 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:42.681 Queue depth: 32 00:07:42.681 Allocate depth: 32 00:07:42.681 # threads/core: 2 00:07:42.681 Run time: 1 seconds 00:07:42.681 Verify: Yes 00:07:42.681 00:07:42.681 Running for 1 seconds... 00:07:42.681 00:07:42.681 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:42.681 ------------------------------------------------------------------------------------ 00:07:42.681 0,1 28064/s 51 MiB/s 0 0 00:07:42.681 0,0 27968/s 51 MiB/s 0 0 00:07:42.681 ==================================================================================== 00:07:42.681 Total 56032/s 218 MiB/s 0 0' 00:07:42.681 09:53:48 -- accel/accel.sh@20 -- # IFS=: 00:07:42.681 09:53:48 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:42.681 09:53:48 -- accel/accel.sh@20 -- # read -r var val 00:07:42.681 09:53:48 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:42.681 09:53:48 -- accel/accel.sh@12 -- # build_accel_config 00:07:42.681 09:53:48 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:42.681 09:53:48 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:42.681 09:53:48 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:42.681 09:53:48 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:42.681 09:53:48 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:42.681 09:53:48 -- accel/accel.sh@41 -- # local IFS=, 00:07:42.681 09:53:48 -- accel/accel.sh@42 -- # jq -r . 00:07:42.681 [2024-07-13 09:53:48.187190] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:07:42.681 [2024-07-13 09:53:48.187274] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2705586 ] 00:07:42.681 EAL: No free 2048 kB hugepages reported on node 1 00:07:42.681 [2024-07-13 09:53:48.247814] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:42.681 [2024-07-13 09:53:48.339849] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:42.681 09:53:48 -- accel/accel.sh@21 -- # val= 00:07:42.681 09:53:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.681 09:53:48 -- accel/accel.sh@20 -- # IFS=: 00:07:42.681 09:53:48 -- accel/accel.sh@20 -- # read -r var val 00:07:42.681 09:53:48 -- accel/accel.sh@21 -- # val= 00:07:42.681 09:53:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.681 09:53:48 -- accel/accel.sh@20 -- # IFS=: 00:07:42.682 09:53:48 -- accel/accel.sh@20 -- # read -r var val 00:07:42.682 09:53:48 -- accel/accel.sh@21 -- # val= 00:07:42.682 09:53:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.682 09:53:48 -- accel/accel.sh@20 -- # IFS=: 00:07:42.682 09:53:48 -- accel/accel.sh@20 -- # read -r var val 00:07:42.682 09:53:48 -- accel/accel.sh@21 -- # val=0x1 00:07:42.682 09:53:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.682 09:53:48 -- accel/accel.sh@20 -- # IFS=: 00:07:42.682 09:53:48 -- accel/accel.sh@20 -- # read -r var val 00:07:42.682 09:53:48 -- accel/accel.sh@21 -- # val= 00:07:42.682 09:53:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.682 09:53:48 -- accel/accel.sh@20 -- # IFS=: 00:07:42.682 09:53:48 -- accel/accel.sh@20 -- # read -r var val 00:07:42.682 09:53:48 -- accel/accel.sh@21 -- # val= 00:07:42.682 09:53:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.682 09:53:48 -- accel/accel.sh@20 -- # IFS=: 00:07:42.682 09:53:48 -- accel/accel.sh@20 -- # read -r var val 00:07:42.682 09:53:48 -- accel/accel.sh@21 -- # val=decompress 00:07:42.682 09:53:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.682 09:53:48 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:42.682 09:53:48 -- accel/accel.sh@20 -- # IFS=: 00:07:42.682 09:53:48 -- accel/accel.sh@20 -- # read -r var val 00:07:42.682 09:53:48 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:42.682 09:53:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.682 09:53:48 -- accel/accel.sh@20 -- # IFS=: 00:07:42.682 09:53:48 -- accel/accel.sh@20 -- # read -r var val 00:07:42.682 09:53:48 -- accel/accel.sh@21 -- # val= 00:07:42.682 09:53:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.682 09:53:48 -- accel/accel.sh@20 -- # IFS=: 00:07:42.682 09:53:48 -- accel/accel.sh@20 -- # read -r var val 00:07:42.682 09:53:48 -- accel/accel.sh@21 -- # val=software 00:07:42.682 09:53:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.682 09:53:48 -- accel/accel.sh@23 -- # accel_module=software 00:07:42.682 09:53:48 -- accel/accel.sh@20 -- # IFS=: 00:07:42.682 09:53:48 -- accel/accel.sh@20 -- # read -r var val 00:07:42.682 09:53:48 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:42.682 09:53:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.682 09:53:48 -- accel/accel.sh@20 -- # IFS=: 00:07:42.682 09:53:48 -- accel/accel.sh@20 -- # read -r var val 00:07:42.682 09:53:48 -- accel/accel.sh@21 -- # val=32 00:07:42.682 09:53:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.682 09:53:48 -- accel/accel.sh@20 -- # IFS=: 00:07:42.682 09:53:48 -- accel/accel.sh@20 -- # read -r var val 00:07:42.682 09:53:48 -- accel/accel.sh@21 -- # val=32 00:07:42.682 09:53:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.682 09:53:48 -- accel/accel.sh@20 -- # IFS=: 00:07:42.682 09:53:48 -- accel/accel.sh@20 -- # read -r var val 00:07:42.682 09:53:48 -- accel/accel.sh@21 -- # val=2 00:07:42.682 09:53:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.682 09:53:48 -- accel/accel.sh@20 -- # IFS=: 00:07:42.682 09:53:48 -- accel/accel.sh@20 -- # read -r var val 00:07:42.682 09:53:48 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:42.682 09:53:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.682 09:53:48 -- accel/accel.sh@20 -- # IFS=: 00:07:42.682 09:53:48 -- accel/accel.sh@20 -- # read -r var val 00:07:42.682 09:53:48 -- accel/accel.sh@21 -- # val=Yes 00:07:42.682 09:53:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.682 09:53:48 -- accel/accel.sh@20 -- # IFS=: 00:07:42.682 09:53:48 -- accel/accel.sh@20 -- # read -r var val 00:07:42.682 09:53:48 -- accel/accel.sh@21 -- # val= 00:07:42.682 09:53:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.682 09:53:48 -- accel/accel.sh@20 -- # IFS=: 00:07:42.682 09:53:48 -- accel/accel.sh@20 -- # read -r var val 00:07:42.682 09:53:48 -- accel/accel.sh@21 -- # val= 00:07:42.682 09:53:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.682 09:53:48 -- accel/accel.sh@20 -- # IFS=: 00:07:42.682 09:53:48 -- accel/accel.sh@20 -- # read -r var val 00:07:44.057 09:53:49 -- accel/accel.sh@21 -- # val= 00:07:44.057 09:53:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.057 09:53:49 -- accel/accel.sh@20 -- # IFS=: 00:07:44.057 09:53:49 -- accel/accel.sh@20 -- # read -r var val 00:07:44.057 09:53:49 -- accel/accel.sh@21 -- # val= 00:07:44.057 09:53:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.057 09:53:49 -- accel/accel.sh@20 -- # IFS=: 00:07:44.057 09:53:49 -- accel/accel.sh@20 -- # read -r var val 00:07:44.057 09:53:49 -- accel/accel.sh@21 -- # val= 00:07:44.057 09:53:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.057 09:53:49 -- accel/accel.sh@20 -- # IFS=: 00:07:44.057 09:53:49 -- accel/accel.sh@20 -- # read -r var val 00:07:44.057 09:53:49 -- accel/accel.sh@21 -- # val= 00:07:44.057 09:53:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.057 09:53:49 -- accel/accel.sh@20 -- # IFS=: 00:07:44.057 09:53:49 -- accel/accel.sh@20 -- # read -r var val 00:07:44.057 09:53:49 -- accel/accel.sh@21 -- # val= 00:07:44.057 09:53:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.057 09:53:49 -- accel/accel.sh@20 -- # IFS=: 00:07:44.057 09:53:49 -- accel/accel.sh@20 -- # read -r var val 00:07:44.057 09:53:49 -- accel/accel.sh@21 -- # val= 00:07:44.057 09:53:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.057 09:53:49 -- accel/accel.sh@20 -- # IFS=: 00:07:44.057 09:53:49 -- accel/accel.sh@20 -- # read -r var val 00:07:44.057 09:53:49 -- accel/accel.sh@21 -- # val= 00:07:44.057 09:53:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.057 09:53:49 -- accel/accel.sh@20 -- # IFS=: 00:07:44.057 09:53:49 -- accel/accel.sh@20 -- # read -r var val 00:07:44.057 09:53:49 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:44.057 09:53:49 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:44.057 09:53:49 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:44.057 00:07:44.057 real 0m2.808s 00:07:44.057 user 0m2.510s 00:07:44.057 sys 0m0.291s 00:07:44.057 09:53:49 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:44.057 09:53:49 -- common/autotest_common.sh@10 -- # set +x 00:07:44.057 ************************************ 00:07:44.057 END TEST accel_decomp_mthread 00:07:44.057 ************************************ 00:07:44.057 09:53:49 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:44.057 09:53:49 -- common/autotest_common.sh@1077 -- # '[' 13 -le 1 ']' 00:07:44.057 09:53:49 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:44.057 09:53:49 -- common/autotest_common.sh@10 -- # set +x 00:07:44.057 ************************************ 00:07:44.057 START TEST accel_deomp_full_mthread 00:07:44.057 ************************************ 00:07:44.057 09:53:49 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:44.057 09:53:49 -- accel/accel.sh@16 -- # local accel_opc 00:07:44.057 09:53:49 -- accel/accel.sh@17 -- # local accel_module 00:07:44.057 09:53:49 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:44.057 09:53:49 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:44.057 09:53:49 -- accel/accel.sh@12 -- # build_accel_config 00:07:44.057 09:53:49 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:44.057 09:53:49 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:44.057 09:53:49 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:44.057 09:53:49 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:44.057 09:53:49 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:44.057 09:53:49 -- accel/accel.sh@41 -- # local IFS=, 00:07:44.057 09:53:49 -- accel/accel.sh@42 -- # jq -r . 00:07:44.057 [2024-07-13 09:53:49.613102] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:07:44.057 [2024-07-13 09:53:49.613180] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2705744 ] 00:07:44.057 EAL: No free 2048 kB hugepages reported on node 1 00:07:44.057 [2024-07-13 09:53:49.677758] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:44.057 [2024-07-13 09:53:49.771372] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:45.430 09:53:51 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:45.431 00:07:45.431 SPDK Configuration: 00:07:45.431 Core mask: 0x1 00:07:45.431 00:07:45.431 Accel Perf Configuration: 00:07:45.431 Workload Type: decompress 00:07:45.431 Transfer size: 111250 bytes 00:07:45.431 Vector count 1 00:07:45.431 Module: software 00:07:45.431 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:45.431 Queue depth: 32 00:07:45.431 Allocate depth: 32 00:07:45.431 # threads/core: 2 00:07:45.431 Run time: 1 seconds 00:07:45.431 Verify: Yes 00:07:45.431 00:07:45.431 Running for 1 seconds... 00:07:45.431 00:07:45.431 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:45.431 ------------------------------------------------------------------------------------ 00:07:45.431 0,1 1920/s 79 MiB/s 0 0 00:07:45.431 0,0 1920/s 79 MiB/s 0 0 00:07:45.431 ==================================================================================== 00:07:45.431 Total 3840/s 407 MiB/s 0 0' 00:07:45.431 09:53:51 -- accel/accel.sh@20 -- # IFS=: 00:07:45.431 09:53:51 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:45.431 09:53:51 -- accel/accel.sh@20 -- # read -r var val 00:07:45.431 09:53:51 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:45.431 09:53:51 -- accel/accel.sh@12 -- # build_accel_config 00:07:45.431 09:53:51 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:45.431 09:53:51 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:45.431 09:53:51 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:45.431 09:53:51 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:45.431 09:53:51 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:45.431 09:53:51 -- accel/accel.sh@41 -- # local IFS=, 00:07:45.431 09:53:51 -- accel/accel.sh@42 -- # jq -r . 00:07:45.431 [2024-07-13 09:53:51.059856] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:07:45.431 [2024-07-13 09:53:51.060050] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2705890 ] 00:07:45.431 EAL: No free 2048 kB hugepages reported on node 1 00:07:45.431 [2024-07-13 09:53:51.121429] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:45.431 [2024-07-13 09:53:51.213265] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:45.690 09:53:51 -- accel/accel.sh@21 -- # val= 00:07:45.690 09:53:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.690 09:53:51 -- accel/accel.sh@20 -- # IFS=: 00:07:45.690 09:53:51 -- accel/accel.sh@20 -- # read -r var val 00:07:45.690 09:53:51 -- accel/accel.sh@21 -- # val= 00:07:45.690 09:53:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.690 09:53:51 -- accel/accel.sh@20 -- # IFS=: 00:07:45.690 09:53:51 -- accel/accel.sh@20 -- # read -r var val 00:07:45.690 09:53:51 -- accel/accel.sh@21 -- # val= 00:07:45.690 09:53:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.690 09:53:51 -- accel/accel.sh@20 -- # IFS=: 00:07:45.690 09:53:51 -- accel/accel.sh@20 -- # read -r var val 00:07:45.690 09:53:51 -- accel/accel.sh@21 -- # val=0x1 00:07:45.690 09:53:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.690 09:53:51 -- accel/accel.sh@20 -- # IFS=: 00:07:45.690 09:53:51 -- accel/accel.sh@20 -- # read -r var val 00:07:45.690 09:53:51 -- accel/accel.sh@21 -- # val= 00:07:45.690 09:53:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.690 09:53:51 -- accel/accel.sh@20 -- # IFS=: 00:07:45.690 09:53:51 -- accel/accel.sh@20 -- # read -r var val 00:07:45.690 09:53:51 -- accel/accel.sh@21 -- # val= 00:07:45.690 09:53:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.690 09:53:51 -- accel/accel.sh@20 -- # IFS=: 00:07:45.690 09:53:51 -- accel/accel.sh@20 -- # read -r var val 00:07:45.690 09:53:51 -- accel/accel.sh@21 -- # val=decompress 00:07:45.690 09:53:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.690 09:53:51 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:45.690 09:53:51 -- accel/accel.sh@20 -- # IFS=: 00:07:45.690 09:53:51 -- accel/accel.sh@20 -- # read -r var val 00:07:45.690 09:53:51 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:45.690 09:53:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.690 09:53:51 -- accel/accel.sh@20 -- # IFS=: 00:07:45.690 09:53:51 -- accel/accel.sh@20 -- # read -r var val 00:07:45.690 09:53:51 -- accel/accel.sh@21 -- # val= 00:07:45.690 09:53:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.690 09:53:51 -- accel/accel.sh@20 -- # IFS=: 00:07:45.690 09:53:51 -- accel/accel.sh@20 -- # read -r var val 00:07:45.690 09:53:51 -- accel/accel.sh@21 -- # val=software 00:07:45.690 09:53:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.690 09:53:51 -- accel/accel.sh@23 -- # accel_module=software 00:07:45.690 09:53:51 -- accel/accel.sh@20 -- # IFS=: 00:07:45.690 09:53:51 -- accel/accel.sh@20 -- # read -r var val 00:07:45.690 09:53:51 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:45.690 09:53:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.690 09:53:51 -- accel/accel.sh@20 -- # IFS=: 00:07:45.690 09:53:51 -- accel/accel.sh@20 -- # read -r var val 00:07:45.690 09:53:51 -- accel/accel.sh@21 -- # val=32 00:07:45.690 09:53:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.690 09:53:51 -- accel/accel.sh@20 -- # IFS=: 00:07:45.690 09:53:51 -- accel/accel.sh@20 -- # read -r var val 00:07:45.690 09:53:51 -- accel/accel.sh@21 -- # val=32 00:07:45.690 09:53:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.690 09:53:51 -- accel/accel.sh@20 -- # IFS=: 00:07:45.690 09:53:51 -- accel/accel.sh@20 -- # read -r var val 00:07:45.690 09:53:51 -- accel/accel.sh@21 -- # val=2 00:07:45.690 09:53:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.690 09:53:51 -- accel/accel.sh@20 -- # IFS=: 00:07:45.690 09:53:51 -- accel/accel.sh@20 -- # read -r var val 00:07:45.690 09:53:51 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:45.690 09:53:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.690 09:53:51 -- accel/accel.sh@20 -- # IFS=: 00:07:45.690 09:53:51 -- accel/accel.sh@20 -- # read -r var val 00:07:45.690 09:53:51 -- accel/accel.sh@21 -- # val=Yes 00:07:45.690 09:53:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.690 09:53:51 -- accel/accel.sh@20 -- # IFS=: 00:07:45.690 09:53:51 -- accel/accel.sh@20 -- # read -r var val 00:07:45.690 09:53:51 -- accel/accel.sh@21 -- # val= 00:07:45.690 09:53:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.690 09:53:51 -- accel/accel.sh@20 -- # IFS=: 00:07:45.690 09:53:51 -- accel/accel.sh@20 -- # read -r var val 00:07:45.690 09:53:51 -- accel/accel.sh@21 -- # val= 00:07:45.690 09:53:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.690 09:53:51 -- accel/accel.sh@20 -- # IFS=: 00:07:45.690 09:53:51 -- accel/accel.sh@20 -- # read -r var val 00:07:47.065 09:53:52 -- accel/accel.sh@21 -- # val= 00:07:47.065 09:53:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.065 09:53:52 -- accel/accel.sh@20 -- # IFS=: 00:07:47.065 09:53:52 -- accel/accel.sh@20 -- # read -r var val 00:07:47.065 09:53:52 -- accel/accel.sh@21 -- # val= 00:07:47.065 09:53:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.065 09:53:52 -- accel/accel.sh@20 -- # IFS=: 00:07:47.065 09:53:52 -- accel/accel.sh@20 -- # read -r var val 00:07:47.065 09:53:52 -- accel/accel.sh@21 -- # val= 00:07:47.065 09:53:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.065 09:53:52 -- accel/accel.sh@20 -- # IFS=: 00:07:47.065 09:53:52 -- accel/accel.sh@20 -- # read -r var val 00:07:47.065 09:53:52 -- accel/accel.sh@21 -- # val= 00:07:47.065 09:53:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.065 09:53:52 -- accel/accel.sh@20 -- # IFS=: 00:07:47.065 09:53:52 -- accel/accel.sh@20 -- # read -r var val 00:07:47.065 09:53:52 -- accel/accel.sh@21 -- # val= 00:07:47.065 09:53:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.065 09:53:52 -- accel/accel.sh@20 -- # IFS=: 00:07:47.065 09:53:52 -- accel/accel.sh@20 -- # read -r var val 00:07:47.065 09:53:52 -- accel/accel.sh@21 -- # val= 00:07:47.065 09:53:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.065 09:53:52 -- accel/accel.sh@20 -- # IFS=: 00:07:47.065 09:53:52 -- accel/accel.sh@20 -- # read -r var val 00:07:47.065 09:53:52 -- accel/accel.sh@21 -- # val= 00:07:47.065 09:53:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.065 09:53:52 -- accel/accel.sh@20 -- # IFS=: 00:07:47.065 09:53:52 -- accel/accel.sh@20 -- # read -r var val 00:07:47.065 09:53:52 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:47.065 09:53:52 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:47.065 09:53:52 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:47.065 00:07:47.065 real 0m2.897s 00:07:47.065 user 0m2.605s 00:07:47.065 sys 0m0.286s 00:07:47.065 09:53:52 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:47.065 09:53:52 -- common/autotest_common.sh@10 -- # set +x 00:07:47.065 ************************************ 00:07:47.065 END TEST accel_deomp_full_mthread 00:07:47.065 ************************************ 00:07:47.065 09:53:52 -- accel/accel.sh@116 -- # [[ n == y ]] 00:07:47.065 09:53:52 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:47.065 09:53:52 -- accel/accel.sh@129 -- # build_accel_config 00:07:47.065 09:53:52 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:47.065 09:53:52 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:07:47.065 09:53:52 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:47.065 09:53:52 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:47.065 09:53:52 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:47.065 09:53:52 -- common/autotest_common.sh@10 -- # set +x 00:07:47.065 09:53:52 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:47.065 09:53:52 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:47.065 09:53:52 -- accel/accel.sh@41 -- # local IFS=, 00:07:47.065 09:53:52 -- accel/accel.sh@42 -- # jq -r . 00:07:47.065 ************************************ 00:07:47.065 START TEST accel_dif_functional_tests 00:07:47.065 ************************************ 00:07:47.065 09:53:52 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:47.065 [2024-07-13 09:53:52.558635] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:07:47.065 [2024-07-13 09:53:52.558721] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2706163 ] 00:07:47.065 EAL: No free 2048 kB hugepages reported on node 1 00:07:47.065 [2024-07-13 09:53:52.619091] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:47.065 [2024-07-13 09:53:52.713264] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:47.065 [2024-07-13 09:53:52.713320] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:47.065 [2024-07-13 09:53:52.713323] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:47.065 00:07:47.065 00:07:47.065 CUnit - A unit testing framework for C - Version 2.1-3 00:07:47.065 http://cunit.sourceforge.net/ 00:07:47.065 00:07:47.065 00:07:47.065 Suite: accel_dif 00:07:47.065 Test: verify: DIF generated, GUARD check ...passed 00:07:47.065 Test: verify: DIF generated, APPTAG check ...passed 00:07:47.065 Test: verify: DIF generated, REFTAG check ...passed 00:07:47.065 Test: verify: DIF not generated, GUARD check ...[2024-07-13 09:53:52.811681] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:47.065 [2024-07-13 09:53:52.811753] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:47.065 passed 00:07:47.065 Test: verify: DIF not generated, APPTAG check ...[2024-07-13 09:53:52.811797] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:47.065 [2024-07-13 09:53:52.811827] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:47.065 passed 00:07:47.065 Test: verify: DIF not generated, REFTAG check ...[2024-07-13 09:53:52.811860] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:47.065 [2024-07-13 09:53:52.811900] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:47.065 passed 00:07:47.065 Test: verify: APPTAG correct, APPTAG check ...passed 00:07:47.065 Test: verify: APPTAG incorrect, APPTAG check ...[2024-07-13 09:53:52.811970] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:07:47.065 passed 00:07:47.065 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:07:47.065 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:07:47.065 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:07:47.065 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-07-13 09:53:52.812124] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:07:47.065 passed 00:07:47.065 Test: generate copy: DIF generated, GUARD check ...passed 00:07:47.065 Test: generate copy: DIF generated, APTTAG check ...passed 00:07:47.065 Test: generate copy: DIF generated, REFTAG check ...passed 00:07:47.065 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:07:47.065 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:07:47.065 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:07:47.065 Test: generate copy: iovecs-len validate ...[2024-07-13 09:53:52.812382] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:07:47.065 passed 00:07:47.065 Test: generate copy: buffer alignment validate ...passed 00:07:47.065 00:07:47.065 Run Summary: Type Total Ran Passed Failed Inactive 00:07:47.065 suites 1 1 n/a 0 0 00:07:47.065 tests 20 20 20 0 0 00:07:47.065 asserts 204 204 204 0 n/a 00:07:47.065 00:07:47.065 Elapsed time = 0.003 seconds 00:07:47.322 00:07:47.322 real 0m0.502s 00:07:47.322 user 0m0.787s 00:07:47.322 sys 0m0.186s 00:07:47.322 09:53:53 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:47.322 09:53:53 -- common/autotest_common.sh@10 -- # set +x 00:07:47.322 ************************************ 00:07:47.322 END TEST accel_dif_functional_tests 00:07:47.322 ************************************ 00:07:47.322 00:07:47.322 real 0m59.888s 00:07:47.322 user 1m7.717s 00:07:47.322 sys 0m7.236s 00:07:47.322 09:53:53 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:47.322 09:53:53 -- common/autotest_common.sh@10 -- # set +x 00:07:47.322 ************************************ 00:07:47.322 END TEST accel 00:07:47.322 ************************************ 00:07:47.323 09:53:53 -- spdk/autotest.sh@190 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:07:47.323 09:53:53 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:07:47.323 09:53:53 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:47.323 09:53:53 -- common/autotest_common.sh@10 -- # set +x 00:07:47.323 ************************************ 00:07:47.323 START TEST accel_rpc 00:07:47.323 ************************************ 00:07:47.323 09:53:53 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:07:47.323 * Looking for test storage... 00:07:47.323 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:07:47.323 09:53:53 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:07:47.323 09:53:53 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=2706238 00:07:47.323 09:53:53 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:07:47.323 09:53:53 -- accel/accel_rpc.sh@15 -- # waitforlisten 2706238 00:07:47.323 09:53:53 -- common/autotest_common.sh@819 -- # '[' -z 2706238 ']' 00:07:47.323 09:53:53 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:47.323 09:53:53 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:47.323 09:53:53 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:47.323 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:47.323 09:53:53 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:47.323 09:53:53 -- common/autotest_common.sh@10 -- # set +x 00:07:47.579 [2024-07-13 09:53:53.168994] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:07:47.579 [2024-07-13 09:53:53.169087] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2706238 ] 00:07:47.579 EAL: No free 2048 kB hugepages reported on node 1 00:07:47.579 [2024-07-13 09:53:53.225187] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:47.579 [2024-07-13 09:53:53.307219] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:47.579 [2024-07-13 09:53:53.307389] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:47.579 09:53:53 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:47.579 09:53:53 -- common/autotest_common.sh@852 -- # return 0 00:07:47.579 09:53:53 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:07:47.579 09:53:53 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:07:47.579 09:53:53 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:07:47.579 09:53:53 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:07:47.579 09:53:53 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:07:47.579 09:53:53 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:07:47.579 09:53:53 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:47.579 09:53:53 -- common/autotest_common.sh@10 -- # set +x 00:07:47.579 ************************************ 00:07:47.579 START TEST accel_assign_opcode 00:07:47.579 ************************************ 00:07:47.579 09:53:53 -- common/autotest_common.sh@1104 -- # accel_assign_opcode_test_suite 00:07:47.579 09:53:53 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:07:47.579 09:53:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:47.579 09:53:53 -- common/autotest_common.sh@10 -- # set +x 00:07:47.579 [2024-07-13 09:53:53.371993] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:07:47.579 09:53:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:47.579 09:53:53 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:07:47.579 09:53:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:47.579 09:53:53 -- common/autotest_common.sh@10 -- # set +x 00:07:47.579 [2024-07-13 09:53:53.380023] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:07:47.579 09:53:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:47.579 09:53:53 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:07:47.579 09:53:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:47.579 09:53:53 -- common/autotest_common.sh@10 -- # set +x 00:07:47.836 09:53:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:47.836 09:53:53 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:07:47.836 09:53:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:47.836 09:53:53 -- common/autotest_common.sh@10 -- # set +x 00:07:47.836 09:53:53 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:07:47.836 09:53:53 -- accel/accel_rpc.sh@42 -- # grep software 00:07:47.836 09:53:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:48.095 software 00:07:48.095 00:07:48.095 real 0m0.291s 00:07:48.095 user 0m0.038s 00:07:48.095 sys 0m0.009s 00:07:48.095 09:53:53 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:48.095 09:53:53 -- common/autotest_common.sh@10 -- # set +x 00:07:48.095 ************************************ 00:07:48.095 END TEST accel_assign_opcode 00:07:48.095 ************************************ 00:07:48.095 09:53:53 -- accel/accel_rpc.sh@55 -- # killprocess 2706238 00:07:48.095 09:53:53 -- common/autotest_common.sh@926 -- # '[' -z 2706238 ']' 00:07:48.095 09:53:53 -- common/autotest_common.sh@930 -- # kill -0 2706238 00:07:48.095 09:53:53 -- common/autotest_common.sh@931 -- # uname 00:07:48.095 09:53:53 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:07:48.095 09:53:53 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2706238 00:07:48.095 09:53:53 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:07:48.095 09:53:53 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:07:48.095 09:53:53 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2706238' 00:07:48.095 killing process with pid 2706238 00:07:48.095 09:53:53 -- common/autotest_common.sh@945 -- # kill 2706238 00:07:48.095 09:53:53 -- common/autotest_common.sh@950 -- # wait 2706238 00:07:48.354 00:07:48.354 real 0m1.044s 00:07:48.354 user 0m0.985s 00:07:48.354 sys 0m0.387s 00:07:48.354 09:53:54 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:48.354 09:53:54 -- common/autotest_common.sh@10 -- # set +x 00:07:48.354 ************************************ 00:07:48.354 END TEST accel_rpc 00:07:48.354 ************************************ 00:07:48.354 09:53:54 -- spdk/autotest.sh@191 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:07:48.354 09:53:54 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:07:48.354 09:53:54 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:48.354 09:53:54 -- common/autotest_common.sh@10 -- # set +x 00:07:48.354 ************************************ 00:07:48.354 START TEST app_cmdline 00:07:48.354 ************************************ 00:07:48.354 09:53:54 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:07:48.612 * Looking for test storage... 00:07:48.612 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:48.612 09:53:54 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:07:48.612 09:53:54 -- app/cmdline.sh@17 -- # spdk_tgt_pid=2706442 00:07:48.612 09:53:54 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:07:48.612 09:53:54 -- app/cmdline.sh@18 -- # waitforlisten 2706442 00:07:48.612 09:53:54 -- common/autotest_common.sh@819 -- # '[' -z 2706442 ']' 00:07:48.612 09:53:54 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:48.612 09:53:54 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:48.612 09:53:54 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:48.612 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:48.612 09:53:54 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:48.612 09:53:54 -- common/autotest_common.sh@10 -- # set +x 00:07:48.612 [2024-07-13 09:53:54.235253] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:07:48.612 [2024-07-13 09:53:54.235344] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2706442 ] 00:07:48.612 EAL: No free 2048 kB hugepages reported on node 1 00:07:48.612 [2024-07-13 09:53:54.291366] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:48.612 [2024-07-13 09:53:54.373012] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:48.612 [2024-07-13 09:53:54.373164] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:49.547 09:53:55 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:49.547 09:53:55 -- common/autotest_common.sh@852 -- # return 0 00:07:49.547 09:53:55 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:07:49.805 { 00:07:49.805 "version": "SPDK v24.01.1-pre git sha1 4b94202c6", 00:07:49.805 "fields": { 00:07:49.805 "major": 24, 00:07:49.805 "minor": 1, 00:07:49.805 "patch": 1, 00:07:49.805 "suffix": "-pre", 00:07:49.805 "commit": "4b94202c6" 00:07:49.805 } 00:07:49.805 } 00:07:49.805 09:53:55 -- app/cmdline.sh@22 -- # expected_methods=() 00:07:49.805 09:53:55 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:07:49.805 09:53:55 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:07:49.805 09:53:55 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:07:49.805 09:53:55 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:07:49.805 09:53:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:49.805 09:53:55 -- common/autotest_common.sh@10 -- # set +x 00:07:49.805 09:53:55 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:07:49.805 09:53:55 -- app/cmdline.sh@26 -- # sort 00:07:49.805 09:53:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:49.805 09:53:55 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:07:49.805 09:53:55 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:07:49.805 09:53:55 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:49.805 09:53:55 -- common/autotest_common.sh@640 -- # local es=0 00:07:49.805 09:53:55 -- common/autotest_common.sh@642 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:49.805 09:53:55 -- common/autotest_common.sh@628 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:49.805 09:53:55 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:07:49.805 09:53:55 -- common/autotest_common.sh@632 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:49.805 09:53:55 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:07:49.805 09:53:55 -- common/autotest_common.sh@634 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:49.805 09:53:55 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:07:49.805 09:53:55 -- common/autotest_common.sh@634 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:49.805 09:53:55 -- common/autotest_common.sh@634 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:07:49.805 09:53:55 -- common/autotest_common.sh@643 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:50.086 request: 00:07:50.086 { 00:07:50.086 "method": "env_dpdk_get_mem_stats", 00:07:50.086 "req_id": 1 00:07:50.086 } 00:07:50.086 Got JSON-RPC error response 00:07:50.086 response: 00:07:50.086 { 00:07:50.086 "code": -32601, 00:07:50.086 "message": "Method not found" 00:07:50.086 } 00:07:50.086 09:53:55 -- common/autotest_common.sh@643 -- # es=1 00:07:50.086 09:53:55 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:07:50.086 09:53:55 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:07:50.086 09:53:55 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:07:50.086 09:53:55 -- app/cmdline.sh@1 -- # killprocess 2706442 00:07:50.086 09:53:55 -- common/autotest_common.sh@926 -- # '[' -z 2706442 ']' 00:07:50.086 09:53:55 -- common/autotest_common.sh@930 -- # kill -0 2706442 00:07:50.086 09:53:55 -- common/autotest_common.sh@931 -- # uname 00:07:50.086 09:53:55 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:07:50.086 09:53:55 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2706442 00:07:50.086 09:53:55 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:07:50.086 09:53:55 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:07:50.086 09:53:55 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2706442' 00:07:50.086 killing process with pid 2706442 00:07:50.086 09:53:55 -- common/autotest_common.sh@945 -- # kill 2706442 00:07:50.086 09:53:55 -- common/autotest_common.sh@950 -- # wait 2706442 00:07:50.344 00:07:50.344 real 0m2.007s 00:07:50.344 user 0m2.521s 00:07:50.344 sys 0m0.486s 00:07:50.344 09:53:56 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:50.344 09:53:56 -- common/autotest_common.sh@10 -- # set +x 00:07:50.344 ************************************ 00:07:50.344 END TEST app_cmdline 00:07:50.344 ************************************ 00:07:50.603 09:53:56 -- spdk/autotest.sh@192 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:07:50.603 09:53:56 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:07:50.603 09:53:56 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:50.603 09:53:56 -- common/autotest_common.sh@10 -- # set +x 00:07:50.603 ************************************ 00:07:50.603 START TEST version 00:07:50.603 ************************************ 00:07:50.603 09:53:56 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:07:50.603 * Looking for test storage... 00:07:50.603 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:50.603 09:53:56 -- app/version.sh@17 -- # get_header_version major 00:07:50.603 09:53:56 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:50.603 09:53:56 -- app/version.sh@14 -- # cut -f2 00:07:50.603 09:53:56 -- app/version.sh@14 -- # tr -d '"' 00:07:50.603 09:53:56 -- app/version.sh@17 -- # major=24 00:07:50.603 09:53:56 -- app/version.sh@18 -- # get_header_version minor 00:07:50.603 09:53:56 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:50.603 09:53:56 -- app/version.sh@14 -- # cut -f2 00:07:50.603 09:53:56 -- app/version.sh@14 -- # tr -d '"' 00:07:50.603 09:53:56 -- app/version.sh@18 -- # minor=1 00:07:50.603 09:53:56 -- app/version.sh@19 -- # get_header_version patch 00:07:50.603 09:53:56 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:50.603 09:53:56 -- app/version.sh@14 -- # cut -f2 00:07:50.603 09:53:56 -- app/version.sh@14 -- # tr -d '"' 00:07:50.603 09:53:56 -- app/version.sh@19 -- # patch=1 00:07:50.603 09:53:56 -- app/version.sh@20 -- # get_header_version suffix 00:07:50.603 09:53:56 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:50.603 09:53:56 -- app/version.sh@14 -- # cut -f2 00:07:50.603 09:53:56 -- app/version.sh@14 -- # tr -d '"' 00:07:50.603 09:53:56 -- app/version.sh@20 -- # suffix=-pre 00:07:50.603 09:53:56 -- app/version.sh@22 -- # version=24.1 00:07:50.603 09:53:56 -- app/version.sh@25 -- # (( patch != 0 )) 00:07:50.603 09:53:56 -- app/version.sh@25 -- # version=24.1.1 00:07:50.603 09:53:56 -- app/version.sh@28 -- # version=24.1.1rc0 00:07:50.603 09:53:56 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:07:50.603 09:53:56 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:07:50.603 09:53:56 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:07:50.603 09:53:56 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:07:50.603 00:07:50.603 real 0m0.103s 00:07:50.603 user 0m0.056s 00:07:50.603 sys 0m0.068s 00:07:50.603 09:53:56 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:50.603 09:53:56 -- common/autotest_common.sh@10 -- # set +x 00:07:50.603 ************************************ 00:07:50.603 END TEST version 00:07:50.603 ************************************ 00:07:50.603 09:53:56 -- spdk/autotest.sh@194 -- # '[' 0 -eq 1 ']' 00:07:50.603 09:53:56 -- spdk/autotest.sh@204 -- # uname -s 00:07:50.603 09:53:56 -- spdk/autotest.sh@204 -- # [[ Linux == Linux ]] 00:07:50.603 09:53:56 -- spdk/autotest.sh@205 -- # [[ 0 -eq 1 ]] 00:07:50.603 09:53:56 -- spdk/autotest.sh@205 -- # [[ 0 -eq 1 ]] 00:07:50.603 09:53:56 -- spdk/autotest.sh@217 -- # '[' 0 -eq 1 ']' 00:07:50.603 09:53:56 -- spdk/autotest.sh@264 -- # '[' 0 -eq 1 ']' 00:07:50.603 09:53:56 -- spdk/autotest.sh@268 -- # timing_exit lib 00:07:50.603 09:53:56 -- common/autotest_common.sh@718 -- # xtrace_disable 00:07:50.603 09:53:56 -- common/autotest_common.sh@10 -- # set +x 00:07:50.603 09:53:56 -- spdk/autotest.sh@270 -- # '[' 0 -eq 1 ']' 00:07:50.603 09:53:56 -- spdk/autotest.sh@278 -- # '[' 0 -eq 1 ']' 00:07:50.603 09:53:56 -- spdk/autotest.sh@287 -- # '[' 1 -eq 1 ']' 00:07:50.603 09:53:56 -- spdk/autotest.sh@288 -- # export NET_TYPE 00:07:50.603 09:53:56 -- spdk/autotest.sh@291 -- # '[' tcp = rdma ']' 00:07:50.603 09:53:56 -- spdk/autotest.sh@294 -- # '[' tcp = tcp ']' 00:07:50.603 09:53:56 -- spdk/autotest.sh@295 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:07:50.603 09:53:56 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:07:50.603 09:53:56 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:50.603 09:53:56 -- common/autotest_common.sh@10 -- # set +x 00:07:50.603 ************************************ 00:07:50.603 START TEST nvmf_tcp 00:07:50.603 ************************************ 00:07:50.603 09:53:56 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:07:50.603 * Looking for test storage... 00:07:50.603 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:07:50.603 09:53:56 -- nvmf/nvmf.sh@10 -- # uname -s 00:07:50.603 09:53:56 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:07:50.603 09:53:56 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:50.603 09:53:56 -- nvmf/common.sh@7 -- # uname -s 00:07:50.603 09:53:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:50.603 09:53:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:50.603 09:53:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:50.603 09:53:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:50.603 09:53:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:50.603 09:53:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:50.603 09:53:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:50.603 09:53:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:50.603 09:53:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:50.603 09:53:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:50.603 09:53:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:50.603 09:53:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:50.603 09:53:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:50.603 09:53:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:50.603 09:53:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:50.603 09:53:56 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:50.603 09:53:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:50.603 09:53:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:50.603 09:53:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:50.603 09:53:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:50.603 09:53:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:50.603 09:53:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:50.603 09:53:56 -- paths/export.sh@5 -- # export PATH 00:07:50.603 09:53:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:50.603 09:53:56 -- nvmf/common.sh@46 -- # : 0 00:07:50.603 09:53:56 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:50.603 09:53:56 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:50.603 09:53:56 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:50.603 09:53:56 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:50.603 09:53:56 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:50.603 09:53:56 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:50.603 09:53:56 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:50.603 09:53:56 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:50.603 09:53:56 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:07:50.603 09:53:56 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:07:50.603 09:53:56 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:07:50.603 09:53:56 -- common/autotest_common.sh@712 -- # xtrace_disable 00:07:50.603 09:53:56 -- common/autotest_common.sh@10 -- # set +x 00:07:50.603 09:53:56 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:07:50.604 09:53:56 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:07:50.604 09:53:56 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:07:50.604 09:53:56 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:50.604 09:53:56 -- common/autotest_common.sh@10 -- # set +x 00:07:50.604 ************************************ 00:07:50.604 START TEST nvmf_example 00:07:50.604 ************************************ 00:07:50.604 09:53:56 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:07:50.863 * Looking for test storage... 00:07:50.863 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:50.863 09:53:56 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:50.863 09:53:56 -- nvmf/common.sh@7 -- # uname -s 00:07:50.863 09:53:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:50.863 09:53:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:50.863 09:53:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:50.863 09:53:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:50.863 09:53:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:50.863 09:53:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:50.863 09:53:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:50.863 09:53:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:50.863 09:53:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:50.863 09:53:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:50.863 09:53:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:50.863 09:53:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:50.863 09:53:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:50.863 09:53:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:50.863 09:53:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:50.863 09:53:56 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:50.863 09:53:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:50.863 09:53:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:50.863 09:53:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:50.863 09:53:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:50.863 09:53:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:50.863 09:53:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:50.863 09:53:56 -- paths/export.sh@5 -- # export PATH 00:07:50.863 09:53:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:50.863 09:53:56 -- nvmf/common.sh@46 -- # : 0 00:07:50.863 09:53:56 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:50.863 09:53:56 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:50.863 09:53:56 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:50.863 09:53:56 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:50.863 09:53:56 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:50.863 09:53:56 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:50.863 09:53:56 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:50.863 09:53:56 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:50.863 09:53:56 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:07:50.863 09:53:56 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:07:50.863 09:53:56 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:07:50.863 09:53:56 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:07:50.863 09:53:56 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:07:50.863 09:53:56 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:07:50.863 09:53:56 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:07:50.863 09:53:56 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:07:50.863 09:53:56 -- common/autotest_common.sh@712 -- # xtrace_disable 00:07:50.863 09:53:56 -- common/autotest_common.sh@10 -- # set +x 00:07:50.863 09:53:56 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:07:50.863 09:53:56 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:50.863 09:53:56 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:50.863 09:53:56 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:50.863 09:53:56 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:50.863 09:53:56 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:50.863 09:53:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:50.863 09:53:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:50.863 09:53:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:50.863 09:53:56 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:50.863 09:53:56 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:50.863 09:53:56 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:50.863 09:53:56 -- common/autotest_common.sh@10 -- # set +x 00:07:52.773 09:53:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:52.773 09:53:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:52.773 09:53:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:52.773 09:53:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:52.774 09:53:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:52.774 09:53:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:52.774 09:53:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:52.774 09:53:58 -- nvmf/common.sh@294 -- # net_devs=() 00:07:52.774 09:53:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:52.774 09:53:58 -- nvmf/common.sh@295 -- # e810=() 00:07:52.774 09:53:58 -- nvmf/common.sh@295 -- # local -ga e810 00:07:52.774 09:53:58 -- nvmf/common.sh@296 -- # x722=() 00:07:52.774 09:53:58 -- nvmf/common.sh@296 -- # local -ga x722 00:07:52.774 09:53:58 -- nvmf/common.sh@297 -- # mlx=() 00:07:52.774 09:53:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:52.774 09:53:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:52.774 09:53:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:52.774 09:53:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:52.774 09:53:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:52.774 09:53:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:52.774 09:53:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:52.774 09:53:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:52.774 09:53:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:52.774 09:53:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:52.774 09:53:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:52.774 09:53:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:52.774 09:53:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:52.774 09:53:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:52.774 09:53:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:52.774 09:53:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:52.774 09:53:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:52.774 09:53:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:52.774 09:53:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:52.774 09:53:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:52.774 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:52.774 09:53:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:52.774 09:53:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:52.774 09:53:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:52.774 09:53:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:52.774 09:53:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:52.774 09:53:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:52.774 09:53:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:52.774 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:52.774 09:53:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:52.774 09:53:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:52.774 09:53:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:52.774 09:53:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:52.774 09:53:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:52.774 09:53:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:52.774 09:53:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:52.774 09:53:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:52.774 09:53:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:52.774 09:53:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:52.774 09:53:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:52.774 09:53:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:52.774 09:53:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:52.774 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:52.774 09:53:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:52.774 09:53:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:52.774 09:53:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:52.774 09:53:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:52.774 09:53:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:52.774 09:53:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:52.774 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:52.774 09:53:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:52.774 09:53:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:52.774 09:53:58 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:52.774 09:53:58 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:52.774 09:53:58 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:52.774 09:53:58 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:52.774 09:53:58 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:52.774 09:53:58 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:52.774 09:53:58 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:52.774 09:53:58 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:52.774 09:53:58 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:52.774 09:53:58 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:52.774 09:53:58 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:52.774 09:53:58 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:52.774 09:53:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:52.774 09:53:58 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:52.774 09:53:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:52.774 09:53:58 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:52.774 09:53:58 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:52.774 09:53:58 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:52.774 09:53:58 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:52.774 09:53:58 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:52.774 09:53:58 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:52.774 09:53:58 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:52.774 09:53:58 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:52.774 09:53:58 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:52.774 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:52.774 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.203 ms 00:07:52.774 00:07:52.774 --- 10.0.0.2 ping statistics --- 00:07:52.774 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:52.774 rtt min/avg/max/mdev = 0.203/0.203/0.203/0.000 ms 00:07:52.774 09:53:58 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:52.774 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:52.774 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.125 ms 00:07:52.774 00:07:52.774 --- 10.0.0.1 ping statistics --- 00:07:52.774 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:52.774 rtt min/avg/max/mdev = 0.125/0.125/0.125/0.000 ms 00:07:52.774 09:53:58 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:52.774 09:53:58 -- nvmf/common.sh@410 -- # return 0 00:07:52.774 09:53:58 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:52.774 09:53:58 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:52.774 09:53:58 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:52.774 09:53:58 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:52.774 09:53:58 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:52.774 09:53:58 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:52.774 09:53:58 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:52.774 09:53:58 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:07:52.774 09:53:58 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:07:52.774 09:53:58 -- common/autotest_common.sh@712 -- # xtrace_disable 00:07:52.774 09:53:58 -- common/autotest_common.sh@10 -- # set +x 00:07:52.774 09:53:58 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:07:52.774 09:53:58 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:07:52.774 09:53:58 -- target/nvmf_example.sh@34 -- # nvmfpid=2708468 00:07:52.774 09:53:58 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:07:52.774 09:53:58 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:07:52.774 09:53:58 -- target/nvmf_example.sh@36 -- # waitforlisten 2708468 00:07:52.774 09:53:58 -- common/autotest_common.sh@819 -- # '[' -z 2708468 ']' 00:07:52.774 09:53:58 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:52.774 09:53:58 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:52.774 09:53:58 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:52.774 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:52.774 09:53:58 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:52.774 09:53:58 -- common/autotest_common.sh@10 -- # set +x 00:07:52.774 EAL: No free 2048 kB hugepages reported on node 1 00:07:53.032 09:53:58 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:53.032 09:53:58 -- common/autotest_common.sh@852 -- # return 0 00:07:53.032 09:53:58 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:07:53.032 09:53:58 -- common/autotest_common.sh@718 -- # xtrace_disable 00:07:53.032 09:53:58 -- common/autotest_common.sh@10 -- # set +x 00:07:53.032 09:53:58 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:53.032 09:53:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:53.032 09:53:58 -- common/autotest_common.sh@10 -- # set +x 00:07:53.032 09:53:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:53.032 09:53:58 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:07:53.032 09:53:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:53.032 09:53:58 -- common/autotest_common.sh@10 -- # set +x 00:07:53.032 09:53:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:53.032 09:53:58 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:07:53.032 09:53:58 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:53.032 09:53:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:53.032 09:53:58 -- common/autotest_common.sh@10 -- # set +x 00:07:53.032 09:53:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:53.032 09:53:58 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:07:53.032 09:53:58 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:53.032 09:53:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:53.032 09:53:58 -- common/autotest_common.sh@10 -- # set +x 00:07:53.290 09:53:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:53.290 09:53:58 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:53.290 09:53:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:53.290 09:53:58 -- common/autotest_common.sh@10 -- # set +x 00:07:53.290 09:53:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:53.290 09:53:58 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:07:53.290 09:53:58 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:07:53.290 EAL: No free 2048 kB hugepages reported on node 1 00:08:05.478 Initializing NVMe Controllers 00:08:05.478 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:08:05.478 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:08:05.478 Initialization complete. Launching workers. 00:08:05.478 ======================================================== 00:08:05.478 Latency(us) 00:08:05.478 Device Information : IOPS MiB/s Average min max 00:08:05.478 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 15656.77 61.16 4089.69 877.19 15655.07 00:08:05.478 ======================================================== 00:08:05.478 Total : 15656.77 61.16 4089.69 877.19 15655.07 00:08:05.478 00:08:05.478 09:54:09 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:08:05.478 09:54:09 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:08:05.478 09:54:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:05.478 09:54:09 -- nvmf/common.sh@116 -- # sync 00:08:05.478 09:54:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:05.478 09:54:09 -- nvmf/common.sh@119 -- # set +e 00:08:05.478 09:54:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:05.478 09:54:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:05.478 rmmod nvme_tcp 00:08:05.478 rmmod nvme_fabrics 00:08:05.478 rmmod nvme_keyring 00:08:05.478 09:54:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:05.478 09:54:09 -- nvmf/common.sh@123 -- # set -e 00:08:05.478 09:54:09 -- nvmf/common.sh@124 -- # return 0 00:08:05.478 09:54:09 -- nvmf/common.sh@477 -- # '[' -n 2708468 ']' 00:08:05.478 09:54:09 -- nvmf/common.sh@478 -- # killprocess 2708468 00:08:05.478 09:54:09 -- common/autotest_common.sh@926 -- # '[' -z 2708468 ']' 00:08:05.478 09:54:09 -- common/autotest_common.sh@930 -- # kill -0 2708468 00:08:05.478 09:54:09 -- common/autotest_common.sh@931 -- # uname 00:08:05.478 09:54:09 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:08:05.478 09:54:09 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2708468 00:08:05.478 09:54:09 -- common/autotest_common.sh@932 -- # process_name=nvmf 00:08:05.478 09:54:09 -- common/autotest_common.sh@936 -- # '[' nvmf = sudo ']' 00:08:05.478 09:54:09 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2708468' 00:08:05.478 killing process with pid 2708468 00:08:05.478 09:54:09 -- common/autotest_common.sh@945 -- # kill 2708468 00:08:05.478 09:54:09 -- common/autotest_common.sh@950 -- # wait 2708468 00:08:05.478 nvmf threads initialize successfully 00:08:05.478 bdev subsystem init successfully 00:08:05.478 created a nvmf target service 00:08:05.478 create targets's poll groups done 00:08:05.478 all subsystems of target started 00:08:05.478 nvmf target is running 00:08:05.478 all subsystems of target stopped 00:08:05.478 destroy targets's poll groups done 00:08:05.478 destroyed the nvmf target service 00:08:05.478 bdev subsystem finish successfully 00:08:05.478 nvmf threads destroy successfully 00:08:05.478 09:54:09 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:05.478 09:54:09 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:05.478 09:54:09 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:05.478 09:54:09 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:05.478 09:54:09 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:05.478 09:54:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:05.478 09:54:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:05.478 09:54:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:05.738 09:54:11 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:05.738 09:54:11 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:08:05.738 09:54:11 -- common/autotest_common.sh@718 -- # xtrace_disable 00:08:05.738 09:54:11 -- common/autotest_common.sh@10 -- # set +x 00:08:05.738 00:08:05.738 real 0m15.101s 00:08:05.738 user 0m42.145s 00:08:05.738 sys 0m3.179s 00:08:05.738 09:54:11 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:05.738 09:54:11 -- common/autotest_common.sh@10 -- # set +x 00:08:05.738 ************************************ 00:08:05.738 END TEST nvmf_example 00:08:05.738 ************************************ 00:08:05.738 09:54:11 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:08:05.738 09:54:11 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:08:05.738 09:54:11 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:05.738 09:54:11 -- common/autotest_common.sh@10 -- # set +x 00:08:05.738 ************************************ 00:08:05.738 START TEST nvmf_filesystem 00:08:05.738 ************************************ 00:08:05.738 09:54:11 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:08:06.000 * Looking for test storage... 00:08:06.000 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:06.000 09:54:11 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:08:06.000 09:54:11 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:08:06.000 09:54:11 -- common/autotest_common.sh@34 -- # set -e 00:08:06.000 09:54:11 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:08:06.000 09:54:11 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:08:06.000 09:54:11 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:08:06.000 09:54:11 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:08:06.000 09:54:11 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:08:06.000 09:54:11 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:08:06.000 09:54:11 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:08:06.000 09:54:11 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:08:06.000 09:54:11 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:08:06.000 09:54:11 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:08:06.000 09:54:11 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:08:06.000 09:54:11 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:08:06.000 09:54:11 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:08:06.000 09:54:11 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:08:06.000 09:54:11 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:08:06.000 09:54:11 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:08:06.000 09:54:11 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:08:06.000 09:54:11 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:08:06.000 09:54:11 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:08:06.000 09:54:11 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:08:06.000 09:54:11 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:08:06.000 09:54:11 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:08:06.000 09:54:11 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:08:06.000 09:54:11 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:08:06.000 09:54:11 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:08:06.000 09:54:11 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:08:06.000 09:54:11 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:08:06.000 09:54:11 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:08:06.000 09:54:11 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:08:06.000 09:54:11 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:08:06.000 09:54:11 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:08:06.000 09:54:11 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:08:06.000 09:54:11 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:08:06.000 09:54:11 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:08:06.000 09:54:11 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:08:06.000 09:54:11 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:08:06.000 09:54:11 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:08:06.000 09:54:11 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:08:06.000 09:54:11 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:08:06.000 09:54:11 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:08:06.000 09:54:11 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:08:06.000 09:54:11 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:08:06.000 09:54:11 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:08:06.000 09:54:11 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:08:06.000 09:54:11 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR=//var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:08:06.000 09:54:11 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:08:06.000 09:54:11 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:08:06.000 09:54:11 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:08:06.000 09:54:11 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:08:06.000 09:54:11 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:08:06.000 09:54:11 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:08:06.000 09:54:11 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:08:06.000 09:54:11 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:08:06.000 09:54:11 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:08:06.000 09:54:11 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=y 00:08:06.000 09:54:11 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:08:06.000 09:54:11 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:08:06.000 09:54:11 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:08:06.000 09:54:11 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:08:06.000 09:54:11 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:08:06.000 09:54:11 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:08:06.000 09:54:11 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:08:06.000 09:54:11 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:08:06.000 09:54:11 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:08:06.000 09:54:11 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:06.000 09:54:11 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:08:06.000 09:54:11 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:08:06.000 09:54:11 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:08:06.000 09:54:11 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:08:06.000 09:54:11 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:08:06.000 09:54:11 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:08:06.000 09:54:11 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:08:06.000 09:54:11 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:08:06.000 09:54:11 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:08:06.000 09:54:11 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:08:06.000 09:54:11 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:08:06.000 09:54:11 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:08:06.000 09:54:11 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:08:06.000 09:54:11 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:08:06.000 09:54:11 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:08:06.000 09:54:11 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:08:06.000 09:54:11 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:08:06.000 09:54:11 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:08:06.000 09:54:11 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:08:06.000 09:54:11 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:08:06.000 09:54:11 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:08:06.000 09:54:11 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:08:06.000 09:54:11 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:08:06.000 09:54:11 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:08:06.000 09:54:11 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:08:06.000 09:54:11 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:08:06.000 09:54:11 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:08:06.000 09:54:11 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:08:06.000 09:54:11 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:08:06.000 09:54:11 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:08:06.000 09:54:11 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:08:06.000 09:54:11 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:08:06.000 09:54:11 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:08:06.000 09:54:11 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:08:06.000 #define SPDK_CONFIG_H 00:08:06.000 #define SPDK_CONFIG_APPS 1 00:08:06.000 #define SPDK_CONFIG_ARCH native 00:08:06.000 #undef SPDK_CONFIG_ASAN 00:08:06.000 #undef SPDK_CONFIG_AVAHI 00:08:06.000 #undef SPDK_CONFIG_CET 00:08:06.000 #define SPDK_CONFIG_COVERAGE 1 00:08:06.000 #define SPDK_CONFIG_CROSS_PREFIX 00:08:06.000 #undef SPDK_CONFIG_CRYPTO 00:08:06.000 #undef SPDK_CONFIG_CRYPTO_MLX5 00:08:06.000 #undef SPDK_CONFIG_CUSTOMOCF 00:08:06.000 #undef SPDK_CONFIG_DAOS 00:08:06.000 #define SPDK_CONFIG_DAOS_DIR 00:08:06.000 #define SPDK_CONFIG_DEBUG 1 00:08:06.000 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:08:06.000 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:08:06.000 #define SPDK_CONFIG_DPDK_INC_DIR //var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:08:06.001 #define SPDK_CONFIG_DPDK_LIB_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:06.001 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:08:06.001 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:08:06.001 #define SPDK_CONFIG_EXAMPLES 1 00:08:06.001 #undef SPDK_CONFIG_FC 00:08:06.001 #define SPDK_CONFIG_FC_PATH 00:08:06.001 #define SPDK_CONFIG_FIO_PLUGIN 1 00:08:06.001 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:08:06.001 #undef SPDK_CONFIG_FUSE 00:08:06.001 #undef SPDK_CONFIG_FUZZER 00:08:06.001 #define SPDK_CONFIG_FUZZER_LIB 00:08:06.001 #undef SPDK_CONFIG_GOLANG 00:08:06.001 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:08:06.001 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:08:06.001 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:08:06.001 #undef SPDK_CONFIG_HAVE_LIBBSD 00:08:06.001 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:08:06.001 #define SPDK_CONFIG_IDXD 1 00:08:06.001 #define SPDK_CONFIG_IDXD_KERNEL 1 00:08:06.001 #undef SPDK_CONFIG_IPSEC_MB 00:08:06.001 #define SPDK_CONFIG_IPSEC_MB_DIR 00:08:06.001 #define SPDK_CONFIG_ISAL 1 00:08:06.001 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:08:06.001 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:08:06.001 #define SPDK_CONFIG_LIBDIR 00:08:06.001 #undef SPDK_CONFIG_LTO 00:08:06.001 #define SPDK_CONFIG_MAX_LCORES 00:08:06.001 #define SPDK_CONFIG_NVME_CUSE 1 00:08:06.001 #undef SPDK_CONFIG_OCF 00:08:06.001 #define SPDK_CONFIG_OCF_PATH 00:08:06.001 #define SPDK_CONFIG_OPENSSL_PATH 00:08:06.001 #undef SPDK_CONFIG_PGO_CAPTURE 00:08:06.001 #undef SPDK_CONFIG_PGO_USE 00:08:06.001 #define SPDK_CONFIG_PREFIX /usr/local 00:08:06.001 #undef SPDK_CONFIG_RAID5F 00:08:06.001 #undef SPDK_CONFIG_RBD 00:08:06.001 #define SPDK_CONFIG_RDMA 1 00:08:06.001 #define SPDK_CONFIG_RDMA_PROV verbs 00:08:06.001 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:08:06.001 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:08:06.001 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:08:06.001 #define SPDK_CONFIG_SHARED 1 00:08:06.001 #undef SPDK_CONFIG_SMA 00:08:06.001 #define SPDK_CONFIG_TESTS 1 00:08:06.001 #undef SPDK_CONFIG_TSAN 00:08:06.001 #define SPDK_CONFIG_UBLK 1 00:08:06.001 #define SPDK_CONFIG_UBSAN 1 00:08:06.001 #undef SPDK_CONFIG_UNIT_TESTS 00:08:06.001 #undef SPDK_CONFIG_URING 00:08:06.001 #define SPDK_CONFIG_URING_PATH 00:08:06.001 #undef SPDK_CONFIG_URING_ZNS 00:08:06.001 #undef SPDK_CONFIG_USDT 00:08:06.001 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:08:06.001 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:08:06.001 #define SPDK_CONFIG_VFIO_USER 1 00:08:06.001 #define SPDK_CONFIG_VFIO_USER_DIR 00:08:06.001 #define SPDK_CONFIG_VHOST 1 00:08:06.001 #define SPDK_CONFIG_VIRTIO 1 00:08:06.001 #undef SPDK_CONFIG_VTUNE 00:08:06.001 #define SPDK_CONFIG_VTUNE_DIR 00:08:06.001 #define SPDK_CONFIG_WERROR 1 00:08:06.001 #define SPDK_CONFIG_WPDK_DIR 00:08:06.001 #undef SPDK_CONFIG_XNVME 00:08:06.001 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:08:06.001 09:54:11 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:08:06.001 09:54:11 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:06.001 09:54:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:06.001 09:54:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:06.001 09:54:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:06.001 09:54:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:06.001 09:54:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:06.001 09:54:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:06.001 09:54:11 -- paths/export.sh@5 -- # export PATH 00:08:06.001 09:54:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:06.001 09:54:11 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:08:06.001 09:54:11 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:08:06.001 09:54:11 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:08:06.001 09:54:11 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:08:06.001 09:54:11 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:08:06.001 09:54:11 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:08:06.001 09:54:11 -- pm/common@16 -- # TEST_TAG=N/A 00:08:06.001 09:54:11 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:08:06.001 09:54:11 -- common/autotest_common.sh@52 -- # : 1 00:08:06.001 09:54:11 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:08:06.001 09:54:11 -- common/autotest_common.sh@56 -- # : 0 00:08:06.001 09:54:11 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:08:06.001 09:54:11 -- common/autotest_common.sh@58 -- # : 0 00:08:06.001 09:54:11 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:08:06.001 09:54:11 -- common/autotest_common.sh@60 -- # : 1 00:08:06.001 09:54:11 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:08:06.001 09:54:11 -- common/autotest_common.sh@62 -- # : 0 00:08:06.001 09:54:11 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:08:06.001 09:54:11 -- common/autotest_common.sh@64 -- # : 00:08:06.001 09:54:11 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:08:06.001 09:54:11 -- common/autotest_common.sh@66 -- # : 0 00:08:06.001 09:54:11 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:08:06.001 09:54:11 -- common/autotest_common.sh@68 -- # : 0 00:08:06.001 09:54:11 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:08:06.001 09:54:11 -- common/autotest_common.sh@70 -- # : 0 00:08:06.001 09:54:11 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:08:06.001 09:54:11 -- common/autotest_common.sh@72 -- # : 0 00:08:06.001 09:54:11 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:08:06.001 09:54:11 -- common/autotest_common.sh@74 -- # : 0 00:08:06.001 09:54:11 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:08:06.001 09:54:11 -- common/autotest_common.sh@76 -- # : 0 00:08:06.001 09:54:11 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:08:06.001 09:54:11 -- common/autotest_common.sh@78 -- # : 0 00:08:06.001 09:54:11 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:08:06.001 09:54:11 -- common/autotest_common.sh@80 -- # : 1 00:08:06.001 09:54:11 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:08:06.001 09:54:11 -- common/autotest_common.sh@82 -- # : 0 00:08:06.001 09:54:11 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:08:06.001 09:54:11 -- common/autotest_common.sh@84 -- # : 0 00:08:06.001 09:54:11 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:08:06.001 09:54:11 -- common/autotest_common.sh@86 -- # : 1 00:08:06.001 09:54:11 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:08:06.001 09:54:11 -- common/autotest_common.sh@88 -- # : 1 00:08:06.001 09:54:11 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:08:06.001 09:54:11 -- common/autotest_common.sh@90 -- # : 0 00:08:06.001 09:54:11 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:08:06.001 09:54:11 -- common/autotest_common.sh@92 -- # : 0 00:08:06.001 09:54:11 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:08:06.001 09:54:11 -- common/autotest_common.sh@94 -- # : 0 00:08:06.001 09:54:11 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:08:06.001 09:54:11 -- common/autotest_common.sh@96 -- # : tcp 00:08:06.001 09:54:11 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:08:06.001 09:54:11 -- common/autotest_common.sh@98 -- # : 0 00:08:06.001 09:54:11 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:08:06.001 09:54:11 -- common/autotest_common.sh@100 -- # : 0 00:08:06.001 09:54:11 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:08:06.001 09:54:11 -- common/autotest_common.sh@102 -- # : 0 00:08:06.001 09:54:11 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:08:06.001 09:54:11 -- common/autotest_common.sh@104 -- # : 0 00:08:06.001 09:54:11 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:08:06.001 09:54:11 -- common/autotest_common.sh@106 -- # : 0 00:08:06.001 09:54:11 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:08:06.001 09:54:11 -- common/autotest_common.sh@108 -- # : 0 00:08:06.001 09:54:11 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:08:06.001 09:54:11 -- common/autotest_common.sh@110 -- # : 0 00:08:06.001 09:54:11 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:08:06.001 09:54:11 -- common/autotest_common.sh@112 -- # : 0 00:08:06.001 09:54:11 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:08:06.001 09:54:11 -- common/autotest_common.sh@114 -- # : 0 00:08:06.001 09:54:11 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:08:06.001 09:54:11 -- common/autotest_common.sh@116 -- # : 1 00:08:06.001 09:54:11 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:08:06.001 09:54:11 -- common/autotest_common.sh@118 -- # : /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:08:06.001 09:54:11 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:08:06.001 09:54:11 -- common/autotest_common.sh@120 -- # : 0 00:08:06.001 09:54:11 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:08:06.001 09:54:11 -- common/autotest_common.sh@122 -- # : 0 00:08:06.001 09:54:11 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:08:06.001 09:54:11 -- common/autotest_common.sh@124 -- # : 0 00:08:06.001 09:54:11 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:08:06.001 09:54:11 -- common/autotest_common.sh@126 -- # : 0 00:08:06.001 09:54:11 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:08:06.001 09:54:11 -- common/autotest_common.sh@128 -- # : 0 00:08:06.001 09:54:11 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:08:06.001 09:54:11 -- common/autotest_common.sh@130 -- # : 0 00:08:06.002 09:54:11 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:08:06.002 09:54:11 -- common/autotest_common.sh@132 -- # : v22.11.4 00:08:06.002 09:54:11 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:08:06.002 09:54:11 -- common/autotest_common.sh@134 -- # : true 00:08:06.002 09:54:11 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:08:06.002 09:54:11 -- common/autotest_common.sh@136 -- # : 0 00:08:06.002 09:54:11 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:08:06.002 09:54:11 -- common/autotest_common.sh@138 -- # : 0 00:08:06.002 09:54:11 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:08:06.002 09:54:11 -- common/autotest_common.sh@140 -- # : 0 00:08:06.002 09:54:11 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:08:06.002 09:54:11 -- common/autotest_common.sh@142 -- # : 0 00:08:06.002 09:54:11 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:08:06.002 09:54:11 -- common/autotest_common.sh@144 -- # : 0 00:08:06.002 09:54:11 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:08:06.002 09:54:11 -- common/autotest_common.sh@146 -- # : 0 00:08:06.002 09:54:11 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:08:06.002 09:54:11 -- common/autotest_common.sh@148 -- # : e810 00:08:06.002 09:54:11 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:08:06.002 09:54:11 -- common/autotest_common.sh@150 -- # : 0 00:08:06.002 09:54:11 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:08:06.002 09:54:11 -- common/autotest_common.sh@152 -- # : 0 00:08:06.002 09:54:11 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:08:06.002 09:54:11 -- common/autotest_common.sh@154 -- # : 0 00:08:06.002 09:54:11 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:08:06.002 09:54:11 -- common/autotest_common.sh@156 -- # : 0 00:08:06.002 09:54:11 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:08:06.002 09:54:11 -- common/autotest_common.sh@158 -- # : 0 00:08:06.002 09:54:11 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:08:06.002 09:54:11 -- common/autotest_common.sh@160 -- # : 0 00:08:06.002 09:54:11 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:08:06.002 09:54:11 -- common/autotest_common.sh@163 -- # : 00:08:06.002 09:54:11 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:08:06.002 09:54:11 -- common/autotest_common.sh@165 -- # : 0 00:08:06.002 09:54:11 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:08:06.002 09:54:11 -- common/autotest_common.sh@167 -- # : 0 00:08:06.002 09:54:11 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:08:06.002 09:54:11 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:08:06.002 09:54:11 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:08:06.002 09:54:11 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:06.002 09:54:11 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:06.002 09:54:11 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:06.002 09:54:11 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:06.002 09:54:11 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:06.002 09:54:11 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:06.002 09:54:11 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:08:06.002 09:54:11 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:08:06.002 09:54:11 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:08:06.002 09:54:11 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:08:06.002 09:54:11 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:08:06.002 09:54:11 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:08:06.002 09:54:11 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:08:06.002 09:54:11 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:08:06.002 09:54:11 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:08:06.002 09:54:11 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:08:06.002 09:54:11 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:08:06.002 09:54:11 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:08:06.002 09:54:11 -- common/autotest_common.sh@196 -- # cat 00:08:06.002 09:54:11 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:08:06.002 09:54:11 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:08:06.002 09:54:11 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:08:06.002 09:54:11 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:08:06.002 09:54:11 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:08:06.002 09:54:11 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:08:06.002 09:54:11 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:08:06.002 09:54:11 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:08:06.002 09:54:11 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:08:06.002 09:54:11 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:08:06.002 09:54:11 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:08:06.002 09:54:11 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:08:06.002 09:54:11 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:08:06.002 09:54:11 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:08:06.002 09:54:11 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:08:06.002 09:54:11 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:08:06.002 09:54:11 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:08:06.002 09:54:11 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:08:06.002 09:54:11 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:08:06.002 09:54:11 -- common/autotest_common.sh@248 -- # '[' 0 -eq 0 ']' 00:08:06.002 09:54:11 -- common/autotest_common.sh@249 -- # export valgrind= 00:08:06.002 09:54:11 -- common/autotest_common.sh@249 -- # valgrind= 00:08:06.002 09:54:11 -- common/autotest_common.sh@255 -- # uname -s 00:08:06.002 09:54:11 -- common/autotest_common.sh@255 -- # '[' Linux = Linux ']' 00:08:06.002 09:54:11 -- common/autotest_common.sh@256 -- # HUGEMEM=4096 00:08:06.002 09:54:11 -- common/autotest_common.sh@257 -- # export CLEAR_HUGE=yes 00:08:06.002 09:54:11 -- common/autotest_common.sh@257 -- # CLEAR_HUGE=yes 00:08:06.002 09:54:11 -- common/autotest_common.sh@258 -- # [[ 0 -eq 1 ]] 00:08:06.002 09:54:11 -- common/autotest_common.sh@258 -- # [[ 0 -eq 1 ]] 00:08:06.002 09:54:11 -- common/autotest_common.sh@265 -- # MAKE=make 00:08:06.002 09:54:11 -- common/autotest_common.sh@266 -- # MAKEFLAGS=-j48 00:08:06.002 09:54:11 -- common/autotest_common.sh@282 -- # export HUGEMEM=4096 00:08:06.002 09:54:11 -- common/autotest_common.sh@282 -- # HUGEMEM=4096 00:08:06.002 09:54:11 -- common/autotest_common.sh@284 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:08:06.002 09:54:11 -- common/autotest_common.sh@289 -- # NO_HUGE=() 00:08:06.002 09:54:11 -- common/autotest_common.sh@290 -- # TEST_MODE= 00:08:06.002 09:54:11 -- common/autotest_common.sh@291 -- # for i in "$@" 00:08:06.002 09:54:11 -- common/autotest_common.sh@292 -- # case "$i" in 00:08:06.002 09:54:11 -- common/autotest_common.sh@297 -- # TEST_TRANSPORT=tcp 00:08:06.002 09:54:11 -- common/autotest_common.sh@309 -- # [[ -z 2710827 ]] 00:08:06.002 09:54:11 -- common/autotest_common.sh@309 -- # kill -0 2710827 00:08:06.002 09:54:11 -- common/autotest_common.sh@1665 -- # set_test_storage 2147483648 00:08:06.002 09:54:11 -- common/autotest_common.sh@319 -- # [[ -v testdir ]] 00:08:06.002 09:54:11 -- common/autotest_common.sh@321 -- # local requested_size=2147483648 00:08:06.002 09:54:11 -- common/autotest_common.sh@322 -- # local mount target_dir 00:08:06.002 09:54:11 -- common/autotest_common.sh@324 -- # local -A mounts fss sizes avails uses 00:08:06.002 09:54:11 -- common/autotest_common.sh@325 -- # local source fs size avail mount use 00:08:06.002 09:54:11 -- common/autotest_common.sh@327 -- # local storage_fallback storage_candidates 00:08:06.002 09:54:11 -- common/autotest_common.sh@329 -- # mktemp -udt spdk.XXXXXX 00:08:06.002 09:54:11 -- common/autotest_common.sh@329 -- # storage_fallback=/tmp/spdk.0tVr7X 00:08:06.002 09:54:11 -- common/autotest_common.sh@334 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:08:06.002 09:54:11 -- common/autotest_common.sh@336 -- # [[ -n '' ]] 00:08:06.002 09:54:11 -- common/autotest_common.sh@341 -- # [[ -n '' ]] 00:08:06.002 09:54:11 -- common/autotest_common.sh@346 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.0tVr7X/tests/target /tmp/spdk.0tVr7X 00:08:06.002 09:54:11 -- common/autotest_common.sh@349 -- # requested_size=2214592512 00:08:06.002 09:54:11 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:08:06.002 09:54:11 -- common/autotest_common.sh@318 -- # df -T 00:08:06.002 09:54:11 -- common/autotest_common.sh@318 -- # grep -v Filesystem 00:08:06.003 09:54:11 -- common/autotest_common.sh@352 -- # mounts["$mount"]=spdk_devtmpfs 00:08:06.003 09:54:11 -- common/autotest_common.sh@352 -- # fss["$mount"]=devtmpfs 00:08:06.003 09:54:11 -- common/autotest_common.sh@353 -- # avails["$mount"]=67108864 00:08:06.003 09:54:11 -- common/autotest_common.sh@353 -- # sizes["$mount"]=67108864 00:08:06.003 09:54:11 -- common/autotest_common.sh@354 -- # uses["$mount"]=0 00:08:06.003 09:54:11 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:08:06.003 09:54:11 -- common/autotest_common.sh@352 -- # mounts["$mount"]=/dev/pmem0 00:08:06.003 09:54:11 -- common/autotest_common.sh@352 -- # fss["$mount"]=ext2 00:08:06.003 09:54:11 -- common/autotest_common.sh@353 -- # avails["$mount"]=953643008 00:08:06.003 09:54:11 -- common/autotest_common.sh@353 -- # sizes["$mount"]=5284429824 00:08:06.003 09:54:11 -- common/autotest_common.sh@354 -- # uses["$mount"]=4330786816 00:08:06.003 09:54:11 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:08:06.003 09:54:11 -- common/autotest_common.sh@352 -- # mounts["$mount"]=spdk_root 00:08:06.003 09:54:11 -- common/autotest_common.sh@352 -- # fss["$mount"]=overlay 00:08:06.003 09:54:11 -- common/autotest_common.sh@353 -- # avails["$mount"]=53507047424 00:08:06.003 09:54:11 -- common/autotest_common.sh@353 -- # sizes["$mount"]=61994708992 00:08:06.003 09:54:11 -- common/autotest_common.sh@354 -- # uses["$mount"]=8487661568 00:08:06.003 09:54:11 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:08:06.003 09:54:11 -- common/autotest_common.sh@352 -- # mounts["$mount"]=tmpfs 00:08:06.003 09:54:11 -- common/autotest_common.sh@352 -- # fss["$mount"]=tmpfs 00:08:06.003 09:54:11 -- common/autotest_common.sh@353 -- # avails["$mount"]=30943834112 00:08:06.003 09:54:11 -- common/autotest_common.sh@353 -- # sizes["$mount"]=30997352448 00:08:06.003 09:54:11 -- common/autotest_common.sh@354 -- # uses["$mount"]=53518336 00:08:06.003 09:54:11 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:08:06.003 09:54:11 -- common/autotest_common.sh@352 -- # mounts["$mount"]=tmpfs 00:08:06.003 09:54:11 -- common/autotest_common.sh@352 -- # fss["$mount"]=tmpfs 00:08:06.003 09:54:11 -- common/autotest_common.sh@353 -- # avails["$mount"]=12390182912 00:08:06.003 09:54:11 -- common/autotest_common.sh@353 -- # sizes["$mount"]=12398944256 00:08:06.003 09:54:11 -- common/autotest_common.sh@354 -- # uses["$mount"]=8761344 00:08:06.003 09:54:11 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:08:06.003 09:54:11 -- common/autotest_common.sh@352 -- # mounts["$mount"]=tmpfs 00:08:06.003 09:54:11 -- common/autotest_common.sh@352 -- # fss["$mount"]=tmpfs 00:08:06.003 09:54:11 -- common/autotest_common.sh@353 -- # avails["$mount"]=30996447232 00:08:06.003 09:54:11 -- common/autotest_common.sh@353 -- # sizes["$mount"]=30997356544 00:08:06.003 09:54:11 -- common/autotest_common.sh@354 -- # uses["$mount"]=909312 00:08:06.003 09:54:11 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:08:06.003 09:54:11 -- common/autotest_common.sh@352 -- # mounts["$mount"]=tmpfs 00:08:06.003 09:54:11 -- common/autotest_common.sh@352 -- # fss["$mount"]=tmpfs 00:08:06.003 09:54:11 -- common/autotest_common.sh@353 -- # avails["$mount"]=6199463936 00:08:06.003 09:54:11 -- common/autotest_common.sh@353 -- # sizes["$mount"]=6199468032 00:08:06.003 09:54:11 -- common/autotest_common.sh@354 -- # uses["$mount"]=4096 00:08:06.003 09:54:11 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:08:06.003 09:54:11 -- common/autotest_common.sh@357 -- # printf '* Looking for test storage...\n' 00:08:06.003 * Looking for test storage... 00:08:06.003 09:54:11 -- common/autotest_common.sh@359 -- # local target_space new_size 00:08:06.003 09:54:11 -- common/autotest_common.sh@360 -- # for target_dir in "${storage_candidates[@]}" 00:08:06.003 09:54:11 -- common/autotest_common.sh@363 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:06.003 09:54:11 -- common/autotest_common.sh@363 -- # awk '$1 !~ /Filesystem/{print $6}' 00:08:06.003 09:54:11 -- common/autotest_common.sh@363 -- # mount=/ 00:08:06.003 09:54:11 -- common/autotest_common.sh@365 -- # target_space=53507047424 00:08:06.003 09:54:11 -- common/autotest_common.sh@366 -- # (( target_space == 0 || target_space < requested_size )) 00:08:06.003 09:54:11 -- common/autotest_common.sh@369 -- # (( target_space >= requested_size )) 00:08:06.003 09:54:11 -- common/autotest_common.sh@371 -- # [[ overlay == tmpfs ]] 00:08:06.003 09:54:11 -- common/autotest_common.sh@371 -- # [[ overlay == ramfs ]] 00:08:06.003 09:54:11 -- common/autotest_common.sh@371 -- # [[ / == / ]] 00:08:06.003 09:54:11 -- common/autotest_common.sh@372 -- # new_size=10702254080 00:08:06.003 09:54:11 -- common/autotest_common.sh@373 -- # (( new_size * 100 / sizes[/] > 95 )) 00:08:06.003 09:54:11 -- common/autotest_common.sh@378 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:06.003 09:54:11 -- common/autotest_common.sh@378 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:06.003 09:54:11 -- common/autotest_common.sh@379 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:06.003 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:06.003 09:54:11 -- common/autotest_common.sh@380 -- # return 0 00:08:06.003 09:54:11 -- common/autotest_common.sh@1667 -- # set -o errtrace 00:08:06.003 09:54:11 -- common/autotest_common.sh@1668 -- # shopt -s extdebug 00:08:06.003 09:54:11 -- common/autotest_common.sh@1669 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:08:06.003 09:54:11 -- common/autotest_common.sh@1671 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:08:06.003 09:54:11 -- common/autotest_common.sh@1672 -- # true 00:08:06.003 09:54:11 -- common/autotest_common.sh@1674 -- # xtrace_fd 00:08:06.003 09:54:11 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:08:06.003 09:54:11 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:08:06.003 09:54:11 -- common/autotest_common.sh@27 -- # exec 00:08:06.003 09:54:11 -- common/autotest_common.sh@29 -- # exec 00:08:06.003 09:54:11 -- common/autotest_common.sh@31 -- # xtrace_restore 00:08:06.003 09:54:11 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:08:06.003 09:54:11 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:08:06.003 09:54:11 -- common/autotest_common.sh@18 -- # set -x 00:08:06.003 09:54:11 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:06.003 09:54:11 -- nvmf/common.sh@7 -- # uname -s 00:08:06.003 09:54:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:06.003 09:54:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:06.003 09:54:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:06.003 09:54:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:06.003 09:54:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:06.003 09:54:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:06.003 09:54:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:06.003 09:54:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:06.003 09:54:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:06.003 09:54:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:06.003 09:54:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:06.003 09:54:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:06.003 09:54:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:06.003 09:54:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:06.003 09:54:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:06.003 09:54:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:06.003 09:54:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:06.003 09:54:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:06.003 09:54:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:06.003 09:54:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:06.004 09:54:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:06.004 09:54:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:06.004 09:54:11 -- paths/export.sh@5 -- # export PATH 00:08:06.004 09:54:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:06.004 09:54:11 -- nvmf/common.sh@46 -- # : 0 00:08:06.004 09:54:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:06.004 09:54:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:06.004 09:54:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:06.004 09:54:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:06.004 09:54:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:06.004 09:54:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:06.004 09:54:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:06.004 09:54:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:06.004 09:54:11 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:08:06.004 09:54:11 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:08:06.004 09:54:11 -- target/filesystem.sh@15 -- # nvmftestinit 00:08:06.004 09:54:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:06.004 09:54:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:06.004 09:54:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:06.004 09:54:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:06.004 09:54:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:06.004 09:54:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:06.004 09:54:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:06.004 09:54:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:06.004 09:54:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:06.004 09:54:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:06.004 09:54:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:06.004 09:54:11 -- common/autotest_common.sh@10 -- # set +x 00:08:07.909 09:54:13 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:07.909 09:54:13 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:07.909 09:54:13 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:07.909 09:54:13 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:07.909 09:54:13 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:07.909 09:54:13 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:07.909 09:54:13 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:07.909 09:54:13 -- nvmf/common.sh@294 -- # net_devs=() 00:08:07.909 09:54:13 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:07.909 09:54:13 -- nvmf/common.sh@295 -- # e810=() 00:08:07.909 09:54:13 -- nvmf/common.sh@295 -- # local -ga e810 00:08:07.909 09:54:13 -- nvmf/common.sh@296 -- # x722=() 00:08:07.909 09:54:13 -- nvmf/common.sh@296 -- # local -ga x722 00:08:07.909 09:54:13 -- nvmf/common.sh@297 -- # mlx=() 00:08:07.909 09:54:13 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:07.909 09:54:13 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:07.909 09:54:13 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:07.909 09:54:13 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:07.909 09:54:13 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:07.909 09:54:13 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:07.909 09:54:13 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:07.909 09:54:13 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:07.909 09:54:13 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:07.909 09:54:13 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:07.909 09:54:13 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:07.909 09:54:13 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:07.909 09:54:13 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:07.909 09:54:13 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:07.909 09:54:13 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:07.909 09:54:13 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:07.909 09:54:13 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:07.909 09:54:13 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:07.909 09:54:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:07.909 09:54:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:07.909 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:07.909 09:54:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:07.909 09:54:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:07.909 09:54:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:07.909 09:54:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:07.909 09:54:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:07.909 09:54:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:07.909 09:54:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:07.909 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:07.909 09:54:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:07.909 09:54:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:07.909 09:54:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:07.909 09:54:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:07.909 09:54:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:07.909 09:54:13 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:07.909 09:54:13 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:07.909 09:54:13 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:07.909 09:54:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:07.909 09:54:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:07.909 09:54:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:07.909 09:54:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:07.909 09:54:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:07.909 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:07.909 09:54:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:07.910 09:54:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:07.910 09:54:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:07.910 09:54:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:07.910 09:54:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:07.910 09:54:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:07.910 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:07.910 09:54:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:07.910 09:54:13 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:07.910 09:54:13 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:07.910 09:54:13 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:07.910 09:54:13 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:07.910 09:54:13 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:07.910 09:54:13 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:07.910 09:54:13 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:07.910 09:54:13 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:07.910 09:54:13 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:07.910 09:54:13 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:07.910 09:54:13 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:07.910 09:54:13 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:07.910 09:54:13 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:07.910 09:54:13 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:07.910 09:54:13 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:07.910 09:54:13 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:08.168 09:54:13 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:08.168 09:54:13 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:08.168 09:54:13 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:08.168 09:54:13 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:08.168 09:54:13 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:08.168 09:54:13 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:08.168 09:54:13 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:08.168 09:54:13 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:08.168 09:54:13 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:08.168 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:08.168 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.265 ms 00:08:08.168 00:08:08.168 --- 10.0.0.2 ping statistics --- 00:08:08.168 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:08.168 rtt min/avg/max/mdev = 0.265/0.265/0.265/0.000 ms 00:08:08.168 09:54:13 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:08.168 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:08.168 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.205 ms 00:08:08.168 00:08:08.168 --- 10.0.0.1 ping statistics --- 00:08:08.168 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:08.168 rtt min/avg/max/mdev = 0.205/0.205/0.205/0.000 ms 00:08:08.168 09:54:13 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:08.168 09:54:13 -- nvmf/common.sh@410 -- # return 0 00:08:08.168 09:54:13 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:08.168 09:54:13 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:08.168 09:54:13 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:08.168 09:54:13 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:08.168 09:54:13 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:08.168 09:54:13 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:08.168 09:54:13 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:08.168 09:54:13 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:08:08.168 09:54:13 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:08:08.168 09:54:13 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:08.168 09:54:13 -- common/autotest_common.sh@10 -- # set +x 00:08:08.168 ************************************ 00:08:08.168 START TEST nvmf_filesystem_no_in_capsule 00:08:08.168 ************************************ 00:08:08.168 09:54:13 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_part 0 00:08:08.168 09:54:13 -- target/filesystem.sh@47 -- # in_capsule=0 00:08:08.168 09:54:13 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:08:08.168 09:54:13 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:08.168 09:54:13 -- common/autotest_common.sh@712 -- # xtrace_disable 00:08:08.168 09:54:13 -- common/autotest_common.sh@10 -- # set +x 00:08:08.168 09:54:13 -- nvmf/common.sh@469 -- # nvmfpid=2712453 00:08:08.168 09:54:13 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:08.168 09:54:13 -- nvmf/common.sh@470 -- # waitforlisten 2712453 00:08:08.168 09:54:13 -- common/autotest_common.sh@819 -- # '[' -z 2712453 ']' 00:08:08.168 09:54:13 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:08.168 09:54:13 -- common/autotest_common.sh@824 -- # local max_retries=100 00:08:08.168 09:54:13 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:08.168 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:08.168 09:54:13 -- common/autotest_common.sh@828 -- # xtrace_disable 00:08:08.168 09:54:13 -- common/autotest_common.sh@10 -- # set +x 00:08:08.168 [2024-07-13 09:54:13.935311] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:08:08.168 [2024-07-13 09:54:13.935393] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:08.168 EAL: No free 2048 kB hugepages reported on node 1 00:08:08.425 [2024-07-13 09:54:14.003963] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:08.425 [2024-07-13 09:54:14.089686] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:08.425 [2024-07-13 09:54:14.089838] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:08.425 [2024-07-13 09:54:14.089854] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:08.425 [2024-07-13 09:54:14.089872] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:08.425 [2024-07-13 09:54:14.089946] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:08.425 [2024-07-13 09:54:14.090008] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:08.426 [2024-07-13 09:54:14.090074] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:08.426 [2024-07-13 09:54:14.090076] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:09.356 09:54:14 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:08:09.356 09:54:14 -- common/autotest_common.sh@852 -- # return 0 00:08:09.356 09:54:14 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:09.356 09:54:14 -- common/autotest_common.sh@718 -- # xtrace_disable 00:08:09.356 09:54:14 -- common/autotest_common.sh@10 -- # set +x 00:08:09.356 09:54:14 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:09.356 09:54:14 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:08:09.356 09:54:14 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:08:09.356 09:54:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:09.356 09:54:14 -- common/autotest_common.sh@10 -- # set +x 00:08:09.356 [2024-07-13 09:54:14.936605] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:09.356 09:54:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:09.356 09:54:14 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:08:09.356 09:54:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:09.356 09:54:14 -- common/autotest_common.sh@10 -- # set +x 00:08:09.356 Malloc1 00:08:09.356 09:54:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:09.356 09:54:15 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:09.356 09:54:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:09.356 09:54:15 -- common/autotest_common.sh@10 -- # set +x 00:08:09.356 09:54:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:09.356 09:54:15 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:09.356 09:54:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:09.356 09:54:15 -- common/autotest_common.sh@10 -- # set +x 00:08:09.356 09:54:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:09.356 09:54:15 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:09.356 09:54:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:09.356 09:54:15 -- common/autotest_common.sh@10 -- # set +x 00:08:09.356 [2024-07-13 09:54:15.121789] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:09.356 09:54:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:09.356 09:54:15 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:08:09.356 09:54:15 -- common/autotest_common.sh@1357 -- # local bdev_name=Malloc1 00:08:09.356 09:54:15 -- common/autotest_common.sh@1358 -- # local bdev_info 00:08:09.356 09:54:15 -- common/autotest_common.sh@1359 -- # local bs 00:08:09.356 09:54:15 -- common/autotest_common.sh@1360 -- # local nb 00:08:09.356 09:54:15 -- common/autotest_common.sh@1361 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:08:09.356 09:54:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:09.356 09:54:15 -- common/autotest_common.sh@10 -- # set +x 00:08:09.356 09:54:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:09.356 09:54:15 -- common/autotest_common.sh@1361 -- # bdev_info='[ 00:08:09.356 { 00:08:09.356 "name": "Malloc1", 00:08:09.356 "aliases": [ 00:08:09.356 "cdaaa71f-6aa2-4e12-88c3-c22b5e0e3e96" 00:08:09.356 ], 00:08:09.356 "product_name": "Malloc disk", 00:08:09.356 "block_size": 512, 00:08:09.356 "num_blocks": 1048576, 00:08:09.356 "uuid": "cdaaa71f-6aa2-4e12-88c3-c22b5e0e3e96", 00:08:09.356 "assigned_rate_limits": { 00:08:09.356 "rw_ios_per_sec": 0, 00:08:09.356 "rw_mbytes_per_sec": 0, 00:08:09.356 "r_mbytes_per_sec": 0, 00:08:09.356 "w_mbytes_per_sec": 0 00:08:09.356 }, 00:08:09.356 "claimed": true, 00:08:09.356 "claim_type": "exclusive_write", 00:08:09.356 "zoned": false, 00:08:09.356 "supported_io_types": { 00:08:09.356 "read": true, 00:08:09.356 "write": true, 00:08:09.356 "unmap": true, 00:08:09.356 "write_zeroes": true, 00:08:09.356 "flush": true, 00:08:09.356 "reset": true, 00:08:09.356 "compare": false, 00:08:09.356 "compare_and_write": false, 00:08:09.356 "abort": true, 00:08:09.356 "nvme_admin": false, 00:08:09.356 "nvme_io": false 00:08:09.356 }, 00:08:09.356 "memory_domains": [ 00:08:09.356 { 00:08:09.356 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:09.356 "dma_device_type": 2 00:08:09.356 } 00:08:09.356 ], 00:08:09.356 "driver_specific": {} 00:08:09.356 } 00:08:09.356 ]' 00:08:09.356 09:54:15 -- common/autotest_common.sh@1362 -- # jq '.[] .block_size' 00:08:09.614 09:54:15 -- common/autotest_common.sh@1362 -- # bs=512 00:08:09.614 09:54:15 -- common/autotest_common.sh@1363 -- # jq '.[] .num_blocks' 00:08:09.614 09:54:15 -- common/autotest_common.sh@1363 -- # nb=1048576 00:08:09.614 09:54:15 -- common/autotest_common.sh@1366 -- # bdev_size=512 00:08:09.614 09:54:15 -- common/autotest_common.sh@1367 -- # echo 512 00:08:09.614 09:54:15 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:08:09.614 09:54:15 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:08:10.191 09:54:15 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:08:10.191 09:54:15 -- common/autotest_common.sh@1177 -- # local i=0 00:08:10.191 09:54:15 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:08:10.191 09:54:15 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:08:10.191 09:54:15 -- common/autotest_common.sh@1184 -- # sleep 2 00:08:12.088 09:54:17 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:08:12.089 09:54:17 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:08:12.089 09:54:17 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:08:12.346 09:54:17 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:08:12.346 09:54:17 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:08:12.346 09:54:17 -- common/autotest_common.sh@1187 -- # return 0 00:08:12.346 09:54:17 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:08:12.346 09:54:17 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:08:12.346 09:54:17 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:08:12.346 09:54:17 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:08:12.346 09:54:17 -- setup/common.sh@76 -- # local dev=nvme0n1 00:08:12.346 09:54:17 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:08:12.346 09:54:17 -- setup/common.sh@80 -- # echo 536870912 00:08:12.346 09:54:17 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:08:12.346 09:54:17 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:08:12.346 09:54:17 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:08:12.346 09:54:17 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:08:12.346 09:54:18 -- target/filesystem.sh@69 -- # partprobe 00:08:12.603 09:54:18 -- target/filesystem.sh@70 -- # sleep 1 00:08:14.011 09:54:19 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:08:14.011 09:54:19 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:08:14.011 09:54:19 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:08:14.011 09:54:19 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:14.011 09:54:19 -- common/autotest_common.sh@10 -- # set +x 00:08:14.011 ************************************ 00:08:14.011 START TEST filesystem_ext4 00:08:14.011 ************************************ 00:08:14.011 09:54:19 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create ext4 nvme0n1 00:08:14.011 09:54:19 -- target/filesystem.sh@18 -- # fstype=ext4 00:08:14.011 09:54:19 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:14.011 09:54:19 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:08:14.011 09:54:19 -- common/autotest_common.sh@902 -- # local fstype=ext4 00:08:14.011 09:54:19 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:08:14.011 09:54:19 -- common/autotest_common.sh@904 -- # local i=0 00:08:14.011 09:54:19 -- common/autotest_common.sh@905 -- # local force 00:08:14.011 09:54:19 -- common/autotest_common.sh@907 -- # '[' ext4 = ext4 ']' 00:08:14.011 09:54:19 -- common/autotest_common.sh@908 -- # force=-F 00:08:14.011 09:54:19 -- common/autotest_common.sh@913 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:08:14.011 mke2fs 1.46.5 (30-Dec-2021) 00:08:14.011 Discarding device blocks: 0/522240 done 00:08:14.011 Creating filesystem with 522240 1k blocks and 130560 inodes 00:08:14.011 Filesystem UUID: f90cde97-03c5-4e52-a0ea-b1297d7f7b29 00:08:14.012 Superblock backups stored on blocks: 00:08:14.012 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:08:14.012 00:08:14.012 Allocating group tables: 0/64 done 00:08:14.012 Writing inode tables: 0/64 done 00:08:14.577 Creating journal (8192 blocks): done 00:08:14.835 Writing superblocks and filesystem accounting information: 0/64 done 00:08:14.835 00:08:14.835 09:54:20 -- common/autotest_common.sh@921 -- # return 0 00:08:14.835 09:54:20 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:15.092 09:54:20 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:15.350 09:54:20 -- target/filesystem.sh@25 -- # sync 00:08:15.350 09:54:20 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:15.350 09:54:20 -- target/filesystem.sh@27 -- # sync 00:08:15.350 09:54:20 -- target/filesystem.sh@29 -- # i=0 00:08:15.350 09:54:20 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:15.350 09:54:20 -- target/filesystem.sh@37 -- # kill -0 2712453 00:08:15.350 09:54:20 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:15.350 09:54:20 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:15.350 09:54:20 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:15.350 09:54:20 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:15.350 00:08:15.350 real 0m1.581s 00:08:15.350 user 0m0.021s 00:08:15.350 sys 0m0.059s 00:08:15.350 09:54:20 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:15.350 09:54:20 -- common/autotest_common.sh@10 -- # set +x 00:08:15.350 ************************************ 00:08:15.350 END TEST filesystem_ext4 00:08:15.350 ************************************ 00:08:15.350 09:54:21 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:15.350 09:54:21 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:08:15.350 09:54:21 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:15.350 09:54:21 -- common/autotest_common.sh@10 -- # set +x 00:08:15.350 ************************************ 00:08:15.350 START TEST filesystem_btrfs 00:08:15.350 ************************************ 00:08:15.350 09:54:21 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:15.350 09:54:21 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:15.350 09:54:21 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:15.350 09:54:21 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:15.350 09:54:21 -- common/autotest_common.sh@902 -- # local fstype=btrfs 00:08:15.350 09:54:21 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:08:15.350 09:54:21 -- common/autotest_common.sh@904 -- # local i=0 00:08:15.350 09:54:21 -- common/autotest_common.sh@905 -- # local force 00:08:15.350 09:54:21 -- common/autotest_common.sh@907 -- # '[' btrfs = ext4 ']' 00:08:15.350 09:54:21 -- common/autotest_common.sh@910 -- # force=-f 00:08:15.350 09:54:21 -- common/autotest_common.sh@913 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:15.608 btrfs-progs v6.6.2 00:08:15.608 See https://btrfs.readthedocs.io for more information. 00:08:15.608 00:08:15.608 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:15.608 NOTE: several default settings have changed in version 5.15, please make sure 00:08:15.608 this does not affect your deployments: 00:08:15.608 - DUP for metadata (-m dup) 00:08:15.608 - enabled no-holes (-O no-holes) 00:08:15.608 - enabled free-space-tree (-R free-space-tree) 00:08:15.608 00:08:15.608 Label: (null) 00:08:15.608 UUID: 8e1674d7-4428-4965-a36c-99641d50209b 00:08:15.608 Node size: 16384 00:08:15.608 Sector size: 4096 00:08:15.608 Filesystem size: 510.00MiB 00:08:15.608 Block group profiles: 00:08:15.608 Data: single 8.00MiB 00:08:15.608 Metadata: DUP 32.00MiB 00:08:15.608 System: DUP 8.00MiB 00:08:15.608 SSD detected: yes 00:08:15.608 Zoned device: no 00:08:15.608 Incompat features: extref, skinny-metadata, no-holes, free-space-tree 00:08:15.608 Runtime features: free-space-tree 00:08:15.608 Checksum: crc32c 00:08:15.608 Number of devices: 1 00:08:15.608 Devices: 00:08:15.608 ID SIZE PATH 00:08:15.608 1 510.00MiB /dev/nvme0n1p1 00:08:15.608 00:08:15.608 09:54:21 -- common/autotest_common.sh@921 -- # return 0 00:08:15.608 09:54:21 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:16.541 09:54:22 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:16.541 09:54:22 -- target/filesystem.sh@25 -- # sync 00:08:16.541 09:54:22 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:16.541 09:54:22 -- target/filesystem.sh@27 -- # sync 00:08:16.541 09:54:22 -- target/filesystem.sh@29 -- # i=0 00:08:16.541 09:54:22 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:16.541 09:54:22 -- target/filesystem.sh@37 -- # kill -0 2712453 00:08:16.541 09:54:22 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:16.541 09:54:22 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:16.541 09:54:22 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:16.541 09:54:22 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:16.541 00:08:16.541 real 0m1.072s 00:08:16.541 user 0m0.020s 00:08:16.541 sys 0m0.115s 00:08:16.541 09:54:22 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:16.541 09:54:22 -- common/autotest_common.sh@10 -- # set +x 00:08:16.541 ************************************ 00:08:16.541 END TEST filesystem_btrfs 00:08:16.541 ************************************ 00:08:16.541 09:54:22 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:08:16.541 09:54:22 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:08:16.541 09:54:22 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:16.541 09:54:22 -- common/autotest_common.sh@10 -- # set +x 00:08:16.541 ************************************ 00:08:16.541 START TEST filesystem_xfs 00:08:16.541 ************************************ 00:08:16.541 09:54:22 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create xfs nvme0n1 00:08:16.541 09:54:22 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:16.541 09:54:22 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:16.541 09:54:22 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:16.541 09:54:22 -- common/autotest_common.sh@902 -- # local fstype=xfs 00:08:16.541 09:54:22 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:08:16.541 09:54:22 -- common/autotest_common.sh@904 -- # local i=0 00:08:16.541 09:54:22 -- common/autotest_common.sh@905 -- # local force 00:08:16.541 09:54:22 -- common/autotest_common.sh@907 -- # '[' xfs = ext4 ']' 00:08:16.541 09:54:22 -- common/autotest_common.sh@910 -- # force=-f 00:08:16.541 09:54:22 -- common/autotest_common.sh@913 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:16.541 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:16.541 = sectsz=512 attr=2, projid32bit=1 00:08:16.541 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:16.541 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:16.541 data = bsize=4096 blocks=130560, imaxpct=25 00:08:16.541 = sunit=0 swidth=0 blks 00:08:16.541 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:16.541 log =internal log bsize=4096 blocks=16384, version=2 00:08:16.541 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:16.541 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:17.472 Discarding blocks...Done. 00:08:17.472 09:54:22 -- common/autotest_common.sh@921 -- # return 0 00:08:17.472 09:54:22 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:19.371 09:54:24 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:19.371 09:54:24 -- target/filesystem.sh@25 -- # sync 00:08:19.371 09:54:24 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:19.371 09:54:24 -- target/filesystem.sh@27 -- # sync 00:08:19.371 09:54:24 -- target/filesystem.sh@29 -- # i=0 00:08:19.371 09:54:24 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:19.371 09:54:24 -- target/filesystem.sh@37 -- # kill -0 2712453 00:08:19.371 09:54:24 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:19.371 09:54:24 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:19.371 09:54:24 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:19.371 09:54:24 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:19.371 00:08:19.371 real 0m2.721s 00:08:19.371 user 0m0.009s 00:08:19.371 sys 0m0.065s 00:08:19.372 09:54:24 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:19.372 09:54:24 -- common/autotest_common.sh@10 -- # set +x 00:08:19.372 ************************************ 00:08:19.372 END TEST filesystem_xfs 00:08:19.372 ************************************ 00:08:19.372 09:54:24 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:19.372 09:54:25 -- target/filesystem.sh@93 -- # sync 00:08:19.372 09:54:25 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:19.629 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:19.629 09:54:25 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:19.629 09:54:25 -- common/autotest_common.sh@1198 -- # local i=0 00:08:19.629 09:54:25 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:08:19.629 09:54:25 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:19.629 09:54:25 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:08:19.629 09:54:25 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:19.629 09:54:25 -- common/autotest_common.sh@1210 -- # return 0 00:08:19.629 09:54:25 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:19.629 09:54:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:19.629 09:54:25 -- common/autotest_common.sh@10 -- # set +x 00:08:19.629 09:54:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:19.629 09:54:25 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:19.629 09:54:25 -- target/filesystem.sh@101 -- # killprocess 2712453 00:08:19.629 09:54:25 -- common/autotest_common.sh@926 -- # '[' -z 2712453 ']' 00:08:19.629 09:54:25 -- common/autotest_common.sh@930 -- # kill -0 2712453 00:08:19.629 09:54:25 -- common/autotest_common.sh@931 -- # uname 00:08:19.629 09:54:25 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:08:19.629 09:54:25 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2712453 00:08:19.629 09:54:25 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:08:19.629 09:54:25 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:08:19.629 09:54:25 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2712453' 00:08:19.629 killing process with pid 2712453 00:08:19.629 09:54:25 -- common/autotest_common.sh@945 -- # kill 2712453 00:08:19.629 09:54:25 -- common/autotest_common.sh@950 -- # wait 2712453 00:08:20.194 09:54:25 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:20.194 00:08:20.194 real 0m11.875s 00:08:20.194 user 0m45.792s 00:08:20.194 sys 0m1.813s 00:08:20.194 09:54:25 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:20.194 09:54:25 -- common/autotest_common.sh@10 -- # set +x 00:08:20.194 ************************************ 00:08:20.194 END TEST nvmf_filesystem_no_in_capsule 00:08:20.194 ************************************ 00:08:20.194 09:54:25 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:08:20.194 09:54:25 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:08:20.194 09:54:25 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:20.194 09:54:25 -- common/autotest_common.sh@10 -- # set +x 00:08:20.194 ************************************ 00:08:20.194 START TEST nvmf_filesystem_in_capsule 00:08:20.194 ************************************ 00:08:20.194 09:54:25 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_part 4096 00:08:20.194 09:54:25 -- target/filesystem.sh@47 -- # in_capsule=4096 00:08:20.194 09:54:25 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:08:20.194 09:54:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:20.195 09:54:25 -- common/autotest_common.sh@712 -- # xtrace_disable 00:08:20.195 09:54:25 -- common/autotest_common.sh@10 -- # set +x 00:08:20.195 09:54:25 -- nvmf/common.sh@469 -- # nvmfpid=2714052 00:08:20.195 09:54:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:20.195 09:54:25 -- nvmf/common.sh@470 -- # waitforlisten 2714052 00:08:20.195 09:54:25 -- common/autotest_common.sh@819 -- # '[' -z 2714052 ']' 00:08:20.195 09:54:25 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:20.195 09:54:25 -- common/autotest_common.sh@824 -- # local max_retries=100 00:08:20.195 09:54:25 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:20.195 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:20.195 09:54:25 -- common/autotest_common.sh@828 -- # xtrace_disable 00:08:20.195 09:54:25 -- common/autotest_common.sh@10 -- # set +x 00:08:20.195 [2024-07-13 09:54:25.840688] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:08:20.195 [2024-07-13 09:54:25.840789] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:20.195 EAL: No free 2048 kB hugepages reported on node 1 00:08:20.195 [2024-07-13 09:54:25.908362] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:20.195 [2024-07-13 09:54:25.996097] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:20.195 [2024-07-13 09:54:25.996272] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:20.195 [2024-07-13 09:54:25.996293] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:20.195 [2024-07-13 09:54:25.996309] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:20.195 [2024-07-13 09:54:25.996369] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:20.195 [2024-07-13 09:54:25.996449] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:20.195 [2024-07-13 09:54:25.996525] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:20.195 [2024-07-13 09:54:25.996527] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:21.126 09:54:26 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:08:21.126 09:54:26 -- common/autotest_common.sh@852 -- # return 0 00:08:21.126 09:54:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:21.126 09:54:26 -- common/autotest_common.sh@718 -- # xtrace_disable 00:08:21.126 09:54:26 -- common/autotest_common.sh@10 -- # set +x 00:08:21.126 09:54:26 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:21.126 09:54:26 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:08:21.126 09:54:26 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:08:21.126 09:54:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:21.126 09:54:26 -- common/autotest_common.sh@10 -- # set +x 00:08:21.126 [2024-07-13 09:54:26.846573] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:21.126 09:54:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:21.126 09:54:26 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:08:21.126 09:54:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:21.126 09:54:26 -- common/autotest_common.sh@10 -- # set +x 00:08:21.384 Malloc1 00:08:21.384 09:54:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:21.384 09:54:27 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:21.384 09:54:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:21.384 09:54:27 -- common/autotest_common.sh@10 -- # set +x 00:08:21.384 09:54:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:21.384 09:54:27 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:21.384 09:54:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:21.384 09:54:27 -- common/autotest_common.sh@10 -- # set +x 00:08:21.384 09:54:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:21.384 09:54:27 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:21.384 09:54:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:21.384 09:54:27 -- common/autotest_common.sh@10 -- # set +x 00:08:21.384 [2024-07-13 09:54:27.033252] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:21.384 09:54:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:21.384 09:54:27 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:08:21.384 09:54:27 -- common/autotest_common.sh@1357 -- # local bdev_name=Malloc1 00:08:21.384 09:54:27 -- common/autotest_common.sh@1358 -- # local bdev_info 00:08:21.384 09:54:27 -- common/autotest_common.sh@1359 -- # local bs 00:08:21.384 09:54:27 -- common/autotest_common.sh@1360 -- # local nb 00:08:21.384 09:54:27 -- common/autotest_common.sh@1361 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:08:21.384 09:54:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:21.384 09:54:27 -- common/autotest_common.sh@10 -- # set +x 00:08:21.384 09:54:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:21.384 09:54:27 -- common/autotest_common.sh@1361 -- # bdev_info='[ 00:08:21.384 { 00:08:21.384 "name": "Malloc1", 00:08:21.384 "aliases": [ 00:08:21.384 "85981e64-2024-4ba0-9535-2aac4d236cc2" 00:08:21.384 ], 00:08:21.384 "product_name": "Malloc disk", 00:08:21.384 "block_size": 512, 00:08:21.384 "num_blocks": 1048576, 00:08:21.384 "uuid": "85981e64-2024-4ba0-9535-2aac4d236cc2", 00:08:21.384 "assigned_rate_limits": { 00:08:21.384 "rw_ios_per_sec": 0, 00:08:21.384 "rw_mbytes_per_sec": 0, 00:08:21.384 "r_mbytes_per_sec": 0, 00:08:21.384 "w_mbytes_per_sec": 0 00:08:21.384 }, 00:08:21.384 "claimed": true, 00:08:21.384 "claim_type": "exclusive_write", 00:08:21.384 "zoned": false, 00:08:21.384 "supported_io_types": { 00:08:21.384 "read": true, 00:08:21.384 "write": true, 00:08:21.384 "unmap": true, 00:08:21.384 "write_zeroes": true, 00:08:21.384 "flush": true, 00:08:21.384 "reset": true, 00:08:21.384 "compare": false, 00:08:21.384 "compare_and_write": false, 00:08:21.384 "abort": true, 00:08:21.384 "nvme_admin": false, 00:08:21.384 "nvme_io": false 00:08:21.384 }, 00:08:21.384 "memory_domains": [ 00:08:21.384 { 00:08:21.384 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:21.384 "dma_device_type": 2 00:08:21.384 } 00:08:21.384 ], 00:08:21.384 "driver_specific": {} 00:08:21.384 } 00:08:21.384 ]' 00:08:21.384 09:54:27 -- common/autotest_common.sh@1362 -- # jq '.[] .block_size' 00:08:21.384 09:54:27 -- common/autotest_common.sh@1362 -- # bs=512 00:08:21.384 09:54:27 -- common/autotest_common.sh@1363 -- # jq '.[] .num_blocks' 00:08:21.384 09:54:27 -- common/autotest_common.sh@1363 -- # nb=1048576 00:08:21.384 09:54:27 -- common/autotest_common.sh@1366 -- # bdev_size=512 00:08:21.384 09:54:27 -- common/autotest_common.sh@1367 -- # echo 512 00:08:21.384 09:54:27 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:08:21.384 09:54:27 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:08:22.316 09:54:27 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:08:22.316 09:54:27 -- common/autotest_common.sh@1177 -- # local i=0 00:08:22.316 09:54:27 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:08:22.316 09:54:27 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:08:22.316 09:54:27 -- common/autotest_common.sh@1184 -- # sleep 2 00:08:24.212 09:54:29 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:08:24.212 09:54:29 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:08:24.212 09:54:29 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:08:24.212 09:54:29 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:08:24.212 09:54:29 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:08:24.212 09:54:29 -- common/autotest_common.sh@1187 -- # return 0 00:08:24.212 09:54:29 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:08:24.212 09:54:29 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:08:24.212 09:54:29 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:08:24.212 09:54:29 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:08:24.212 09:54:29 -- setup/common.sh@76 -- # local dev=nvme0n1 00:08:24.212 09:54:29 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:08:24.212 09:54:29 -- setup/common.sh@80 -- # echo 536870912 00:08:24.212 09:54:29 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:08:24.212 09:54:29 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:08:24.212 09:54:29 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:08:24.212 09:54:29 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:08:24.469 09:54:30 -- target/filesystem.sh@69 -- # partprobe 00:08:25.400 09:54:30 -- target/filesystem.sh@70 -- # sleep 1 00:08:26.334 09:54:31 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:08:26.334 09:54:31 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:08:26.334 09:54:31 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:08:26.334 09:54:31 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:26.334 09:54:31 -- common/autotest_common.sh@10 -- # set +x 00:08:26.334 ************************************ 00:08:26.334 START TEST filesystem_in_capsule_ext4 00:08:26.334 ************************************ 00:08:26.334 09:54:31 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create ext4 nvme0n1 00:08:26.334 09:54:31 -- target/filesystem.sh@18 -- # fstype=ext4 00:08:26.334 09:54:31 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:26.334 09:54:31 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:08:26.334 09:54:31 -- common/autotest_common.sh@902 -- # local fstype=ext4 00:08:26.334 09:54:31 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:08:26.334 09:54:31 -- common/autotest_common.sh@904 -- # local i=0 00:08:26.334 09:54:31 -- common/autotest_common.sh@905 -- # local force 00:08:26.334 09:54:31 -- common/autotest_common.sh@907 -- # '[' ext4 = ext4 ']' 00:08:26.334 09:54:31 -- common/autotest_common.sh@908 -- # force=-F 00:08:26.334 09:54:31 -- common/autotest_common.sh@913 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:08:26.334 mke2fs 1.46.5 (30-Dec-2021) 00:08:26.334 Discarding device blocks: 0/522240 done 00:08:26.334 Creating filesystem with 522240 1k blocks and 130560 inodes 00:08:26.334 Filesystem UUID: 771f41d3-58a3-452a-9645-dde8bf5fa8f0 00:08:26.334 Superblock backups stored on blocks: 00:08:26.334 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:08:26.334 00:08:26.334 Allocating group tables: 0/64 done 00:08:26.334 Writing inode tables: 0/64 done 00:08:29.615 Creating journal (8192 blocks): done 00:08:30.178 Writing superblocks and filesystem accounting information: 0/64 1/64 done 00:08:30.178 00:08:30.178 09:54:35 -- common/autotest_common.sh@921 -- # return 0 00:08:30.178 09:54:35 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:30.178 09:54:35 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:30.178 09:54:35 -- target/filesystem.sh@25 -- # sync 00:08:30.435 09:54:35 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:30.435 09:54:35 -- target/filesystem.sh@27 -- # sync 00:08:30.435 09:54:36 -- target/filesystem.sh@29 -- # i=0 00:08:30.435 09:54:36 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:30.435 09:54:36 -- target/filesystem.sh@37 -- # kill -0 2714052 00:08:30.435 09:54:36 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:30.435 09:54:36 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:30.435 09:54:36 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:30.435 09:54:36 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:30.435 00:08:30.435 real 0m4.190s 00:08:30.435 user 0m0.017s 00:08:30.435 sys 0m0.063s 00:08:30.435 09:54:36 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:30.435 09:54:36 -- common/autotest_common.sh@10 -- # set +x 00:08:30.435 ************************************ 00:08:30.435 END TEST filesystem_in_capsule_ext4 00:08:30.435 ************************************ 00:08:30.435 09:54:36 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:30.435 09:54:36 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:08:30.435 09:54:36 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:30.435 09:54:36 -- common/autotest_common.sh@10 -- # set +x 00:08:30.435 ************************************ 00:08:30.435 START TEST filesystem_in_capsule_btrfs 00:08:30.435 ************************************ 00:08:30.435 09:54:36 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:30.435 09:54:36 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:30.435 09:54:36 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:30.435 09:54:36 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:30.435 09:54:36 -- common/autotest_common.sh@902 -- # local fstype=btrfs 00:08:30.435 09:54:36 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:08:30.435 09:54:36 -- common/autotest_common.sh@904 -- # local i=0 00:08:30.435 09:54:36 -- common/autotest_common.sh@905 -- # local force 00:08:30.435 09:54:36 -- common/autotest_common.sh@907 -- # '[' btrfs = ext4 ']' 00:08:30.435 09:54:36 -- common/autotest_common.sh@910 -- # force=-f 00:08:30.435 09:54:36 -- common/autotest_common.sh@913 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:31.001 btrfs-progs v6.6.2 00:08:31.001 See https://btrfs.readthedocs.io for more information. 00:08:31.001 00:08:31.001 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:31.001 NOTE: several default settings have changed in version 5.15, please make sure 00:08:31.001 this does not affect your deployments: 00:08:31.001 - DUP for metadata (-m dup) 00:08:31.001 - enabled no-holes (-O no-holes) 00:08:31.001 - enabled free-space-tree (-R free-space-tree) 00:08:31.001 00:08:31.001 Label: (null) 00:08:31.001 UUID: bd5483a1-b463-44e3-9c73-66a93c229fbd 00:08:31.001 Node size: 16384 00:08:31.001 Sector size: 4096 00:08:31.001 Filesystem size: 510.00MiB 00:08:31.001 Block group profiles: 00:08:31.001 Data: single 8.00MiB 00:08:31.001 Metadata: DUP 32.00MiB 00:08:31.001 System: DUP 8.00MiB 00:08:31.001 SSD detected: yes 00:08:31.001 Zoned device: no 00:08:31.001 Incompat features: extref, skinny-metadata, no-holes, free-space-tree 00:08:31.001 Runtime features: free-space-tree 00:08:31.001 Checksum: crc32c 00:08:31.001 Number of devices: 1 00:08:31.001 Devices: 00:08:31.001 ID SIZE PATH 00:08:31.001 1 510.00MiB /dev/nvme0n1p1 00:08:31.001 00:08:31.001 09:54:36 -- common/autotest_common.sh@921 -- # return 0 00:08:31.001 09:54:36 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:31.567 09:54:37 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:31.567 09:54:37 -- target/filesystem.sh@25 -- # sync 00:08:31.567 09:54:37 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:31.567 09:54:37 -- target/filesystem.sh@27 -- # sync 00:08:31.567 09:54:37 -- target/filesystem.sh@29 -- # i=0 00:08:31.567 09:54:37 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:31.567 09:54:37 -- target/filesystem.sh@37 -- # kill -0 2714052 00:08:31.567 09:54:37 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:31.567 09:54:37 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:31.567 09:54:37 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:31.567 09:54:37 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:31.567 00:08:31.567 real 0m1.206s 00:08:31.567 user 0m0.025s 00:08:31.567 sys 0m0.114s 00:08:31.567 09:54:37 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:31.567 09:54:37 -- common/autotest_common.sh@10 -- # set +x 00:08:31.567 ************************************ 00:08:31.567 END TEST filesystem_in_capsule_btrfs 00:08:31.567 ************************************ 00:08:31.567 09:54:37 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:08:31.567 09:54:37 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:08:31.567 09:54:37 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:31.567 09:54:37 -- common/autotest_common.sh@10 -- # set +x 00:08:31.567 ************************************ 00:08:31.567 START TEST filesystem_in_capsule_xfs 00:08:31.567 ************************************ 00:08:31.567 09:54:37 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create xfs nvme0n1 00:08:31.567 09:54:37 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:31.567 09:54:37 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:31.567 09:54:37 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:31.567 09:54:37 -- common/autotest_common.sh@902 -- # local fstype=xfs 00:08:31.567 09:54:37 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:08:31.567 09:54:37 -- common/autotest_common.sh@904 -- # local i=0 00:08:31.567 09:54:37 -- common/autotest_common.sh@905 -- # local force 00:08:31.567 09:54:37 -- common/autotest_common.sh@907 -- # '[' xfs = ext4 ']' 00:08:31.567 09:54:37 -- common/autotest_common.sh@910 -- # force=-f 00:08:31.567 09:54:37 -- common/autotest_common.sh@913 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:31.825 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:31.825 = sectsz=512 attr=2, projid32bit=1 00:08:31.825 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:31.825 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:31.825 data = bsize=4096 blocks=130560, imaxpct=25 00:08:31.825 = sunit=0 swidth=0 blks 00:08:31.825 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:31.825 log =internal log bsize=4096 blocks=16384, version=2 00:08:31.825 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:31.825 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:32.757 Discarding blocks...Done. 00:08:32.757 09:54:38 -- common/autotest_common.sh@921 -- # return 0 00:08:32.757 09:54:38 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:35.283 09:54:40 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:35.283 09:54:40 -- target/filesystem.sh@25 -- # sync 00:08:35.283 09:54:40 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:35.283 09:54:40 -- target/filesystem.sh@27 -- # sync 00:08:35.283 09:54:40 -- target/filesystem.sh@29 -- # i=0 00:08:35.283 09:54:40 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:35.283 09:54:40 -- target/filesystem.sh@37 -- # kill -0 2714052 00:08:35.283 09:54:40 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:35.283 09:54:40 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:35.283 09:54:40 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:35.283 09:54:40 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:35.283 00:08:35.283 real 0m3.302s 00:08:35.283 user 0m0.018s 00:08:35.283 sys 0m0.062s 00:08:35.283 09:54:40 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:35.283 09:54:40 -- common/autotest_common.sh@10 -- # set +x 00:08:35.283 ************************************ 00:08:35.283 END TEST filesystem_in_capsule_xfs 00:08:35.283 ************************************ 00:08:35.283 09:54:40 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:35.283 09:54:40 -- target/filesystem.sh@93 -- # sync 00:08:35.283 09:54:40 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:35.283 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:35.283 09:54:40 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:35.283 09:54:40 -- common/autotest_common.sh@1198 -- # local i=0 00:08:35.283 09:54:40 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:08:35.283 09:54:40 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:35.283 09:54:40 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:08:35.283 09:54:40 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:35.283 09:54:40 -- common/autotest_common.sh@1210 -- # return 0 00:08:35.283 09:54:40 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:35.283 09:54:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:35.283 09:54:40 -- common/autotest_common.sh@10 -- # set +x 00:08:35.283 09:54:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:35.284 09:54:40 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:35.284 09:54:40 -- target/filesystem.sh@101 -- # killprocess 2714052 00:08:35.284 09:54:40 -- common/autotest_common.sh@926 -- # '[' -z 2714052 ']' 00:08:35.284 09:54:40 -- common/autotest_common.sh@930 -- # kill -0 2714052 00:08:35.284 09:54:40 -- common/autotest_common.sh@931 -- # uname 00:08:35.284 09:54:40 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:08:35.284 09:54:40 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2714052 00:08:35.284 09:54:40 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:08:35.284 09:54:40 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:08:35.284 09:54:40 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2714052' 00:08:35.284 killing process with pid 2714052 00:08:35.284 09:54:40 -- common/autotest_common.sh@945 -- # kill 2714052 00:08:35.284 09:54:40 -- common/autotest_common.sh@950 -- # wait 2714052 00:08:35.542 09:54:41 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:35.542 00:08:35.542 real 0m15.546s 00:08:35.542 user 1m0.253s 00:08:35.542 sys 0m1.989s 00:08:35.542 09:54:41 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:35.542 09:54:41 -- common/autotest_common.sh@10 -- # set +x 00:08:35.542 ************************************ 00:08:35.542 END TEST nvmf_filesystem_in_capsule 00:08:35.542 ************************************ 00:08:35.800 09:54:41 -- target/filesystem.sh@108 -- # nvmftestfini 00:08:35.800 09:54:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:35.800 09:54:41 -- nvmf/common.sh@116 -- # sync 00:08:35.800 09:54:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:35.800 09:54:41 -- nvmf/common.sh@119 -- # set +e 00:08:35.800 09:54:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:35.800 09:54:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:35.800 rmmod nvme_tcp 00:08:35.801 rmmod nvme_fabrics 00:08:35.801 rmmod nvme_keyring 00:08:35.801 09:54:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:35.801 09:54:41 -- nvmf/common.sh@123 -- # set -e 00:08:35.801 09:54:41 -- nvmf/common.sh@124 -- # return 0 00:08:35.801 09:54:41 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:08:35.801 09:54:41 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:35.801 09:54:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:35.801 09:54:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:35.801 09:54:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:35.801 09:54:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:35.801 09:54:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:35.801 09:54:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:35.801 09:54:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:37.715 09:54:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:37.715 00:08:37.715 real 0m31.951s 00:08:37.715 user 1m46.946s 00:08:37.715 sys 0m5.422s 00:08:37.715 09:54:43 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:37.715 09:54:43 -- common/autotest_common.sh@10 -- # set +x 00:08:37.715 ************************************ 00:08:37.715 END TEST nvmf_filesystem 00:08:37.715 ************************************ 00:08:37.715 09:54:43 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:08:37.715 09:54:43 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:08:37.715 09:54:43 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:37.715 09:54:43 -- common/autotest_common.sh@10 -- # set +x 00:08:37.715 ************************************ 00:08:37.715 START TEST nvmf_discovery 00:08:37.715 ************************************ 00:08:37.715 09:54:43 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:08:37.973 * Looking for test storage... 00:08:37.973 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:37.973 09:54:43 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:37.973 09:54:43 -- nvmf/common.sh@7 -- # uname -s 00:08:37.973 09:54:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:37.973 09:54:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:37.973 09:54:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:37.973 09:54:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:37.973 09:54:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:37.973 09:54:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:37.973 09:54:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:37.973 09:54:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:37.973 09:54:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:37.973 09:54:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:37.973 09:54:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:37.973 09:54:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:37.973 09:54:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:37.973 09:54:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:37.973 09:54:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:37.973 09:54:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:37.973 09:54:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:37.973 09:54:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:37.973 09:54:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:37.973 09:54:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:37.973 09:54:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:37.973 09:54:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:37.973 09:54:43 -- paths/export.sh@5 -- # export PATH 00:08:37.973 09:54:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:37.973 09:54:43 -- nvmf/common.sh@46 -- # : 0 00:08:37.973 09:54:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:37.973 09:54:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:37.973 09:54:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:37.973 09:54:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:37.973 09:54:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:37.973 09:54:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:37.973 09:54:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:37.973 09:54:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:37.973 09:54:43 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:08:37.973 09:54:43 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:08:37.973 09:54:43 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:08:37.973 09:54:43 -- target/discovery.sh@15 -- # hash nvme 00:08:37.973 09:54:43 -- target/discovery.sh@20 -- # nvmftestinit 00:08:37.973 09:54:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:37.973 09:54:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:37.973 09:54:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:37.973 09:54:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:37.973 09:54:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:37.973 09:54:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:37.973 09:54:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:37.973 09:54:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:37.973 09:54:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:37.973 09:54:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:37.973 09:54:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:37.973 09:54:43 -- common/autotest_common.sh@10 -- # set +x 00:08:39.870 09:54:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:39.870 09:54:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:39.870 09:54:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:39.870 09:54:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:39.870 09:54:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:39.870 09:54:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:39.870 09:54:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:39.870 09:54:45 -- nvmf/common.sh@294 -- # net_devs=() 00:08:39.870 09:54:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:39.870 09:54:45 -- nvmf/common.sh@295 -- # e810=() 00:08:39.870 09:54:45 -- nvmf/common.sh@295 -- # local -ga e810 00:08:39.870 09:54:45 -- nvmf/common.sh@296 -- # x722=() 00:08:39.870 09:54:45 -- nvmf/common.sh@296 -- # local -ga x722 00:08:39.870 09:54:45 -- nvmf/common.sh@297 -- # mlx=() 00:08:39.870 09:54:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:39.870 09:54:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:39.870 09:54:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:39.870 09:54:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:39.870 09:54:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:39.870 09:54:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:39.870 09:54:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:39.870 09:54:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:39.870 09:54:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:39.870 09:54:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:39.870 09:54:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:39.870 09:54:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:39.870 09:54:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:39.870 09:54:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:39.870 09:54:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:39.870 09:54:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:39.870 09:54:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:39.870 09:54:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:39.870 09:54:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:39.870 09:54:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:39.870 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:39.870 09:54:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:39.870 09:54:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:39.870 09:54:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:39.870 09:54:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:39.870 09:54:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:39.870 09:54:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:39.870 09:54:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:39.870 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:39.870 09:54:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:39.870 09:54:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:39.870 09:54:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:39.870 09:54:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:39.870 09:54:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:39.870 09:54:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:39.870 09:54:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:39.870 09:54:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:39.870 09:54:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:39.870 09:54:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:39.870 09:54:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:39.870 09:54:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:39.870 09:54:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:39.870 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:39.870 09:54:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:39.870 09:54:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:39.870 09:54:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:39.870 09:54:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:39.870 09:54:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:39.870 09:54:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:39.870 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:39.870 09:54:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:39.870 09:54:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:39.870 09:54:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:39.870 09:54:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:39.870 09:54:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:39.870 09:54:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:39.870 09:54:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:39.870 09:54:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:39.870 09:54:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:39.870 09:54:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:39.870 09:54:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:39.870 09:54:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:39.870 09:54:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:39.870 09:54:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:39.870 09:54:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:39.870 09:54:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:39.870 09:54:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:39.870 09:54:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:39.870 09:54:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:39.870 09:54:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:39.870 09:54:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:39.870 09:54:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:39.870 09:54:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:39.870 09:54:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:39.870 09:54:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:39.870 09:54:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:39.870 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:39.870 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.195 ms 00:08:39.870 00:08:39.870 --- 10.0.0.2 ping statistics --- 00:08:39.870 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:39.870 rtt min/avg/max/mdev = 0.195/0.195/0.195/0.000 ms 00:08:39.870 09:54:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:39.870 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:39.870 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.120 ms 00:08:39.870 00:08:39.870 --- 10.0.0.1 ping statistics --- 00:08:39.870 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:39.870 rtt min/avg/max/mdev = 0.120/0.120/0.120/0.000 ms 00:08:39.870 09:54:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:39.870 09:54:45 -- nvmf/common.sh@410 -- # return 0 00:08:39.870 09:54:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:39.870 09:54:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:39.870 09:54:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:39.870 09:54:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:39.870 09:54:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:39.870 09:54:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:39.870 09:54:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:40.128 09:54:45 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:08:40.128 09:54:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:40.128 09:54:45 -- common/autotest_common.sh@712 -- # xtrace_disable 00:08:40.128 09:54:45 -- common/autotest_common.sh@10 -- # set +x 00:08:40.128 09:54:45 -- nvmf/common.sh@469 -- # nvmfpid=2718130 00:08:40.128 09:54:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:40.128 09:54:45 -- nvmf/common.sh@470 -- # waitforlisten 2718130 00:08:40.128 09:54:45 -- common/autotest_common.sh@819 -- # '[' -z 2718130 ']' 00:08:40.128 09:54:45 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:40.128 09:54:45 -- common/autotest_common.sh@824 -- # local max_retries=100 00:08:40.128 09:54:45 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:40.128 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:40.128 09:54:45 -- common/autotest_common.sh@828 -- # xtrace_disable 00:08:40.128 09:54:45 -- common/autotest_common.sh@10 -- # set +x 00:08:40.128 [2024-07-13 09:54:45.752364] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:08:40.128 [2024-07-13 09:54:45.752460] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:40.128 EAL: No free 2048 kB hugepages reported on node 1 00:08:40.128 [2024-07-13 09:54:45.822044] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:40.128 [2024-07-13 09:54:45.914279] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:40.128 [2024-07-13 09:54:45.914457] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:40.128 [2024-07-13 09:54:45.914477] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:40.128 [2024-07-13 09:54:45.914492] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:40.128 [2024-07-13 09:54:45.914575] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:40.128 [2024-07-13 09:54:45.914628] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:40.128 [2024-07-13 09:54:45.914679] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:40.128 [2024-07-13 09:54:45.914682] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:41.056 09:54:46 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:08:41.056 09:54:46 -- common/autotest_common.sh@852 -- # return 0 00:08:41.056 09:54:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:41.056 09:54:46 -- common/autotest_common.sh@718 -- # xtrace_disable 00:08:41.056 09:54:46 -- common/autotest_common.sh@10 -- # set +x 00:08:41.057 09:54:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:41.057 09:54:46 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:08:41.057 09:54:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:41.057 09:54:46 -- common/autotest_common.sh@10 -- # set +x 00:08:41.057 [2024-07-13 09:54:46.759586] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:41.057 09:54:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:41.057 09:54:46 -- target/discovery.sh@26 -- # seq 1 4 00:08:41.057 09:54:46 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:41.057 09:54:46 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:08:41.057 09:54:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:41.057 09:54:46 -- common/autotest_common.sh@10 -- # set +x 00:08:41.057 Null1 00:08:41.057 09:54:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:41.057 09:54:46 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:08:41.057 09:54:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:41.057 09:54:46 -- common/autotest_common.sh@10 -- # set +x 00:08:41.057 09:54:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:41.057 09:54:46 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:08:41.057 09:54:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:41.057 09:54:46 -- common/autotest_common.sh@10 -- # set +x 00:08:41.057 09:54:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:41.057 09:54:46 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:41.057 09:54:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:41.057 09:54:46 -- common/autotest_common.sh@10 -- # set +x 00:08:41.057 [2024-07-13 09:54:46.799860] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:41.057 09:54:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:41.057 09:54:46 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:41.057 09:54:46 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:08:41.057 09:54:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:41.057 09:54:46 -- common/autotest_common.sh@10 -- # set +x 00:08:41.057 Null2 00:08:41.057 09:54:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:41.057 09:54:46 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:08:41.057 09:54:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:41.057 09:54:46 -- common/autotest_common.sh@10 -- # set +x 00:08:41.057 09:54:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:41.057 09:54:46 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:08:41.057 09:54:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:41.057 09:54:46 -- common/autotest_common.sh@10 -- # set +x 00:08:41.057 09:54:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:41.057 09:54:46 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:08:41.057 09:54:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:41.057 09:54:46 -- common/autotest_common.sh@10 -- # set +x 00:08:41.057 09:54:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:41.057 09:54:46 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:41.057 09:54:46 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:08:41.057 09:54:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:41.057 09:54:46 -- common/autotest_common.sh@10 -- # set +x 00:08:41.057 Null3 00:08:41.057 09:54:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:41.057 09:54:46 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:08:41.057 09:54:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:41.057 09:54:46 -- common/autotest_common.sh@10 -- # set +x 00:08:41.057 09:54:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:41.057 09:54:46 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:08:41.057 09:54:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:41.057 09:54:46 -- common/autotest_common.sh@10 -- # set +x 00:08:41.057 09:54:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:41.057 09:54:46 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:08:41.057 09:54:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:41.057 09:54:46 -- common/autotest_common.sh@10 -- # set +x 00:08:41.057 09:54:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:41.057 09:54:46 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:41.057 09:54:46 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:08:41.057 09:54:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:41.057 09:54:46 -- common/autotest_common.sh@10 -- # set +x 00:08:41.313 Null4 00:08:41.313 09:54:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:41.313 09:54:46 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:08:41.313 09:54:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:41.313 09:54:46 -- common/autotest_common.sh@10 -- # set +x 00:08:41.313 09:54:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:41.313 09:54:46 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:08:41.313 09:54:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:41.313 09:54:46 -- common/autotest_common.sh@10 -- # set +x 00:08:41.313 09:54:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:41.314 09:54:46 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:08:41.314 09:54:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:41.314 09:54:46 -- common/autotest_common.sh@10 -- # set +x 00:08:41.314 09:54:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:41.314 09:54:46 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:08:41.314 09:54:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:41.314 09:54:46 -- common/autotest_common.sh@10 -- # set +x 00:08:41.314 09:54:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:41.314 09:54:46 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:08:41.314 09:54:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:41.314 09:54:46 -- common/autotest_common.sh@10 -- # set +x 00:08:41.314 09:54:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:41.314 09:54:46 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:08:41.314 00:08:41.314 Discovery Log Number of Records 6, Generation counter 6 00:08:41.314 =====Discovery Log Entry 0====== 00:08:41.314 trtype: tcp 00:08:41.314 adrfam: ipv4 00:08:41.314 subtype: current discovery subsystem 00:08:41.314 treq: not required 00:08:41.314 portid: 0 00:08:41.314 trsvcid: 4420 00:08:41.314 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:08:41.314 traddr: 10.0.0.2 00:08:41.314 eflags: explicit discovery connections, duplicate discovery information 00:08:41.314 sectype: none 00:08:41.314 =====Discovery Log Entry 1====== 00:08:41.314 trtype: tcp 00:08:41.314 adrfam: ipv4 00:08:41.314 subtype: nvme subsystem 00:08:41.314 treq: not required 00:08:41.314 portid: 0 00:08:41.314 trsvcid: 4420 00:08:41.314 subnqn: nqn.2016-06.io.spdk:cnode1 00:08:41.314 traddr: 10.0.0.2 00:08:41.314 eflags: none 00:08:41.314 sectype: none 00:08:41.314 =====Discovery Log Entry 2====== 00:08:41.314 trtype: tcp 00:08:41.314 adrfam: ipv4 00:08:41.314 subtype: nvme subsystem 00:08:41.314 treq: not required 00:08:41.314 portid: 0 00:08:41.314 trsvcid: 4420 00:08:41.314 subnqn: nqn.2016-06.io.spdk:cnode2 00:08:41.314 traddr: 10.0.0.2 00:08:41.314 eflags: none 00:08:41.314 sectype: none 00:08:41.314 =====Discovery Log Entry 3====== 00:08:41.314 trtype: tcp 00:08:41.314 adrfam: ipv4 00:08:41.314 subtype: nvme subsystem 00:08:41.314 treq: not required 00:08:41.314 portid: 0 00:08:41.314 trsvcid: 4420 00:08:41.314 subnqn: nqn.2016-06.io.spdk:cnode3 00:08:41.314 traddr: 10.0.0.2 00:08:41.314 eflags: none 00:08:41.314 sectype: none 00:08:41.314 =====Discovery Log Entry 4====== 00:08:41.314 trtype: tcp 00:08:41.314 adrfam: ipv4 00:08:41.314 subtype: nvme subsystem 00:08:41.314 treq: not required 00:08:41.314 portid: 0 00:08:41.314 trsvcid: 4420 00:08:41.314 subnqn: nqn.2016-06.io.spdk:cnode4 00:08:41.314 traddr: 10.0.0.2 00:08:41.314 eflags: none 00:08:41.314 sectype: none 00:08:41.314 =====Discovery Log Entry 5====== 00:08:41.314 trtype: tcp 00:08:41.314 adrfam: ipv4 00:08:41.314 subtype: discovery subsystem referral 00:08:41.314 treq: not required 00:08:41.314 portid: 0 00:08:41.314 trsvcid: 4430 00:08:41.314 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:08:41.314 traddr: 10.0.0.2 00:08:41.314 eflags: none 00:08:41.314 sectype: none 00:08:41.314 09:54:47 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:08:41.314 Perform nvmf subsystem discovery via RPC 00:08:41.314 09:54:47 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:08:41.314 09:54:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:41.314 09:54:47 -- common/autotest_common.sh@10 -- # set +x 00:08:41.314 [2024-07-13 09:54:47.044493] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:08:41.314 [ 00:08:41.314 { 00:08:41.314 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:08:41.314 "subtype": "Discovery", 00:08:41.314 "listen_addresses": [ 00:08:41.314 { 00:08:41.314 "transport": "TCP", 00:08:41.314 "trtype": "TCP", 00:08:41.314 "adrfam": "IPv4", 00:08:41.314 "traddr": "10.0.0.2", 00:08:41.314 "trsvcid": "4420" 00:08:41.314 } 00:08:41.314 ], 00:08:41.314 "allow_any_host": true, 00:08:41.314 "hosts": [] 00:08:41.314 }, 00:08:41.314 { 00:08:41.314 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:08:41.314 "subtype": "NVMe", 00:08:41.314 "listen_addresses": [ 00:08:41.314 { 00:08:41.314 "transport": "TCP", 00:08:41.314 "trtype": "TCP", 00:08:41.314 "adrfam": "IPv4", 00:08:41.314 "traddr": "10.0.0.2", 00:08:41.314 "trsvcid": "4420" 00:08:41.314 } 00:08:41.314 ], 00:08:41.314 "allow_any_host": true, 00:08:41.314 "hosts": [], 00:08:41.314 "serial_number": "SPDK00000000000001", 00:08:41.314 "model_number": "SPDK bdev Controller", 00:08:41.314 "max_namespaces": 32, 00:08:41.314 "min_cntlid": 1, 00:08:41.314 "max_cntlid": 65519, 00:08:41.314 "namespaces": [ 00:08:41.314 { 00:08:41.314 "nsid": 1, 00:08:41.314 "bdev_name": "Null1", 00:08:41.314 "name": "Null1", 00:08:41.314 "nguid": "D0CF94D12C3347008EA0E0E6A5BFB8D8", 00:08:41.314 "uuid": "d0cf94d1-2c33-4700-8ea0-e0e6a5bfb8d8" 00:08:41.314 } 00:08:41.314 ] 00:08:41.314 }, 00:08:41.314 { 00:08:41.314 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:08:41.314 "subtype": "NVMe", 00:08:41.314 "listen_addresses": [ 00:08:41.314 { 00:08:41.314 "transport": "TCP", 00:08:41.314 "trtype": "TCP", 00:08:41.314 "adrfam": "IPv4", 00:08:41.314 "traddr": "10.0.0.2", 00:08:41.314 "trsvcid": "4420" 00:08:41.314 } 00:08:41.314 ], 00:08:41.314 "allow_any_host": true, 00:08:41.314 "hosts": [], 00:08:41.314 "serial_number": "SPDK00000000000002", 00:08:41.314 "model_number": "SPDK bdev Controller", 00:08:41.314 "max_namespaces": 32, 00:08:41.314 "min_cntlid": 1, 00:08:41.314 "max_cntlid": 65519, 00:08:41.314 "namespaces": [ 00:08:41.314 { 00:08:41.314 "nsid": 1, 00:08:41.314 "bdev_name": "Null2", 00:08:41.314 "name": "Null2", 00:08:41.314 "nguid": "FCAC4526BA1C45B5ACAA2B9508835216", 00:08:41.314 "uuid": "fcac4526-ba1c-45b5-acaa-2b9508835216" 00:08:41.314 } 00:08:41.314 ] 00:08:41.314 }, 00:08:41.314 { 00:08:41.314 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:08:41.314 "subtype": "NVMe", 00:08:41.314 "listen_addresses": [ 00:08:41.314 { 00:08:41.314 "transport": "TCP", 00:08:41.314 "trtype": "TCP", 00:08:41.314 "adrfam": "IPv4", 00:08:41.314 "traddr": "10.0.0.2", 00:08:41.314 "trsvcid": "4420" 00:08:41.314 } 00:08:41.314 ], 00:08:41.314 "allow_any_host": true, 00:08:41.314 "hosts": [], 00:08:41.314 "serial_number": "SPDK00000000000003", 00:08:41.314 "model_number": "SPDK bdev Controller", 00:08:41.314 "max_namespaces": 32, 00:08:41.314 "min_cntlid": 1, 00:08:41.314 "max_cntlid": 65519, 00:08:41.314 "namespaces": [ 00:08:41.314 { 00:08:41.314 "nsid": 1, 00:08:41.314 "bdev_name": "Null3", 00:08:41.314 "name": "Null3", 00:08:41.314 "nguid": "583908CF36B84096A3E3AC147FCBDEB3", 00:08:41.314 "uuid": "583908cf-36b8-4096-a3e3-ac147fcbdeb3" 00:08:41.314 } 00:08:41.314 ] 00:08:41.314 }, 00:08:41.314 { 00:08:41.314 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:08:41.314 "subtype": "NVMe", 00:08:41.314 "listen_addresses": [ 00:08:41.314 { 00:08:41.314 "transport": "TCP", 00:08:41.314 "trtype": "TCP", 00:08:41.314 "adrfam": "IPv4", 00:08:41.314 "traddr": "10.0.0.2", 00:08:41.314 "trsvcid": "4420" 00:08:41.314 } 00:08:41.314 ], 00:08:41.314 "allow_any_host": true, 00:08:41.314 "hosts": [], 00:08:41.314 "serial_number": "SPDK00000000000004", 00:08:41.314 "model_number": "SPDK bdev Controller", 00:08:41.314 "max_namespaces": 32, 00:08:41.314 "min_cntlid": 1, 00:08:41.314 "max_cntlid": 65519, 00:08:41.314 "namespaces": [ 00:08:41.314 { 00:08:41.314 "nsid": 1, 00:08:41.314 "bdev_name": "Null4", 00:08:41.314 "name": "Null4", 00:08:41.314 "nguid": "982BF60E5511407095DF5DA5D5D81AEA", 00:08:41.314 "uuid": "982bf60e-5511-4070-95df-5da5d5d81aea" 00:08:41.314 } 00:08:41.314 ] 00:08:41.314 } 00:08:41.314 ] 00:08:41.314 09:54:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:41.314 09:54:47 -- target/discovery.sh@42 -- # seq 1 4 00:08:41.314 09:54:47 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:41.314 09:54:47 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:41.314 09:54:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:41.314 09:54:47 -- common/autotest_common.sh@10 -- # set +x 00:08:41.314 09:54:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:41.314 09:54:47 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:08:41.314 09:54:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:41.314 09:54:47 -- common/autotest_common.sh@10 -- # set +x 00:08:41.314 09:54:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:41.314 09:54:47 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:41.314 09:54:47 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:08:41.314 09:54:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:41.314 09:54:47 -- common/autotest_common.sh@10 -- # set +x 00:08:41.314 09:54:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:41.314 09:54:47 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:08:41.314 09:54:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:41.314 09:54:47 -- common/autotest_common.sh@10 -- # set +x 00:08:41.314 09:54:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:41.314 09:54:47 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:41.314 09:54:47 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:08:41.314 09:54:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:41.314 09:54:47 -- common/autotest_common.sh@10 -- # set +x 00:08:41.314 09:54:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:41.314 09:54:47 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:08:41.314 09:54:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:41.314 09:54:47 -- common/autotest_common.sh@10 -- # set +x 00:08:41.314 09:54:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:41.314 09:54:47 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:41.314 09:54:47 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:08:41.314 09:54:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:41.314 09:54:47 -- common/autotest_common.sh@10 -- # set +x 00:08:41.314 09:54:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:41.314 09:54:47 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:08:41.314 09:54:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:41.314 09:54:47 -- common/autotest_common.sh@10 -- # set +x 00:08:41.314 09:54:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:41.314 09:54:47 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:08:41.314 09:54:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:41.314 09:54:47 -- common/autotest_common.sh@10 -- # set +x 00:08:41.570 09:54:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:41.570 09:54:47 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:08:41.570 09:54:47 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:08:41.570 09:54:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:41.570 09:54:47 -- common/autotest_common.sh@10 -- # set +x 00:08:41.571 09:54:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:41.571 09:54:47 -- target/discovery.sh@49 -- # check_bdevs= 00:08:41.571 09:54:47 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:08:41.571 09:54:47 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:08:41.571 09:54:47 -- target/discovery.sh@57 -- # nvmftestfini 00:08:41.571 09:54:47 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:41.571 09:54:47 -- nvmf/common.sh@116 -- # sync 00:08:41.571 09:54:47 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:41.571 09:54:47 -- nvmf/common.sh@119 -- # set +e 00:08:41.571 09:54:47 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:41.571 09:54:47 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:41.571 rmmod nvme_tcp 00:08:41.571 rmmod nvme_fabrics 00:08:41.571 rmmod nvme_keyring 00:08:41.571 09:54:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:41.571 09:54:47 -- nvmf/common.sh@123 -- # set -e 00:08:41.571 09:54:47 -- nvmf/common.sh@124 -- # return 0 00:08:41.571 09:54:47 -- nvmf/common.sh@477 -- # '[' -n 2718130 ']' 00:08:41.571 09:54:47 -- nvmf/common.sh@478 -- # killprocess 2718130 00:08:41.571 09:54:47 -- common/autotest_common.sh@926 -- # '[' -z 2718130 ']' 00:08:41.571 09:54:47 -- common/autotest_common.sh@930 -- # kill -0 2718130 00:08:41.571 09:54:47 -- common/autotest_common.sh@931 -- # uname 00:08:41.571 09:54:47 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:08:41.571 09:54:47 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2718130 00:08:41.571 09:54:47 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:08:41.571 09:54:47 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:08:41.571 09:54:47 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2718130' 00:08:41.571 killing process with pid 2718130 00:08:41.571 09:54:47 -- common/autotest_common.sh@945 -- # kill 2718130 00:08:41.571 [2024-07-13 09:54:47.253269] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:08:41.571 09:54:47 -- common/autotest_common.sh@950 -- # wait 2718130 00:08:41.829 09:54:47 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:41.829 09:54:47 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:41.829 09:54:47 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:41.829 09:54:47 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:41.829 09:54:47 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:41.829 09:54:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:41.829 09:54:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:41.829 09:54:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:43.728 09:54:49 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:43.728 00:08:43.728 real 0m6.017s 00:08:43.728 user 0m7.224s 00:08:43.728 sys 0m1.835s 00:08:43.728 09:54:49 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:43.728 09:54:49 -- common/autotest_common.sh@10 -- # set +x 00:08:43.728 ************************************ 00:08:43.728 END TEST nvmf_discovery 00:08:43.728 ************************************ 00:08:43.728 09:54:49 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:08:43.728 09:54:49 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:08:43.728 09:54:49 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:43.728 09:54:49 -- common/autotest_common.sh@10 -- # set +x 00:08:43.988 ************************************ 00:08:43.988 START TEST nvmf_referrals 00:08:43.988 ************************************ 00:08:43.988 09:54:49 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:08:43.988 * Looking for test storage... 00:08:43.988 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:43.988 09:54:49 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:43.988 09:54:49 -- nvmf/common.sh@7 -- # uname -s 00:08:43.988 09:54:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:43.988 09:54:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:43.988 09:54:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:43.988 09:54:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:43.988 09:54:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:43.988 09:54:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:43.988 09:54:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:43.988 09:54:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:43.988 09:54:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:43.988 09:54:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:43.988 09:54:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:43.988 09:54:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:43.988 09:54:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:43.988 09:54:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:43.988 09:54:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:43.988 09:54:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:43.988 09:54:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:43.988 09:54:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:43.988 09:54:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:43.988 09:54:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:43.988 09:54:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:43.988 09:54:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:43.989 09:54:49 -- paths/export.sh@5 -- # export PATH 00:08:43.989 09:54:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:43.989 09:54:49 -- nvmf/common.sh@46 -- # : 0 00:08:43.989 09:54:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:43.989 09:54:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:43.989 09:54:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:43.989 09:54:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:43.989 09:54:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:43.989 09:54:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:43.989 09:54:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:43.989 09:54:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:43.989 09:54:49 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:08:43.989 09:54:49 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:08:43.989 09:54:49 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:08:43.989 09:54:49 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:08:43.989 09:54:49 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:08:43.989 09:54:49 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:08:43.989 09:54:49 -- target/referrals.sh@37 -- # nvmftestinit 00:08:43.989 09:54:49 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:43.989 09:54:49 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:43.989 09:54:49 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:43.989 09:54:49 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:43.989 09:54:49 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:43.989 09:54:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:43.989 09:54:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:43.989 09:54:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:43.989 09:54:49 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:43.989 09:54:49 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:43.989 09:54:49 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:43.989 09:54:49 -- common/autotest_common.sh@10 -- # set +x 00:08:45.890 09:54:51 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:45.890 09:54:51 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:45.890 09:54:51 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:45.890 09:54:51 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:45.890 09:54:51 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:45.890 09:54:51 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:45.890 09:54:51 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:45.890 09:54:51 -- nvmf/common.sh@294 -- # net_devs=() 00:08:45.890 09:54:51 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:45.890 09:54:51 -- nvmf/common.sh@295 -- # e810=() 00:08:45.890 09:54:51 -- nvmf/common.sh@295 -- # local -ga e810 00:08:45.890 09:54:51 -- nvmf/common.sh@296 -- # x722=() 00:08:45.890 09:54:51 -- nvmf/common.sh@296 -- # local -ga x722 00:08:45.890 09:54:51 -- nvmf/common.sh@297 -- # mlx=() 00:08:45.890 09:54:51 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:45.890 09:54:51 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:45.890 09:54:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:45.890 09:54:51 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:45.890 09:54:51 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:45.890 09:54:51 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:45.890 09:54:51 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:45.890 09:54:51 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:45.890 09:54:51 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:45.890 09:54:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:45.890 09:54:51 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:45.890 09:54:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:45.890 09:54:51 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:45.890 09:54:51 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:45.890 09:54:51 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:45.890 09:54:51 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:45.890 09:54:51 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:45.890 09:54:51 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:45.890 09:54:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:45.890 09:54:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:45.890 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:45.890 09:54:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:45.891 09:54:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:45.891 09:54:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:45.891 09:54:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:45.891 09:54:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:45.891 09:54:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:45.891 09:54:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:45.891 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:45.891 09:54:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:45.891 09:54:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:45.891 09:54:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:45.891 09:54:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:45.891 09:54:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:45.891 09:54:51 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:45.891 09:54:51 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:45.891 09:54:51 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:45.891 09:54:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:45.891 09:54:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:45.891 09:54:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:45.891 09:54:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:45.891 09:54:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:45.891 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:45.891 09:54:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:45.891 09:54:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:45.891 09:54:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:45.891 09:54:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:45.891 09:54:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:45.891 09:54:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:45.891 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:45.891 09:54:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:45.891 09:54:51 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:45.891 09:54:51 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:45.891 09:54:51 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:45.891 09:54:51 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:45.891 09:54:51 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:45.891 09:54:51 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:45.891 09:54:51 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:45.891 09:54:51 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:45.891 09:54:51 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:45.891 09:54:51 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:45.891 09:54:51 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:45.891 09:54:51 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:45.891 09:54:51 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:45.891 09:54:51 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:45.891 09:54:51 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:45.891 09:54:51 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:45.891 09:54:51 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:45.891 09:54:51 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:45.891 09:54:51 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:45.891 09:54:51 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:45.891 09:54:51 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:45.891 09:54:51 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:46.148 09:54:51 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:46.148 09:54:51 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:46.148 09:54:51 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:46.148 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:46.148 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.254 ms 00:08:46.148 00:08:46.148 --- 10.0.0.2 ping statistics --- 00:08:46.148 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:46.149 rtt min/avg/max/mdev = 0.254/0.254/0.254/0.000 ms 00:08:46.149 09:54:51 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:46.149 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:46.149 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.164 ms 00:08:46.149 00:08:46.149 --- 10.0.0.1 ping statistics --- 00:08:46.149 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:46.149 rtt min/avg/max/mdev = 0.164/0.164/0.164/0.000 ms 00:08:46.149 09:54:51 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:46.149 09:54:51 -- nvmf/common.sh@410 -- # return 0 00:08:46.149 09:54:51 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:46.149 09:54:51 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:46.149 09:54:51 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:46.149 09:54:51 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:46.149 09:54:51 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:46.149 09:54:51 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:46.149 09:54:51 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:46.149 09:54:51 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:08:46.149 09:54:51 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:46.149 09:54:51 -- common/autotest_common.sh@712 -- # xtrace_disable 00:08:46.149 09:54:51 -- common/autotest_common.sh@10 -- # set +x 00:08:46.149 09:54:51 -- nvmf/common.sh@469 -- # nvmfpid=2720252 00:08:46.149 09:54:51 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:46.149 09:54:51 -- nvmf/common.sh@470 -- # waitforlisten 2720252 00:08:46.149 09:54:51 -- common/autotest_common.sh@819 -- # '[' -z 2720252 ']' 00:08:46.149 09:54:51 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:46.149 09:54:51 -- common/autotest_common.sh@824 -- # local max_retries=100 00:08:46.149 09:54:51 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:46.149 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:46.149 09:54:51 -- common/autotest_common.sh@828 -- # xtrace_disable 00:08:46.149 09:54:51 -- common/autotest_common.sh@10 -- # set +x 00:08:46.149 [2024-07-13 09:54:51.819977] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:08:46.149 [2024-07-13 09:54:51.820069] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:46.149 EAL: No free 2048 kB hugepages reported on node 1 00:08:46.149 [2024-07-13 09:54:51.896794] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:46.405 [2024-07-13 09:54:51.995527] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:46.405 [2024-07-13 09:54:51.995696] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:46.405 [2024-07-13 09:54:51.995716] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:46.405 [2024-07-13 09:54:51.995730] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:46.405 [2024-07-13 09:54:51.995810] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:46.405 [2024-07-13 09:54:51.995923] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:46.405 [2024-07-13 09:54:51.995863] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:46.405 [2024-07-13 09:54:51.995926] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:47.337 09:54:52 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:08:47.337 09:54:52 -- common/autotest_common.sh@852 -- # return 0 00:08:47.337 09:54:52 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:47.337 09:54:52 -- common/autotest_common.sh@718 -- # xtrace_disable 00:08:47.337 09:54:52 -- common/autotest_common.sh@10 -- # set +x 00:08:47.337 09:54:52 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:47.337 09:54:52 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:08:47.337 09:54:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:47.337 09:54:52 -- common/autotest_common.sh@10 -- # set +x 00:08:47.337 [2024-07-13 09:54:52.846641] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:47.337 09:54:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:47.337 09:54:52 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:08:47.337 09:54:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:47.337 09:54:52 -- common/autotest_common.sh@10 -- # set +x 00:08:47.337 [2024-07-13 09:54:52.858807] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:08:47.337 09:54:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:47.337 09:54:52 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:08:47.337 09:54:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:47.337 09:54:52 -- common/autotest_common.sh@10 -- # set +x 00:08:47.337 09:54:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:47.337 09:54:52 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:08:47.337 09:54:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:47.337 09:54:52 -- common/autotest_common.sh@10 -- # set +x 00:08:47.337 09:54:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:47.337 09:54:52 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:08:47.337 09:54:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:47.337 09:54:52 -- common/autotest_common.sh@10 -- # set +x 00:08:47.337 09:54:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:47.337 09:54:52 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:47.337 09:54:52 -- target/referrals.sh@48 -- # jq length 00:08:47.337 09:54:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:47.337 09:54:52 -- common/autotest_common.sh@10 -- # set +x 00:08:47.337 09:54:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:47.337 09:54:52 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:08:47.337 09:54:52 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:08:47.337 09:54:52 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:47.337 09:54:52 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:47.337 09:54:52 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:47.337 09:54:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:47.337 09:54:52 -- common/autotest_common.sh@10 -- # set +x 00:08:47.337 09:54:52 -- target/referrals.sh@21 -- # sort 00:08:47.337 09:54:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:47.337 09:54:52 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:08:47.337 09:54:52 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:08:47.337 09:54:52 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:08:47.337 09:54:52 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:47.337 09:54:52 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:47.337 09:54:52 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:47.337 09:54:52 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:47.337 09:54:52 -- target/referrals.sh@26 -- # sort 00:08:47.337 09:54:53 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:08:47.337 09:54:53 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:08:47.337 09:54:53 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:08:47.337 09:54:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:47.337 09:54:53 -- common/autotest_common.sh@10 -- # set +x 00:08:47.337 09:54:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:47.337 09:54:53 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:08:47.337 09:54:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:47.337 09:54:53 -- common/autotest_common.sh@10 -- # set +x 00:08:47.337 09:54:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:47.337 09:54:53 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:08:47.337 09:54:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:47.337 09:54:53 -- common/autotest_common.sh@10 -- # set +x 00:08:47.337 09:54:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:47.337 09:54:53 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:47.337 09:54:53 -- target/referrals.sh@56 -- # jq length 00:08:47.337 09:54:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:47.337 09:54:53 -- common/autotest_common.sh@10 -- # set +x 00:08:47.595 09:54:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:47.595 09:54:53 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:08:47.595 09:54:53 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:08:47.595 09:54:53 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:47.595 09:54:53 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:47.595 09:54:53 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:47.595 09:54:53 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:47.595 09:54:53 -- target/referrals.sh@26 -- # sort 00:08:47.595 09:54:53 -- target/referrals.sh@26 -- # echo 00:08:47.595 09:54:53 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:08:47.595 09:54:53 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:08:47.595 09:54:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:47.595 09:54:53 -- common/autotest_common.sh@10 -- # set +x 00:08:47.595 09:54:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:47.595 09:54:53 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:08:47.595 09:54:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:47.595 09:54:53 -- common/autotest_common.sh@10 -- # set +x 00:08:47.595 09:54:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:47.595 09:54:53 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:08:47.595 09:54:53 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:47.595 09:54:53 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:47.595 09:54:53 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:47.595 09:54:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:47.595 09:54:53 -- common/autotest_common.sh@10 -- # set +x 00:08:47.595 09:54:53 -- target/referrals.sh@21 -- # sort 00:08:47.595 09:54:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:47.595 09:54:53 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:08:47.595 09:54:53 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:08:47.596 09:54:53 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:08:47.596 09:54:53 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:47.596 09:54:53 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:47.596 09:54:53 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:47.596 09:54:53 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:47.596 09:54:53 -- target/referrals.sh@26 -- # sort 00:08:47.596 09:54:53 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:08:47.596 09:54:53 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:08:47.596 09:54:53 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:08:47.596 09:54:53 -- target/referrals.sh@67 -- # jq -r .subnqn 00:08:47.596 09:54:53 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:08:47.596 09:54:53 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:47.596 09:54:53 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:08:47.854 09:54:53 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:08:47.854 09:54:53 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:08:47.854 09:54:53 -- target/referrals.sh@68 -- # jq -r .subnqn 00:08:47.854 09:54:53 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:08:47.854 09:54:53 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:47.854 09:54:53 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:08:47.854 09:54:53 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:08:47.854 09:54:53 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:08:47.854 09:54:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:47.854 09:54:53 -- common/autotest_common.sh@10 -- # set +x 00:08:47.854 09:54:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:47.854 09:54:53 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:08:47.854 09:54:53 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:47.854 09:54:53 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:47.854 09:54:53 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:47.854 09:54:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:47.854 09:54:53 -- common/autotest_common.sh@10 -- # set +x 00:08:47.854 09:54:53 -- target/referrals.sh@21 -- # sort 00:08:47.854 09:54:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:47.854 09:54:53 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:08:47.854 09:54:53 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:08:47.854 09:54:53 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:08:47.854 09:54:53 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:47.854 09:54:53 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:47.854 09:54:53 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:47.854 09:54:53 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:47.854 09:54:53 -- target/referrals.sh@26 -- # sort 00:08:48.110 09:54:53 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:08:48.110 09:54:53 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:08:48.110 09:54:53 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:08:48.110 09:54:53 -- target/referrals.sh@75 -- # jq -r .subnqn 00:08:48.110 09:54:53 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:08:48.111 09:54:53 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:48.111 09:54:53 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:08:48.367 09:54:53 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:08:48.367 09:54:53 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:08:48.367 09:54:53 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:08:48.367 09:54:53 -- target/referrals.sh@76 -- # jq -r .subnqn 00:08:48.367 09:54:53 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:48.367 09:54:53 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:08:48.367 09:54:54 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:08:48.367 09:54:54 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:08:48.367 09:54:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:48.367 09:54:54 -- common/autotest_common.sh@10 -- # set +x 00:08:48.367 09:54:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:48.367 09:54:54 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:48.367 09:54:54 -- target/referrals.sh@82 -- # jq length 00:08:48.367 09:54:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:48.368 09:54:54 -- common/autotest_common.sh@10 -- # set +x 00:08:48.368 09:54:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:48.368 09:54:54 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:08:48.368 09:54:54 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:08:48.368 09:54:54 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:48.368 09:54:54 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:48.368 09:54:54 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:48.368 09:54:54 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:48.368 09:54:54 -- target/referrals.sh@26 -- # sort 00:08:48.625 09:54:54 -- target/referrals.sh@26 -- # echo 00:08:48.625 09:54:54 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:08:48.625 09:54:54 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:08:48.625 09:54:54 -- target/referrals.sh@86 -- # nvmftestfini 00:08:48.625 09:54:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:48.625 09:54:54 -- nvmf/common.sh@116 -- # sync 00:08:48.625 09:54:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:48.625 09:54:54 -- nvmf/common.sh@119 -- # set +e 00:08:48.625 09:54:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:48.625 09:54:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:48.625 rmmod nvme_tcp 00:08:48.625 rmmod nvme_fabrics 00:08:48.625 rmmod nvme_keyring 00:08:48.625 09:54:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:48.625 09:54:54 -- nvmf/common.sh@123 -- # set -e 00:08:48.625 09:54:54 -- nvmf/common.sh@124 -- # return 0 00:08:48.625 09:54:54 -- nvmf/common.sh@477 -- # '[' -n 2720252 ']' 00:08:48.625 09:54:54 -- nvmf/common.sh@478 -- # killprocess 2720252 00:08:48.625 09:54:54 -- common/autotest_common.sh@926 -- # '[' -z 2720252 ']' 00:08:48.625 09:54:54 -- common/autotest_common.sh@930 -- # kill -0 2720252 00:08:48.625 09:54:54 -- common/autotest_common.sh@931 -- # uname 00:08:48.625 09:54:54 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:08:48.625 09:54:54 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2720252 00:08:48.625 09:54:54 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:08:48.625 09:54:54 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:08:48.625 09:54:54 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2720252' 00:08:48.625 killing process with pid 2720252 00:08:48.625 09:54:54 -- common/autotest_common.sh@945 -- # kill 2720252 00:08:48.625 09:54:54 -- common/autotest_common.sh@950 -- # wait 2720252 00:08:48.883 09:54:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:48.883 09:54:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:48.883 09:54:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:48.883 09:54:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:48.883 09:54:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:48.883 09:54:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:48.883 09:54:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:48.883 09:54:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:50.791 09:54:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:50.791 00:08:50.791 real 0m7.007s 00:08:50.791 user 0m11.605s 00:08:50.791 sys 0m2.166s 00:08:50.791 09:54:56 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:50.791 09:54:56 -- common/autotest_common.sh@10 -- # set +x 00:08:50.791 ************************************ 00:08:50.791 END TEST nvmf_referrals 00:08:50.791 ************************************ 00:08:50.791 09:54:56 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:08:50.791 09:54:56 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:08:50.791 09:54:56 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:50.791 09:54:56 -- common/autotest_common.sh@10 -- # set +x 00:08:50.791 ************************************ 00:08:50.791 START TEST nvmf_connect_disconnect 00:08:50.791 ************************************ 00:08:50.791 09:54:56 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:08:51.050 * Looking for test storage... 00:08:51.050 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:51.050 09:54:56 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:51.050 09:54:56 -- nvmf/common.sh@7 -- # uname -s 00:08:51.050 09:54:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:51.050 09:54:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:51.050 09:54:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:51.050 09:54:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:51.050 09:54:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:51.050 09:54:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:51.050 09:54:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:51.050 09:54:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:51.050 09:54:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:51.050 09:54:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:51.050 09:54:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:51.050 09:54:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:51.050 09:54:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:51.050 09:54:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:51.050 09:54:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:51.050 09:54:56 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:51.050 09:54:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:51.050 09:54:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:51.050 09:54:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:51.050 09:54:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:51.050 09:54:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:51.050 09:54:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:51.050 09:54:56 -- paths/export.sh@5 -- # export PATH 00:08:51.050 09:54:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:51.050 09:54:56 -- nvmf/common.sh@46 -- # : 0 00:08:51.050 09:54:56 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:51.050 09:54:56 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:51.050 09:54:56 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:51.050 09:54:56 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:51.050 09:54:56 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:51.050 09:54:56 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:51.050 09:54:56 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:51.050 09:54:56 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:51.050 09:54:56 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:08:51.050 09:54:56 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:08:51.050 09:54:56 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:08:51.050 09:54:56 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:51.050 09:54:56 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:51.050 09:54:56 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:51.050 09:54:56 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:51.050 09:54:56 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:51.050 09:54:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:51.050 09:54:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:51.050 09:54:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:51.050 09:54:56 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:51.050 09:54:56 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:51.050 09:54:56 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:51.050 09:54:56 -- common/autotest_common.sh@10 -- # set +x 00:08:52.953 09:54:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:52.953 09:54:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:52.953 09:54:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:52.953 09:54:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:52.953 09:54:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:52.953 09:54:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:52.953 09:54:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:52.953 09:54:58 -- nvmf/common.sh@294 -- # net_devs=() 00:08:52.953 09:54:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:52.953 09:54:58 -- nvmf/common.sh@295 -- # e810=() 00:08:52.953 09:54:58 -- nvmf/common.sh@295 -- # local -ga e810 00:08:52.953 09:54:58 -- nvmf/common.sh@296 -- # x722=() 00:08:52.953 09:54:58 -- nvmf/common.sh@296 -- # local -ga x722 00:08:52.953 09:54:58 -- nvmf/common.sh@297 -- # mlx=() 00:08:52.953 09:54:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:52.953 09:54:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:52.953 09:54:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:52.953 09:54:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:52.953 09:54:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:52.953 09:54:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:52.953 09:54:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:52.953 09:54:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:52.953 09:54:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:52.953 09:54:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:52.953 09:54:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:52.953 09:54:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:52.953 09:54:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:52.953 09:54:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:52.953 09:54:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:52.953 09:54:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:52.953 09:54:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:52.953 09:54:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:52.953 09:54:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:52.953 09:54:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:52.953 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:52.953 09:54:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:52.953 09:54:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:52.953 09:54:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:52.953 09:54:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:52.953 09:54:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:52.953 09:54:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:52.953 09:54:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:52.953 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:52.953 09:54:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:52.953 09:54:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:52.953 09:54:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:52.953 09:54:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:52.953 09:54:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:52.953 09:54:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:52.953 09:54:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:52.953 09:54:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:52.953 09:54:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:52.953 09:54:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:52.953 09:54:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:52.953 09:54:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:52.953 09:54:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:52.953 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:52.953 09:54:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:52.953 09:54:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:52.953 09:54:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:52.953 09:54:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:52.953 09:54:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:52.953 09:54:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:52.953 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:52.953 09:54:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:52.953 09:54:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:52.953 09:54:58 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:52.953 09:54:58 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:52.953 09:54:58 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:52.953 09:54:58 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:52.953 09:54:58 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:52.953 09:54:58 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:52.953 09:54:58 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:52.953 09:54:58 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:52.953 09:54:58 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:52.953 09:54:58 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:52.953 09:54:58 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:52.953 09:54:58 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:52.953 09:54:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:52.953 09:54:58 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:52.953 09:54:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:52.953 09:54:58 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:52.953 09:54:58 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:52.953 09:54:58 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:52.953 09:54:58 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:52.953 09:54:58 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:52.953 09:54:58 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:53.211 09:54:58 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:53.211 09:54:58 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:53.211 09:54:58 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:53.211 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:53.211 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.187 ms 00:08:53.211 00:08:53.211 --- 10.0.0.2 ping statistics --- 00:08:53.211 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:53.211 rtt min/avg/max/mdev = 0.187/0.187/0.187/0.000 ms 00:08:53.211 09:54:58 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:53.211 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:53.211 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.117 ms 00:08:53.211 00:08:53.211 --- 10.0.0.1 ping statistics --- 00:08:53.211 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:53.211 rtt min/avg/max/mdev = 0.117/0.117/0.117/0.000 ms 00:08:53.211 09:54:58 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:53.211 09:54:58 -- nvmf/common.sh@410 -- # return 0 00:08:53.211 09:54:58 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:53.211 09:54:58 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:53.211 09:54:58 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:53.211 09:54:58 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:53.212 09:54:58 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:53.212 09:54:58 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:53.212 09:54:58 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:53.212 09:54:58 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:08:53.212 09:54:58 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:53.212 09:54:58 -- common/autotest_common.sh@712 -- # xtrace_disable 00:08:53.212 09:54:58 -- common/autotest_common.sh@10 -- # set +x 00:08:53.212 09:54:58 -- nvmf/common.sh@469 -- # nvmfpid=2722572 00:08:53.212 09:54:58 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:53.212 09:54:58 -- nvmf/common.sh@470 -- # waitforlisten 2722572 00:08:53.212 09:54:58 -- common/autotest_common.sh@819 -- # '[' -z 2722572 ']' 00:08:53.212 09:54:58 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:53.212 09:54:58 -- common/autotest_common.sh@824 -- # local max_retries=100 00:08:53.212 09:54:58 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:53.212 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:53.212 09:54:58 -- common/autotest_common.sh@828 -- # xtrace_disable 00:08:53.212 09:54:58 -- common/autotest_common.sh@10 -- # set +x 00:08:53.212 [2024-07-13 09:54:58.885235] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:08:53.212 [2024-07-13 09:54:58.885328] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:53.212 EAL: No free 2048 kB hugepages reported on node 1 00:08:53.212 [2024-07-13 09:54:58.955262] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:53.470 [2024-07-13 09:54:59.048492] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:53.470 [2024-07-13 09:54:59.048656] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:53.470 [2024-07-13 09:54:59.048677] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:53.470 [2024-07-13 09:54:59.048692] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:53.470 [2024-07-13 09:54:59.048773] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:53.470 [2024-07-13 09:54:59.048829] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:53.470 [2024-07-13 09:54:59.048891] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:53.470 [2024-07-13 09:54:59.048894] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:54.034 09:54:59 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:08:54.034 09:54:59 -- common/autotest_common.sh@852 -- # return 0 00:08:54.034 09:54:59 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:54.034 09:54:59 -- common/autotest_common.sh@718 -- # xtrace_disable 00:08:54.034 09:54:59 -- common/autotest_common.sh@10 -- # set +x 00:08:54.034 09:54:59 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:54.034 09:54:59 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:08:54.034 09:54:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:54.034 09:54:59 -- common/autotest_common.sh@10 -- # set +x 00:08:54.034 [2024-07-13 09:54:59.840397] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:54.034 09:54:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:54.034 09:54:59 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:08:54.034 09:54:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:54.034 09:54:59 -- common/autotest_common.sh@10 -- # set +x 00:08:54.291 09:54:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:54.291 09:54:59 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:08:54.291 09:54:59 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:54.291 09:54:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:54.291 09:54:59 -- common/autotest_common.sh@10 -- # set +x 00:08:54.291 09:54:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:54.291 09:54:59 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:08:54.291 09:54:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:54.291 09:54:59 -- common/autotest_common.sh@10 -- # set +x 00:08:54.291 09:54:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:54.291 09:54:59 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:54.291 09:54:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:54.291 09:54:59 -- common/autotest_common.sh@10 -- # set +x 00:08:54.291 [2024-07-13 09:54:59.897501] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:54.291 09:54:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:54.291 09:54:59 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:08:54.291 09:54:59 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:08:54.291 09:54:59 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:08:54.291 09:54:59 -- target/connect_disconnect.sh@34 -- # set +x 00:08:56.816 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:58.712 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:01.236 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:03.757 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:05.653 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:08.177 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:10.075 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:12.600 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:15.126 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:17.065 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:19.589 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:21.484 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:24.008 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:26.533 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:29.056 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:30.951 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:33.485 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:36.008 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:37.937 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:40.461 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:42.986 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:44.883 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:47.425 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:49.944 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:51.839 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:54.358 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:56.913 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:58.803 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:01.326 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:03.851 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:05.748 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:08.273 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:10.797 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:12.691 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:15.217 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:17.757 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:20.282 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:22.179 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:24.705 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:27.229 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:29.125 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:31.650 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:33.547 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:36.068 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:38.589 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:41.114 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:43.012 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:45.539 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:47.436 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:49.958 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:52.508 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:54.404 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:56.928 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:59.451 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:01.348 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:03.873 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:06.399 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:08.294 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:10.845 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:13.368 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:15.265 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:17.785 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:19.679 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:22.200 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:24.725 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:26.622 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:29.149 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:31.044 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:33.572 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:36.098 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:37.990 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:40.515 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:43.040 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:44.935 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:47.518 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:50.040 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:51.937 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:54.465 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:56.986 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:58.879 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:01.404 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:03.933 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:05.835 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:08.355 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:10.249 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:12.775 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:14.673 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:17.198 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:19.097 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:21.639 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:24.201 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:26.108 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:28.643 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:30.547 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:33.079 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:35.609 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:37.513 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:40.046 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:42.578 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:44.474 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:44.731 09:58:50 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:12:44.731 09:58:50 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:12:44.731 09:58:50 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:44.731 09:58:50 -- nvmf/common.sh@116 -- # sync 00:12:44.731 09:58:50 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:44.731 09:58:50 -- nvmf/common.sh@119 -- # set +e 00:12:44.731 09:58:50 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:44.731 09:58:50 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:44.731 rmmod nvme_tcp 00:12:44.731 rmmod nvme_fabrics 00:12:44.731 rmmod nvme_keyring 00:12:44.731 09:58:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:44.731 09:58:50 -- nvmf/common.sh@123 -- # set -e 00:12:44.731 09:58:50 -- nvmf/common.sh@124 -- # return 0 00:12:44.731 09:58:50 -- nvmf/common.sh@477 -- # '[' -n 2722572 ']' 00:12:44.732 09:58:50 -- nvmf/common.sh@478 -- # killprocess 2722572 00:12:44.732 09:58:50 -- common/autotest_common.sh@926 -- # '[' -z 2722572 ']' 00:12:44.732 09:58:50 -- common/autotest_common.sh@930 -- # kill -0 2722572 00:12:44.732 09:58:50 -- common/autotest_common.sh@931 -- # uname 00:12:44.732 09:58:50 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:12:44.732 09:58:50 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2722572 00:12:44.732 09:58:50 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:12:44.732 09:58:50 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:12:44.732 09:58:50 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2722572' 00:12:44.732 killing process with pid 2722572 00:12:44.732 09:58:50 -- common/autotest_common.sh@945 -- # kill 2722572 00:12:44.732 09:58:50 -- common/autotest_common.sh@950 -- # wait 2722572 00:12:44.990 09:58:50 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:44.990 09:58:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:44.990 09:58:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:44.990 09:58:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:44.990 09:58:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:44.990 09:58:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:44.990 09:58:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:44.990 09:58:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:46.893 09:58:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:46.893 00:12:46.893 real 3m56.102s 00:12:46.893 user 14m58.786s 00:12:46.893 sys 0m35.056s 00:12:46.893 09:58:52 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:12:46.893 09:58:52 -- common/autotest_common.sh@10 -- # set +x 00:12:46.893 ************************************ 00:12:46.893 END TEST nvmf_connect_disconnect 00:12:46.893 ************************************ 00:12:46.893 09:58:52 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:12:46.893 09:58:52 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:12:46.893 09:58:52 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:12:46.893 09:58:52 -- common/autotest_common.sh@10 -- # set +x 00:12:47.152 ************************************ 00:12:47.152 START TEST nvmf_multitarget 00:12:47.152 ************************************ 00:12:47.152 09:58:52 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:12:47.152 * Looking for test storage... 00:12:47.152 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:47.152 09:58:52 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:47.152 09:58:52 -- nvmf/common.sh@7 -- # uname -s 00:12:47.152 09:58:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:47.152 09:58:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:47.152 09:58:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:47.152 09:58:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:47.152 09:58:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:47.152 09:58:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:47.152 09:58:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:47.152 09:58:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:47.152 09:58:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:47.152 09:58:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:47.152 09:58:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:47.152 09:58:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:47.152 09:58:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:47.152 09:58:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:47.152 09:58:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:47.152 09:58:52 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:47.152 09:58:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:47.152 09:58:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:47.152 09:58:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:47.152 09:58:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:47.152 09:58:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:47.152 09:58:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:47.152 09:58:52 -- paths/export.sh@5 -- # export PATH 00:12:47.152 09:58:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:47.152 09:58:52 -- nvmf/common.sh@46 -- # : 0 00:12:47.152 09:58:52 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:47.152 09:58:52 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:47.152 09:58:52 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:47.152 09:58:52 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:47.152 09:58:52 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:47.152 09:58:52 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:47.152 09:58:52 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:47.152 09:58:52 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:47.152 09:58:52 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:12:47.152 09:58:52 -- target/multitarget.sh@15 -- # nvmftestinit 00:12:47.152 09:58:52 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:47.152 09:58:52 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:47.152 09:58:52 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:47.152 09:58:52 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:47.152 09:58:52 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:47.152 09:58:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:47.152 09:58:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:47.152 09:58:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:47.152 09:58:52 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:47.152 09:58:52 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:47.152 09:58:52 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:47.152 09:58:52 -- common/autotest_common.sh@10 -- # set +x 00:12:49.053 09:58:54 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:49.053 09:58:54 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:49.053 09:58:54 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:49.053 09:58:54 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:49.053 09:58:54 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:49.053 09:58:54 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:49.053 09:58:54 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:49.053 09:58:54 -- nvmf/common.sh@294 -- # net_devs=() 00:12:49.053 09:58:54 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:49.053 09:58:54 -- nvmf/common.sh@295 -- # e810=() 00:12:49.053 09:58:54 -- nvmf/common.sh@295 -- # local -ga e810 00:12:49.053 09:58:54 -- nvmf/common.sh@296 -- # x722=() 00:12:49.053 09:58:54 -- nvmf/common.sh@296 -- # local -ga x722 00:12:49.053 09:58:54 -- nvmf/common.sh@297 -- # mlx=() 00:12:49.053 09:58:54 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:49.053 09:58:54 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:49.053 09:58:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:49.053 09:58:54 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:49.053 09:58:54 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:49.053 09:58:54 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:49.053 09:58:54 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:49.053 09:58:54 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:49.053 09:58:54 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:49.053 09:58:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:49.053 09:58:54 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:49.053 09:58:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:49.053 09:58:54 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:49.053 09:58:54 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:49.053 09:58:54 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:49.053 09:58:54 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:49.053 09:58:54 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:49.053 09:58:54 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:49.053 09:58:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:49.053 09:58:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:49.053 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:49.053 09:58:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:49.053 09:58:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:49.053 09:58:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:49.053 09:58:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:49.053 09:58:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:49.053 09:58:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:49.053 09:58:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:49.053 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:49.053 09:58:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:49.053 09:58:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:49.053 09:58:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:49.053 09:58:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:49.053 09:58:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:49.053 09:58:54 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:49.053 09:58:54 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:49.053 09:58:54 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:49.053 09:58:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:49.053 09:58:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:49.053 09:58:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:49.053 09:58:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:49.053 09:58:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:49.053 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:49.053 09:58:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:49.053 09:58:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:49.053 09:58:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:49.053 09:58:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:49.053 09:58:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:49.053 09:58:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:49.053 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:49.053 09:58:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:49.053 09:58:54 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:49.053 09:58:54 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:49.053 09:58:54 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:49.053 09:58:54 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:49.053 09:58:54 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:49.053 09:58:54 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:49.053 09:58:54 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:49.053 09:58:54 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:49.053 09:58:54 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:49.053 09:58:54 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:49.053 09:58:54 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:49.053 09:58:54 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:49.053 09:58:54 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:49.053 09:58:54 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:49.053 09:58:54 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:49.053 09:58:54 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:49.053 09:58:54 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:49.053 09:58:54 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:49.053 09:58:54 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:49.053 09:58:54 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:49.053 09:58:54 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:49.053 09:58:54 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:49.053 09:58:54 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:49.053 09:58:54 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:49.053 09:58:54 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:49.312 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:49.312 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.182 ms 00:12:49.312 00:12:49.312 --- 10.0.0.2 ping statistics --- 00:12:49.312 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:49.312 rtt min/avg/max/mdev = 0.182/0.182/0.182/0.000 ms 00:12:49.312 09:58:54 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:49.312 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:49.312 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.209 ms 00:12:49.312 00:12:49.312 --- 10.0.0.1 ping statistics --- 00:12:49.312 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:49.312 rtt min/avg/max/mdev = 0.209/0.209/0.209/0.000 ms 00:12:49.312 09:58:54 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:49.312 09:58:54 -- nvmf/common.sh@410 -- # return 0 00:12:49.312 09:58:54 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:49.312 09:58:54 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:49.312 09:58:54 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:49.312 09:58:54 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:49.312 09:58:54 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:49.312 09:58:54 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:49.312 09:58:54 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:49.312 09:58:54 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:12:49.312 09:58:54 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:49.312 09:58:54 -- common/autotest_common.sh@712 -- # xtrace_disable 00:12:49.312 09:58:54 -- common/autotest_common.sh@10 -- # set +x 00:12:49.312 09:58:54 -- nvmf/common.sh@469 -- # nvmfpid=2754469 00:12:49.312 09:58:54 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:49.312 09:58:54 -- nvmf/common.sh@470 -- # waitforlisten 2754469 00:12:49.312 09:58:54 -- common/autotest_common.sh@819 -- # '[' -z 2754469 ']' 00:12:49.312 09:58:54 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:49.312 09:58:54 -- common/autotest_common.sh@824 -- # local max_retries=100 00:12:49.312 09:58:54 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:49.312 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:49.312 09:58:54 -- common/autotest_common.sh@828 -- # xtrace_disable 00:12:49.312 09:58:54 -- common/autotest_common.sh@10 -- # set +x 00:12:49.312 [2024-07-13 09:58:54.954077] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:12:49.312 [2024-07-13 09:58:54.954172] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:49.312 EAL: No free 2048 kB hugepages reported on node 1 00:12:49.312 [2024-07-13 09:58:55.030717] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:49.312 [2024-07-13 09:58:55.125021] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:49.312 [2024-07-13 09:58:55.125178] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:49.312 [2024-07-13 09:58:55.125198] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:49.312 [2024-07-13 09:58:55.125212] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:49.312 [2024-07-13 09:58:55.125280] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:49.312 [2024-07-13 09:58:55.125337] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:49.312 [2024-07-13 09:58:55.125386] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:49.312 [2024-07-13 09:58:55.125390] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:50.245 09:58:55 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:12:50.245 09:58:55 -- common/autotest_common.sh@852 -- # return 0 00:12:50.245 09:58:55 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:50.245 09:58:55 -- common/autotest_common.sh@718 -- # xtrace_disable 00:12:50.245 09:58:55 -- common/autotest_common.sh@10 -- # set +x 00:12:50.245 09:58:55 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:50.245 09:58:55 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:12:50.245 09:58:55 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:12:50.245 09:58:55 -- target/multitarget.sh@21 -- # jq length 00:12:50.502 09:58:56 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:12:50.502 09:58:56 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:12:50.502 "nvmf_tgt_1" 00:12:50.502 09:58:56 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:12:50.502 "nvmf_tgt_2" 00:12:50.502 09:58:56 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:12:50.502 09:58:56 -- target/multitarget.sh@28 -- # jq length 00:12:50.760 09:58:56 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:12:50.760 09:58:56 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:12:50.760 true 00:12:50.760 09:58:56 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:12:51.017 true 00:12:51.017 09:58:56 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:12:51.017 09:58:56 -- target/multitarget.sh@35 -- # jq length 00:12:51.017 09:58:56 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:12:51.017 09:58:56 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:12:51.017 09:58:56 -- target/multitarget.sh@41 -- # nvmftestfini 00:12:51.017 09:58:56 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:51.017 09:58:56 -- nvmf/common.sh@116 -- # sync 00:12:51.017 09:58:56 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:51.017 09:58:56 -- nvmf/common.sh@119 -- # set +e 00:12:51.017 09:58:56 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:51.017 09:58:56 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:51.017 rmmod nvme_tcp 00:12:51.017 rmmod nvme_fabrics 00:12:51.017 rmmod nvme_keyring 00:12:51.017 09:58:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:51.017 09:58:56 -- nvmf/common.sh@123 -- # set -e 00:12:51.017 09:58:56 -- nvmf/common.sh@124 -- # return 0 00:12:51.017 09:58:56 -- nvmf/common.sh@477 -- # '[' -n 2754469 ']' 00:12:51.017 09:58:56 -- nvmf/common.sh@478 -- # killprocess 2754469 00:12:51.017 09:58:56 -- common/autotest_common.sh@926 -- # '[' -z 2754469 ']' 00:12:51.017 09:58:56 -- common/autotest_common.sh@930 -- # kill -0 2754469 00:12:51.017 09:58:56 -- common/autotest_common.sh@931 -- # uname 00:12:51.017 09:58:56 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:12:51.017 09:58:56 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2754469 00:12:51.017 09:58:56 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:12:51.017 09:58:56 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:12:51.017 09:58:56 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2754469' 00:12:51.017 killing process with pid 2754469 00:12:51.017 09:58:56 -- common/autotest_common.sh@945 -- # kill 2754469 00:12:51.017 09:58:56 -- common/autotest_common.sh@950 -- # wait 2754469 00:12:51.275 09:58:57 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:51.275 09:58:57 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:51.275 09:58:57 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:51.275 09:58:57 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:51.275 09:58:57 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:51.275 09:58:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:51.275 09:58:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:51.275 09:58:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:53.810 09:58:59 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:53.810 00:12:53.810 real 0m6.376s 00:12:53.810 user 0m9.371s 00:12:53.810 sys 0m1.888s 00:12:53.810 09:58:59 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:12:53.810 09:58:59 -- common/autotest_common.sh@10 -- # set +x 00:12:53.810 ************************************ 00:12:53.810 END TEST nvmf_multitarget 00:12:53.810 ************************************ 00:12:53.810 09:58:59 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:12:53.810 09:58:59 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:12:53.810 09:58:59 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:12:53.810 09:58:59 -- common/autotest_common.sh@10 -- # set +x 00:12:53.810 ************************************ 00:12:53.810 START TEST nvmf_rpc 00:12:53.810 ************************************ 00:12:53.810 09:58:59 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:12:53.810 * Looking for test storage... 00:12:53.810 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:53.810 09:58:59 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:53.810 09:58:59 -- nvmf/common.sh@7 -- # uname -s 00:12:53.810 09:58:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:53.810 09:58:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:53.810 09:58:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:53.810 09:58:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:53.810 09:58:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:53.810 09:58:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:53.810 09:58:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:53.810 09:58:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:53.810 09:58:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:53.810 09:58:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:53.810 09:58:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:53.810 09:58:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:53.810 09:58:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:53.810 09:58:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:53.810 09:58:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:53.810 09:58:59 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:53.810 09:58:59 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:53.810 09:58:59 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:53.810 09:58:59 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:53.811 09:58:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:53.811 09:58:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:53.811 09:58:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:53.811 09:58:59 -- paths/export.sh@5 -- # export PATH 00:12:53.811 09:58:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:53.811 09:58:59 -- nvmf/common.sh@46 -- # : 0 00:12:53.811 09:58:59 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:53.811 09:58:59 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:53.811 09:58:59 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:53.811 09:58:59 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:53.811 09:58:59 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:53.811 09:58:59 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:53.811 09:58:59 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:53.811 09:58:59 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:53.811 09:58:59 -- target/rpc.sh@11 -- # loops=5 00:12:53.811 09:58:59 -- target/rpc.sh@23 -- # nvmftestinit 00:12:53.811 09:58:59 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:53.811 09:58:59 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:53.811 09:58:59 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:53.811 09:58:59 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:53.811 09:58:59 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:53.811 09:58:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:53.811 09:58:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:53.811 09:58:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:53.811 09:58:59 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:53.811 09:58:59 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:53.811 09:58:59 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:53.811 09:58:59 -- common/autotest_common.sh@10 -- # set +x 00:12:55.711 09:59:01 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:55.711 09:59:01 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:55.711 09:59:01 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:55.711 09:59:01 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:55.711 09:59:01 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:55.711 09:59:01 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:55.712 09:59:01 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:55.712 09:59:01 -- nvmf/common.sh@294 -- # net_devs=() 00:12:55.712 09:59:01 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:55.712 09:59:01 -- nvmf/common.sh@295 -- # e810=() 00:12:55.712 09:59:01 -- nvmf/common.sh@295 -- # local -ga e810 00:12:55.712 09:59:01 -- nvmf/common.sh@296 -- # x722=() 00:12:55.712 09:59:01 -- nvmf/common.sh@296 -- # local -ga x722 00:12:55.712 09:59:01 -- nvmf/common.sh@297 -- # mlx=() 00:12:55.712 09:59:01 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:55.712 09:59:01 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:55.712 09:59:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:55.712 09:59:01 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:55.712 09:59:01 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:55.712 09:59:01 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:55.712 09:59:01 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:55.712 09:59:01 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:55.712 09:59:01 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:55.712 09:59:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:55.712 09:59:01 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:55.712 09:59:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:55.712 09:59:01 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:55.712 09:59:01 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:55.712 09:59:01 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:55.712 09:59:01 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:55.712 09:59:01 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:55.712 09:59:01 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:55.712 09:59:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:55.712 09:59:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:55.712 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:55.712 09:59:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:55.712 09:59:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:55.712 09:59:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:55.712 09:59:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:55.712 09:59:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:55.712 09:59:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:55.712 09:59:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:55.712 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:55.712 09:59:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:55.712 09:59:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:55.712 09:59:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:55.712 09:59:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:55.712 09:59:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:55.712 09:59:01 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:55.712 09:59:01 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:55.712 09:59:01 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:55.712 09:59:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:55.712 09:59:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:55.712 09:59:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:55.712 09:59:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:55.712 09:59:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:55.712 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:55.712 09:59:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:55.712 09:59:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:55.712 09:59:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:55.712 09:59:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:55.712 09:59:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:55.712 09:59:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:55.712 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:55.712 09:59:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:55.712 09:59:01 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:55.712 09:59:01 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:55.712 09:59:01 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:55.712 09:59:01 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:55.712 09:59:01 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:55.712 09:59:01 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:55.712 09:59:01 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:55.712 09:59:01 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:55.712 09:59:01 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:55.712 09:59:01 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:55.712 09:59:01 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:55.712 09:59:01 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:55.712 09:59:01 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:55.712 09:59:01 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:55.712 09:59:01 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:55.712 09:59:01 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:55.712 09:59:01 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:55.712 09:59:01 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:55.712 09:59:01 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:55.712 09:59:01 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:55.712 09:59:01 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:55.712 09:59:01 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:55.712 09:59:01 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:55.712 09:59:01 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:55.712 09:59:01 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:55.712 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:55.712 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.232 ms 00:12:55.712 00:12:55.712 --- 10.0.0.2 ping statistics --- 00:12:55.712 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:55.712 rtt min/avg/max/mdev = 0.232/0.232/0.232/0.000 ms 00:12:55.712 09:59:01 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:55.712 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:55.712 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.200 ms 00:12:55.712 00:12:55.712 --- 10.0.0.1 ping statistics --- 00:12:55.712 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:55.712 rtt min/avg/max/mdev = 0.200/0.200/0.200/0.000 ms 00:12:55.712 09:59:01 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:55.712 09:59:01 -- nvmf/common.sh@410 -- # return 0 00:12:55.712 09:59:01 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:55.712 09:59:01 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:55.712 09:59:01 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:55.712 09:59:01 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:55.712 09:59:01 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:55.712 09:59:01 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:55.712 09:59:01 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:55.712 09:59:01 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:12:55.712 09:59:01 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:55.712 09:59:01 -- common/autotest_common.sh@712 -- # xtrace_disable 00:12:55.712 09:59:01 -- common/autotest_common.sh@10 -- # set +x 00:12:55.712 09:59:01 -- nvmf/common.sh@469 -- # nvmfpid=2756710 00:12:55.712 09:59:01 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:55.712 09:59:01 -- nvmf/common.sh@470 -- # waitforlisten 2756710 00:12:55.712 09:59:01 -- common/autotest_common.sh@819 -- # '[' -z 2756710 ']' 00:12:55.712 09:59:01 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:55.712 09:59:01 -- common/autotest_common.sh@824 -- # local max_retries=100 00:12:55.712 09:59:01 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:55.712 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:55.712 09:59:01 -- common/autotest_common.sh@828 -- # xtrace_disable 00:12:55.712 09:59:01 -- common/autotest_common.sh@10 -- # set +x 00:12:55.712 [2024-07-13 09:59:01.443458] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:12:55.712 [2024-07-13 09:59:01.443546] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:55.712 EAL: No free 2048 kB hugepages reported on node 1 00:12:55.712 [2024-07-13 09:59:01.518970] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:55.971 [2024-07-13 09:59:01.616485] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:55.971 [2024-07-13 09:59:01.616646] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:55.971 [2024-07-13 09:59:01.616666] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:55.971 [2024-07-13 09:59:01.616681] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:55.971 [2024-07-13 09:59:01.616740] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:55.971 [2024-07-13 09:59:01.616791] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:55.971 [2024-07-13 09:59:01.616855] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:55.971 [2024-07-13 09:59:01.616858] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:56.904 09:59:02 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:12:56.904 09:59:02 -- common/autotest_common.sh@852 -- # return 0 00:12:56.904 09:59:02 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:56.904 09:59:02 -- common/autotest_common.sh@718 -- # xtrace_disable 00:12:56.904 09:59:02 -- common/autotest_common.sh@10 -- # set +x 00:12:56.904 09:59:02 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:56.904 09:59:02 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:12:56.904 09:59:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:56.904 09:59:02 -- common/autotest_common.sh@10 -- # set +x 00:12:56.904 09:59:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:56.904 09:59:02 -- target/rpc.sh@26 -- # stats='{ 00:12:56.904 "tick_rate": 2700000000, 00:12:56.904 "poll_groups": [ 00:12:56.904 { 00:12:56.904 "name": "nvmf_tgt_poll_group_0", 00:12:56.904 "admin_qpairs": 0, 00:12:56.904 "io_qpairs": 0, 00:12:56.904 "current_admin_qpairs": 0, 00:12:56.904 "current_io_qpairs": 0, 00:12:56.904 "pending_bdev_io": 0, 00:12:56.904 "completed_nvme_io": 0, 00:12:56.904 "transports": [] 00:12:56.904 }, 00:12:56.904 { 00:12:56.904 "name": "nvmf_tgt_poll_group_1", 00:12:56.904 "admin_qpairs": 0, 00:12:56.904 "io_qpairs": 0, 00:12:56.904 "current_admin_qpairs": 0, 00:12:56.904 "current_io_qpairs": 0, 00:12:56.904 "pending_bdev_io": 0, 00:12:56.904 "completed_nvme_io": 0, 00:12:56.904 "transports": [] 00:12:56.904 }, 00:12:56.904 { 00:12:56.904 "name": "nvmf_tgt_poll_group_2", 00:12:56.904 "admin_qpairs": 0, 00:12:56.904 "io_qpairs": 0, 00:12:56.904 "current_admin_qpairs": 0, 00:12:56.904 "current_io_qpairs": 0, 00:12:56.904 "pending_bdev_io": 0, 00:12:56.904 "completed_nvme_io": 0, 00:12:56.904 "transports": [] 00:12:56.904 }, 00:12:56.904 { 00:12:56.904 "name": "nvmf_tgt_poll_group_3", 00:12:56.904 "admin_qpairs": 0, 00:12:56.904 "io_qpairs": 0, 00:12:56.904 "current_admin_qpairs": 0, 00:12:56.904 "current_io_qpairs": 0, 00:12:56.904 "pending_bdev_io": 0, 00:12:56.904 "completed_nvme_io": 0, 00:12:56.904 "transports": [] 00:12:56.904 } 00:12:56.904 ] 00:12:56.904 }' 00:12:56.904 09:59:02 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:12:56.904 09:59:02 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:12:56.904 09:59:02 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:12:56.904 09:59:02 -- target/rpc.sh@15 -- # wc -l 00:12:56.904 09:59:02 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:12:56.904 09:59:02 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:12:56.904 09:59:02 -- target/rpc.sh@29 -- # [[ null == null ]] 00:12:56.904 09:59:02 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:12:56.904 09:59:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:56.904 09:59:02 -- common/autotest_common.sh@10 -- # set +x 00:12:56.904 [2024-07-13 09:59:02.582979] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:56.904 09:59:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:56.904 09:59:02 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:12:56.904 09:59:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:56.904 09:59:02 -- common/autotest_common.sh@10 -- # set +x 00:12:56.904 09:59:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:56.904 09:59:02 -- target/rpc.sh@33 -- # stats='{ 00:12:56.904 "tick_rate": 2700000000, 00:12:56.904 "poll_groups": [ 00:12:56.904 { 00:12:56.904 "name": "nvmf_tgt_poll_group_0", 00:12:56.904 "admin_qpairs": 0, 00:12:56.904 "io_qpairs": 0, 00:12:56.904 "current_admin_qpairs": 0, 00:12:56.904 "current_io_qpairs": 0, 00:12:56.904 "pending_bdev_io": 0, 00:12:56.904 "completed_nvme_io": 0, 00:12:56.904 "transports": [ 00:12:56.904 { 00:12:56.904 "trtype": "TCP" 00:12:56.904 } 00:12:56.904 ] 00:12:56.904 }, 00:12:56.904 { 00:12:56.904 "name": "nvmf_tgt_poll_group_1", 00:12:56.904 "admin_qpairs": 0, 00:12:56.904 "io_qpairs": 0, 00:12:56.904 "current_admin_qpairs": 0, 00:12:56.904 "current_io_qpairs": 0, 00:12:56.904 "pending_bdev_io": 0, 00:12:56.904 "completed_nvme_io": 0, 00:12:56.904 "transports": [ 00:12:56.904 { 00:12:56.904 "trtype": "TCP" 00:12:56.904 } 00:12:56.904 ] 00:12:56.904 }, 00:12:56.904 { 00:12:56.904 "name": "nvmf_tgt_poll_group_2", 00:12:56.904 "admin_qpairs": 0, 00:12:56.904 "io_qpairs": 0, 00:12:56.904 "current_admin_qpairs": 0, 00:12:56.904 "current_io_qpairs": 0, 00:12:56.904 "pending_bdev_io": 0, 00:12:56.904 "completed_nvme_io": 0, 00:12:56.904 "transports": [ 00:12:56.904 { 00:12:56.904 "trtype": "TCP" 00:12:56.904 } 00:12:56.904 ] 00:12:56.904 }, 00:12:56.904 { 00:12:56.904 "name": "nvmf_tgt_poll_group_3", 00:12:56.904 "admin_qpairs": 0, 00:12:56.904 "io_qpairs": 0, 00:12:56.904 "current_admin_qpairs": 0, 00:12:56.904 "current_io_qpairs": 0, 00:12:56.904 "pending_bdev_io": 0, 00:12:56.904 "completed_nvme_io": 0, 00:12:56.904 "transports": [ 00:12:56.904 { 00:12:56.904 "trtype": "TCP" 00:12:56.904 } 00:12:56.904 ] 00:12:56.904 } 00:12:56.904 ] 00:12:56.904 }' 00:12:56.904 09:59:02 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:12:56.904 09:59:02 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:12:56.904 09:59:02 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:12:56.904 09:59:02 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:56.904 09:59:02 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:12:56.904 09:59:02 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:12:56.904 09:59:02 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:12:56.904 09:59:02 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:12:56.904 09:59:02 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:56.904 09:59:02 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:12:56.904 09:59:02 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:12:56.904 09:59:02 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:12:56.904 09:59:02 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:12:56.904 09:59:02 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:12:56.904 09:59:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:56.904 09:59:02 -- common/autotest_common.sh@10 -- # set +x 00:12:56.904 Malloc1 00:12:56.904 09:59:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:56.904 09:59:02 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:12:56.904 09:59:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:56.905 09:59:02 -- common/autotest_common.sh@10 -- # set +x 00:12:56.905 09:59:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:56.905 09:59:02 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:56.905 09:59:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:56.905 09:59:02 -- common/autotest_common.sh@10 -- # set +x 00:12:57.162 09:59:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:57.162 09:59:02 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:12:57.162 09:59:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:57.162 09:59:02 -- common/autotest_common.sh@10 -- # set +x 00:12:57.162 09:59:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:57.162 09:59:02 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:57.162 09:59:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:57.162 09:59:02 -- common/autotest_common.sh@10 -- # set +x 00:12:57.162 [2024-07-13 09:59:02.736561] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:57.162 09:59:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:57.162 09:59:02 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:12:57.162 09:59:02 -- common/autotest_common.sh@640 -- # local es=0 00:12:57.162 09:59:02 -- common/autotest_common.sh@642 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:12:57.162 09:59:02 -- common/autotest_common.sh@628 -- # local arg=nvme 00:12:57.162 09:59:02 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:12:57.162 09:59:02 -- common/autotest_common.sh@632 -- # type -t nvme 00:12:57.162 09:59:02 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:12:57.162 09:59:02 -- common/autotest_common.sh@634 -- # type -P nvme 00:12:57.162 09:59:02 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:12:57.162 09:59:02 -- common/autotest_common.sh@634 -- # arg=/usr/sbin/nvme 00:12:57.162 09:59:02 -- common/autotest_common.sh@634 -- # [[ -x /usr/sbin/nvme ]] 00:12:57.162 09:59:02 -- common/autotest_common.sh@643 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:12:57.162 [2024-07-13 09:59:02.759014] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:12:57.162 Failed to write to /dev/nvme-fabrics: Input/output error 00:12:57.162 could not add new controller: failed to write to nvme-fabrics device 00:12:57.162 09:59:02 -- common/autotest_common.sh@643 -- # es=1 00:12:57.162 09:59:02 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:12:57.162 09:59:02 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:12:57.162 09:59:02 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:12:57.162 09:59:02 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:57.162 09:59:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:57.162 09:59:02 -- common/autotest_common.sh@10 -- # set +x 00:12:57.162 09:59:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:57.162 09:59:02 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:57.760 09:59:03 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:12:57.760 09:59:03 -- common/autotest_common.sh@1177 -- # local i=0 00:12:57.760 09:59:03 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:12:57.760 09:59:03 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:12:57.760 09:59:03 -- common/autotest_common.sh@1184 -- # sleep 2 00:12:59.655 09:59:05 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:12:59.656 09:59:05 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:12:59.656 09:59:05 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:12:59.656 09:59:05 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:12:59.656 09:59:05 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:12:59.656 09:59:05 -- common/autotest_common.sh@1187 -- # return 0 00:12:59.656 09:59:05 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:59.656 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:59.656 09:59:05 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:59.656 09:59:05 -- common/autotest_common.sh@1198 -- # local i=0 00:12:59.656 09:59:05 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:12:59.656 09:59:05 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:59.913 09:59:05 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:12:59.913 09:59:05 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:59.913 09:59:05 -- common/autotest_common.sh@1210 -- # return 0 00:12:59.913 09:59:05 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:59.913 09:59:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:59.913 09:59:05 -- common/autotest_common.sh@10 -- # set +x 00:12:59.913 09:59:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:59.913 09:59:05 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:59.913 09:59:05 -- common/autotest_common.sh@640 -- # local es=0 00:12:59.913 09:59:05 -- common/autotest_common.sh@642 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:59.913 09:59:05 -- common/autotest_common.sh@628 -- # local arg=nvme 00:12:59.913 09:59:05 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:12:59.913 09:59:05 -- common/autotest_common.sh@632 -- # type -t nvme 00:12:59.913 09:59:05 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:12:59.913 09:59:05 -- common/autotest_common.sh@634 -- # type -P nvme 00:12:59.913 09:59:05 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:12:59.913 09:59:05 -- common/autotest_common.sh@634 -- # arg=/usr/sbin/nvme 00:12:59.913 09:59:05 -- common/autotest_common.sh@634 -- # [[ -x /usr/sbin/nvme ]] 00:12:59.913 09:59:05 -- common/autotest_common.sh@643 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:59.913 [2024-07-13 09:59:05.512464] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:12:59.913 Failed to write to /dev/nvme-fabrics: Input/output error 00:12:59.913 could not add new controller: failed to write to nvme-fabrics device 00:12:59.913 09:59:05 -- common/autotest_common.sh@643 -- # es=1 00:12:59.913 09:59:05 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:12:59.913 09:59:05 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:12:59.913 09:59:05 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:12:59.913 09:59:05 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:12:59.913 09:59:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:59.913 09:59:05 -- common/autotest_common.sh@10 -- # set +x 00:12:59.913 09:59:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:59.913 09:59:05 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:00.478 09:59:06 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:13:00.478 09:59:06 -- common/autotest_common.sh@1177 -- # local i=0 00:13:00.478 09:59:06 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:13:00.478 09:59:06 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:13:00.478 09:59:06 -- common/autotest_common.sh@1184 -- # sleep 2 00:13:02.374 09:59:08 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:13:02.374 09:59:08 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:13:02.374 09:59:08 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:13:02.374 09:59:08 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:13:02.374 09:59:08 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:13:02.374 09:59:08 -- common/autotest_common.sh@1187 -- # return 0 00:13:02.374 09:59:08 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:02.632 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:02.632 09:59:08 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:02.633 09:59:08 -- common/autotest_common.sh@1198 -- # local i=0 00:13:02.633 09:59:08 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:13:02.633 09:59:08 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:02.633 09:59:08 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:13:02.633 09:59:08 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:02.633 09:59:08 -- common/autotest_common.sh@1210 -- # return 0 00:13:02.633 09:59:08 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:02.633 09:59:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:02.633 09:59:08 -- common/autotest_common.sh@10 -- # set +x 00:13:02.633 09:59:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:02.633 09:59:08 -- target/rpc.sh@81 -- # seq 1 5 00:13:02.633 09:59:08 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:02.633 09:59:08 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:02.633 09:59:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:02.633 09:59:08 -- common/autotest_common.sh@10 -- # set +x 00:13:02.633 09:59:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:02.633 09:59:08 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:02.633 09:59:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:02.633 09:59:08 -- common/autotest_common.sh@10 -- # set +x 00:13:02.633 [2024-07-13 09:59:08.303198] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:02.633 09:59:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:02.633 09:59:08 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:02.633 09:59:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:02.633 09:59:08 -- common/autotest_common.sh@10 -- # set +x 00:13:02.633 09:59:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:02.633 09:59:08 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:02.633 09:59:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:02.633 09:59:08 -- common/autotest_common.sh@10 -- # set +x 00:13:02.633 09:59:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:02.633 09:59:08 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:03.198 09:59:08 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:03.198 09:59:08 -- common/autotest_common.sh@1177 -- # local i=0 00:13:03.198 09:59:08 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:13:03.198 09:59:08 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:13:03.198 09:59:08 -- common/autotest_common.sh@1184 -- # sleep 2 00:13:05.726 09:59:10 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:13:05.726 09:59:10 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:13:05.726 09:59:10 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:13:05.726 09:59:10 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:13:05.726 09:59:10 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:13:05.726 09:59:10 -- common/autotest_common.sh@1187 -- # return 0 00:13:05.726 09:59:10 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:05.726 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:05.726 09:59:11 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:05.726 09:59:11 -- common/autotest_common.sh@1198 -- # local i=0 00:13:05.726 09:59:11 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:13:05.726 09:59:11 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:05.726 09:59:11 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:13:05.726 09:59:11 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:05.726 09:59:11 -- common/autotest_common.sh@1210 -- # return 0 00:13:05.726 09:59:11 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:05.726 09:59:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:05.726 09:59:11 -- common/autotest_common.sh@10 -- # set +x 00:13:05.726 09:59:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:05.726 09:59:11 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:05.726 09:59:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:05.726 09:59:11 -- common/autotest_common.sh@10 -- # set +x 00:13:05.726 09:59:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:05.726 09:59:11 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:05.726 09:59:11 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:05.726 09:59:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:05.726 09:59:11 -- common/autotest_common.sh@10 -- # set +x 00:13:05.726 09:59:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:05.726 09:59:11 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:05.726 09:59:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:05.726 09:59:11 -- common/autotest_common.sh@10 -- # set +x 00:13:05.726 [2024-07-13 09:59:11.077321] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:05.726 09:59:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:05.726 09:59:11 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:05.726 09:59:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:05.726 09:59:11 -- common/autotest_common.sh@10 -- # set +x 00:13:05.726 09:59:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:05.726 09:59:11 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:05.726 09:59:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:05.726 09:59:11 -- common/autotest_common.sh@10 -- # set +x 00:13:05.726 09:59:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:05.726 09:59:11 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:05.985 09:59:11 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:05.985 09:59:11 -- common/autotest_common.sh@1177 -- # local i=0 00:13:05.985 09:59:11 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:13:05.985 09:59:11 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:13:05.985 09:59:11 -- common/autotest_common.sh@1184 -- # sleep 2 00:13:08.512 09:59:13 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:13:08.512 09:59:13 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:13:08.512 09:59:13 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:13:08.512 09:59:13 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:13:08.512 09:59:13 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:13:08.512 09:59:13 -- common/autotest_common.sh@1187 -- # return 0 00:13:08.512 09:59:13 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:08.512 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:08.512 09:59:13 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:08.512 09:59:13 -- common/autotest_common.sh@1198 -- # local i=0 00:13:08.512 09:59:13 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:13:08.512 09:59:13 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:08.512 09:59:13 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:13:08.512 09:59:13 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:08.512 09:59:13 -- common/autotest_common.sh@1210 -- # return 0 00:13:08.512 09:59:13 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:08.512 09:59:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:08.512 09:59:13 -- common/autotest_common.sh@10 -- # set +x 00:13:08.512 09:59:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:08.512 09:59:13 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:08.512 09:59:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:08.512 09:59:13 -- common/autotest_common.sh@10 -- # set +x 00:13:08.512 09:59:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:08.512 09:59:13 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:08.512 09:59:13 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:08.512 09:59:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:08.512 09:59:13 -- common/autotest_common.sh@10 -- # set +x 00:13:08.512 09:59:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:08.512 09:59:13 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:08.512 09:59:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:08.512 09:59:13 -- common/autotest_common.sh@10 -- # set +x 00:13:08.512 [2024-07-13 09:59:13.911227] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:08.512 09:59:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:08.512 09:59:13 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:08.512 09:59:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:08.512 09:59:13 -- common/autotest_common.sh@10 -- # set +x 00:13:08.512 09:59:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:08.512 09:59:13 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:08.512 09:59:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:08.512 09:59:13 -- common/autotest_common.sh@10 -- # set +x 00:13:08.512 09:59:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:08.512 09:59:13 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:08.770 09:59:14 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:08.770 09:59:14 -- common/autotest_common.sh@1177 -- # local i=0 00:13:08.770 09:59:14 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:13:08.770 09:59:14 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:13:08.770 09:59:14 -- common/autotest_common.sh@1184 -- # sleep 2 00:13:11.296 09:59:16 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:13:11.296 09:59:16 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:13:11.296 09:59:16 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:13:11.296 09:59:16 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:13:11.296 09:59:16 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:13:11.296 09:59:16 -- common/autotest_common.sh@1187 -- # return 0 00:13:11.296 09:59:16 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:11.296 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:11.296 09:59:16 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:11.296 09:59:16 -- common/autotest_common.sh@1198 -- # local i=0 00:13:11.296 09:59:16 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:13:11.296 09:59:16 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:11.296 09:59:16 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:13:11.296 09:59:16 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:11.296 09:59:16 -- common/autotest_common.sh@1210 -- # return 0 00:13:11.296 09:59:16 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:11.296 09:59:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:11.296 09:59:16 -- common/autotest_common.sh@10 -- # set +x 00:13:11.296 09:59:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:11.296 09:59:16 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:11.296 09:59:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:11.296 09:59:16 -- common/autotest_common.sh@10 -- # set +x 00:13:11.296 09:59:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:11.296 09:59:16 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:11.296 09:59:16 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:11.296 09:59:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:11.296 09:59:16 -- common/autotest_common.sh@10 -- # set +x 00:13:11.296 09:59:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:11.296 09:59:16 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:11.296 09:59:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:11.296 09:59:16 -- common/autotest_common.sh@10 -- # set +x 00:13:11.296 [2024-07-13 09:59:16.697297] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:11.296 09:59:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:11.296 09:59:16 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:11.296 09:59:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:11.296 09:59:16 -- common/autotest_common.sh@10 -- # set +x 00:13:11.296 09:59:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:11.296 09:59:16 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:11.296 09:59:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:11.296 09:59:16 -- common/autotest_common.sh@10 -- # set +x 00:13:11.296 09:59:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:11.296 09:59:16 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:11.862 09:59:17 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:11.862 09:59:17 -- common/autotest_common.sh@1177 -- # local i=0 00:13:11.862 09:59:17 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:13:11.862 09:59:17 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:13:11.862 09:59:17 -- common/autotest_common.sh@1184 -- # sleep 2 00:13:13.758 09:59:19 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:13:13.758 09:59:19 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:13:13.758 09:59:19 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:13:13.758 09:59:19 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:13:13.758 09:59:19 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:13:13.758 09:59:19 -- common/autotest_common.sh@1187 -- # return 0 00:13:13.758 09:59:19 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:13.758 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:13.758 09:59:19 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:13.758 09:59:19 -- common/autotest_common.sh@1198 -- # local i=0 00:13:13.758 09:59:19 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:13:13.758 09:59:19 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:13.758 09:59:19 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:13:13.758 09:59:19 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:13.758 09:59:19 -- common/autotest_common.sh@1210 -- # return 0 00:13:13.758 09:59:19 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:13.758 09:59:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:13.758 09:59:19 -- common/autotest_common.sh@10 -- # set +x 00:13:13.758 09:59:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:13.758 09:59:19 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:13.758 09:59:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:13.758 09:59:19 -- common/autotest_common.sh@10 -- # set +x 00:13:13.758 09:59:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:13.758 09:59:19 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:13.758 09:59:19 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:13.758 09:59:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:13.758 09:59:19 -- common/autotest_common.sh@10 -- # set +x 00:13:13.758 09:59:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:13.758 09:59:19 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:13.758 09:59:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:13.758 09:59:19 -- common/autotest_common.sh@10 -- # set +x 00:13:13.758 [2024-07-13 09:59:19.520433] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:13.758 09:59:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:13.758 09:59:19 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:13.758 09:59:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:13.758 09:59:19 -- common/autotest_common.sh@10 -- # set +x 00:13:13.758 09:59:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:13.758 09:59:19 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:13.758 09:59:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:13.758 09:59:19 -- common/autotest_common.sh@10 -- # set +x 00:13:13.758 09:59:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:13.758 09:59:19 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:14.692 09:59:20 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:14.692 09:59:20 -- common/autotest_common.sh@1177 -- # local i=0 00:13:14.692 09:59:20 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:13:14.692 09:59:20 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:13:14.692 09:59:20 -- common/autotest_common.sh@1184 -- # sleep 2 00:13:16.587 09:59:22 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:13:16.587 09:59:22 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:13:16.587 09:59:22 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:13:16.587 09:59:22 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:13:16.587 09:59:22 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:13:16.587 09:59:22 -- common/autotest_common.sh@1187 -- # return 0 00:13:16.587 09:59:22 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:16.587 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:16.587 09:59:22 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:16.587 09:59:22 -- common/autotest_common.sh@1198 -- # local i=0 00:13:16.587 09:59:22 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:13:16.587 09:59:22 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:16.587 09:59:22 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:13:16.587 09:59:22 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:16.587 09:59:22 -- common/autotest_common.sh@1210 -- # return 0 00:13:16.587 09:59:22 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:16.587 09:59:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.587 09:59:22 -- common/autotest_common.sh@10 -- # set +x 00:13:16.587 09:59:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.587 09:59:22 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:16.587 09:59:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.587 09:59:22 -- common/autotest_common.sh@10 -- # set +x 00:13:16.587 09:59:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.587 09:59:22 -- target/rpc.sh@99 -- # seq 1 5 00:13:16.587 09:59:22 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:16.587 09:59:22 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:16.587 09:59:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.587 09:59:22 -- common/autotest_common.sh@10 -- # set +x 00:13:16.587 09:59:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.587 09:59:22 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:16.587 09:59:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.587 09:59:22 -- common/autotest_common.sh@10 -- # set +x 00:13:16.587 [2024-07-13 09:59:22.342646] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:16.587 09:59:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.587 09:59:22 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:16.587 09:59:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.587 09:59:22 -- common/autotest_common.sh@10 -- # set +x 00:13:16.587 09:59:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.587 09:59:22 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:16.587 09:59:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.587 09:59:22 -- common/autotest_common.sh@10 -- # set +x 00:13:16.587 09:59:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.587 09:59:22 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:16.587 09:59:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.587 09:59:22 -- common/autotest_common.sh@10 -- # set +x 00:13:16.587 09:59:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.587 09:59:22 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:16.587 09:59:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.587 09:59:22 -- common/autotest_common.sh@10 -- # set +x 00:13:16.587 09:59:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.587 09:59:22 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:16.587 09:59:22 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:16.587 09:59:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.587 09:59:22 -- common/autotest_common.sh@10 -- # set +x 00:13:16.587 09:59:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.587 09:59:22 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:16.587 09:59:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.587 09:59:22 -- common/autotest_common.sh@10 -- # set +x 00:13:16.587 [2024-07-13 09:59:22.390741] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:16.587 09:59:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.587 09:59:22 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:16.587 09:59:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.587 09:59:22 -- common/autotest_common.sh@10 -- # set +x 00:13:16.587 09:59:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.587 09:59:22 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:16.587 09:59:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.587 09:59:22 -- common/autotest_common.sh@10 -- # set +x 00:13:16.845 09:59:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.845 09:59:22 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:16.845 09:59:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.845 09:59:22 -- common/autotest_common.sh@10 -- # set +x 00:13:16.845 09:59:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.845 09:59:22 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:16.845 09:59:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.845 09:59:22 -- common/autotest_common.sh@10 -- # set +x 00:13:16.845 09:59:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.845 09:59:22 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:16.845 09:59:22 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:16.845 09:59:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.845 09:59:22 -- common/autotest_common.sh@10 -- # set +x 00:13:16.845 09:59:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.845 09:59:22 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:16.845 09:59:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.845 09:59:22 -- common/autotest_common.sh@10 -- # set +x 00:13:16.845 [2024-07-13 09:59:22.438950] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:16.845 09:59:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.845 09:59:22 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:16.845 09:59:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.845 09:59:22 -- common/autotest_common.sh@10 -- # set +x 00:13:16.845 09:59:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.845 09:59:22 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:16.845 09:59:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.845 09:59:22 -- common/autotest_common.sh@10 -- # set +x 00:13:16.845 09:59:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.845 09:59:22 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:16.845 09:59:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.845 09:59:22 -- common/autotest_common.sh@10 -- # set +x 00:13:16.845 09:59:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.845 09:59:22 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:16.845 09:59:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.845 09:59:22 -- common/autotest_common.sh@10 -- # set +x 00:13:16.845 09:59:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.845 09:59:22 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:16.845 09:59:22 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:16.845 09:59:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.845 09:59:22 -- common/autotest_common.sh@10 -- # set +x 00:13:16.845 09:59:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.845 09:59:22 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:16.845 09:59:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.845 09:59:22 -- common/autotest_common.sh@10 -- # set +x 00:13:16.845 [2024-07-13 09:59:22.487095] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:16.845 09:59:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.845 09:59:22 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:16.845 09:59:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.845 09:59:22 -- common/autotest_common.sh@10 -- # set +x 00:13:16.845 09:59:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.845 09:59:22 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:16.845 09:59:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.845 09:59:22 -- common/autotest_common.sh@10 -- # set +x 00:13:16.845 09:59:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.845 09:59:22 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:16.845 09:59:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.845 09:59:22 -- common/autotest_common.sh@10 -- # set +x 00:13:16.845 09:59:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.845 09:59:22 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:16.845 09:59:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.845 09:59:22 -- common/autotest_common.sh@10 -- # set +x 00:13:16.845 09:59:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.845 09:59:22 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:16.845 09:59:22 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:16.845 09:59:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.845 09:59:22 -- common/autotest_common.sh@10 -- # set +x 00:13:16.845 09:59:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.845 09:59:22 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:16.845 09:59:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.845 09:59:22 -- common/autotest_common.sh@10 -- # set +x 00:13:16.845 [2024-07-13 09:59:22.535268] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:16.845 09:59:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.845 09:59:22 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:16.845 09:59:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.845 09:59:22 -- common/autotest_common.sh@10 -- # set +x 00:13:16.845 09:59:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.845 09:59:22 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:16.845 09:59:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.845 09:59:22 -- common/autotest_common.sh@10 -- # set +x 00:13:16.845 09:59:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.845 09:59:22 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:16.845 09:59:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.845 09:59:22 -- common/autotest_common.sh@10 -- # set +x 00:13:16.845 09:59:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.845 09:59:22 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:16.845 09:59:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.845 09:59:22 -- common/autotest_common.sh@10 -- # set +x 00:13:16.845 09:59:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.845 09:59:22 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:13:16.845 09:59:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.845 09:59:22 -- common/autotest_common.sh@10 -- # set +x 00:13:16.845 09:59:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.845 09:59:22 -- target/rpc.sh@110 -- # stats='{ 00:13:16.845 "tick_rate": 2700000000, 00:13:16.845 "poll_groups": [ 00:13:16.845 { 00:13:16.845 "name": "nvmf_tgt_poll_group_0", 00:13:16.845 "admin_qpairs": 2, 00:13:16.845 "io_qpairs": 84, 00:13:16.845 "current_admin_qpairs": 0, 00:13:16.845 "current_io_qpairs": 0, 00:13:16.845 "pending_bdev_io": 0, 00:13:16.845 "completed_nvme_io": 184, 00:13:16.845 "transports": [ 00:13:16.845 { 00:13:16.845 "trtype": "TCP" 00:13:16.845 } 00:13:16.845 ] 00:13:16.845 }, 00:13:16.845 { 00:13:16.845 "name": "nvmf_tgt_poll_group_1", 00:13:16.845 "admin_qpairs": 2, 00:13:16.846 "io_qpairs": 84, 00:13:16.846 "current_admin_qpairs": 0, 00:13:16.846 "current_io_qpairs": 0, 00:13:16.846 "pending_bdev_io": 0, 00:13:16.846 "completed_nvme_io": 133, 00:13:16.846 "transports": [ 00:13:16.846 { 00:13:16.846 "trtype": "TCP" 00:13:16.846 } 00:13:16.846 ] 00:13:16.846 }, 00:13:16.846 { 00:13:16.846 "name": "nvmf_tgt_poll_group_2", 00:13:16.846 "admin_qpairs": 1, 00:13:16.846 "io_qpairs": 84, 00:13:16.846 "current_admin_qpairs": 0, 00:13:16.846 "current_io_qpairs": 0, 00:13:16.846 "pending_bdev_io": 0, 00:13:16.846 "completed_nvme_io": 214, 00:13:16.846 "transports": [ 00:13:16.846 { 00:13:16.846 "trtype": "TCP" 00:13:16.846 } 00:13:16.846 ] 00:13:16.846 }, 00:13:16.846 { 00:13:16.846 "name": "nvmf_tgt_poll_group_3", 00:13:16.846 "admin_qpairs": 2, 00:13:16.846 "io_qpairs": 84, 00:13:16.846 "current_admin_qpairs": 0, 00:13:16.846 "current_io_qpairs": 0, 00:13:16.846 "pending_bdev_io": 0, 00:13:16.846 "completed_nvme_io": 155, 00:13:16.846 "transports": [ 00:13:16.846 { 00:13:16.846 "trtype": "TCP" 00:13:16.846 } 00:13:16.846 ] 00:13:16.846 } 00:13:16.846 ] 00:13:16.846 }' 00:13:16.846 09:59:22 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:13:16.846 09:59:22 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:13:16.846 09:59:22 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:13:16.846 09:59:22 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:16.846 09:59:22 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:13:16.846 09:59:22 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:13:16.846 09:59:22 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:13:16.846 09:59:22 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:13:16.846 09:59:22 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:16.846 09:59:22 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:13:16.846 09:59:22 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:13:16.846 09:59:22 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:13:16.846 09:59:22 -- target/rpc.sh@123 -- # nvmftestfini 00:13:16.846 09:59:22 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:16.846 09:59:22 -- nvmf/common.sh@116 -- # sync 00:13:16.846 09:59:22 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:16.846 09:59:22 -- nvmf/common.sh@119 -- # set +e 00:13:16.846 09:59:22 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:16.846 09:59:22 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:16.846 rmmod nvme_tcp 00:13:17.103 rmmod nvme_fabrics 00:13:17.103 rmmod nvme_keyring 00:13:17.103 09:59:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:17.103 09:59:22 -- nvmf/common.sh@123 -- # set -e 00:13:17.103 09:59:22 -- nvmf/common.sh@124 -- # return 0 00:13:17.103 09:59:22 -- nvmf/common.sh@477 -- # '[' -n 2756710 ']' 00:13:17.103 09:59:22 -- nvmf/common.sh@478 -- # killprocess 2756710 00:13:17.103 09:59:22 -- common/autotest_common.sh@926 -- # '[' -z 2756710 ']' 00:13:17.103 09:59:22 -- common/autotest_common.sh@930 -- # kill -0 2756710 00:13:17.103 09:59:22 -- common/autotest_common.sh@931 -- # uname 00:13:17.103 09:59:22 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:13:17.103 09:59:22 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2756710 00:13:17.103 09:59:22 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:13:17.103 09:59:22 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:13:17.103 09:59:22 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2756710' 00:13:17.103 killing process with pid 2756710 00:13:17.103 09:59:22 -- common/autotest_common.sh@945 -- # kill 2756710 00:13:17.103 09:59:22 -- common/autotest_common.sh@950 -- # wait 2756710 00:13:17.401 09:59:23 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:17.401 09:59:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:17.401 09:59:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:17.401 09:59:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:17.401 09:59:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:17.401 09:59:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:17.401 09:59:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:17.401 09:59:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:19.304 09:59:25 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:19.304 00:13:19.304 real 0m25.935s 00:13:19.304 user 1m24.798s 00:13:19.304 sys 0m4.278s 00:13:19.304 09:59:25 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:13:19.304 09:59:25 -- common/autotest_common.sh@10 -- # set +x 00:13:19.304 ************************************ 00:13:19.304 END TEST nvmf_rpc 00:13:19.304 ************************************ 00:13:19.304 09:59:25 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:13:19.304 09:59:25 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:13:19.304 09:59:25 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:13:19.304 09:59:25 -- common/autotest_common.sh@10 -- # set +x 00:13:19.304 ************************************ 00:13:19.304 START TEST nvmf_invalid 00:13:19.304 ************************************ 00:13:19.304 09:59:25 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:13:19.562 * Looking for test storage... 00:13:19.562 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:19.562 09:59:25 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:19.562 09:59:25 -- nvmf/common.sh@7 -- # uname -s 00:13:19.562 09:59:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:19.562 09:59:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:19.562 09:59:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:19.562 09:59:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:19.562 09:59:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:19.562 09:59:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:19.562 09:59:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:19.562 09:59:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:19.562 09:59:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:19.562 09:59:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:19.562 09:59:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:19.562 09:59:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:19.562 09:59:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:19.562 09:59:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:19.562 09:59:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:19.562 09:59:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:19.562 09:59:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:19.562 09:59:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:19.562 09:59:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:19.562 09:59:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:19.562 09:59:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:19.562 09:59:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:19.562 09:59:25 -- paths/export.sh@5 -- # export PATH 00:13:19.562 09:59:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:19.562 09:59:25 -- nvmf/common.sh@46 -- # : 0 00:13:19.562 09:59:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:19.562 09:59:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:19.562 09:59:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:19.562 09:59:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:19.562 09:59:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:19.562 09:59:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:19.562 09:59:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:19.562 09:59:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:19.562 09:59:25 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:13:19.562 09:59:25 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:19.562 09:59:25 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:13:19.562 09:59:25 -- target/invalid.sh@14 -- # target=foobar 00:13:19.562 09:59:25 -- target/invalid.sh@16 -- # RANDOM=0 00:13:19.562 09:59:25 -- target/invalid.sh@34 -- # nvmftestinit 00:13:19.562 09:59:25 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:19.562 09:59:25 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:19.562 09:59:25 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:19.562 09:59:25 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:19.562 09:59:25 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:19.562 09:59:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:19.562 09:59:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:19.562 09:59:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:19.562 09:59:25 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:19.562 09:59:25 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:19.562 09:59:25 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:19.562 09:59:25 -- common/autotest_common.sh@10 -- # set +x 00:13:21.465 09:59:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:21.465 09:59:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:21.465 09:59:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:21.465 09:59:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:21.465 09:59:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:21.465 09:59:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:21.465 09:59:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:21.465 09:59:27 -- nvmf/common.sh@294 -- # net_devs=() 00:13:21.465 09:59:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:21.465 09:59:27 -- nvmf/common.sh@295 -- # e810=() 00:13:21.465 09:59:27 -- nvmf/common.sh@295 -- # local -ga e810 00:13:21.465 09:59:27 -- nvmf/common.sh@296 -- # x722=() 00:13:21.465 09:59:27 -- nvmf/common.sh@296 -- # local -ga x722 00:13:21.466 09:59:27 -- nvmf/common.sh@297 -- # mlx=() 00:13:21.466 09:59:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:21.466 09:59:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:21.466 09:59:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:21.466 09:59:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:21.466 09:59:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:21.466 09:59:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:21.466 09:59:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:21.466 09:59:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:21.466 09:59:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:21.466 09:59:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:21.466 09:59:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:21.466 09:59:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:21.466 09:59:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:21.466 09:59:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:21.466 09:59:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:21.466 09:59:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:21.466 09:59:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:21.466 09:59:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:21.466 09:59:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:21.466 09:59:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:21.466 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:21.466 09:59:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:21.466 09:59:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:21.466 09:59:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:21.466 09:59:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:21.466 09:59:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:21.466 09:59:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:21.466 09:59:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:21.466 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:21.466 09:59:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:21.466 09:59:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:21.466 09:59:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:21.466 09:59:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:21.466 09:59:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:21.466 09:59:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:21.466 09:59:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:21.466 09:59:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:21.466 09:59:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:21.466 09:59:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:21.466 09:59:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:21.466 09:59:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:21.466 09:59:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:21.466 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:21.466 09:59:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:21.466 09:59:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:21.466 09:59:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:21.466 09:59:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:21.466 09:59:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:21.466 09:59:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:21.466 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:21.466 09:59:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:21.466 09:59:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:21.466 09:59:27 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:21.466 09:59:27 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:21.466 09:59:27 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:21.466 09:59:27 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:21.466 09:59:27 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:21.466 09:59:27 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:21.466 09:59:27 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:21.466 09:59:27 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:21.466 09:59:27 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:21.466 09:59:27 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:21.466 09:59:27 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:21.466 09:59:27 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:21.466 09:59:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:21.466 09:59:27 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:21.466 09:59:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:21.466 09:59:27 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:21.466 09:59:27 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:21.466 09:59:27 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:21.466 09:59:27 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:21.466 09:59:27 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:21.466 09:59:27 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:21.725 09:59:27 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:21.725 09:59:27 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:21.725 09:59:27 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:21.725 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:21.725 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.270 ms 00:13:21.725 00:13:21.725 --- 10.0.0.2 ping statistics --- 00:13:21.725 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:21.725 rtt min/avg/max/mdev = 0.270/0.270/0.270/0.000 ms 00:13:21.725 09:59:27 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:21.725 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:21.725 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.216 ms 00:13:21.725 00:13:21.725 --- 10.0.0.1 ping statistics --- 00:13:21.725 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:21.725 rtt min/avg/max/mdev = 0.216/0.216/0.216/0.000 ms 00:13:21.725 09:59:27 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:21.725 09:59:27 -- nvmf/common.sh@410 -- # return 0 00:13:21.725 09:59:27 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:21.725 09:59:27 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:21.725 09:59:27 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:21.725 09:59:27 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:21.725 09:59:27 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:21.725 09:59:27 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:21.725 09:59:27 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:21.725 09:59:27 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:13:21.725 09:59:27 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:21.725 09:59:27 -- common/autotest_common.sh@712 -- # xtrace_disable 00:13:21.725 09:59:27 -- common/autotest_common.sh@10 -- # set +x 00:13:21.725 09:59:27 -- nvmf/common.sh@469 -- # nvmfpid=2761422 00:13:21.725 09:59:27 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:21.725 09:59:27 -- nvmf/common.sh@470 -- # waitforlisten 2761422 00:13:21.725 09:59:27 -- common/autotest_common.sh@819 -- # '[' -z 2761422 ']' 00:13:21.725 09:59:27 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:21.725 09:59:27 -- common/autotest_common.sh@824 -- # local max_retries=100 00:13:21.725 09:59:27 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:21.725 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:21.725 09:59:27 -- common/autotest_common.sh@828 -- # xtrace_disable 00:13:21.725 09:59:27 -- common/autotest_common.sh@10 -- # set +x 00:13:21.725 [2024-07-13 09:59:27.422929] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:13:21.725 [2024-07-13 09:59:27.423030] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:21.725 EAL: No free 2048 kB hugepages reported on node 1 00:13:21.725 [2024-07-13 09:59:27.488984] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:21.983 [2024-07-13 09:59:27.578509] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:21.983 [2024-07-13 09:59:27.578675] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:21.983 [2024-07-13 09:59:27.578691] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:21.983 [2024-07-13 09:59:27.578704] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:21.983 [2024-07-13 09:59:27.578758] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:21.983 [2024-07-13 09:59:27.578819] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:21.983 [2024-07-13 09:59:27.578893] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:21.983 [2024-07-13 09:59:27.578896] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:22.549 09:59:28 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:13:22.549 09:59:28 -- common/autotest_common.sh@852 -- # return 0 00:13:22.549 09:59:28 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:22.549 09:59:28 -- common/autotest_common.sh@718 -- # xtrace_disable 00:13:22.549 09:59:28 -- common/autotest_common.sh@10 -- # set +x 00:13:22.807 09:59:28 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:22.807 09:59:28 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:13:22.807 09:59:28 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode12715 00:13:22.807 [2024-07-13 09:59:28.595053] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:13:22.807 09:59:28 -- target/invalid.sh@40 -- # out='request: 00:13:22.807 { 00:13:22.807 "nqn": "nqn.2016-06.io.spdk:cnode12715", 00:13:22.807 "tgt_name": "foobar", 00:13:22.807 "method": "nvmf_create_subsystem", 00:13:22.807 "req_id": 1 00:13:22.807 } 00:13:22.807 Got JSON-RPC error response 00:13:22.807 response: 00:13:22.807 { 00:13:22.807 "code": -32603, 00:13:22.807 "message": "Unable to find target foobar" 00:13:22.807 }' 00:13:22.807 09:59:28 -- target/invalid.sh@41 -- # [[ request: 00:13:22.807 { 00:13:22.807 "nqn": "nqn.2016-06.io.spdk:cnode12715", 00:13:22.807 "tgt_name": "foobar", 00:13:22.807 "method": "nvmf_create_subsystem", 00:13:22.807 "req_id": 1 00:13:22.807 } 00:13:22.807 Got JSON-RPC error response 00:13:22.807 response: 00:13:22.807 { 00:13:22.807 "code": -32603, 00:13:22.807 "message": "Unable to find target foobar" 00:13:22.807 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:13:22.807 09:59:28 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:13:22.807 09:59:28 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode13797 00:13:23.065 [2024-07-13 09:59:28.831854] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode13797: invalid serial number 'SPDKISFASTANDAWESOME' 00:13:23.065 09:59:28 -- target/invalid.sh@45 -- # out='request: 00:13:23.065 { 00:13:23.065 "nqn": "nqn.2016-06.io.spdk:cnode13797", 00:13:23.065 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:13:23.065 "method": "nvmf_create_subsystem", 00:13:23.065 "req_id": 1 00:13:23.065 } 00:13:23.065 Got JSON-RPC error response 00:13:23.065 response: 00:13:23.065 { 00:13:23.065 "code": -32602, 00:13:23.065 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:13:23.065 }' 00:13:23.065 09:59:28 -- target/invalid.sh@46 -- # [[ request: 00:13:23.065 { 00:13:23.065 "nqn": "nqn.2016-06.io.spdk:cnode13797", 00:13:23.065 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:13:23.065 "method": "nvmf_create_subsystem", 00:13:23.065 "req_id": 1 00:13:23.065 } 00:13:23.065 Got JSON-RPC error response 00:13:23.065 response: 00:13:23.065 { 00:13:23.065 "code": -32602, 00:13:23.065 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:13:23.065 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:13:23.065 09:59:28 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:13:23.065 09:59:28 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode2585 00:13:23.323 [2024-07-13 09:59:29.072648] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2585: invalid model number 'SPDK_Controller' 00:13:23.323 09:59:29 -- target/invalid.sh@50 -- # out='request: 00:13:23.323 { 00:13:23.323 "nqn": "nqn.2016-06.io.spdk:cnode2585", 00:13:23.323 "model_number": "SPDK_Controller\u001f", 00:13:23.323 "method": "nvmf_create_subsystem", 00:13:23.323 "req_id": 1 00:13:23.323 } 00:13:23.323 Got JSON-RPC error response 00:13:23.323 response: 00:13:23.323 { 00:13:23.323 "code": -32602, 00:13:23.323 "message": "Invalid MN SPDK_Controller\u001f" 00:13:23.323 }' 00:13:23.323 09:59:29 -- target/invalid.sh@51 -- # [[ request: 00:13:23.323 { 00:13:23.323 "nqn": "nqn.2016-06.io.spdk:cnode2585", 00:13:23.323 "model_number": "SPDK_Controller\u001f", 00:13:23.323 "method": "nvmf_create_subsystem", 00:13:23.323 "req_id": 1 00:13:23.323 } 00:13:23.323 Got JSON-RPC error response 00:13:23.323 response: 00:13:23.323 { 00:13:23.323 "code": -32602, 00:13:23.323 "message": "Invalid MN SPDK_Controller\u001f" 00:13:23.323 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:13:23.323 09:59:29 -- target/invalid.sh@54 -- # gen_random_s 21 00:13:23.323 09:59:29 -- target/invalid.sh@19 -- # local length=21 ll 00:13:23.323 09:59:29 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:13:23.323 09:59:29 -- target/invalid.sh@21 -- # local chars 00:13:23.323 09:59:29 -- target/invalid.sh@22 -- # local string 00:13:23.323 09:59:29 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:13:23.323 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.323 09:59:29 -- target/invalid.sh@25 -- # printf %x 100 00:13:23.323 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x64' 00:13:23.323 09:59:29 -- target/invalid.sh@25 -- # string+=d 00:13:23.323 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.323 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.323 09:59:29 -- target/invalid.sh@25 -- # printf %x 98 00:13:23.323 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x62' 00:13:23.323 09:59:29 -- target/invalid.sh@25 -- # string+=b 00:13:23.323 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.323 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.323 09:59:29 -- target/invalid.sh@25 -- # printf %x 50 00:13:23.323 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x32' 00:13:23.323 09:59:29 -- target/invalid.sh@25 -- # string+=2 00:13:23.323 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.323 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.323 09:59:29 -- target/invalid.sh@25 -- # printf %x 59 00:13:23.323 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x3b' 00:13:23.323 09:59:29 -- target/invalid.sh@25 -- # string+=';' 00:13:23.323 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.323 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.323 09:59:29 -- target/invalid.sh@25 -- # printf %x 82 00:13:23.323 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x52' 00:13:23.323 09:59:29 -- target/invalid.sh@25 -- # string+=R 00:13:23.323 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.323 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.323 09:59:29 -- target/invalid.sh@25 -- # printf %x 79 00:13:23.323 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x4f' 00:13:23.323 09:59:29 -- target/invalid.sh@25 -- # string+=O 00:13:23.323 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.323 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.323 09:59:29 -- target/invalid.sh@25 -- # printf %x 37 00:13:23.323 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x25' 00:13:23.323 09:59:29 -- target/invalid.sh@25 -- # string+=% 00:13:23.323 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.323 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.323 09:59:29 -- target/invalid.sh@25 -- # printf %x 73 00:13:23.323 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x49' 00:13:23.323 09:59:29 -- target/invalid.sh@25 -- # string+=I 00:13:23.323 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.323 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.323 09:59:29 -- target/invalid.sh@25 -- # printf %x 68 00:13:23.323 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x44' 00:13:23.323 09:59:29 -- target/invalid.sh@25 -- # string+=D 00:13:23.323 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.323 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.323 09:59:29 -- target/invalid.sh@25 -- # printf %x 57 00:13:23.323 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x39' 00:13:23.323 09:59:29 -- target/invalid.sh@25 -- # string+=9 00:13:23.323 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.323 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.323 09:59:29 -- target/invalid.sh@25 -- # printf %x 104 00:13:23.323 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x68' 00:13:23.323 09:59:29 -- target/invalid.sh@25 -- # string+=h 00:13:23.324 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.324 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.324 09:59:29 -- target/invalid.sh@25 -- # printf %x 100 00:13:23.582 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x64' 00:13:23.582 09:59:29 -- target/invalid.sh@25 -- # string+=d 00:13:23.582 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.582 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.582 09:59:29 -- target/invalid.sh@25 -- # printf %x 64 00:13:23.582 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x40' 00:13:23.582 09:59:29 -- target/invalid.sh@25 -- # string+=@ 00:13:23.582 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.582 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.582 09:59:29 -- target/invalid.sh@25 -- # printf %x 60 00:13:23.582 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x3c' 00:13:23.582 09:59:29 -- target/invalid.sh@25 -- # string+='<' 00:13:23.582 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.582 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.582 09:59:29 -- target/invalid.sh@25 -- # printf %x 73 00:13:23.582 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x49' 00:13:23.582 09:59:29 -- target/invalid.sh@25 -- # string+=I 00:13:23.582 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.582 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.582 09:59:29 -- target/invalid.sh@25 -- # printf %x 118 00:13:23.582 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x76' 00:13:23.582 09:59:29 -- target/invalid.sh@25 -- # string+=v 00:13:23.582 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.582 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.582 09:59:29 -- target/invalid.sh@25 -- # printf %x 62 00:13:23.582 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x3e' 00:13:23.582 09:59:29 -- target/invalid.sh@25 -- # string+='>' 00:13:23.582 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.582 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.582 09:59:29 -- target/invalid.sh@25 -- # printf %x 96 00:13:23.582 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x60' 00:13:23.582 09:59:29 -- target/invalid.sh@25 -- # string+='`' 00:13:23.582 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.582 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.582 09:59:29 -- target/invalid.sh@25 -- # printf %x 112 00:13:23.582 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x70' 00:13:23.582 09:59:29 -- target/invalid.sh@25 -- # string+=p 00:13:23.582 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.582 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.582 09:59:29 -- target/invalid.sh@25 -- # printf %x 90 00:13:23.582 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x5a' 00:13:23.582 09:59:29 -- target/invalid.sh@25 -- # string+=Z 00:13:23.582 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.582 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.582 09:59:29 -- target/invalid.sh@25 -- # printf %x 111 00:13:23.582 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:13:23.582 09:59:29 -- target/invalid.sh@25 -- # string+=o 00:13:23.582 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.582 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.582 09:59:29 -- target/invalid.sh@28 -- # [[ d == \- ]] 00:13:23.582 09:59:29 -- target/invalid.sh@31 -- # echo 'db2;RO%ID9hd@`pZo' 00:13:23.582 09:59:29 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s 'db2;RO%ID9hd@`pZo' nqn.2016-06.io.spdk:cnode19933 00:13:23.582 [2024-07-13 09:59:29.393751] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode19933: invalid serial number 'db2;RO%ID9hd@`pZo' 00:13:23.840 09:59:29 -- target/invalid.sh@54 -- # out='request: 00:13:23.840 { 00:13:23.840 "nqn": "nqn.2016-06.io.spdk:cnode19933", 00:13:23.840 "serial_number": "db2;RO%ID9hd@`pZo", 00:13:23.840 "method": "nvmf_create_subsystem", 00:13:23.840 "req_id": 1 00:13:23.840 } 00:13:23.840 Got JSON-RPC error response 00:13:23.840 response: 00:13:23.840 { 00:13:23.840 "code": -32602, 00:13:23.840 "message": "Invalid SN db2;RO%ID9hd@`pZo" 00:13:23.840 }' 00:13:23.840 09:59:29 -- target/invalid.sh@55 -- # [[ request: 00:13:23.840 { 00:13:23.840 "nqn": "nqn.2016-06.io.spdk:cnode19933", 00:13:23.840 "serial_number": "db2;RO%ID9hd@`pZo", 00:13:23.840 "method": "nvmf_create_subsystem", 00:13:23.840 "req_id": 1 00:13:23.840 } 00:13:23.840 Got JSON-RPC error response 00:13:23.840 response: 00:13:23.840 { 00:13:23.840 "code": -32602, 00:13:23.840 "message": "Invalid SN db2;RO%ID9hd@`pZo" 00:13:23.840 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:13:23.840 09:59:29 -- target/invalid.sh@58 -- # gen_random_s 41 00:13:23.840 09:59:29 -- target/invalid.sh@19 -- # local length=41 ll 00:13:23.840 09:59:29 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:13:23.840 09:59:29 -- target/invalid.sh@21 -- # local chars 00:13:23.840 09:59:29 -- target/invalid.sh@22 -- # local string 00:13:23.840 09:59:29 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:13:23.840 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # printf %x 54 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x36' 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # string+=6 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # printf %x 73 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x49' 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # string+=I 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # printf %x 105 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x69' 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # string+=i 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # printf %x 109 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x6d' 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # string+=m 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # printf %x 110 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # string+=n 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # printf %x 66 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x42' 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # string+=B 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # printf %x 100 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x64' 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # string+=d 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # printf %x 44 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x2c' 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # string+=, 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # printf %x 43 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x2b' 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # string+=+ 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # printf %x 101 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x65' 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # string+=e 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # printf %x 101 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x65' 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # string+=e 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # printf %x 118 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x76' 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # string+=v 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # printf %x 60 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x3c' 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # string+='<' 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # printf %x 122 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x7a' 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # string+=z 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # printf %x 71 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x47' 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # string+=G 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # printf %x 104 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x68' 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # string+=h 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # printf %x 98 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x62' 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # string+=b 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # printf %x 121 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x79' 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # string+=y 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # printf %x 107 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x6b' 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # string+=k 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # printf %x 110 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # string+=n 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # printf %x 90 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x5a' 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # string+=Z 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # printf %x 35 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x23' 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # string+='#' 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # printf %x 62 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x3e' 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # string+='>' 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # printf %x 80 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x50' 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # string+=P 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # printf %x 103 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x67' 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # string+=g 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # printf %x 60 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x3c' 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # string+='<' 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # printf %x 43 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x2b' 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # string+=+ 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # printf %x 78 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x4e' 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # string+=N 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # printf %x 94 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x5e' 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # string+='^' 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # printf %x 77 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x4d' 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # string+=M 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # printf %x 121 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x79' 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # string+=y 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # printf %x 75 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x4b' 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # string+=K 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # printf %x 122 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x7a' 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # string+=z 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # printf %x 32 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x20' 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # string+=' ' 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # printf %x 71 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x47' 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # string+=G 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # printf %x 88 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x58' 00:13:23.841 09:59:29 -- target/invalid.sh@25 -- # string+=X 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.841 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.842 09:59:29 -- target/invalid.sh@25 -- # printf %x 98 00:13:23.842 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x62' 00:13:23.842 09:59:29 -- target/invalid.sh@25 -- # string+=b 00:13:23.842 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.842 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.842 09:59:29 -- target/invalid.sh@25 -- # printf %x 109 00:13:23.842 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x6d' 00:13:23.842 09:59:29 -- target/invalid.sh@25 -- # string+=m 00:13:23.842 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.842 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.842 09:59:29 -- target/invalid.sh@25 -- # printf %x 60 00:13:23.842 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x3c' 00:13:23.842 09:59:29 -- target/invalid.sh@25 -- # string+='<' 00:13:23.842 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.842 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.842 09:59:29 -- target/invalid.sh@25 -- # printf %x 122 00:13:23.842 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x7a' 00:13:23.842 09:59:29 -- target/invalid.sh@25 -- # string+=z 00:13:23.842 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.842 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.842 09:59:29 -- target/invalid.sh@25 -- # printf %x 76 00:13:23.842 09:59:29 -- target/invalid.sh@25 -- # echo -e '\x4c' 00:13:23.842 09:59:29 -- target/invalid.sh@25 -- # string+=L 00:13:23.842 09:59:29 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.842 09:59:29 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.842 09:59:29 -- target/invalid.sh@28 -- # [[ 6 == \- ]] 00:13:23.842 09:59:29 -- target/invalid.sh@31 -- # echo '6IimnBd,+eevPg<+N^MyKz GXbmPg<+N^MyKz GXbmPg<+N^MyKz GXbmPg<+N^MyKz GXbmPg<+N^MyKz GXbm /dev/null' 00:13:26.422 09:59:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:28.958 09:59:34 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:28.958 00:13:28.958 real 0m9.070s 00:13:28.958 user 0m21.670s 00:13:28.958 sys 0m2.491s 00:13:28.958 09:59:34 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:13:28.958 09:59:34 -- common/autotest_common.sh@10 -- # set +x 00:13:28.958 ************************************ 00:13:28.958 END TEST nvmf_invalid 00:13:28.958 ************************************ 00:13:28.958 09:59:34 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:13:28.958 09:59:34 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:13:28.958 09:59:34 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:13:28.958 09:59:34 -- common/autotest_common.sh@10 -- # set +x 00:13:28.958 ************************************ 00:13:28.958 START TEST nvmf_abort 00:13:28.958 ************************************ 00:13:28.958 09:59:34 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:13:28.958 * Looking for test storage... 00:13:28.958 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:28.958 09:59:34 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:28.959 09:59:34 -- nvmf/common.sh@7 -- # uname -s 00:13:28.959 09:59:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:28.959 09:59:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:28.959 09:59:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:28.959 09:59:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:28.959 09:59:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:28.959 09:59:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:28.959 09:59:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:28.959 09:59:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:28.959 09:59:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:28.959 09:59:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:28.959 09:59:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:28.959 09:59:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:28.959 09:59:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:28.959 09:59:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:28.959 09:59:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:28.959 09:59:34 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:28.959 09:59:34 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:28.959 09:59:34 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:28.959 09:59:34 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:28.959 09:59:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:28.959 09:59:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:28.959 09:59:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:28.959 09:59:34 -- paths/export.sh@5 -- # export PATH 00:13:28.959 09:59:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:28.959 09:59:34 -- nvmf/common.sh@46 -- # : 0 00:13:28.959 09:59:34 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:28.959 09:59:34 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:28.959 09:59:34 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:28.959 09:59:34 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:28.959 09:59:34 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:28.959 09:59:34 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:28.959 09:59:34 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:28.959 09:59:34 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:28.959 09:59:34 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:28.959 09:59:34 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:13:28.959 09:59:34 -- target/abort.sh@14 -- # nvmftestinit 00:13:28.959 09:59:34 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:28.959 09:59:34 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:28.959 09:59:34 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:28.959 09:59:34 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:28.959 09:59:34 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:28.959 09:59:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:28.959 09:59:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:28.959 09:59:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:28.959 09:59:34 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:28.959 09:59:34 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:28.959 09:59:34 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:28.959 09:59:34 -- common/autotest_common.sh@10 -- # set +x 00:13:30.862 09:59:36 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:30.862 09:59:36 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:30.862 09:59:36 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:30.862 09:59:36 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:30.862 09:59:36 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:30.862 09:59:36 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:30.862 09:59:36 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:30.862 09:59:36 -- nvmf/common.sh@294 -- # net_devs=() 00:13:30.862 09:59:36 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:30.862 09:59:36 -- nvmf/common.sh@295 -- # e810=() 00:13:30.862 09:59:36 -- nvmf/common.sh@295 -- # local -ga e810 00:13:30.862 09:59:36 -- nvmf/common.sh@296 -- # x722=() 00:13:30.862 09:59:36 -- nvmf/common.sh@296 -- # local -ga x722 00:13:30.862 09:59:36 -- nvmf/common.sh@297 -- # mlx=() 00:13:30.862 09:59:36 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:30.862 09:59:36 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:30.862 09:59:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:30.862 09:59:36 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:30.862 09:59:36 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:30.862 09:59:36 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:30.862 09:59:36 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:30.862 09:59:36 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:30.862 09:59:36 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:30.862 09:59:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:30.862 09:59:36 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:30.862 09:59:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:30.862 09:59:36 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:30.862 09:59:36 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:30.862 09:59:36 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:30.862 09:59:36 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:30.862 09:59:36 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:30.862 09:59:36 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:30.862 09:59:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:30.862 09:59:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:30.862 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:30.862 09:59:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:30.862 09:59:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:30.862 09:59:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:30.862 09:59:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:30.862 09:59:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:30.862 09:59:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:30.862 09:59:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:30.862 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:30.862 09:59:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:30.862 09:59:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:30.862 09:59:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:30.862 09:59:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:30.862 09:59:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:30.862 09:59:36 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:30.862 09:59:36 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:30.862 09:59:36 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:30.862 09:59:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:30.862 09:59:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:30.862 09:59:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:30.862 09:59:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:30.862 09:59:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:30.862 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:30.862 09:59:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:30.862 09:59:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:30.862 09:59:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:30.862 09:59:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:30.862 09:59:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:30.862 09:59:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:30.862 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:30.862 09:59:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:30.862 09:59:36 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:30.862 09:59:36 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:30.862 09:59:36 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:30.862 09:59:36 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:30.862 09:59:36 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:30.862 09:59:36 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:30.862 09:59:36 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:30.862 09:59:36 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:30.862 09:59:36 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:30.862 09:59:36 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:30.862 09:59:36 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:30.862 09:59:36 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:30.862 09:59:36 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:30.862 09:59:36 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:30.862 09:59:36 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:30.862 09:59:36 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:30.862 09:59:36 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:30.862 09:59:36 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:30.862 09:59:36 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:30.862 09:59:36 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:30.862 09:59:36 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:30.862 09:59:36 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:30.862 09:59:36 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:30.862 09:59:36 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:30.862 09:59:36 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:30.862 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:30.862 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.165 ms 00:13:30.862 00:13:30.862 --- 10.0.0.2 ping statistics --- 00:13:30.862 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:30.862 rtt min/avg/max/mdev = 0.165/0.165/0.165/0.000 ms 00:13:30.862 09:59:36 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:30.862 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:30.862 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.109 ms 00:13:30.862 00:13:30.862 --- 10.0.0.1 ping statistics --- 00:13:30.862 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:30.862 rtt min/avg/max/mdev = 0.109/0.109/0.109/0.000 ms 00:13:30.862 09:59:36 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:30.862 09:59:36 -- nvmf/common.sh@410 -- # return 0 00:13:30.862 09:59:36 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:30.862 09:59:36 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:30.862 09:59:36 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:30.862 09:59:36 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:30.862 09:59:36 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:30.862 09:59:36 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:30.862 09:59:36 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:30.862 09:59:36 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:13:30.862 09:59:36 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:30.863 09:59:36 -- common/autotest_common.sh@712 -- # xtrace_disable 00:13:30.863 09:59:36 -- common/autotest_common.sh@10 -- # set +x 00:13:30.863 09:59:36 -- nvmf/common.sh@469 -- # nvmfpid=2764089 00:13:30.863 09:59:36 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:30.863 09:59:36 -- nvmf/common.sh@470 -- # waitforlisten 2764089 00:13:30.863 09:59:36 -- common/autotest_common.sh@819 -- # '[' -z 2764089 ']' 00:13:30.863 09:59:36 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:30.863 09:59:36 -- common/autotest_common.sh@824 -- # local max_retries=100 00:13:30.863 09:59:36 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:30.863 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:30.863 09:59:36 -- common/autotest_common.sh@828 -- # xtrace_disable 00:13:30.863 09:59:36 -- common/autotest_common.sh@10 -- # set +x 00:13:30.863 [2024-07-13 09:59:36.455303] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:13:30.863 [2024-07-13 09:59:36.455372] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:30.863 EAL: No free 2048 kB hugepages reported on node 1 00:13:30.863 [2024-07-13 09:59:36.517772] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:30.863 [2024-07-13 09:59:36.603474] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:30.863 [2024-07-13 09:59:36.603633] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:30.863 [2024-07-13 09:59:36.603652] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:30.863 [2024-07-13 09:59:36.603665] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:30.863 [2024-07-13 09:59:36.603749] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:30.863 [2024-07-13 09:59:36.603776] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:30.863 [2024-07-13 09:59:36.603779] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:31.796 09:59:37 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:13:31.796 09:59:37 -- common/autotest_common.sh@852 -- # return 0 00:13:31.797 09:59:37 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:31.797 09:59:37 -- common/autotest_common.sh@718 -- # xtrace_disable 00:13:31.797 09:59:37 -- common/autotest_common.sh@10 -- # set +x 00:13:31.797 09:59:37 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:31.797 09:59:37 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:13:31.797 09:59:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:31.797 09:59:37 -- common/autotest_common.sh@10 -- # set +x 00:13:31.797 [2024-07-13 09:59:37.427752] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:31.797 09:59:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:31.797 09:59:37 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:13:31.797 09:59:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:31.797 09:59:37 -- common/autotest_common.sh@10 -- # set +x 00:13:31.797 Malloc0 00:13:31.797 09:59:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:31.797 09:59:37 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:31.797 09:59:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:31.797 09:59:37 -- common/autotest_common.sh@10 -- # set +x 00:13:31.797 Delay0 00:13:31.797 09:59:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:31.797 09:59:37 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:13:31.797 09:59:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:31.797 09:59:37 -- common/autotest_common.sh@10 -- # set +x 00:13:31.797 09:59:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:31.797 09:59:37 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:13:31.797 09:59:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:31.797 09:59:37 -- common/autotest_common.sh@10 -- # set +x 00:13:31.797 09:59:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:31.797 09:59:37 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:13:31.797 09:59:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:31.797 09:59:37 -- common/autotest_common.sh@10 -- # set +x 00:13:31.797 [2024-07-13 09:59:37.496764] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:31.797 09:59:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:31.797 09:59:37 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:31.797 09:59:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:31.797 09:59:37 -- common/autotest_common.sh@10 -- # set +x 00:13:31.797 09:59:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:31.797 09:59:37 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:13:31.797 EAL: No free 2048 kB hugepages reported on node 1 00:13:31.797 [2024-07-13 09:59:37.602003] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:13:34.321 Initializing NVMe Controllers 00:13:34.321 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:13:34.321 controller IO queue size 128 less than required 00:13:34.321 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:13:34.321 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:13:34.321 Initialization complete. Launching workers. 00:13:34.321 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 34133 00:13:34.321 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 34194, failed to submit 62 00:13:34.321 success 34133, unsuccess 61, failed 0 00:13:34.321 09:59:39 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:13:34.321 09:59:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:34.321 09:59:39 -- common/autotest_common.sh@10 -- # set +x 00:13:34.321 09:59:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:34.321 09:59:39 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:13:34.321 09:59:39 -- target/abort.sh@38 -- # nvmftestfini 00:13:34.321 09:59:39 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:34.321 09:59:39 -- nvmf/common.sh@116 -- # sync 00:13:34.321 09:59:39 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:34.321 09:59:39 -- nvmf/common.sh@119 -- # set +e 00:13:34.321 09:59:39 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:34.321 09:59:39 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:34.321 rmmod nvme_tcp 00:13:34.321 rmmod nvme_fabrics 00:13:34.321 rmmod nvme_keyring 00:13:34.321 09:59:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:34.321 09:59:39 -- nvmf/common.sh@123 -- # set -e 00:13:34.321 09:59:39 -- nvmf/common.sh@124 -- # return 0 00:13:34.321 09:59:39 -- nvmf/common.sh@477 -- # '[' -n 2764089 ']' 00:13:34.321 09:59:39 -- nvmf/common.sh@478 -- # killprocess 2764089 00:13:34.321 09:59:39 -- common/autotest_common.sh@926 -- # '[' -z 2764089 ']' 00:13:34.321 09:59:39 -- common/autotest_common.sh@930 -- # kill -0 2764089 00:13:34.321 09:59:39 -- common/autotest_common.sh@931 -- # uname 00:13:34.321 09:59:39 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:13:34.321 09:59:39 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2764089 00:13:34.321 09:59:39 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:13:34.321 09:59:39 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:13:34.321 09:59:39 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2764089' 00:13:34.321 killing process with pid 2764089 00:13:34.321 09:59:39 -- common/autotest_common.sh@945 -- # kill 2764089 00:13:34.321 09:59:39 -- common/autotest_common.sh@950 -- # wait 2764089 00:13:34.321 09:59:40 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:34.321 09:59:40 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:34.321 09:59:40 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:34.321 09:59:40 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:34.321 09:59:40 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:34.321 09:59:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:34.321 09:59:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:34.321 09:59:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:36.854 09:59:42 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:36.854 00:13:36.854 real 0m7.946s 00:13:36.854 user 0m12.765s 00:13:36.854 sys 0m2.600s 00:13:36.854 09:59:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:13:36.854 09:59:42 -- common/autotest_common.sh@10 -- # set +x 00:13:36.854 ************************************ 00:13:36.854 END TEST nvmf_abort 00:13:36.854 ************************************ 00:13:36.854 09:59:42 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:13:36.854 09:59:42 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:13:36.854 09:59:42 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:13:36.854 09:59:42 -- common/autotest_common.sh@10 -- # set +x 00:13:36.854 ************************************ 00:13:36.854 START TEST nvmf_ns_hotplug_stress 00:13:36.854 ************************************ 00:13:36.854 09:59:42 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:13:36.854 * Looking for test storage... 00:13:36.854 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:36.854 09:59:42 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:36.854 09:59:42 -- nvmf/common.sh@7 -- # uname -s 00:13:36.854 09:59:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:36.854 09:59:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:36.854 09:59:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:36.854 09:59:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:36.854 09:59:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:36.854 09:59:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:36.854 09:59:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:36.854 09:59:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:36.854 09:59:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:36.854 09:59:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:36.854 09:59:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:36.854 09:59:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:36.854 09:59:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:36.854 09:59:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:36.854 09:59:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:36.854 09:59:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:36.854 09:59:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:36.854 09:59:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:36.854 09:59:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:36.854 09:59:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:36.854 09:59:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:36.854 09:59:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:36.854 09:59:42 -- paths/export.sh@5 -- # export PATH 00:13:36.854 09:59:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:36.854 09:59:42 -- nvmf/common.sh@46 -- # : 0 00:13:36.854 09:59:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:36.854 09:59:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:36.854 09:59:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:36.854 09:59:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:36.854 09:59:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:36.854 09:59:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:36.854 09:59:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:36.854 09:59:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:36.854 09:59:42 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:36.854 09:59:42 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:13:36.854 09:59:42 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:36.854 09:59:42 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:36.854 09:59:42 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:36.854 09:59:42 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:36.854 09:59:42 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:36.854 09:59:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:36.854 09:59:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:36.854 09:59:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:36.854 09:59:42 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:36.854 09:59:42 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:36.854 09:59:42 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:36.854 09:59:42 -- common/autotest_common.sh@10 -- # set +x 00:13:38.751 09:59:44 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:38.751 09:59:44 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:38.751 09:59:44 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:38.751 09:59:44 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:38.751 09:59:44 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:38.751 09:59:44 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:38.751 09:59:44 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:38.751 09:59:44 -- nvmf/common.sh@294 -- # net_devs=() 00:13:38.751 09:59:44 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:38.751 09:59:44 -- nvmf/common.sh@295 -- # e810=() 00:13:38.751 09:59:44 -- nvmf/common.sh@295 -- # local -ga e810 00:13:38.751 09:59:44 -- nvmf/common.sh@296 -- # x722=() 00:13:38.751 09:59:44 -- nvmf/common.sh@296 -- # local -ga x722 00:13:38.751 09:59:44 -- nvmf/common.sh@297 -- # mlx=() 00:13:38.751 09:59:44 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:38.751 09:59:44 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:38.751 09:59:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:38.751 09:59:44 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:38.751 09:59:44 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:38.751 09:59:44 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:38.751 09:59:44 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:38.751 09:59:44 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:38.751 09:59:44 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:38.751 09:59:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:38.751 09:59:44 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:38.751 09:59:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:38.751 09:59:44 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:38.751 09:59:44 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:38.751 09:59:44 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:38.751 09:59:44 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:38.751 09:59:44 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:38.751 09:59:44 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:38.751 09:59:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:38.751 09:59:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:38.751 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:38.751 09:59:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:38.751 09:59:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:38.751 09:59:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:38.751 09:59:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:38.751 09:59:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:38.751 09:59:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:38.751 09:59:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:38.751 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:38.751 09:59:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:38.751 09:59:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:38.751 09:59:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:38.751 09:59:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:38.751 09:59:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:38.751 09:59:44 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:38.751 09:59:44 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:38.751 09:59:44 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:38.751 09:59:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:38.751 09:59:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:38.751 09:59:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:38.751 09:59:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:38.751 09:59:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:38.752 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:38.752 09:59:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:38.752 09:59:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:38.752 09:59:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:38.752 09:59:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:38.752 09:59:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:38.752 09:59:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:38.752 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:38.752 09:59:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:38.752 09:59:44 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:38.752 09:59:44 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:38.752 09:59:44 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:38.752 09:59:44 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:38.752 09:59:44 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:38.752 09:59:44 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:38.752 09:59:44 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:38.752 09:59:44 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:38.752 09:59:44 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:38.752 09:59:44 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:38.752 09:59:44 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:38.752 09:59:44 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:38.752 09:59:44 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:38.752 09:59:44 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:38.752 09:59:44 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:38.752 09:59:44 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:38.752 09:59:44 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:38.752 09:59:44 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:38.752 09:59:44 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:38.752 09:59:44 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:38.752 09:59:44 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:38.752 09:59:44 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:38.752 09:59:44 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:38.752 09:59:44 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:38.752 09:59:44 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:38.752 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:38.752 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.274 ms 00:13:38.752 00:13:38.752 --- 10.0.0.2 ping statistics --- 00:13:38.752 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:38.752 rtt min/avg/max/mdev = 0.274/0.274/0.274/0.000 ms 00:13:38.752 09:59:44 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:38.752 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:38.752 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.175 ms 00:13:38.752 00:13:38.752 --- 10.0.0.1 ping statistics --- 00:13:38.752 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:38.752 rtt min/avg/max/mdev = 0.175/0.175/0.175/0.000 ms 00:13:38.752 09:59:44 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:38.752 09:59:44 -- nvmf/common.sh@410 -- # return 0 00:13:38.752 09:59:44 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:38.752 09:59:44 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:38.752 09:59:44 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:38.752 09:59:44 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:38.752 09:59:44 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:38.752 09:59:44 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:38.752 09:59:44 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:38.752 09:59:44 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:13:38.752 09:59:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:38.752 09:59:44 -- common/autotest_common.sh@712 -- # xtrace_disable 00:13:38.752 09:59:44 -- common/autotest_common.sh@10 -- # set +x 00:13:38.752 09:59:44 -- nvmf/common.sh@469 -- # nvmfpid=2766462 00:13:38.752 09:59:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:38.752 09:59:44 -- nvmf/common.sh@470 -- # waitforlisten 2766462 00:13:38.752 09:59:44 -- common/autotest_common.sh@819 -- # '[' -z 2766462 ']' 00:13:38.752 09:59:44 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:38.752 09:59:44 -- common/autotest_common.sh@824 -- # local max_retries=100 00:13:38.752 09:59:44 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:38.752 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:38.752 09:59:44 -- common/autotest_common.sh@828 -- # xtrace_disable 00:13:38.752 09:59:44 -- common/autotest_common.sh@10 -- # set +x 00:13:38.752 [2024-07-13 09:59:44.364680] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:13:38.752 [2024-07-13 09:59:44.364769] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:38.752 EAL: No free 2048 kB hugepages reported on node 1 00:13:38.752 [2024-07-13 09:59:44.442961] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:38.752 [2024-07-13 09:59:44.536335] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:38.752 [2024-07-13 09:59:44.536495] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:38.752 [2024-07-13 09:59:44.536515] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:38.752 [2024-07-13 09:59:44.536529] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:38.752 [2024-07-13 09:59:44.536588] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:38.752 [2024-07-13 09:59:44.536642] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:38.752 [2024-07-13 09:59:44.536646] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:39.683 09:59:45 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:13:39.683 09:59:45 -- common/autotest_common.sh@852 -- # return 0 00:13:39.683 09:59:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:39.683 09:59:45 -- common/autotest_common.sh@718 -- # xtrace_disable 00:13:39.683 09:59:45 -- common/autotest_common.sh@10 -- # set +x 00:13:39.683 09:59:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:39.683 09:59:45 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:13:39.683 09:59:45 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:13:39.940 [2024-07-13 09:59:45.600652] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:39.940 09:59:45 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:40.197 09:59:45 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:40.455 [2024-07-13 09:59:46.067323] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:40.455 09:59:46 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:40.713 09:59:46 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:13:40.970 Malloc0 00:13:40.970 09:59:46 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:41.228 Delay0 00:13:41.228 09:59:46 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:41.485 09:59:47 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:13:41.485 NULL1 00:13:41.485 09:59:47 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:13:41.742 09:59:47 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=2766898 00:13:41.742 09:59:47 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:13:41.742 09:59:47 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2766898 00:13:41.742 09:59:47 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:41.999 EAL: No free 2048 kB hugepages reported on node 1 00:13:42.932 Read completed with error (sct=0, sc=11) 00:13:42.932 09:59:48 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:42.932 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:42.932 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:43.189 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:43.189 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:43.189 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:43.189 09:59:48 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:13:43.189 09:59:48 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:13:43.446 true 00:13:43.446 09:59:49 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2766898 00:13:43.446 09:59:49 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:44.378 09:59:49 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:44.378 09:59:50 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:13:44.378 09:59:50 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:13:44.634 true 00:13:44.634 09:59:50 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2766898 00:13:44.634 09:59:50 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:44.892 09:59:50 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:45.151 09:59:50 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:13:45.151 09:59:50 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:13:45.409 true 00:13:45.409 09:59:51 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2766898 00:13:45.409 09:59:51 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:46.342 09:59:52 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:46.342 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:46.342 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:46.600 09:59:52 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:13:46.600 09:59:52 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:13:46.858 true 00:13:46.858 09:59:52 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2766898 00:13:46.858 09:59:52 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:47.116 09:59:52 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:47.373 09:59:52 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:13:47.373 09:59:52 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:13:47.629 true 00:13:47.629 09:59:53 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2766898 00:13:47.629 09:59:53 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:48.561 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:48.561 09:59:54 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:48.818 09:59:54 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:13:48.818 09:59:54 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:13:49.076 true 00:13:49.076 09:59:54 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2766898 00:13:49.076 09:59:54 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:49.076 09:59:54 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:49.334 09:59:55 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:13:49.334 09:59:55 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:13:49.591 true 00:13:49.591 09:59:55 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2766898 00:13:49.591 09:59:55 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:50.962 09:59:56 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:50.962 09:59:56 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:13:50.962 09:59:56 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:13:51.220 true 00:13:51.220 09:59:56 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2766898 00:13:51.220 09:59:56 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:51.478 09:59:57 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:51.736 09:59:57 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:13:51.736 09:59:57 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:13:51.994 true 00:13:51.994 09:59:57 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2766898 00:13:51.994 09:59:57 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:52.927 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:52.927 09:59:58 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:52.927 09:59:58 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:13:52.927 09:59:58 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:13:53.185 true 00:13:53.185 09:59:58 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2766898 00:13:53.185 09:59:58 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:53.443 09:59:59 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:53.700 09:59:59 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:13:53.700 09:59:59 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:13:53.959 true 00:13:53.959 09:59:59 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2766898 00:13:53.959 09:59:59 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:54.890 10:00:00 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:55.147 10:00:00 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:13:55.148 10:00:00 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:13:55.405 true 00:13:55.405 10:00:01 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2766898 00:13:55.405 10:00:01 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:55.662 10:00:01 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:55.917 10:00:01 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:13:55.918 10:00:01 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:13:55.918 true 00:13:56.173 10:00:01 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2766898 00:13:56.173 10:00:01 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:56.748 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:57.004 10:00:02 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:57.004 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:57.004 10:00:02 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:13:57.004 10:00:02 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:13:57.259 true 00:13:57.259 10:00:03 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2766898 00:13:57.259 10:00:03 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:57.515 10:00:03 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:57.771 10:00:03 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:13:57.771 10:00:03 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:13:58.028 true 00:13:58.028 10:00:03 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2766898 00:13:58.028 10:00:03 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:58.957 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:58.957 10:00:04 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:59.215 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:59.215 10:00:05 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:13:59.215 10:00:05 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:13:59.472 true 00:13:59.472 10:00:05 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2766898 00:13:59.472 10:00:05 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:59.729 10:00:05 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:59.986 10:00:05 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:13:59.986 10:00:05 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:14:00.242 true 00:14:00.242 10:00:05 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2766898 00:14:00.242 10:00:05 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:01.172 10:00:06 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:01.428 10:00:07 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:14:01.428 10:00:07 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:14:01.683 true 00:14:01.683 10:00:07 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2766898 00:14:01.683 10:00:07 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:01.939 10:00:07 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:02.195 10:00:07 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:14:02.195 10:00:07 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:14:02.452 true 00:14:02.452 10:00:08 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2766898 00:14:02.452 10:00:08 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:03.382 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:03.382 10:00:08 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:03.640 10:00:09 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:14:03.640 10:00:09 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:14:03.640 true 00:14:03.897 10:00:09 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2766898 00:14:03.897 10:00:09 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:03.897 10:00:09 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:04.154 10:00:09 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:14:04.154 10:00:09 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:14:04.411 true 00:14:04.411 10:00:10 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2766898 00:14:04.411 10:00:10 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:05.340 10:00:11 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:05.340 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:05.598 10:00:11 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:14:05.598 10:00:11 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:14:05.855 true 00:14:05.855 10:00:11 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2766898 00:14:05.855 10:00:11 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:06.113 10:00:11 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:06.371 10:00:11 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:14:06.371 10:00:11 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:14:06.372 true 00:14:06.628 10:00:12 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2766898 00:14:06.628 10:00:12 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:07.559 10:00:13 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:07.559 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:07.559 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:07.559 10:00:13 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:14:07.559 10:00:13 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:14:07.817 true 00:14:07.817 10:00:13 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2766898 00:14:07.817 10:00:13 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:08.072 10:00:13 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:08.328 10:00:14 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:14:08.328 10:00:14 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:14:08.585 true 00:14:08.585 10:00:14 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2766898 00:14:08.585 10:00:14 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:09.554 10:00:15 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:09.554 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:09.554 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:09.810 10:00:15 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:14:09.810 10:00:15 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:14:10.066 true 00:14:10.066 10:00:15 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2766898 00:14:10.066 10:00:15 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:10.322 10:00:15 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:10.579 10:00:16 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:14:10.579 10:00:16 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:14:10.836 true 00:14:10.836 10:00:16 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2766898 00:14:10.836 10:00:16 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:11.766 10:00:17 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:12.024 10:00:17 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:14:12.024 10:00:17 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:14:12.024 Initializing NVMe Controllers 00:14:12.024 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:12.024 Controller IO queue size 128, less than required. 00:14:12.024 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:12.024 Controller IO queue size 128, less than required. 00:14:12.024 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:12.024 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:14:12.024 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:14:12.024 Initialization complete. Launching workers. 00:14:12.024 ======================================================== 00:14:12.024 Latency(us) 00:14:12.024 Device Information : IOPS MiB/s Average min max 00:14:12.024 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 709.02 0.35 101158.61 2673.58 1065271.85 00:14:12.024 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 12951.51 6.32 9882.62 2245.69 446082.01 00:14:12.024 ======================================================== 00:14:12.024 Total : 13660.53 6.67 14620.09 2245.69 1065271.85 00:14:12.024 00:14:12.281 true 00:14:12.281 10:00:17 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2766898 00:14:12.281 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (2766898) - No such process 00:14:12.281 10:00:17 -- target/ns_hotplug_stress.sh@53 -- # wait 2766898 00:14:12.281 10:00:17 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:12.544 10:00:18 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:12.802 10:00:18 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:14:12.802 10:00:18 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:14:12.802 10:00:18 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:14:12.802 10:00:18 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:12.802 10:00:18 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:14:13.059 null0 00:14:13.059 10:00:18 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:13.059 10:00:18 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:13.059 10:00:18 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:14:13.315 null1 00:14:13.315 10:00:18 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:13.315 10:00:18 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:13.315 10:00:18 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:14:13.315 null2 00:14:13.315 10:00:19 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:13.315 10:00:19 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:13.315 10:00:19 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:14:13.573 null3 00:14:13.573 10:00:19 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:13.573 10:00:19 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:13.573 10:00:19 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:14:13.830 null4 00:14:13.830 10:00:19 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:13.830 10:00:19 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:13.830 10:00:19 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:14:14.087 null5 00:14:14.087 10:00:19 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:14.087 10:00:19 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:14.087 10:00:19 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:14:14.344 null6 00:14:14.344 10:00:20 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:14.344 10:00:20 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:14.344 10:00:20 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:14:14.602 null7 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@66 -- # wait 2771545 2771546 2771548 2771550 2771552 2771554 2771556 2771558 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:14.602 10:00:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:14.860 10:00:20 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:14.860 10:00:20 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:14.860 10:00:20 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:14.860 10:00:20 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:14.860 10:00:20 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:14.860 10:00:20 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:14.860 10:00:20 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:14.860 10:00:20 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:15.117 10:00:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:15.117 10:00:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:15.117 10:00:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:15.117 10:00:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:15.117 10:00:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:15.117 10:00:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:15.117 10:00:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:15.117 10:00:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:15.117 10:00:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:15.117 10:00:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:15.117 10:00:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:15.117 10:00:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:15.117 10:00:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:15.117 10:00:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:15.117 10:00:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:15.117 10:00:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:15.117 10:00:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:15.117 10:00:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:15.117 10:00:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:15.117 10:00:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:15.117 10:00:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:15.117 10:00:20 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:15.117 10:00:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:15.117 10:00:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:15.375 10:00:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:15.375 10:00:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:15.375 10:00:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:15.375 10:00:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:15.375 10:00:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:15.375 10:00:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:15.375 10:00:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:15.375 10:00:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:15.633 10:00:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:15.633 10:00:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:15.633 10:00:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:15.633 10:00:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:15.633 10:00:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:15.633 10:00:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:15.633 10:00:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:15.633 10:00:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:15.633 10:00:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:15.633 10:00:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:15.633 10:00:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:15.633 10:00:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:15.633 10:00:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:15.633 10:00:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:15.633 10:00:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:15.633 10:00:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:15.633 10:00:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:15.633 10:00:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:15.633 10:00:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:15.633 10:00:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:15.633 10:00:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:15.633 10:00:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:15.633 10:00:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:15.633 10:00:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:15.890 10:00:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:15.890 10:00:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:15.890 10:00:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:15.890 10:00:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:15.890 10:00:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:15.890 10:00:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:15.890 10:00:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:15.890 10:00:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:16.147 10:00:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.147 10:00:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.147 10:00:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:16.147 10:00:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.147 10:00:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.147 10:00:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:16.147 10:00:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.147 10:00:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.147 10:00:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:16.147 10:00:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.147 10:00:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.147 10:00:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:16.147 10:00:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.147 10:00:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.147 10:00:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:16.147 10:00:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.147 10:00:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.147 10:00:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:16.147 10:00:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.147 10:00:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.147 10:00:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:16.147 10:00:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.147 10:00:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.147 10:00:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:16.403 10:00:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:16.403 10:00:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:16.403 10:00:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:16.403 10:00:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:16.403 10:00:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:16.403 10:00:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:16.403 10:00:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:16.403 10:00:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:16.661 10:00:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.661 10:00:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.661 10:00:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:16.661 10:00:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.661 10:00:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.661 10:00:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:16.661 10:00:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.661 10:00:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.661 10:00:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:16.661 10:00:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.661 10:00:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.661 10:00:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:16.661 10:00:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.661 10:00:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.661 10:00:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:16.661 10:00:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.661 10:00:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.661 10:00:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:16.661 10:00:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.661 10:00:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.661 10:00:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:16.661 10:00:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.661 10:00:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.661 10:00:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:16.918 10:00:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:16.918 10:00:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:16.918 10:00:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:16.918 10:00:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:16.918 10:00:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:16.918 10:00:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:16.918 10:00:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:16.918 10:00:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:17.175 10:00:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.175 10:00:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.175 10:00:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:17.175 10:00:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.175 10:00:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.175 10:00:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:17.175 10:00:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.175 10:00:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.175 10:00:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:17.175 10:00:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.175 10:00:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.175 10:00:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:17.175 10:00:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.175 10:00:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.175 10:00:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:17.175 10:00:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.175 10:00:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.175 10:00:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:17.175 10:00:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.175 10:00:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.175 10:00:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:17.175 10:00:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.175 10:00:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.175 10:00:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:17.431 10:00:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:17.431 10:00:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:17.431 10:00:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:17.431 10:00:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:17.431 10:00:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:17.431 10:00:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:17.431 10:00:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:17.431 10:00:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:17.687 10:00:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.687 10:00:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.687 10:00:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:17.687 10:00:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.687 10:00:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.687 10:00:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:17.687 10:00:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.687 10:00:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.687 10:00:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:17.687 10:00:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.687 10:00:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.687 10:00:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:17.687 10:00:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.687 10:00:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.687 10:00:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:17.687 10:00:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.687 10:00:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.687 10:00:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:17.687 10:00:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.687 10:00:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.688 10:00:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:17.688 10:00:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.688 10:00:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.688 10:00:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:17.945 10:00:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:17.945 10:00:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:17.945 10:00:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:17.945 10:00:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:17.945 10:00:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:17.945 10:00:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:17.945 10:00:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:17.945 10:00:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:18.203 10:00:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.203 10:00:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.203 10:00:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:18.203 10:00:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.203 10:00:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.203 10:00:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:18.203 10:00:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.203 10:00:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.203 10:00:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:18.203 10:00:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.203 10:00:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.203 10:00:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:18.203 10:00:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.203 10:00:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.203 10:00:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:18.203 10:00:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.203 10:00:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.203 10:00:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:18.203 10:00:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.203 10:00:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.203 10:00:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.203 10:00:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.203 10:00:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:18.203 10:00:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:18.462 10:00:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:18.462 10:00:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:18.462 10:00:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:18.462 10:00:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:18.462 10:00:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:18.462 10:00:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:18.462 10:00:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:18.462 10:00:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:18.720 10:00:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.720 10:00:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.720 10:00:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:18.720 10:00:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.720 10:00:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.720 10:00:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:18.720 10:00:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.720 10:00:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.720 10:00:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:18.720 10:00:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.720 10:00:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.720 10:00:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:18.720 10:00:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.720 10:00:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.720 10:00:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:18.720 10:00:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.720 10:00:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.720 10:00:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:18.720 10:00:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.720 10:00:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.720 10:00:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:18.720 10:00:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.720 10:00:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.720 10:00:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:18.977 10:00:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:18.977 10:00:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:18.977 10:00:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:18.977 10:00:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:18.977 10:00:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:18.977 10:00:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:18.977 10:00:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:18.977 10:00:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:19.234 10:00:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:19.234 10:00:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:19.234 10:00:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:19.234 10:00:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:19.234 10:00:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:19.234 10:00:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:19.234 10:00:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:19.234 10:00:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:19.234 10:00:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:19.234 10:00:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:19.234 10:00:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:19.234 10:00:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:19.234 10:00:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:19.234 10:00:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:19.234 10:00:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:19.234 10:00:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:19.234 10:00:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:19.234 10:00:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:19.234 10:00:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:19.234 10:00:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:19.234 10:00:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:19.234 10:00:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:19.234 10:00:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:19.234 10:00:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:19.491 10:00:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:19.491 10:00:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:19.491 10:00:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:19.491 10:00:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:19.491 10:00:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:19.491 10:00:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:19.491 10:00:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:19.491 10:00:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:19.749 10:00:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:19.749 10:00:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:19.749 10:00:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:19.749 10:00:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:19.749 10:00:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:19.749 10:00:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:19.749 10:00:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:19.749 10:00:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:19.749 10:00:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:19.749 10:00:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:19.749 10:00:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:19.749 10:00:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:19.749 10:00:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:19.749 10:00:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:19.749 10:00:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:19.749 10:00:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:19.749 10:00:25 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:14:19.749 10:00:25 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:14:19.749 10:00:25 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:19.749 10:00:25 -- nvmf/common.sh@116 -- # sync 00:14:19.749 10:00:25 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:19.749 10:00:25 -- nvmf/common.sh@119 -- # set +e 00:14:19.749 10:00:25 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:19.749 10:00:25 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:20.006 rmmod nvme_tcp 00:14:20.006 rmmod nvme_fabrics 00:14:20.006 rmmod nvme_keyring 00:14:20.006 10:00:25 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:20.006 10:00:25 -- nvmf/common.sh@123 -- # set -e 00:14:20.006 10:00:25 -- nvmf/common.sh@124 -- # return 0 00:14:20.006 10:00:25 -- nvmf/common.sh@477 -- # '[' -n 2766462 ']' 00:14:20.006 10:00:25 -- nvmf/common.sh@478 -- # killprocess 2766462 00:14:20.006 10:00:25 -- common/autotest_common.sh@926 -- # '[' -z 2766462 ']' 00:14:20.006 10:00:25 -- common/autotest_common.sh@930 -- # kill -0 2766462 00:14:20.006 10:00:25 -- common/autotest_common.sh@931 -- # uname 00:14:20.006 10:00:25 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:14:20.006 10:00:25 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2766462 00:14:20.006 10:00:25 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:14:20.006 10:00:25 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:14:20.006 10:00:25 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2766462' 00:14:20.006 killing process with pid 2766462 00:14:20.006 10:00:25 -- common/autotest_common.sh@945 -- # kill 2766462 00:14:20.006 10:00:25 -- common/autotest_common.sh@950 -- # wait 2766462 00:14:20.264 10:00:25 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:20.264 10:00:25 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:20.264 10:00:25 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:20.264 10:00:25 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:20.264 10:00:25 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:20.264 10:00:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:20.264 10:00:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:20.264 10:00:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:22.168 10:00:27 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:22.168 00:14:22.168 real 0m45.750s 00:14:22.168 user 3m19.313s 00:14:22.168 sys 0m18.517s 00:14:22.168 10:00:27 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:14:22.168 10:00:27 -- common/autotest_common.sh@10 -- # set +x 00:14:22.168 ************************************ 00:14:22.168 END TEST nvmf_ns_hotplug_stress 00:14:22.168 ************************************ 00:14:22.168 10:00:27 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:14:22.168 10:00:27 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:14:22.168 10:00:27 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:14:22.168 10:00:27 -- common/autotest_common.sh@10 -- # set +x 00:14:22.168 ************************************ 00:14:22.168 START TEST nvmf_connect_stress 00:14:22.168 ************************************ 00:14:22.168 10:00:27 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:14:22.168 * Looking for test storage... 00:14:22.168 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:22.168 10:00:27 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:22.168 10:00:27 -- nvmf/common.sh@7 -- # uname -s 00:14:22.168 10:00:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:22.168 10:00:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:22.168 10:00:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:22.168 10:00:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:22.168 10:00:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:22.168 10:00:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:22.168 10:00:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:22.168 10:00:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:22.168 10:00:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:22.168 10:00:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:22.168 10:00:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:22.168 10:00:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:22.168 10:00:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:22.168 10:00:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:22.168 10:00:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:22.168 10:00:27 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:22.426 10:00:27 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:22.426 10:00:27 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:22.426 10:00:27 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:22.426 10:00:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:22.426 10:00:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:22.426 10:00:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:22.426 10:00:27 -- paths/export.sh@5 -- # export PATH 00:14:22.426 10:00:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:22.426 10:00:27 -- nvmf/common.sh@46 -- # : 0 00:14:22.426 10:00:27 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:22.426 10:00:27 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:22.426 10:00:27 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:22.426 10:00:27 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:22.426 10:00:27 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:22.426 10:00:27 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:22.426 10:00:27 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:22.426 10:00:27 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:22.426 10:00:27 -- target/connect_stress.sh@12 -- # nvmftestinit 00:14:22.426 10:00:27 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:22.426 10:00:27 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:22.426 10:00:27 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:22.426 10:00:27 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:22.426 10:00:27 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:22.426 10:00:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:22.426 10:00:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:22.426 10:00:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:22.426 10:00:27 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:22.426 10:00:27 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:22.426 10:00:27 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:22.426 10:00:27 -- common/autotest_common.sh@10 -- # set +x 00:14:24.324 10:00:29 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:24.324 10:00:29 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:24.324 10:00:29 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:24.324 10:00:29 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:24.324 10:00:29 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:24.324 10:00:29 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:24.324 10:00:29 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:24.324 10:00:29 -- nvmf/common.sh@294 -- # net_devs=() 00:14:24.324 10:00:29 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:24.324 10:00:29 -- nvmf/common.sh@295 -- # e810=() 00:14:24.324 10:00:29 -- nvmf/common.sh@295 -- # local -ga e810 00:14:24.324 10:00:29 -- nvmf/common.sh@296 -- # x722=() 00:14:24.324 10:00:29 -- nvmf/common.sh@296 -- # local -ga x722 00:14:24.324 10:00:29 -- nvmf/common.sh@297 -- # mlx=() 00:14:24.324 10:00:29 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:24.324 10:00:29 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:24.324 10:00:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:24.324 10:00:29 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:24.324 10:00:29 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:24.324 10:00:29 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:24.324 10:00:29 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:24.324 10:00:29 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:24.324 10:00:29 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:24.324 10:00:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:24.324 10:00:29 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:24.324 10:00:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:24.324 10:00:29 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:24.324 10:00:29 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:24.324 10:00:29 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:24.324 10:00:29 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:24.324 10:00:29 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:24.324 10:00:29 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:24.324 10:00:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:24.324 10:00:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:24.324 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:24.324 10:00:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:24.324 10:00:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:24.324 10:00:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:24.324 10:00:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:24.324 10:00:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:24.324 10:00:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:24.324 10:00:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:24.324 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:24.324 10:00:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:24.324 10:00:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:24.324 10:00:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:24.324 10:00:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:24.324 10:00:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:24.324 10:00:29 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:24.324 10:00:29 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:24.324 10:00:29 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:24.324 10:00:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:24.324 10:00:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:24.324 10:00:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:24.324 10:00:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:24.324 10:00:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:24.324 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:24.324 10:00:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:24.324 10:00:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:24.324 10:00:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:24.325 10:00:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:24.325 10:00:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:24.325 10:00:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:24.325 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:24.325 10:00:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:24.325 10:00:29 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:24.325 10:00:29 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:24.325 10:00:29 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:24.325 10:00:29 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:24.325 10:00:29 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:24.325 10:00:29 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:24.325 10:00:29 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:24.325 10:00:29 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:24.325 10:00:29 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:24.325 10:00:29 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:24.325 10:00:29 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:24.325 10:00:29 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:24.325 10:00:29 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:24.325 10:00:29 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:24.325 10:00:29 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:24.325 10:00:29 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:24.325 10:00:29 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:24.325 10:00:29 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:24.325 10:00:29 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:24.325 10:00:29 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:24.325 10:00:29 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:24.325 10:00:29 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:24.325 10:00:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:24.325 10:00:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:24.325 10:00:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:24.325 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:24.325 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.174 ms 00:14:24.325 00:14:24.325 --- 10.0.0.2 ping statistics --- 00:14:24.325 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:24.325 rtt min/avg/max/mdev = 0.174/0.174/0.174/0.000 ms 00:14:24.325 10:00:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:24.325 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:24.325 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.117 ms 00:14:24.325 00:14:24.325 --- 10.0.0.1 ping statistics --- 00:14:24.325 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:24.325 rtt min/avg/max/mdev = 0.117/0.117/0.117/0.000 ms 00:14:24.325 10:00:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:24.325 10:00:30 -- nvmf/common.sh@410 -- # return 0 00:14:24.325 10:00:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:24.325 10:00:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:24.325 10:00:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:24.325 10:00:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:24.325 10:00:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:24.325 10:00:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:24.325 10:00:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:24.325 10:00:30 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:14:24.325 10:00:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:24.325 10:00:30 -- common/autotest_common.sh@712 -- # xtrace_disable 00:14:24.325 10:00:30 -- common/autotest_common.sh@10 -- # set +x 00:14:24.325 10:00:30 -- nvmf/common.sh@469 -- # nvmfpid=2774328 00:14:24.325 10:00:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:14:24.325 10:00:30 -- nvmf/common.sh@470 -- # waitforlisten 2774328 00:14:24.325 10:00:30 -- common/autotest_common.sh@819 -- # '[' -z 2774328 ']' 00:14:24.325 10:00:30 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:24.325 10:00:30 -- common/autotest_common.sh@824 -- # local max_retries=100 00:14:24.325 10:00:30 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:24.325 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:24.325 10:00:30 -- common/autotest_common.sh@828 -- # xtrace_disable 00:14:24.325 10:00:30 -- common/autotest_common.sh@10 -- # set +x 00:14:24.325 [2024-07-13 10:00:30.125318] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:14:24.325 [2024-07-13 10:00:30.125390] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:24.583 EAL: No free 2048 kB hugepages reported on node 1 00:14:24.583 [2024-07-13 10:00:30.192404] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:24.583 [2024-07-13 10:00:30.284647] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:24.583 [2024-07-13 10:00:30.284810] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:24.583 [2024-07-13 10:00:30.284828] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:24.583 [2024-07-13 10:00:30.284841] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:24.583 [2024-07-13 10:00:30.284931] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:24.583 [2024-07-13 10:00:30.284984] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:24.583 [2024-07-13 10:00:30.284988] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:25.517 10:00:31 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:14:25.517 10:00:31 -- common/autotest_common.sh@852 -- # return 0 00:14:25.517 10:00:31 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:25.517 10:00:31 -- common/autotest_common.sh@718 -- # xtrace_disable 00:14:25.517 10:00:31 -- common/autotest_common.sh@10 -- # set +x 00:14:25.517 10:00:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:25.517 10:00:31 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:25.517 10:00:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:25.517 10:00:31 -- common/autotest_common.sh@10 -- # set +x 00:14:25.517 [2024-07-13 10:00:31.111144] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:25.517 10:00:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:25.517 10:00:31 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:25.517 10:00:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:25.517 10:00:31 -- common/autotest_common.sh@10 -- # set +x 00:14:25.517 10:00:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:25.517 10:00:31 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:25.517 10:00:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:25.517 10:00:31 -- common/autotest_common.sh@10 -- # set +x 00:14:25.517 [2024-07-13 10:00:31.142992] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:25.517 10:00:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:25.517 10:00:31 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:14:25.517 10:00:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:25.517 10:00:31 -- common/autotest_common.sh@10 -- # set +x 00:14:25.517 NULL1 00:14:25.517 10:00:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:25.517 10:00:31 -- target/connect_stress.sh@21 -- # PERF_PID=2774487 00:14:25.517 10:00:31 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:14:25.517 10:00:31 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:25.517 10:00:31 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:25.517 10:00:31 -- target/connect_stress.sh@27 -- # seq 1 20 00:14:25.517 10:00:31 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:25.517 10:00:31 -- target/connect_stress.sh@28 -- # cat 00:14:25.517 10:00:31 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:25.517 10:00:31 -- target/connect_stress.sh@28 -- # cat 00:14:25.517 10:00:31 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:25.517 10:00:31 -- target/connect_stress.sh@28 -- # cat 00:14:25.517 10:00:31 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:25.517 10:00:31 -- target/connect_stress.sh@28 -- # cat 00:14:25.517 10:00:31 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:25.517 10:00:31 -- target/connect_stress.sh@28 -- # cat 00:14:25.517 10:00:31 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:25.517 10:00:31 -- target/connect_stress.sh@28 -- # cat 00:14:25.517 10:00:31 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:25.517 10:00:31 -- target/connect_stress.sh@28 -- # cat 00:14:25.517 10:00:31 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:25.517 10:00:31 -- target/connect_stress.sh@28 -- # cat 00:14:25.517 10:00:31 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:25.517 10:00:31 -- target/connect_stress.sh@28 -- # cat 00:14:25.517 10:00:31 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:25.517 10:00:31 -- target/connect_stress.sh@28 -- # cat 00:14:25.517 10:00:31 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:25.517 10:00:31 -- target/connect_stress.sh@28 -- # cat 00:14:25.517 EAL: No free 2048 kB hugepages reported on node 1 00:14:25.517 10:00:31 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:25.517 10:00:31 -- target/connect_stress.sh@28 -- # cat 00:14:25.517 10:00:31 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:25.517 10:00:31 -- target/connect_stress.sh@28 -- # cat 00:14:25.517 10:00:31 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:25.517 10:00:31 -- target/connect_stress.sh@28 -- # cat 00:14:25.517 10:00:31 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:25.517 10:00:31 -- target/connect_stress.sh@28 -- # cat 00:14:25.517 10:00:31 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:25.517 10:00:31 -- target/connect_stress.sh@28 -- # cat 00:14:25.517 10:00:31 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:25.517 10:00:31 -- target/connect_stress.sh@28 -- # cat 00:14:25.517 10:00:31 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:25.517 10:00:31 -- target/connect_stress.sh@28 -- # cat 00:14:25.517 10:00:31 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:25.517 10:00:31 -- target/connect_stress.sh@28 -- # cat 00:14:25.517 10:00:31 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:25.517 10:00:31 -- target/connect_stress.sh@28 -- # cat 00:14:25.517 10:00:31 -- target/connect_stress.sh@34 -- # kill -0 2774487 00:14:25.517 10:00:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:25.517 10:00:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:25.517 10:00:31 -- common/autotest_common.sh@10 -- # set +x 00:14:25.774 10:00:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:25.774 10:00:31 -- target/connect_stress.sh@34 -- # kill -0 2774487 00:14:25.774 10:00:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:25.774 10:00:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:25.774 10:00:31 -- common/autotest_common.sh@10 -- # set +x 00:14:26.032 10:00:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:26.032 10:00:31 -- target/connect_stress.sh@34 -- # kill -0 2774487 00:14:26.032 10:00:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:26.032 10:00:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:26.032 10:00:31 -- common/autotest_common.sh@10 -- # set +x 00:14:26.596 10:00:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:26.596 10:00:32 -- target/connect_stress.sh@34 -- # kill -0 2774487 00:14:26.596 10:00:32 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:26.596 10:00:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:26.596 10:00:32 -- common/autotest_common.sh@10 -- # set +x 00:14:26.853 10:00:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:26.853 10:00:32 -- target/connect_stress.sh@34 -- # kill -0 2774487 00:14:26.853 10:00:32 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:26.853 10:00:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:26.853 10:00:32 -- common/autotest_common.sh@10 -- # set +x 00:14:27.111 10:00:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:27.111 10:00:32 -- target/connect_stress.sh@34 -- # kill -0 2774487 00:14:27.111 10:00:32 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:27.111 10:00:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:27.111 10:00:32 -- common/autotest_common.sh@10 -- # set +x 00:14:27.369 10:00:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:27.369 10:00:33 -- target/connect_stress.sh@34 -- # kill -0 2774487 00:14:27.369 10:00:33 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:27.369 10:00:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:27.369 10:00:33 -- common/autotest_common.sh@10 -- # set +x 00:14:27.932 10:00:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:27.932 10:00:33 -- target/connect_stress.sh@34 -- # kill -0 2774487 00:14:27.932 10:00:33 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:27.932 10:00:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:27.932 10:00:33 -- common/autotest_common.sh@10 -- # set +x 00:14:28.188 10:00:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:28.188 10:00:33 -- target/connect_stress.sh@34 -- # kill -0 2774487 00:14:28.188 10:00:33 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:28.188 10:00:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:28.188 10:00:33 -- common/autotest_common.sh@10 -- # set +x 00:14:28.445 10:00:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:28.445 10:00:34 -- target/connect_stress.sh@34 -- # kill -0 2774487 00:14:28.445 10:00:34 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:28.445 10:00:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:28.445 10:00:34 -- common/autotest_common.sh@10 -- # set +x 00:14:28.702 10:00:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:28.702 10:00:34 -- target/connect_stress.sh@34 -- # kill -0 2774487 00:14:28.702 10:00:34 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:28.702 10:00:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:28.702 10:00:34 -- common/autotest_common.sh@10 -- # set +x 00:14:28.959 10:00:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:28.959 10:00:34 -- target/connect_stress.sh@34 -- # kill -0 2774487 00:14:28.959 10:00:34 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:28.959 10:00:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:28.959 10:00:34 -- common/autotest_common.sh@10 -- # set +x 00:14:29.522 10:00:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:29.522 10:00:35 -- target/connect_stress.sh@34 -- # kill -0 2774487 00:14:29.522 10:00:35 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:29.522 10:00:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:29.522 10:00:35 -- common/autotest_common.sh@10 -- # set +x 00:14:29.778 10:00:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:29.778 10:00:35 -- target/connect_stress.sh@34 -- # kill -0 2774487 00:14:29.778 10:00:35 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:29.778 10:00:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:29.778 10:00:35 -- common/autotest_common.sh@10 -- # set +x 00:14:30.035 10:00:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:30.035 10:00:35 -- target/connect_stress.sh@34 -- # kill -0 2774487 00:14:30.035 10:00:35 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:30.035 10:00:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:30.035 10:00:35 -- common/autotest_common.sh@10 -- # set +x 00:14:30.291 10:00:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:30.291 10:00:36 -- target/connect_stress.sh@34 -- # kill -0 2774487 00:14:30.291 10:00:36 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:30.291 10:00:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:30.291 10:00:36 -- common/autotest_common.sh@10 -- # set +x 00:14:30.548 10:00:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:30.548 10:00:36 -- target/connect_stress.sh@34 -- # kill -0 2774487 00:14:30.548 10:00:36 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:30.548 10:00:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:30.548 10:00:36 -- common/autotest_common.sh@10 -- # set +x 00:14:31.110 10:00:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:31.110 10:00:36 -- target/connect_stress.sh@34 -- # kill -0 2774487 00:14:31.110 10:00:36 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:31.110 10:00:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:31.110 10:00:36 -- common/autotest_common.sh@10 -- # set +x 00:14:31.366 10:00:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:31.366 10:00:36 -- target/connect_stress.sh@34 -- # kill -0 2774487 00:14:31.366 10:00:36 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:31.366 10:00:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:31.366 10:00:36 -- common/autotest_common.sh@10 -- # set +x 00:14:31.622 10:00:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:31.622 10:00:37 -- target/connect_stress.sh@34 -- # kill -0 2774487 00:14:31.622 10:00:37 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:31.622 10:00:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:31.622 10:00:37 -- common/autotest_common.sh@10 -- # set +x 00:14:31.880 10:00:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:31.880 10:00:37 -- target/connect_stress.sh@34 -- # kill -0 2774487 00:14:31.880 10:00:37 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:31.880 10:00:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:31.880 10:00:37 -- common/autotest_common.sh@10 -- # set +x 00:14:32.137 10:00:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:32.137 10:00:37 -- target/connect_stress.sh@34 -- # kill -0 2774487 00:14:32.137 10:00:37 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:32.137 10:00:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:32.137 10:00:37 -- common/autotest_common.sh@10 -- # set +x 00:14:32.711 10:00:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:32.711 10:00:38 -- target/connect_stress.sh@34 -- # kill -0 2774487 00:14:32.711 10:00:38 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:32.711 10:00:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:32.711 10:00:38 -- common/autotest_common.sh@10 -- # set +x 00:14:32.973 10:00:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:32.973 10:00:38 -- target/connect_stress.sh@34 -- # kill -0 2774487 00:14:32.973 10:00:38 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:32.973 10:00:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:32.973 10:00:38 -- common/autotest_common.sh@10 -- # set +x 00:14:33.229 10:00:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:33.229 10:00:38 -- target/connect_stress.sh@34 -- # kill -0 2774487 00:14:33.229 10:00:38 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:33.229 10:00:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:33.229 10:00:38 -- common/autotest_common.sh@10 -- # set +x 00:14:33.486 10:00:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:33.486 10:00:39 -- target/connect_stress.sh@34 -- # kill -0 2774487 00:14:33.486 10:00:39 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:33.486 10:00:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:33.486 10:00:39 -- common/autotest_common.sh@10 -- # set +x 00:14:33.744 10:00:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:33.744 10:00:39 -- target/connect_stress.sh@34 -- # kill -0 2774487 00:14:33.744 10:00:39 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:33.744 10:00:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:33.744 10:00:39 -- common/autotest_common.sh@10 -- # set +x 00:14:34.308 10:00:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:34.308 10:00:39 -- target/connect_stress.sh@34 -- # kill -0 2774487 00:14:34.308 10:00:39 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:34.308 10:00:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:34.308 10:00:39 -- common/autotest_common.sh@10 -- # set +x 00:14:34.565 10:00:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:34.565 10:00:40 -- target/connect_stress.sh@34 -- # kill -0 2774487 00:14:34.565 10:00:40 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:34.565 10:00:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:34.565 10:00:40 -- common/autotest_common.sh@10 -- # set +x 00:14:34.823 10:00:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:34.823 10:00:40 -- target/connect_stress.sh@34 -- # kill -0 2774487 00:14:34.823 10:00:40 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:34.823 10:00:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:34.823 10:00:40 -- common/autotest_common.sh@10 -- # set +x 00:14:35.080 10:00:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:35.080 10:00:40 -- target/connect_stress.sh@34 -- # kill -0 2774487 00:14:35.080 10:00:40 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:35.080 10:00:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:35.080 10:00:40 -- common/autotest_common.sh@10 -- # set +x 00:14:35.643 10:00:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:35.643 10:00:41 -- target/connect_stress.sh@34 -- # kill -0 2774487 00:14:35.643 10:00:41 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:35.643 10:00:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:35.643 10:00:41 -- common/autotest_common.sh@10 -- # set +x 00:14:35.643 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:35.901 10:00:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:35.901 10:00:41 -- target/connect_stress.sh@34 -- # kill -0 2774487 00:14:35.901 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (2774487) - No such process 00:14:35.901 10:00:41 -- target/connect_stress.sh@38 -- # wait 2774487 00:14:35.901 10:00:41 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:35.901 10:00:41 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:14:35.901 10:00:41 -- target/connect_stress.sh@43 -- # nvmftestfini 00:14:35.901 10:00:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:35.901 10:00:41 -- nvmf/common.sh@116 -- # sync 00:14:35.901 10:00:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:35.901 10:00:41 -- nvmf/common.sh@119 -- # set +e 00:14:35.901 10:00:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:35.901 10:00:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:35.901 rmmod nvme_tcp 00:14:35.901 rmmod nvme_fabrics 00:14:35.901 rmmod nvme_keyring 00:14:35.901 10:00:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:35.901 10:00:41 -- nvmf/common.sh@123 -- # set -e 00:14:35.901 10:00:41 -- nvmf/common.sh@124 -- # return 0 00:14:35.901 10:00:41 -- nvmf/common.sh@477 -- # '[' -n 2774328 ']' 00:14:35.901 10:00:41 -- nvmf/common.sh@478 -- # killprocess 2774328 00:14:35.901 10:00:41 -- common/autotest_common.sh@926 -- # '[' -z 2774328 ']' 00:14:35.901 10:00:41 -- common/autotest_common.sh@930 -- # kill -0 2774328 00:14:35.901 10:00:41 -- common/autotest_common.sh@931 -- # uname 00:14:35.901 10:00:41 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:14:35.901 10:00:41 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2774328 00:14:35.901 10:00:41 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:14:35.901 10:00:41 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:14:35.901 10:00:41 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2774328' 00:14:35.901 killing process with pid 2774328 00:14:35.901 10:00:41 -- common/autotest_common.sh@945 -- # kill 2774328 00:14:35.901 10:00:41 -- common/autotest_common.sh@950 -- # wait 2774328 00:14:36.159 10:00:41 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:36.159 10:00:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:36.159 10:00:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:36.159 10:00:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:36.159 10:00:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:36.159 10:00:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:36.159 10:00:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:36.159 10:00:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:38.061 10:00:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:38.061 00:14:38.061 real 0m15.911s 00:14:38.061 user 0m40.465s 00:14:38.061 sys 0m5.921s 00:14:38.061 10:00:43 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:14:38.061 10:00:43 -- common/autotest_common.sh@10 -- # set +x 00:14:38.061 ************************************ 00:14:38.061 END TEST nvmf_connect_stress 00:14:38.061 ************************************ 00:14:38.061 10:00:43 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:14:38.061 10:00:43 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:14:38.061 10:00:43 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:14:38.061 10:00:43 -- common/autotest_common.sh@10 -- # set +x 00:14:38.061 ************************************ 00:14:38.061 START TEST nvmf_fused_ordering 00:14:38.061 ************************************ 00:14:38.061 10:00:43 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:14:38.319 * Looking for test storage... 00:14:38.319 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:38.319 10:00:43 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:38.319 10:00:43 -- nvmf/common.sh@7 -- # uname -s 00:14:38.319 10:00:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:38.319 10:00:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:38.319 10:00:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:38.319 10:00:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:38.319 10:00:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:38.319 10:00:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:38.319 10:00:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:38.319 10:00:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:38.319 10:00:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:38.319 10:00:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:38.319 10:00:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:38.319 10:00:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:38.319 10:00:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:38.319 10:00:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:38.319 10:00:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:38.319 10:00:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:38.319 10:00:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:38.319 10:00:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:38.319 10:00:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:38.319 10:00:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:38.319 10:00:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:38.319 10:00:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:38.319 10:00:43 -- paths/export.sh@5 -- # export PATH 00:14:38.320 10:00:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:38.320 10:00:43 -- nvmf/common.sh@46 -- # : 0 00:14:38.320 10:00:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:38.320 10:00:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:38.320 10:00:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:38.320 10:00:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:38.320 10:00:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:38.320 10:00:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:38.320 10:00:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:38.320 10:00:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:38.320 10:00:43 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:14:38.320 10:00:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:38.320 10:00:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:38.320 10:00:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:38.320 10:00:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:38.320 10:00:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:38.320 10:00:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:38.320 10:00:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:38.320 10:00:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:38.320 10:00:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:38.320 10:00:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:38.320 10:00:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:38.320 10:00:43 -- common/autotest_common.sh@10 -- # set +x 00:14:40.220 10:00:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:40.220 10:00:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:40.220 10:00:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:40.220 10:00:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:40.220 10:00:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:40.220 10:00:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:40.220 10:00:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:40.220 10:00:45 -- nvmf/common.sh@294 -- # net_devs=() 00:14:40.220 10:00:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:40.220 10:00:45 -- nvmf/common.sh@295 -- # e810=() 00:14:40.220 10:00:45 -- nvmf/common.sh@295 -- # local -ga e810 00:14:40.220 10:00:45 -- nvmf/common.sh@296 -- # x722=() 00:14:40.220 10:00:45 -- nvmf/common.sh@296 -- # local -ga x722 00:14:40.220 10:00:45 -- nvmf/common.sh@297 -- # mlx=() 00:14:40.220 10:00:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:40.220 10:00:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:40.220 10:00:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:40.220 10:00:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:40.220 10:00:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:40.220 10:00:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:40.220 10:00:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:40.220 10:00:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:40.220 10:00:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:40.220 10:00:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:40.220 10:00:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:40.220 10:00:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:40.220 10:00:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:40.220 10:00:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:40.220 10:00:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:40.220 10:00:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:40.220 10:00:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:40.220 10:00:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:40.220 10:00:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:40.220 10:00:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:40.220 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:40.220 10:00:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:40.220 10:00:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:40.220 10:00:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:40.220 10:00:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:40.220 10:00:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:40.220 10:00:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:40.220 10:00:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:40.220 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:40.220 10:00:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:40.220 10:00:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:40.220 10:00:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:40.220 10:00:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:40.220 10:00:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:40.220 10:00:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:40.220 10:00:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:40.220 10:00:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:40.220 10:00:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:40.220 10:00:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:40.220 10:00:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:40.220 10:00:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:40.220 10:00:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:40.220 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:40.220 10:00:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:40.220 10:00:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:40.220 10:00:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:40.220 10:00:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:40.220 10:00:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:40.220 10:00:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:40.220 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:40.220 10:00:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:40.220 10:00:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:40.220 10:00:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:40.220 10:00:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:40.220 10:00:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:40.220 10:00:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:40.220 10:00:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:40.220 10:00:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:40.220 10:00:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:40.220 10:00:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:40.220 10:00:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:40.220 10:00:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:40.221 10:00:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:40.221 10:00:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:40.221 10:00:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:40.221 10:00:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:40.221 10:00:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:40.221 10:00:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:40.221 10:00:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:40.221 10:00:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:40.221 10:00:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:40.221 10:00:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:40.221 10:00:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:40.478 10:00:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:40.478 10:00:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:40.478 10:00:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:40.478 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:40.478 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.108 ms 00:14:40.478 00:14:40.478 --- 10.0.0.2 ping statistics --- 00:14:40.478 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:40.478 rtt min/avg/max/mdev = 0.108/0.108/0.108/0.000 ms 00:14:40.478 10:00:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:40.478 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:40.478 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.181 ms 00:14:40.478 00:14:40.478 --- 10.0.0.1 ping statistics --- 00:14:40.478 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:40.479 rtt min/avg/max/mdev = 0.181/0.181/0.181/0.000 ms 00:14:40.479 10:00:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:40.479 10:00:46 -- nvmf/common.sh@410 -- # return 0 00:14:40.479 10:00:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:40.479 10:00:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:40.479 10:00:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:40.479 10:00:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:40.479 10:00:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:40.479 10:00:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:40.479 10:00:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:40.479 10:00:46 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:14:40.479 10:00:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:40.479 10:00:46 -- common/autotest_common.sh@712 -- # xtrace_disable 00:14:40.479 10:00:46 -- common/autotest_common.sh@10 -- # set +x 00:14:40.479 10:00:46 -- nvmf/common.sh@469 -- # nvmfpid=2777680 00:14:40.479 10:00:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:14:40.479 10:00:46 -- nvmf/common.sh@470 -- # waitforlisten 2777680 00:14:40.479 10:00:46 -- common/autotest_common.sh@819 -- # '[' -z 2777680 ']' 00:14:40.479 10:00:46 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:40.479 10:00:46 -- common/autotest_common.sh@824 -- # local max_retries=100 00:14:40.479 10:00:46 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:40.479 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:40.479 10:00:46 -- common/autotest_common.sh@828 -- # xtrace_disable 00:14:40.479 10:00:46 -- common/autotest_common.sh@10 -- # set +x 00:14:40.479 [2024-07-13 10:00:46.163938] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:14:40.479 [2024-07-13 10:00:46.164011] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:40.479 EAL: No free 2048 kB hugepages reported on node 1 00:14:40.479 [2024-07-13 10:00:46.228566] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:40.736 [2024-07-13 10:00:46.314472] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:40.736 [2024-07-13 10:00:46.314621] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:40.736 [2024-07-13 10:00:46.314646] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:40.736 [2024-07-13 10:00:46.314659] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:40.736 [2024-07-13 10:00:46.314686] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:41.300 10:00:47 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:14:41.300 10:00:47 -- common/autotest_common.sh@852 -- # return 0 00:14:41.300 10:00:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:41.300 10:00:47 -- common/autotest_common.sh@718 -- # xtrace_disable 00:14:41.300 10:00:47 -- common/autotest_common.sh@10 -- # set +x 00:14:41.300 10:00:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:41.300 10:00:47 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:41.300 10:00:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:41.300 10:00:47 -- common/autotest_common.sh@10 -- # set +x 00:14:41.300 [2024-07-13 10:00:47.106242] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:41.300 10:00:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:41.300 10:00:47 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:41.300 10:00:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:41.300 10:00:47 -- common/autotest_common.sh@10 -- # set +x 00:14:41.556 10:00:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:41.556 10:00:47 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:41.556 10:00:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:41.556 10:00:47 -- common/autotest_common.sh@10 -- # set +x 00:14:41.556 [2024-07-13 10:00:47.122407] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:41.556 10:00:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:41.556 10:00:47 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:14:41.556 10:00:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:41.556 10:00:47 -- common/autotest_common.sh@10 -- # set +x 00:14:41.556 NULL1 00:14:41.556 10:00:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:41.556 10:00:47 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:14:41.556 10:00:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:41.556 10:00:47 -- common/autotest_common.sh@10 -- # set +x 00:14:41.556 10:00:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:41.556 10:00:47 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:14:41.556 10:00:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:41.556 10:00:47 -- common/autotest_common.sh@10 -- # set +x 00:14:41.556 10:00:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:41.556 10:00:47 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:14:41.556 [2024-07-13 10:00:47.165917] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:14:41.556 [2024-07-13 10:00:47.165960] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2777834 ] 00:14:41.556 EAL: No free 2048 kB hugepages reported on node 1 00:14:42.142 Attached to nqn.2016-06.io.spdk:cnode1 00:14:42.142 Namespace ID: 1 size: 1GB 00:14:42.142 fused_ordering(0) 00:14:42.142 fused_ordering(1) 00:14:42.142 fused_ordering(2) 00:14:42.142 fused_ordering(3) 00:14:42.142 fused_ordering(4) 00:14:42.142 fused_ordering(5) 00:14:42.142 fused_ordering(6) 00:14:42.142 fused_ordering(7) 00:14:42.142 fused_ordering(8) 00:14:42.142 fused_ordering(9) 00:14:42.142 fused_ordering(10) 00:14:42.142 fused_ordering(11) 00:14:42.142 fused_ordering(12) 00:14:42.142 fused_ordering(13) 00:14:42.142 fused_ordering(14) 00:14:42.142 fused_ordering(15) 00:14:42.142 fused_ordering(16) 00:14:42.142 fused_ordering(17) 00:14:42.142 fused_ordering(18) 00:14:42.142 fused_ordering(19) 00:14:42.142 fused_ordering(20) 00:14:42.142 fused_ordering(21) 00:14:42.142 fused_ordering(22) 00:14:42.142 fused_ordering(23) 00:14:42.142 fused_ordering(24) 00:14:42.142 fused_ordering(25) 00:14:42.142 fused_ordering(26) 00:14:42.142 fused_ordering(27) 00:14:42.142 fused_ordering(28) 00:14:42.142 fused_ordering(29) 00:14:42.142 fused_ordering(30) 00:14:42.142 fused_ordering(31) 00:14:42.142 fused_ordering(32) 00:14:42.142 fused_ordering(33) 00:14:42.142 fused_ordering(34) 00:14:42.142 fused_ordering(35) 00:14:42.142 fused_ordering(36) 00:14:42.142 fused_ordering(37) 00:14:42.142 fused_ordering(38) 00:14:42.142 fused_ordering(39) 00:14:42.142 fused_ordering(40) 00:14:42.142 fused_ordering(41) 00:14:42.142 fused_ordering(42) 00:14:42.142 fused_ordering(43) 00:14:42.142 fused_ordering(44) 00:14:42.142 fused_ordering(45) 00:14:42.142 fused_ordering(46) 00:14:42.142 fused_ordering(47) 00:14:42.142 fused_ordering(48) 00:14:42.142 fused_ordering(49) 00:14:42.142 fused_ordering(50) 00:14:42.142 fused_ordering(51) 00:14:42.142 fused_ordering(52) 00:14:42.142 fused_ordering(53) 00:14:42.142 fused_ordering(54) 00:14:42.142 fused_ordering(55) 00:14:42.142 fused_ordering(56) 00:14:42.142 fused_ordering(57) 00:14:42.142 fused_ordering(58) 00:14:42.142 fused_ordering(59) 00:14:42.142 fused_ordering(60) 00:14:42.142 fused_ordering(61) 00:14:42.142 fused_ordering(62) 00:14:42.142 fused_ordering(63) 00:14:42.142 fused_ordering(64) 00:14:42.143 fused_ordering(65) 00:14:42.143 fused_ordering(66) 00:14:42.143 fused_ordering(67) 00:14:42.143 fused_ordering(68) 00:14:42.143 fused_ordering(69) 00:14:42.143 fused_ordering(70) 00:14:42.143 fused_ordering(71) 00:14:42.143 fused_ordering(72) 00:14:42.143 fused_ordering(73) 00:14:42.143 fused_ordering(74) 00:14:42.143 fused_ordering(75) 00:14:42.143 fused_ordering(76) 00:14:42.143 fused_ordering(77) 00:14:42.143 fused_ordering(78) 00:14:42.143 fused_ordering(79) 00:14:42.143 fused_ordering(80) 00:14:42.143 fused_ordering(81) 00:14:42.143 fused_ordering(82) 00:14:42.143 fused_ordering(83) 00:14:42.143 fused_ordering(84) 00:14:42.143 fused_ordering(85) 00:14:42.143 fused_ordering(86) 00:14:42.143 fused_ordering(87) 00:14:42.143 fused_ordering(88) 00:14:42.143 fused_ordering(89) 00:14:42.143 fused_ordering(90) 00:14:42.143 fused_ordering(91) 00:14:42.143 fused_ordering(92) 00:14:42.143 fused_ordering(93) 00:14:42.143 fused_ordering(94) 00:14:42.143 fused_ordering(95) 00:14:42.143 fused_ordering(96) 00:14:42.143 fused_ordering(97) 00:14:42.143 fused_ordering(98) 00:14:42.143 fused_ordering(99) 00:14:42.143 fused_ordering(100) 00:14:42.143 fused_ordering(101) 00:14:42.143 fused_ordering(102) 00:14:42.143 fused_ordering(103) 00:14:42.143 fused_ordering(104) 00:14:42.143 fused_ordering(105) 00:14:42.143 fused_ordering(106) 00:14:42.143 fused_ordering(107) 00:14:42.143 fused_ordering(108) 00:14:42.143 fused_ordering(109) 00:14:42.143 fused_ordering(110) 00:14:42.143 fused_ordering(111) 00:14:42.143 fused_ordering(112) 00:14:42.143 fused_ordering(113) 00:14:42.143 fused_ordering(114) 00:14:42.143 fused_ordering(115) 00:14:42.143 fused_ordering(116) 00:14:42.143 fused_ordering(117) 00:14:42.143 fused_ordering(118) 00:14:42.143 fused_ordering(119) 00:14:42.143 fused_ordering(120) 00:14:42.143 fused_ordering(121) 00:14:42.143 fused_ordering(122) 00:14:42.143 fused_ordering(123) 00:14:42.143 fused_ordering(124) 00:14:42.143 fused_ordering(125) 00:14:42.143 fused_ordering(126) 00:14:42.143 fused_ordering(127) 00:14:42.143 fused_ordering(128) 00:14:42.143 fused_ordering(129) 00:14:42.143 fused_ordering(130) 00:14:42.143 fused_ordering(131) 00:14:42.143 fused_ordering(132) 00:14:42.143 fused_ordering(133) 00:14:42.143 fused_ordering(134) 00:14:42.143 fused_ordering(135) 00:14:42.143 fused_ordering(136) 00:14:42.143 fused_ordering(137) 00:14:42.143 fused_ordering(138) 00:14:42.143 fused_ordering(139) 00:14:42.143 fused_ordering(140) 00:14:42.143 fused_ordering(141) 00:14:42.143 fused_ordering(142) 00:14:42.143 fused_ordering(143) 00:14:42.143 fused_ordering(144) 00:14:42.143 fused_ordering(145) 00:14:42.143 fused_ordering(146) 00:14:42.143 fused_ordering(147) 00:14:42.143 fused_ordering(148) 00:14:42.143 fused_ordering(149) 00:14:42.143 fused_ordering(150) 00:14:42.143 fused_ordering(151) 00:14:42.143 fused_ordering(152) 00:14:42.143 fused_ordering(153) 00:14:42.143 fused_ordering(154) 00:14:42.143 fused_ordering(155) 00:14:42.143 fused_ordering(156) 00:14:42.143 fused_ordering(157) 00:14:42.143 fused_ordering(158) 00:14:42.143 fused_ordering(159) 00:14:42.143 fused_ordering(160) 00:14:42.143 fused_ordering(161) 00:14:42.143 fused_ordering(162) 00:14:42.143 fused_ordering(163) 00:14:42.143 fused_ordering(164) 00:14:42.143 fused_ordering(165) 00:14:42.143 fused_ordering(166) 00:14:42.143 fused_ordering(167) 00:14:42.143 fused_ordering(168) 00:14:42.143 fused_ordering(169) 00:14:42.143 fused_ordering(170) 00:14:42.143 fused_ordering(171) 00:14:42.143 fused_ordering(172) 00:14:42.143 fused_ordering(173) 00:14:42.143 fused_ordering(174) 00:14:42.143 fused_ordering(175) 00:14:42.143 fused_ordering(176) 00:14:42.143 fused_ordering(177) 00:14:42.143 fused_ordering(178) 00:14:42.143 fused_ordering(179) 00:14:42.143 fused_ordering(180) 00:14:42.143 fused_ordering(181) 00:14:42.143 fused_ordering(182) 00:14:42.143 fused_ordering(183) 00:14:42.143 fused_ordering(184) 00:14:42.143 fused_ordering(185) 00:14:42.143 fused_ordering(186) 00:14:42.143 fused_ordering(187) 00:14:42.143 fused_ordering(188) 00:14:42.143 fused_ordering(189) 00:14:42.143 fused_ordering(190) 00:14:42.143 fused_ordering(191) 00:14:42.143 fused_ordering(192) 00:14:42.143 fused_ordering(193) 00:14:42.143 fused_ordering(194) 00:14:42.143 fused_ordering(195) 00:14:42.143 fused_ordering(196) 00:14:42.143 fused_ordering(197) 00:14:42.143 fused_ordering(198) 00:14:42.143 fused_ordering(199) 00:14:42.143 fused_ordering(200) 00:14:42.143 fused_ordering(201) 00:14:42.143 fused_ordering(202) 00:14:42.143 fused_ordering(203) 00:14:42.143 fused_ordering(204) 00:14:42.143 fused_ordering(205) 00:14:42.399 fused_ordering(206) 00:14:42.399 fused_ordering(207) 00:14:42.399 fused_ordering(208) 00:14:42.399 fused_ordering(209) 00:14:42.399 fused_ordering(210) 00:14:42.399 fused_ordering(211) 00:14:42.399 fused_ordering(212) 00:14:42.399 fused_ordering(213) 00:14:42.399 fused_ordering(214) 00:14:42.399 fused_ordering(215) 00:14:42.399 fused_ordering(216) 00:14:42.399 fused_ordering(217) 00:14:42.399 fused_ordering(218) 00:14:42.399 fused_ordering(219) 00:14:42.399 fused_ordering(220) 00:14:42.399 fused_ordering(221) 00:14:42.399 fused_ordering(222) 00:14:42.399 fused_ordering(223) 00:14:42.399 fused_ordering(224) 00:14:42.399 fused_ordering(225) 00:14:42.399 fused_ordering(226) 00:14:42.399 fused_ordering(227) 00:14:42.399 fused_ordering(228) 00:14:42.399 fused_ordering(229) 00:14:42.399 fused_ordering(230) 00:14:42.399 fused_ordering(231) 00:14:42.399 fused_ordering(232) 00:14:42.399 fused_ordering(233) 00:14:42.399 fused_ordering(234) 00:14:42.399 fused_ordering(235) 00:14:42.399 fused_ordering(236) 00:14:42.399 fused_ordering(237) 00:14:42.399 fused_ordering(238) 00:14:42.399 fused_ordering(239) 00:14:42.399 fused_ordering(240) 00:14:42.399 fused_ordering(241) 00:14:42.399 fused_ordering(242) 00:14:42.399 fused_ordering(243) 00:14:42.399 fused_ordering(244) 00:14:42.399 fused_ordering(245) 00:14:42.399 fused_ordering(246) 00:14:42.399 fused_ordering(247) 00:14:42.399 fused_ordering(248) 00:14:42.399 fused_ordering(249) 00:14:42.399 fused_ordering(250) 00:14:42.399 fused_ordering(251) 00:14:42.399 fused_ordering(252) 00:14:42.399 fused_ordering(253) 00:14:42.399 fused_ordering(254) 00:14:42.399 fused_ordering(255) 00:14:42.399 fused_ordering(256) 00:14:42.399 fused_ordering(257) 00:14:42.399 fused_ordering(258) 00:14:42.399 fused_ordering(259) 00:14:42.399 fused_ordering(260) 00:14:42.399 fused_ordering(261) 00:14:42.399 fused_ordering(262) 00:14:42.399 fused_ordering(263) 00:14:42.399 fused_ordering(264) 00:14:42.399 fused_ordering(265) 00:14:42.399 fused_ordering(266) 00:14:42.399 fused_ordering(267) 00:14:42.399 fused_ordering(268) 00:14:42.399 fused_ordering(269) 00:14:42.399 fused_ordering(270) 00:14:42.399 fused_ordering(271) 00:14:42.399 fused_ordering(272) 00:14:42.399 fused_ordering(273) 00:14:42.399 fused_ordering(274) 00:14:42.399 fused_ordering(275) 00:14:42.399 fused_ordering(276) 00:14:42.399 fused_ordering(277) 00:14:42.399 fused_ordering(278) 00:14:42.399 fused_ordering(279) 00:14:42.399 fused_ordering(280) 00:14:42.399 fused_ordering(281) 00:14:42.399 fused_ordering(282) 00:14:42.399 fused_ordering(283) 00:14:42.399 fused_ordering(284) 00:14:42.399 fused_ordering(285) 00:14:42.399 fused_ordering(286) 00:14:42.399 fused_ordering(287) 00:14:42.399 fused_ordering(288) 00:14:42.399 fused_ordering(289) 00:14:42.399 fused_ordering(290) 00:14:42.399 fused_ordering(291) 00:14:42.399 fused_ordering(292) 00:14:42.399 fused_ordering(293) 00:14:42.399 fused_ordering(294) 00:14:42.399 fused_ordering(295) 00:14:42.399 fused_ordering(296) 00:14:42.399 fused_ordering(297) 00:14:42.399 fused_ordering(298) 00:14:42.399 fused_ordering(299) 00:14:42.399 fused_ordering(300) 00:14:42.399 fused_ordering(301) 00:14:42.399 fused_ordering(302) 00:14:42.399 fused_ordering(303) 00:14:42.399 fused_ordering(304) 00:14:42.399 fused_ordering(305) 00:14:42.399 fused_ordering(306) 00:14:42.399 fused_ordering(307) 00:14:42.399 fused_ordering(308) 00:14:42.399 fused_ordering(309) 00:14:42.399 fused_ordering(310) 00:14:42.399 fused_ordering(311) 00:14:42.399 fused_ordering(312) 00:14:42.399 fused_ordering(313) 00:14:42.399 fused_ordering(314) 00:14:42.399 fused_ordering(315) 00:14:42.399 fused_ordering(316) 00:14:42.399 fused_ordering(317) 00:14:42.399 fused_ordering(318) 00:14:42.399 fused_ordering(319) 00:14:42.399 fused_ordering(320) 00:14:42.399 fused_ordering(321) 00:14:42.399 fused_ordering(322) 00:14:42.399 fused_ordering(323) 00:14:42.399 fused_ordering(324) 00:14:42.399 fused_ordering(325) 00:14:42.399 fused_ordering(326) 00:14:42.399 fused_ordering(327) 00:14:42.399 fused_ordering(328) 00:14:42.399 fused_ordering(329) 00:14:42.399 fused_ordering(330) 00:14:42.399 fused_ordering(331) 00:14:42.399 fused_ordering(332) 00:14:42.399 fused_ordering(333) 00:14:42.399 fused_ordering(334) 00:14:42.399 fused_ordering(335) 00:14:42.399 fused_ordering(336) 00:14:42.399 fused_ordering(337) 00:14:42.399 fused_ordering(338) 00:14:42.399 fused_ordering(339) 00:14:42.399 fused_ordering(340) 00:14:42.399 fused_ordering(341) 00:14:42.399 fused_ordering(342) 00:14:42.399 fused_ordering(343) 00:14:42.399 fused_ordering(344) 00:14:42.399 fused_ordering(345) 00:14:42.399 fused_ordering(346) 00:14:42.399 fused_ordering(347) 00:14:42.399 fused_ordering(348) 00:14:42.399 fused_ordering(349) 00:14:42.399 fused_ordering(350) 00:14:42.399 fused_ordering(351) 00:14:42.399 fused_ordering(352) 00:14:42.399 fused_ordering(353) 00:14:42.399 fused_ordering(354) 00:14:42.399 fused_ordering(355) 00:14:42.399 fused_ordering(356) 00:14:42.399 fused_ordering(357) 00:14:42.399 fused_ordering(358) 00:14:42.399 fused_ordering(359) 00:14:42.399 fused_ordering(360) 00:14:42.399 fused_ordering(361) 00:14:42.399 fused_ordering(362) 00:14:42.399 fused_ordering(363) 00:14:42.399 fused_ordering(364) 00:14:42.399 fused_ordering(365) 00:14:42.399 fused_ordering(366) 00:14:42.399 fused_ordering(367) 00:14:42.399 fused_ordering(368) 00:14:42.399 fused_ordering(369) 00:14:42.399 fused_ordering(370) 00:14:42.399 fused_ordering(371) 00:14:42.399 fused_ordering(372) 00:14:42.399 fused_ordering(373) 00:14:42.399 fused_ordering(374) 00:14:42.399 fused_ordering(375) 00:14:42.399 fused_ordering(376) 00:14:42.399 fused_ordering(377) 00:14:42.399 fused_ordering(378) 00:14:42.399 fused_ordering(379) 00:14:42.399 fused_ordering(380) 00:14:42.399 fused_ordering(381) 00:14:42.399 fused_ordering(382) 00:14:42.399 fused_ordering(383) 00:14:42.399 fused_ordering(384) 00:14:42.399 fused_ordering(385) 00:14:42.399 fused_ordering(386) 00:14:42.399 fused_ordering(387) 00:14:42.399 fused_ordering(388) 00:14:42.399 fused_ordering(389) 00:14:42.399 fused_ordering(390) 00:14:42.399 fused_ordering(391) 00:14:42.399 fused_ordering(392) 00:14:42.399 fused_ordering(393) 00:14:42.399 fused_ordering(394) 00:14:42.399 fused_ordering(395) 00:14:42.399 fused_ordering(396) 00:14:42.399 fused_ordering(397) 00:14:42.399 fused_ordering(398) 00:14:42.399 fused_ordering(399) 00:14:42.399 fused_ordering(400) 00:14:42.399 fused_ordering(401) 00:14:42.399 fused_ordering(402) 00:14:42.399 fused_ordering(403) 00:14:42.399 fused_ordering(404) 00:14:42.399 fused_ordering(405) 00:14:42.399 fused_ordering(406) 00:14:42.399 fused_ordering(407) 00:14:42.399 fused_ordering(408) 00:14:42.399 fused_ordering(409) 00:14:42.399 fused_ordering(410) 00:14:42.961 fused_ordering(411) 00:14:42.961 fused_ordering(412) 00:14:42.961 fused_ordering(413) 00:14:42.961 fused_ordering(414) 00:14:42.961 fused_ordering(415) 00:14:42.961 fused_ordering(416) 00:14:42.961 fused_ordering(417) 00:14:42.961 fused_ordering(418) 00:14:42.961 fused_ordering(419) 00:14:42.961 fused_ordering(420) 00:14:42.961 fused_ordering(421) 00:14:42.961 fused_ordering(422) 00:14:42.961 fused_ordering(423) 00:14:42.961 fused_ordering(424) 00:14:42.961 fused_ordering(425) 00:14:42.961 fused_ordering(426) 00:14:42.961 fused_ordering(427) 00:14:42.961 fused_ordering(428) 00:14:42.961 fused_ordering(429) 00:14:42.961 fused_ordering(430) 00:14:42.961 fused_ordering(431) 00:14:42.961 fused_ordering(432) 00:14:42.961 fused_ordering(433) 00:14:42.961 fused_ordering(434) 00:14:42.961 fused_ordering(435) 00:14:42.961 fused_ordering(436) 00:14:42.961 fused_ordering(437) 00:14:42.961 fused_ordering(438) 00:14:42.961 fused_ordering(439) 00:14:42.961 fused_ordering(440) 00:14:42.961 fused_ordering(441) 00:14:42.961 fused_ordering(442) 00:14:42.961 fused_ordering(443) 00:14:42.961 fused_ordering(444) 00:14:42.961 fused_ordering(445) 00:14:42.961 fused_ordering(446) 00:14:42.961 fused_ordering(447) 00:14:42.961 fused_ordering(448) 00:14:42.961 fused_ordering(449) 00:14:42.961 fused_ordering(450) 00:14:42.961 fused_ordering(451) 00:14:42.961 fused_ordering(452) 00:14:42.961 fused_ordering(453) 00:14:42.961 fused_ordering(454) 00:14:42.961 fused_ordering(455) 00:14:42.961 fused_ordering(456) 00:14:42.961 fused_ordering(457) 00:14:42.961 fused_ordering(458) 00:14:42.961 fused_ordering(459) 00:14:42.961 fused_ordering(460) 00:14:42.961 fused_ordering(461) 00:14:42.961 fused_ordering(462) 00:14:42.961 fused_ordering(463) 00:14:42.961 fused_ordering(464) 00:14:42.961 fused_ordering(465) 00:14:42.961 fused_ordering(466) 00:14:42.961 fused_ordering(467) 00:14:42.961 fused_ordering(468) 00:14:42.961 fused_ordering(469) 00:14:42.961 fused_ordering(470) 00:14:42.961 fused_ordering(471) 00:14:42.961 fused_ordering(472) 00:14:42.961 fused_ordering(473) 00:14:42.961 fused_ordering(474) 00:14:42.961 fused_ordering(475) 00:14:42.961 fused_ordering(476) 00:14:42.961 fused_ordering(477) 00:14:42.961 fused_ordering(478) 00:14:42.961 fused_ordering(479) 00:14:42.961 fused_ordering(480) 00:14:42.961 fused_ordering(481) 00:14:42.961 fused_ordering(482) 00:14:42.962 fused_ordering(483) 00:14:42.962 fused_ordering(484) 00:14:42.962 fused_ordering(485) 00:14:42.962 fused_ordering(486) 00:14:42.962 fused_ordering(487) 00:14:42.962 fused_ordering(488) 00:14:42.962 fused_ordering(489) 00:14:42.962 fused_ordering(490) 00:14:42.962 fused_ordering(491) 00:14:42.962 fused_ordering(492) 00:14:42.962 fused_ordering(493) 00:14:42.962 fused_ordering(494) 00:14:42.962 fused_ordering(495) 00:14:42.962 fused_ordering(496) 00:14:42.962 fused_ordering(497) 00:14:42.962 fused_ordering(498) 00:14:42.962 fused_ordering(499) 00:14:42.962 fused_ordering(500) 00:14:42.962 fused_ordering(501) 00:14:42.962 fused_ordering(502) 00:14:42.962 fused_ordering(503) 00:14:42.962 fused_ordering(504) 00:14:42.962 fused_ordering(505) 00:14:42.962 fused_ordering(506) 00:14:42.962 fused_ordering(507) 00:14:42.962 fused_ordering(508) 00:14:42.962 fused_ordering(509) 00:14:42.962 fused_ordering(510) 00:14:42.962 fused_ordering(511) 00:14:42.962 fused_ordering(512) 00:14:42.962 fused_ordering(513) 00:14:42.962 fused_ordering(514) 00:14:42.962 fused_ordering(515) 00:14:42.962 fused_ordering(516) 00:14:42.962 fused_ordering(517) 00:14:42.962 fused_ordering(518) 00:14:42.962 fused_ordering(519) 00:14:42.962 fused_ordering(520) 00:14:42.962 fused_ordering(521) 00:14:42.962 fused_ordering(522) 00:14:42.962 fused_ordering(523) 00:14:42.962 fused_ordering(524) 00:14:42.962 fused_ordering(525) 00:14:42.962 fused_ordering(526) 00:14:42.962 fused_ordering(527) 00:14:42.962 fused_ordering(528) 00:14:42.962 fused_ordering(529) 00:14:42.962 fused_ordering(530) 00:14:42.962 fused_ordering(531) 00:14:42.962 fused_ordering(532) 00:14:42.962 fused_ordering(533) 00:14:42.962 fused_ordering(534) 00:14:42.962 fused_ordering(535) 00:14:42.962 fused_ordering(536) 00:14:42.962 fused_ordering(537) 00:14:42.962 fused_ordering(538) 00:14:42.962 fused_ordering(539) 00:14:42.962 fused_ordering(540) 00:14:42.962 fused_ordering(541) 00:14:42.962 fused_ordering(542) 00:14:42.962 fused_ordering(543) 00:14:42.962 fused_ordering(544) 00:14:42.962 fused_ordering(545) 00:14:42.962 fused_ordering(546) 00:14:42.962 fused_ordering(547) 00:14:42.962 fused_ordering(548) 00:14:42.962 fused_ordering(549) 00:14:42.962 fused_ordering(550) 00:14:42.962 fused_ordering(551) 00:14:42.962 fused_ordering(552) 00:14:42.962 fused_ordering(553) 00:14:42.962 fused_ordering(554) 00:14:42.962 fused_ordering(555) 00:14:42.962 fused_ordering(556) 00:14:42.962 fused_ordering(557) 00:14:42.962 fused_ordering(558) 00:14:42.962 fused_ordering(559) 00:14:42.962 fused_ordering(560) 00:14:42.962 fused_ordering(561) 00:14:42.962 fused_ordering(562) 00:14:42.962 fused_ordering(563) 00:14:42.962 fused_ordering(564) 00:14:42.962 fused_ordering(565) 00:14:42.962 fused_ordering(566) 00:14:42.962 fused_ordering(567) 00:14:42.962 fused_ordering(568) 00:14:42.962 fused_ordering(569) 00:14:42.962 fused_ordering(570) 00:14:42.962 fused_ordering(571) 00:14:42.962 fused_ordering(572) 00:14:42.962 fused_ordering(573) 00:14:42.962 fused_ordering(574) 00:14:42.962 fused_ordering(575) 00:14:42.962 fused_ordering(576) 00:14:42.962 fused_ordering(577) 00:14:42.962 fused_ordering(578) 00:14:42.962 fused_ordering(579) 00:14:42.962 fused_ordering(580) 00:14:42.962 fused_ordering(581) 00:14:42.962 fused_ordering(582) 00:14:42.962 fused_ordering(583) 00:14:42.962 fused_ordering(584) 00:14:42.962 fused_ordering(585) 00:14:42.962 fused_ordering(586) 00:14:42.962 fused_ordering(587) 00:14:42.962 fused_ordering(588) 00:14:42.962 fused_ordering(589) 00:14:42.962 fused_ordering(590) 00:14:42.962 fused_ordering(591) 00:14:42.962 fused_ordering(592) 00:14:42.962 fused_ordering(593) 00:14:42.962 fused_ordering(594) 00:14:42.962 fused_ordering(595) 00:14:42.962 fused_ordering(596) 00:14:42.962 fused_ordering(597) 00:14:42.962 fused_ordering(598) 00:14:42.962 fused_ordering(599) 00:14:42.962 fused_ordering(600) 00:14:42.962 fused_ordering(601) 00:14:42.962 fused_ordering(602) 00:14:42.962 fused_ordering(603) 00:14:42.962 fused_ordering(604) 00:14:42.962 fused_ordering(605) 00:14:42.962 fused_ordering(606) 00:14:42.962 fused_ordering(607) 00:14:42.962 fused_ordering(608) 00:14:42.962 fused_ordering(609) 00:14:42.962 fused_ordering(610) 00:14:42.962 fused_ordering(611) 00:14:42.962 fused_ordering(612) 00:14:42.962 fused_ordering(613) 00:14:42.962 fused_ordering(614) 00:14:42.962 fused_ordering(615) 00:14:43.893 fused_ordering(616) 00:14:43.893 fused_ordering(617) 00:14:43.893 fused_ordering(618) 00:14:43.893 fused_ordering(619) 00:14:43.893 fused_ordering(620) 00:14:43.893 fused_ordering(621) 00:14:43.893 fused_ordering(622) 00:14:43.893 fused_ordering(623) 00:14:43.893 fused_ordering(624) 00:14:43.893 fused_ordering(625) 00:14:43.893 fused_ordering(626) 00:14:43.893 fused_ordering(627) 00:14:43.893 fused_ordering(628) 00:14:43.893 fused_ordering(629) 00:14:43.893 fused_ordering(630) 00:14:43.893 fused_ordering(631) 00:14:43.893 fused_ordering(632) 00:14:43.893 fused_ordering(633) 00:14:43.893 fused_ordering(634) 00:14:43.893 fused_ordering(635) 00:14:43.893 fused_ordering(636) 00:14:43.893 fused_ordering(637) 00:14:43.893 fused_ordering(638) 00:14:43.893 fused_ordering(639) 00:14:43.893 fused_ordering(640) 00:14:43.893 fused_ordering(641) 00:14:43.893 fused_ordering(642) 00:14:43.893 fused_ordering(643) 00:14:43.893 fused_ordering(644) 00:14:43.893 fused_ordering(645) 00:14:43.893 fused_ordering(646) 00:14:43.893 fused_ordering(647) 00:14:43.893 fused_ordering(648) 00:14:43.893 fused_ordering(649) 00:14:43.893 fused_ordering(650) 00:14:43.893 fused_ordering(651) 00:14:43.893 fused_ordering(652) 00:14:43.893 fused_ordering(653) 00:14:43.893 fused_ordering(654) 00:14:43.893 fused_ordering(655) 00:14:43.893 fused_ordering(656) 00:14:43.893 fused_ordering(657) 00:14:43.893 fused_ordering(658) 00:14:43.893 fused_ordering(659) 00:14:43.893 fused_ordering(660) 00:14:43.893 fused_ordering(661) 00:14:43.893 fused_ordering(662) 00:14:43.893 fused_ordering(663) 00:14:43.893 fused_ordering(664) 00:14:43.893 fused_ordering(665) 00:14:43.893 fused_ordering(666) 00:14:43.893 fused_ordering(667) 00:14:43.893 fused_ordering(668) 00:14:43.893 fused_ordering(669) 00:14:43.893 fused_ordering(670) 00:14:43.893 fused_ordering(671) 00:14:43.893 fused_ordering(672) 00:14:43.893 fused_ordering(673) 00:14:43.893 fused_ordering(674) 00:14:43.893 fused_ordering(675) 00:14:43.893 fused_ordering(676) 00:14:43.893 fused_ordering(677) 00:14:43.893 fused_ordering(678) 00:14:43.893 fused_ordering(679) 00:14:43.893 fused_ordering(680) 00:14:43.893 fused_ordering(681) 00:14:43.893 fused_ordering(682) 00:14:43.893 fused_ordering(683) 00:14:43.893 fused_ordering(684) 00:14:43.893 fused_ordering(685) 00:14:43.893 fused_ordering(686) 00:14:43.893 fused_ordering(687) 00:14:43.893 fused_ordering(688) 00:14:43.893 fused_ordering(689) 00:14:43.893 fused_ordering(690) 00:14:43.893 fused_ordering(691) 00:14:43.893 fused_ordering(692) 00:14:43.893 fused_ordering(693) 00:14:43.893 fused_ordering(694) 00:14:43.893 fused_ordering(695) 00:14:43.893 fused_ordering(696) 00:14:43.893 fused_ordering(697) 00:14:43.894 fused_ordering(698) 00:14:43.894 fused_ordering(699) 00:14:43.894 fused_ordering(700) 00:14:43.894 fused_ordering(701) 00:14:43.894 fused_ordering(702) 00:14:43.894 fused_ordering(703) 00:14:43.894 fused_ordering(704) 00:14:43.894 fused_ordering(705) 00:14:43.894 fused_ordering(706) 00:14:43.894 fused_ordering(707) 00:14:43.894 fused_ordering(708) 00:14:43.894 fused_ordering(709) 00:14:43.894 fused_ordering(710) 00:14:43.894 fused_ordering(711) 00:14:43.894 fused_ordering(712) 00:14:43.894 fused_ordering(713) 00:14:43.894 fused_ordering(714) 00:14:43.894 fused_ordering(715) 00:14:43.894 fused_ordering(716) 00:14:43.894 fused_ordering(717) 00:14:43.894 fused_ordering(718) 00:14:43.894 fused_ordering(719) 00:14:43.894 fused_ordering(720) 00:14:43.894 fused_ordering(721) 00:14:43.894 fused_ordering(722) 00:14:43.894 fused_ordering(723) 00:14:43.894 fused_ordering(724) 00:14:43.894 fused_ordering(725) 00:14:43.894 fused_ordering(726) 00:14:43.894 fused_ordering(727) 00:14:43.894 fused_ordering(728) 00:14:43.894 fused_ordering(729) 00:14:43.894 fused_ordering(730) 00:14:43.894 fused_ordering(731) 00:14:43.894 fused_ordering(732) 00:14:43.894 fused_ordering(733) 00:14:43.894 fused_ordering(734) 00:14:43.894 fused_ordering(735) 00:14:43.894 fused_ordering(736) 00:14:43.894 fused_ordering(737) 00:14:43.894 fused_ordering(738) 00:14:43.894 fused_ordering(739) 00:14:43.894 fused_ordering(740) 00:14:43.894 fused_ordering(741) 00:14:43.894 fused_ordering(742) 00:14:43.894 fused_ordering(743) 00:14:43.894 fused_ordering(744) 00:14:43.894 fused_ordering(745) 00:14:43.894 fused_ordering(746) 00:14:43.894 fused_ordering(747) 00:14:43.894 fused_ordering(748) 00:14:43.894 fused_ordering(749) 00:14:43.894 fused_ordering(750) 00:14:43.894 fused_ordering(751) 00:14:43.894 fused_ordering(752) 00:14:43.894 fused_ordering(753) 00:14:43.894 fused_ordering(754) 00:14:43.894 fused_ordering(755) 00:14:43.894 fused_ordering(756) 00:14:43.894 fused_ordering(757) 00:14:43.894 fused_ordering(758) 00:14:43.894 fused_ordering(759) 00:14:43.894 fused_ordering(760) 00:14:43.894 fused_ordering(761) 00:14:43.894 fused_ordering(762) 00:14:43.894 fused_ordering(763) 00:14:43.894 fused_ordering(764) 00:14:43.894 fused_ordering(765) 00:14:43.894 fused_ordering(766) 00:14:43.894 fused_ordering(767) 00:14:43.894 fused_ordering(768) 00:14:43.894 fused_ordering(769) 00:14:43.894 fused_ordering(770) 00:14:43.894 fused_ordering(771) 00:14:43.894 fused_ordering(772) 00:14:43.894 fused_ordering(773) 00:14:43.894 fused_ordering(774) 00:14:43.894 fused_ordering(775) 00:14:43.894 fused_ordering(776) 00:14:43.894 fused_ordering(777) 00:14:43.894 fused_ordering(778) 00:14:43.894 fused_ordering(779) 00:14:43.894 fused_ordering(780) 00:14:43.894 fused_ordering(781) 00:14:43.894 fused_ordering(782) 00:14:43.894 fused_ordering(783) 00:14:43.894 fused_ordering(784) 00:14:43.894 fused_ordering(785) 00:14:43.894 fused_ordering(786) 00:14:43.894 fused_ordering(787) 00:14:43.894 fused_ordering(788) 00:14:43.894 fused_ordering(789) 00:14:43.894 fused_ordering(790) 00:14:43.894 fused_ordering(791) 00:14:43.894 fused_ordering(792) 00:14:43.894 fused_ordering(793) 00:14:43.894 fused_ordering(794) 00:14:43.894 fused_ordering(795) 00:14:43.894 fused_ordering(796) 00:14:43.894 fused_ordering(797) 00:14:43.894 fused_ordering(798) 00:14:43.894 fused_ordering(799) 00:14:43.894 fused_ordering(800) 00:14:43.894 fused_ordering(801) 00:14:43.894 fused_ordering(802) 00:14:43.894 fused_ordering(803) 00:14:43.894 fused_ordering(804) 00:14:43.894 fused_ordering(805) 00:14:43.894 fused_ordering(806) 00:14:43.894 fused_ordering(807) 00:14:43.894 fused_ordering(808) 00:14:43.894 fused_ordering(809) 00:14:43.894 fused_ordering(810) 00:14:43.894 fused_ordering(811) 00:14:43.894 fused_ordering(812) 00:14:43.894 fused_ordering(813) 00:14:43.894 fused_ordering(814) 00:14:43.894 fused_ordering(815) 00:14:43.894 fused_ordering(816) 00:14:43.894 fused_ordering(817) 00:14:43.894 fused_ordering(818) 00:14:43.894 fused_ordering(819) 00:14:43.894 fused_ordering(820) 00:14:44.460 fused_ordering(821) 00:14:44.460 fused_ordering(822) 00:14:44.460 fused_ordering(823) 00:14:44.460 fused_ordering(824) 00:14:44.460 fused_ordering(825) 00:14:44.460 fused_ordering(826) 00:14:44.460 fused_ordering(827) 00:14:44.460 fused_ordering(828) 00:14:44.460 fused_ordering(829) 00:14:44.460 fused_ordering(830) 00:14:44.460 fused_ordering(831) 00:14:44.460 fused_ordering(832) 00:14:44.460 fused_ordering(833) 00:14:44.460 fused_ordering(834) 00:14:44.460 fused_ordering(835) 00:14:44.460 fused_ordering(836) 00:14:44.461 fused_ordering(837) 00:14:44.461 fused_ordering(838) 00:14:44.461 fused_ordering(839) 00:14:44.461 fused_ordering(840) 00:14:44.461 fused_ordering(841) 00:14:44.461 fused_ordering(842) 00:14:44.461 fused_ordering(843) 00:14:44.461 fused_ordering(844) 00:14:44.461 fused_ordering(845) 00:14:44.461 fused_ordering(846) 00:14:44.461 fused_ordering(847) 00:14:44.461 fused_ordering(848) 00:14:44.461 fused_ordering(849) 00:14:44.461 fused_ordering(850) 00:14:44.461 fused_ordering(851) 00:14:44.461 fused_ordering(852) 00:14:44.461 fused_ordering(853) 00:14:44.461 fused_ordering(854) 00:14:44.461 fused_ordering(855) 00:14:44.461 fused_ordering(856) 00:14:44.461 fused_ordering(857) 00:14:44.461 fused_ordering(858) 00:14:44.461 fused_ordering(859) 00:14:44.461 fused_ordering(860) 00:14:44.461 fused_ordering(861) 00:14:44.461 fused_ordering(862) 00:14:44.461 fused_ordering(863) 00:14:44.461 fused_ordering(864) 00:14:44.461 fused_ordering(865) 00:14:44.461 fused_ordering(866) 00:14:44.461 fused_ordering(867) 00:14:44.461 fused_ordering(868) 00:14:44.461 fused_ordering(869) 00:14:44.461 fused_ordering(870) 00:14:44.461 fused_ordering(871) 00:14:44.461 fused_ordering(872) 00:14:44.461 fused_ordering(873) 00:14:44.461 fused_ordering(874) 00:14:44.461 fused_ordering(875) 00:14:44.461 fused_ordering(876) 00:14:44.461 fused_ordering(877) 00:14:44.461 fused_ordering(878) 00:14:44.461 fused_ordering(879) 00:14:44.461 fused_ordering(880) 00:14:44.461 fused_ordering(881) 00:14:44.461 fused_ordering(882) 00:14:44.461 fused_ordering(883) 00:14:44.461 fused_ordering(884) 00:14:44.461 fused_ordering(885) 00:14:44.461 fused_ordering(886) 00:14:44.461 fused_ordering(887) 00:14:44.461 fused_ordering(888) 00:14:44.461 fused_ordering(889) 00:14:44.461 fused_ordering(890) 00:14:44.461 fused_ordering(891) 00:14:44.461 fused_ordering(892) 00:14:44.461 fused_ordering(893) 00:14:44.461 fused_ordering(894) 00:14:44.461 fused_ordering(895) 00:14:44.461 fused_ordering(896) 00:14:44.461 fused_ordering(897) 00:14:44.461 fused_ordering(898) 00:14:44.461 fused_ordering(899) 00:14:44.461 fused_ordering(900) 00:14:44.461 fused_ordering(901) 00:14:44.461 fused_ordering(902) 00:14:44.461 fused_ordering(903) 00:14:44.461 fused_ordering(904) 00:14:44.461 fused_ordering(905) 00:14:44.461 fused_ordering(906) 00:14:44.461 fused_ordering(907) 00:14:44.461 fused_ordering(908) 00:14:44.461 fused_ordering(909) 00:14:44.461 fused_ordering(910) 00:14:44.461 fused_ordering(911) 00:14:44.461 fused_ordering(912) 00:14:44.461 fused_ordering(913) 00:14:44.461 fused_ordering(914) 00:14:44.461 fused_ordering(915) 00:14:44.461 fused_ordering(916) 00:14:44.461 fused_ordering(917) 00:14:44.461 fused_ordering(918) 00:14:44.461 fused_ordering(919) 00:14:44.461 fused_ordering(920) 00:14:44.461 fused_ordering(921) 00:14:44.461 fused_ordering(922) 00:14:44.461 fused_ordering(923) 00:14:44.461 fused_ordering(924) 00:14:44.461 fused_ordering(925) 00:14:44.461 fused_ordering(926) 00:14:44.461 fused_ordering(927) 00:14:44.461 fused_ordering(928) 00:14:44.461 fused_ordering(929) 00:14:44.461 fused_ordering(930) 00:14:44.461 fused_ordering(931) 00:14:44.461 fused_ordering(932) 00:14:44.461 fused_ordering(933) 00:14:44.461 fused_ordering(934) 00:14:44.461 fused_ordering(935) 00:14:44.461 fused_ordering(936) 00:14:44.461 fused_ordering(937) 00:14:44.461 fused_ordering(938) 00:14:44.461 fused_ordering(939) 00:14:44.461 fused_ordering(940) 00:14:44.461 fused_ordering(941) 00:14:44.461 fused_ordering(942) 00:14:44.461 fused_ordering(943) 00:14:44.461 fused_ordering(944) 00:14:44.461 fused_ordering(945) 00:14:44.461 fused_ordering(946) 00:14:44.461 fused_ordering(947) 00:14:44.461 fused_ordering(948) 00:14:44.461 fused_ordering(949) 00:14:44.461 fused_ordering(950) 00:14:44.461 fused_ordering(951) 00:14:44.461 fused_ordering(952) 00:14:44.461 fused_ordering(953) 00:14:44.461 fused_ordering(954) 00:14:44.461 fused_ordering(955) 00:14:44.461 fused_ordering(956) 00:14:44.461 fused_ordering(957) 00:14:44.461 fused_ordering(958) 00:14:44.461 fused_ordering(959) 00:14:44.461 fused_ordering(960) 00:14:44.461 fused_ordering(961) 00:14:44.461 fused_ordering(962) 00:14:44.461 fused_ordering(963) 00:14:44.461 fused_ordering(964) 00:14:44.461 fused_ordering(965) 00:14:44.461 fused_ordering(966) 00:14:44.461 fused_ordering(967) 00:14:44.461 fused_ordering(968) 00:14:44.461 fused_ordering(969) 00:14:44.461 fused_ordering(970) 00:14:44.461 fused_ordering(971) 00:14:44.461 fused_ordering(972) 00:14:44.461 fused_ordering(973) 00:14:44.461 fused_ordering(974) 00:14:44.461 fused_ordering(975) 00:14:44.461 fused_ordering(976) 00:14:44.461 fused_ordering(977) 00:14:44.461 fused_ordering(978) 00:14:44.461 fused_ordering(979) 00:14:44.461 fused_ordering(980) 00:14:44.461 fused_ordering(981) 00:14:44.461 fused_ordering(982) 00:14:44.461 fused_ordering(983) 00:14:44.461 fused_ordering(984) 00:14:44.461 fused_ordering(985) 00:14:44.461 fused_ordering(986) 00:14:44.461 fused_ordering(987) 00:14:44.461 fused_ordering(988) 00:14:44.461 fused_ordering(989) 00:14:44.461 fused_ordering(990) 00:14:44.461 fused_ordering(991) 00:14:44.461 fused_ordering(992) 00:14:44.461 fused_ordering(993) 00:14:44.461 fused_ordering(994) 00:14:44.461 fused_ordering(995) 00:14:44.461 fused_ordering(996) 00:14:44.461 fused_ordering(997) 00:14:44.461 fused_ordering(998) 00:14:44.461 fused_ordering(999) 00:14:44.461 fused_ordering(1000) 00:14:44.462 fused_ordering(1001) 00:14:44.462 fused_ordering(1002) 00:14:44.462 fused_ordering(1003) 00:14:44.462 fused_ordering(1004) 00:14:44.462 fused_ordering(1005) 00:14:44.462 fused_ordering(1006) 00:14:44.462 fused_ordering(1007) 00:14:44.462 fused_ordering(1008) 00:14:44.462 fused_ordering(1009) 00:14:44.462 fused_ordering(1010) 00:14:44.462 fused_ordering(1011) 00:14:44.462 fused_ordering(1012) 00:14:44.462 fused_ordering(1013) 00:14:44.462 fused_ordering(1014) 00:14:44.462 fused_ordering(1015) 00:14:44.462 fused_ordering(1016) 00:14:44.462 fused_ordering(1017) 00:14:44.462 fused_ordering(1018) 00:14:44.462 fused_ordering(1019) 00:14:44.462 fused_ordering(1020) 00:14:44.462 fused_ordering(1021) 00:14:44.462 fused_ordering(1022) 00:14:44.462 fused_ordering(1023) 00:14:44.462 10:00:50 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:14:44.462 10:00:50 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:14:44.462 10:00:50 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:44.462 10:00:50 -- nvmf/common.sh@116 -- # sync 00:14:44.462 10:00:50 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:44.462 10:00:50 -- nvmf/common.sh@119 -- # set +e 00:14:44.462 10:00:50 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:44.462 10:00:50 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:44.462 rmmod nvme_tcp 00:14:44.462 rmmod nvme_fabrics 00:14:44.462 rmmod nvme_keyring 00:14:44.462 10:00:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:44.462 10:00:50 -- nvmf/common.sh@123 -- # set -e 00:14:44.462 10:00:50 -- nvmf/common.sh@124 -- # return 0 00:14:44.462 10:00:50 -- nvmf/common.sh@477 -- # '[' -n 2777680 ']' 00:14:44.462 10:00:50 -- nvmf/common.sh@478 -- # killprocess 2777680 00:14:44.462 10:00:50 -- common/autotest_common.sh@926 -- # '[' -z 2777680 ']' 00:14:44.462 10:00:50 -- common/autotest_common.sh@930 -- # kill -0 2777680 00:14:44.462 10:00:50 -- common/autotest_common.sh@931 -- # uname 00:14:44.462 10:00:50 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:14:44.462 10:00:50 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2777680 00:14:44.462 10:00:50 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:14:44.462 10:00:50 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:14:44.462 10:00:50 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2777680' 00:14:44.462 killing process with pid 2777680 00:14:44.462 10:00:50 -- common/autotest_common.sh@945 -- # kill 2777680 00:14:44.462 10:00:50 -- common/autotest_common.sh@950 -- # wait 2777680 00:14:44.722 10:00:50 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:44.722 10:00:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:44.722 10:00:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:44.722 10:00:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:44.722 10:00:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:44.722 10:00:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:44.722 10:00:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:44.722 10:00:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:47.249 10:00:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:47.249 00:14:47.249 real 0m8.687s 00:14:47.249 user 0m6.376s 00:14:47.249 sys 0m3.794s 00:14:47.249 10:00:52 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:14:47.249 10:00:52 -- common/autotest_common.sh@10 -- # set +x 00:14:47.249 ************************************ 00:14:47.249 END TEST nvmf_fused_ordering 00:14:47.249 ************************************ 00:14:47.249 10:00:52 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:14:47.249 10:00:52 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:14:47.249 10:00:52 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:14:47.249 10:00:52 -- common/autotest_common.sh@10 -- # set +x 00:14:47.249 ************************************ 00:14:47.249 START TEST nvmf_delete_subsystem 00:14:47.249 ************************************ 00:14:47.249 10:00:52 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:14:47.249 * Looking for test storage... 00:14:47.249 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:47.249 10:00:52 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:47.249 10:00:52 -- nvmf/common.sh@7 -- # uname -s 00:14:47.249 10:00:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:47.249 10:00:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:47.249 10:00:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:47.249 10:00:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:47.249 10:00:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:47.249 10:00:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:47.249 10:00:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:47.249 10:00:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:47.249 10:00:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:47.249 10:00:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:47.249 10:00:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:47.249 10:00:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:47.249 10:00:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:47.249 10:00:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:47.249 10:00:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:47.249 10:00:52 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:47.249 10:00:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:47.249 10:00:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:47.249 10:00:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:47.249 10:00:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:47.249 10:00:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:47.249 10:00:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:47.249 10:00:52 -- paths/export.sh@5 -- # export PATH 00:14:47.249 10:00:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:47.249 10:00:52 -- nvmf/common.sh@46 -- # : 0 00:14:47.249 10:00:52 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:47.249 10:00:52 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:47.249 10:00:52 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:47.249 10:00:52 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:47.249 10:00:52 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:47.249 10:00:52 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:47.249 10:00:52 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:47.249 10:00:52 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:47.249 10:00:52 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:14:47.249 10:00:52 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:47.249 10:00:52 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:47.249 10:00:52 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:47.249 10:00:52 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:47.249 10:00:52 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:47.249 10:00:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:47.249 10:00:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:47.249 10:00:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:47.249 10:00:52 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:47.249 10:00:52 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:47.249 10:00:52 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:47.249 10:00:52 -- common/autotest_common.sh@10 -- # set +x 00:14:49.187 10:00:54 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:49.187 10:00:54 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:49.188 10:00:54 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:49.188 10:00:54 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:49.188 10:00:54 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:49.188 10:00:54 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:49.188 10:00:54 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:49.188 10:00:54 -- nvmf/common.sh@294 -- # net_devs=() 00:14:49.188 10:00:54 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:49.188 10:00:54 -- nvmf/common.sh@295 -- # e810=() 00:14:49.188 10:00:54 -- nvmf/common.sh@295 -- # local -ga e810 00:14:49.188 10:00:54 -- nvmf/common.sh@296 -- # x722=() 00:14:49.188 10:00:54 -- nvmf/common.sh@296 -- # local -ga x722 00:14:49.188 10:00:54 -- nvmf/common.sh@297 -- # mlx=() 00:14:49.188 10:00:54 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:49.188 10:00:54 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:49.188 10:00:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:49.188 10:00:54 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:49.188 10:00:54 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:49.188 10:00:54 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:49.188 10:00:54 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:49.188 10:00:54 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:49.188 10:00:54 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:49.188 10:00:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:49.188 10:00:54 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:49.188 10:00:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:49.188 10:00:54 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:49.188 10:00:54 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:49.188 10:00:54 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:49.188 10:00:54 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:49.188 10:00:54 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:49.188 10:00:54 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:49.188 10:00:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:49.188 10:00:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:49.188 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:49.188 10:00:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:49.188 10:00:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:49.188 10:00:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:49.188 10:00:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:49.188 10:00:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:49.188 10:00:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:49.188 10:00:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:49.188 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:49.188 10:00:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:49.188 10:00:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:49.188 10:00:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:49.188 10:00:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:49.188 10:00:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:49.188 10:00:54 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:49.188 10:00:54 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:49.188 10:00:54 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:49.188 10:00:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:49.188 10:00:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:49.188 10:00:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:49.188 10:00:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:49.188 10:00:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:49.188 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:49.188 10:00:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:49.188 10:00:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:49.188 10:00:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:49.188 10:00:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:49.188 10:00:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:49.188 10:00:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:49.188 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:49.188 10:00:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:49.188 10:00:54 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:49.188 10:00:54 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:49.188 10:00:54 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:49.188 10:00:54 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:49.188 10:00:54 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:49.188 10:00:54 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:49.188 10:00:54 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:49.188 10:00:54 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:49.188 10:00:54 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:49.188 10:00:54 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:49.188 10:00:54 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:49.188 10:00:54 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:49.188 10:00:54 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:49.188 10:00:54 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:49.188 10:00:54 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:49.188 10:00:54 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:49.188 10:00:54 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:49.188 10:00:54 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:49.188 10:00:54 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:49.188 10:00:54 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:49.188 10:00:54 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:49.188 10:00:54 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:49.188 10:00:54 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:49.188 10:00:54 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:49.188 10:00:54 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:49.188 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:49.188 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.220 ms 00:14:49.188 00:14:49.188 --- 10.0.0.2 ping statistics --- 00:14:49.188 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:49.188 rtt min/avg/max/mdev = 0.220/0.220/0.220/0.000 ms 00:14:49.188 10:00:54 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:49.188 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:49.188 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.126 ms 00:14:49.188 00:14:49.188 --- 10.0.0.1 ping statistics --- 00:14:49.188 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:49.188 rtt min/avg/max/mdev = 0.126/0.126/0.126/0.000 ms 00:14:49.188 10:00:54 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:49.188 10:00:54 -- nvmf/common.sh@410 -- # return 0 00:14:49.188 10:00:54 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:49.188 10:00:54 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:49.188 10:00:54 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:49.188 10:00:54 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:49.188 10:00:54 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:49.188 10:00:54 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:49.188 10:00:54 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:49.188 10:00:54 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:14:49.188 10:00:54 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:49.188 10:00:54 -- common/autotest_common.sh@712 -- # xtrace_disable 00:14:49.188 10:00:54 -- common/autotest_common.sh@10 -- # set +x 00:14:49.188 10:00:54 -- nvmf/common.sh@469 -- # nvmfpid=2780189 00:14:49.188 10:00:54 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:14:49.188 10:00:54 -- nvmf/common.sh@470 -- # waitforlisten 2780189 00:14:49.188 10:00:54 -- common/autotest_common.sh@819 -- # '[' -z 2780189 ']' 00:14:49.188 10:00:54 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:49.188 10:00:54 -- common/autotest_common.sh@824 -- # local max_retries=100 00:14:49.188 10:00:54 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:49.188 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:49.188 10:00:54 -- common/autotest_common.sh@828 -- # xtrace_disable 00:14:49.188 10:00:54 -- common/autotest_common.sh@10 -- # set +x 00:14:49.188 [2024-07-13 10:00:54.895645] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:14:49.188 [2024-07-13 10:00:54.895711] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:49.188 EAL: No free 2048 kB hugepages reported on node 1 00:14:49.188 [2024-07-13 10:00:54.962749] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:14:49.445 [2024-07-13 10:00:55.053384] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:49.445 [2024-07-13 10:00:55.053540] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:49.445 [2024-07-13 10:00:55.053559] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:49.445 [2024-07-13 10:00:55.053579] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:49.445 [2024-07-13 10:00:55.053636] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:49.445 [2024-07-13 10:00:55.053642] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:50.377 10:00:55 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:14:50.377 10:00:55 -- common/autotest_common.sh@852 -- # return 0 00:14:50.377 10:00:55 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:50.377 10:00:55 -- common/autotest_common.sh@718 -- # xtrace_disable 00:14:50.377 10:00:55 -- common/autotest_common.sh@10 -- # set +x 00:14:50.377 10:00:55 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:50.377 10:00:55 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:50.377 10:00:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:50.377 10:00:55 -- common/autotest_common.sh@10 -- # set +x 00:14:50.377 [2024-07-13 10:00:55.880863] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:50.377 10:00:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:50.377 10:00:55 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:50.377 10:00:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:50.377 10:00:55 -- common/autotest_common.sh@10 -- # set +x 00:14:50.377 10:00:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:50.377 10:00:55 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:50.377 10:00:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:50.377 10:00:55 -- common/autotest_common.sh@10 -- # set +x 00:14:50.377 [2024-07-13 10:00:55.897065] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:50.377 10:00:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:50.377 10:00:55 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:14:50.377 10:00:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:50.377 10:00:55 -- common/autotest_common.sh@10 -- # set +x 00:14:50.377 NULL1 00:14:50.377 10:00:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:50.377 10:00:55 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:14:50.377 10:00:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:50.377 10:00:55 -- common/autotest_common.sh@10 -- # set +x 00:14:50.377 Delay0 00:14:50.377 10:00:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:50.377 10:00:55 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:50.377 10:00:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:50.377 10:00:55 -- common/autotest_common.sh@10 -- # set +x 00:14:50.377 10:00:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:50.377 10:00:55 -- target/delete_subsystem.sh@28 -- # perf_pid=2780333 00:14:50.377 10:00:55 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:14:50.377 10:00:55 -- target/delete_subsystem.sh@30 -- # sleep 2 00:14:50.377 EAL: No free 2048 kB hugepages reported on node 1 00:14:50.377 [2024-07-13 10:00:55.971822] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:14:52.273 10:00:57 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:52.273 10:00:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:52.273 10:00:57 -- common/autotest_common.sh@10 -- # set +x 00:14:52.530 Write completed with error (sct=0, sc=8) 00:14:52.530 Read completed with error (sct=0, sc=8) 00:14:52.530 starting I/O failed: -6 00:14:52.530 Read completed with error (sct=0, sc=8) 00:14:52.530 Read completed with error (sct=0, sc=8) 00:14:52.530 Write completed with error (sct=0, sc=8) 00:14:52.530 Read completed with error (sct=0, sc=8) 00:14:52.530 starting I/O failed: -6 00:14:52.530 Read completed with error (sct=0, sc=8) 00:14:52.530 Write completed with error (sct=0, sc=8) 00:14:52.530 Write completed with error (sct=0, sc=8) 00:14:52.530 Read completed with error (sct=0, sc=8) 00:14:52.530 starting I/O failed: -6 00:14:52.530 Read completed with error (sct=0, sc=8) 00:14:52.530 Read completed with error (sct=0, sc=8) 00:14:52.530 Read completed with error (sct=0, sc=8) 00:14:52.530 Read completed with error (sct=0, sc=8) 00:14:52.530 starting I/O failed: -6 00:14:52.530 Write completed with error (sct=0, sc=8) 00:14:52.530 Read completed with error (sct=0, sc=8) 00:14:52.530 Read completed with error (sct=0, sc=8) 00:14:52.530 Write completed with error (sct=0, sc=8) 00:14:52.530 starting I/O failed: -6 00:14:52.530 Read completed with error (sct=0, sc=8) 00:14:52.530 Read completed with error (sct=0, sc=8) 00:14:52.530 Read completed with error (sct=0, sc=8) 00:14:52.530 Read completed with error (sct=0, sc=8) 00:14:52.530 starting I/O failed: -6 00:14:52.530 Write completed with error (sct=0, sc=8) 00:14:52.530 Read completed with error (sct=0, sc=8) 00:14:52.530 Read completed with error (sct=0, sc=8) 00:14:52.530 Write completed with error (sct=0, sc=8) 00:14:52.530 starting I/O failed: -6 00:14:52.530 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 starting I/O failed: -6 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 starting I/O failed: -6 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 starting I/O failed: -6 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 [2024-07-13 10:00:58.263204] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14a5060 is same with the state(5) to be set 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 starting I/O failed: -6 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 starting I/O failed: -6 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 starting I/O failed: -6 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 starting I/O failed: -6 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 starting I/O failed: -6 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 starting I/O failed: -6 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 starting I/O failed: -6 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 starting I/O failed: -6 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 starting I/O failed: -6 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 starting I/O failed: -6 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 [2024-07-13 10:00:58.263857] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f4a4400c350 is same with the state(5) to be set 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:52.531 Read completed with error (sct=0, sc=8) 00:14:52.531 Write completed with error (sct=0, sc=8) 00:14:53.462 [2024-07-13 10:00:59.230571] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14a85e0 is same with the state(5) to be set 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Write completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Write completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Write completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 [2024-07-13 10:00:59.264063] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f4a4400bf20 is same with the state(5) to be set 00:14:53.462 Write completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Write completed with error (sct=0, sc=8) 00:14:53.462 Write completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Write completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Write completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Write completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Write completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 [2024-07-13 10:00:59.264223] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f4a4400c600 is same with the state(5) to be set 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Write completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Write completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Write completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Write completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 [2024-07-13 10:00:59.267104] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14a5310 is same with the state(5) to be set 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Write completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Write completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Write completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Write completed with error (sct=0, sc=8) 00:14:53.462 Write completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.462 Read completed with error (sct=0, sc=8) 00:14:53.463 [2024-07-13 10:00:59.267592] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14a4d30 is same with the state(5) to be set 00:14:53.463 [2024-07-13 10:00:59.268032] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14a85e0 (9): Bad file descriptor 00:14:53.463 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:14:53.463 10:00:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:53.463 10:00:59 -- target/delete_subsystem.sh@34 -- # delay=0 00:14:53.463 10:00:59 -- target/delete_subsystem.sh@35 -- # kill -0 2780333 00:14:53.463 10:00:59 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:14:53.463 Initializing NVMe Controllers 00:14:53.463 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:53.463 Controller IO queue size 128, less than required. 00:14:53.463 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:53.463 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:14:53.463 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:14:53.463 Initialization complete. Launching workers. 00:14:53.463 ======================================================== 00:14:53.463 Latency(us) 00:14:53.463 Device Information : IOPS MiB/s Average min max 00:14:53.463 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 157.84 0.08 924491.91 636.20 1011630.76 00:14:53.463 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 162.80 0.08 911247.05 360.61 1013023.16 00:14:53.463 ======================================================== 00:14:53.463 Total : 320.64 0.16 917766.96 360.61 1013023.16 00:14:53.463 00:14:54.027 10:00:59 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:14:54.027 10:00:59 -- target/delete_subsystem.sh@35 -- # kill -0 2780333 00:14:54.027 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (2780333) - No such process 00:14:54.027 10:00:59 -- target/delete_subsystem.sh@45 -- # NOT wait 2780333 00:14:54.027 10:00:59 -- common/autotest_common.sh@640 -- # local es=0 00:14:54.027 10:00:59 -- common/autotest_common.sh@642 -- # valid_exec_arg wait 2780333 00:14:54.027 10:00:59 -- common/autotest_common.sh@628 -- # local arg=wait 00:14:54.027 10:00:59 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:14:54.027 10:00:59 -- common/autotest_common.sh@632 -- # type -t wait 00:14:54.027 10:00:59 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:14:54.027 10:00:59 -- common/autotest_common.sh@643 -- # wait 2780333 00:14:54.027 10:00:59 -- common/autotest_common.sh@643 -- # es=1 00:14:54.027 10:00:59 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:14:54.027 10:00:59 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:14:54.027 10:00:59 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:14:54.027 10:00:59 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:54.027 10:00:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:54.027 10:00:59 -- common/autotest_common.sh@10 -- # set +x 00:14:54.027 10:00:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:54.027 10:00:59 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:54.027 10:00:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:54.027 10:00:59 -- common/autotest_common.sh@10 -- # set +x 00:14:54.027 [2024-07-13 10:00:59.791185] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:54.027 10:00:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:54.027 10:00:59 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:54.027 10:00:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:54.027 10:00:59 -- common/autotest_common.sh@10 -- # set +x 00:14:54.027 10:00:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:54.027 10:00:59 -- target/delete_subsystem.sh@54 -- # perf_pid=2780756 00:14:54.027 10:00:59 -- target/delete_subsystem.sh@56 -- # delay=0 00:14:54.027 10:00:59 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:14:54.027 10:00:59 -- target/delete_subsystem.sh@57 -- # kill -0 2780756 00:14:54.027 10:00:59 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:54.027 EAL: No free 2048 kB hugepages reported on node 1 00:14:54.284 [2024-07-13 10:00:59.853723] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:14:54.547 10:01:00 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:54.547 10:01:00 -- target/delete_subsystem.sh@57 -- # kill -0 2780756 00:14:54.547 10:01:00 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:55.113 10:01:00 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:55.113 10:01:00 -- target/delete_subsystem.sh@57 -- # kill -0 2780756 00:14:55.113 10:01:00 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:55.677 10:01:01 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:55.677 10:01:01 -- target/delete_subsystem.sh@57 -- # kill -0 2780756 00:14:55.677 10:01:01 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:56.242 10:01:01 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:56.242 10:01:01 -- target/delete_subsystem.sh@57 -- # kill -0 2780756 00:14:56.242 10:01:01 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:56.807 10:01:02 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:56.807 10:01:02 -- target/delete_subsystem.sh@57 -- # kill -0 2780756 00:14:56.807 10:01:02 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:57.063 10:01:02 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:57.063 10:01:02 -- target/delete_subsystem.sh@57 -- # kill -0 2780756 00:14:57.063 10:01:02 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:57.320 Initializing NVMe Controllers 00:14:57.320 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:57.320 Controller IO queue size 128, less than required. 00:14:57.320 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:57.320 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:14:57.320 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:14:57.320 Initialization complete. Launching workers. 00:14:57.320 ======================================================== 00:14:57.320 Latency(us) 00:14:57.320 Device Information : IOPS MiB/s Average min max 00:14:57.320 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1003170.00 1000189.40 1010656.88 00:14:57.320 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1005664.01 1000243.87 1043861.21 00:14:57.320 ======================================================== 00:14:57.320 Total : 256.00 0.12 1004417.01 1000189.40 1043861.21 00:14:57.320 00:14:57.577 10:01:03 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:57.577 10:01:03 -- target/delete_subsystem.sh@57 -- # kill -0 2780756 00:14:57.577 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (2780756) - No such process 00:14:57.577 10:01:03 -- target/delete_subsystem.sh@67 -- # wait 2780756 00:14:57.577 10:01:03 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:14:57.577 10:01:03 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:14:57.577 10:01:03 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:57.577 10:01:03 -- nvmf/common.sh@116 -- # sync 00:14:57.577 10:01:03 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:57.577 10:01:03 -- nvmf/common.sh@119 -- # set +e 00:14:57.577 10:01:03 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:57.577 10:01:03 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:57.577 rmmod nvme_tcp 00:14:57.577 rmmod nvme_fabrics 00:14:57.577 rmmod nvme_keyring 00:14:57.577 10:01:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:57.577 10:01:03 -- nvmf/common.sh@123 -- # set -e 00:14:57.577 10:01:03 -- nvmf/common.sh@124 -- # return 0 00:14:57.577 10:01:03 -- nvmf/common.sh@477 -- # '[' -n 2780189 ']' 00:14:57.577 10:01:03 -- nvmf/common.sh@478 -- # killprocess 2780189 00:14:57.577 10:01:03 -- common/autotest_common.sh@926 -- # '[' -z 2780189 ']' 00:14:57.577 10:01:03 -- common/autotest_common.sh@930 -- # kill -0 2780189 00:14:57.577 10:01:03 -- common/autotest_common.sh@931 -- # uname 00:14:57.577 10:01:03 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:14:57.577 10:01:03 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2780189 00:14:57.834 10:01:03 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:14:57.834 10:01:03 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:14:57.834 10:01:03 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2780189' 00:14:57.834 killing process with pid 2780189 00:14:57.834 10:01:03 -- common/autotest_common.sh@945 -- # kill 2780189 00:14:57.834 10:01:03 -- common/autotest_common.sh@950 -- # wait 2780189 00:14:57.834 10:01:03 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:57.834 10:01:03 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:57.834 10:01:03 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:57.834 10:01:03 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:57.834 10:01:03 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:57.834 10:01:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:57.834 10:01:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:57.834 10:01:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:00.364 10:01:05 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:00.364 00:15:00.364 real 0m13.083s 00:15:00.364 user 0m29.709s 00:15:00.364 sys 0m3.020s 00:15:00.364 10:01:05 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:15:00.364 10:01:05 -- common/autotest_common.sh@10 -- # set +x 00:15:00.364 ************************************ 00:15:00.364 END TEST nvmf_delete_subsystem 00:15:00.364 ************************************ 00:15:00.364 10:01:05 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:15:00.364 10:01:05 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:15:00.364 10:01:05 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:15:00.364 10:01:05 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:15:00.364 10:01:05 -- common/autotest_common.sh@10 -- # set +x 00:15:00.364 ************************************ 00:15:00.364 START TEST nvmf_nvme_cli 00:15:00.364 ************************************ 00:15:00.364 10:01:05 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:15:00.364 * Looking for test storage... 00:15:00.364 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:00.364 10:01:05 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:00.364 10:01:05 -- nvmf/common.sh@7 -- # uname -s 00:15:00.364 10:01:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:00.364 10:01:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:00.364 10:01:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:00.364 10:01:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:00.364 10:01:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:00.364 10:01:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:00.364 10:01:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:00.364 10:01:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:00.364 10:01:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:00.364 10:01:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:00.364 10:01:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:00.364 10:01:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:00.364 10:01:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:00.364 10:01:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:00.364 10:01:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:00.364 10:01:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:00.364 10:01:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:00.364 10:01:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:00.364 10:01:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:00.364 10:01:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:00.364 10:01:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:00.364 10:01:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:00.364 10:01:05 -- paths/export.sh@5 -- # export PATH 00:15:00.364 10:01:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:00.364 10:01:05 -- nvmf/common.sh@46 -- # : 0 00:15:00.364 10:01:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:00.364 10:01:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:00.364 10:01:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:00.364 10:01:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:00.364 10:01:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:00.364 10:01:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:00.364 10:01:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:00.364 10:01:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:00.364 10:01:05 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:00.364 10:01:05 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:00.364 10:01:05 -- target/nvme_cli.sh@14 -- # devs=() 00:15:00.364 10:01:05 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:15:00.365 10:01:05 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:00.365 10:01:05 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:00.365 10:01:05 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:00.365 10:01:05 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:00.365 10:01:05 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:00.365 10:01:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:00.365 10:01:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:00.365 10:01:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:00.365 10:01:05 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:00.365 10:01:05 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:00.365 10:01:05 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:00.365 10:01:05 -- common/autotest_common.sh@10 -- # set +x 00:15:02.263 10:01:07 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:02.263 10:01:07 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:02.263 10:01:07 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:02.263 10:01:07 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:02.263 10:01:07 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:02.263 10:01:07 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:02.263 10:01:07 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:02.263 10:01:07 -- nvmf/common.sh@294 -- # net_devs=() 00:15:02.263 10:01:07 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:02.263 10:01:07 -- nvmf/common.sh@295 -- # e810=() 00:15:02.263 10:01:07 -- nvmf/common.sh@295 -- # local -ga e810 00:15:02.263 10:01:07 -- nvmf/common.sh@296 -- # x722=() 00:15:02.263 10:01:07 -- nvmf/common.sh@296 -- # local -ga x722 00:15:02.263 10:01:07 -- nvmf/common.sh@297 -- # mlx=() 00:15:02.263 10:01:07 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:02.263 10:01:07 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:02.263 10:01:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:02.263 10:01:07 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:02.263 10:01:07 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:02.263 10:01:07 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:02.263 10:01:07 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:02.263 10:01:07 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:02.263 10:01:07 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:02.263 10:01:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:02.263 10:01:07 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:02.263 10:01:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:02.264 10:01:07 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:02.264 10:01:07 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:02.264 10:01:07 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:02.264 10:01:07 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:02.264 10:01:07 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:02.264 10:01:07 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:02.264 10:01:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:02.264 10:01:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:02.264 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:02.264 10:01:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:02.264 10:01:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:02.264 10:01:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:02.264 10:01:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:02.264 10:01:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:02.264 10:01:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:02.264 10:01:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:02.264 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:02.264 10:01:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:02.264 10:01:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:02.264 10:01:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:02.264 10:01:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:02.264 10:01:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:02.264 10:01:07 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:02.264 10:01:07 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:02.264 10:01:07 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:02.264 10:01:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:02.264 10:01:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:02.264 10:01:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:02.264 10:01:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:02.264 10:01:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:02.264 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:02.264 10:01:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:02.264 10:01:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:02.264 10:01:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:02.264 10:01:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:02.264 10:01:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:02.264 10:01:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:02.264 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:02.264 10:01:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:02.264 10:01:07 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:02.264 10:01:07 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:02.264 10:01:07 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:02.264 10:01:07 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:02.264 10:01:07 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:02.264 10:01:07 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:02.264 10:01:07 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:02.264 10:01:07 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:02.264 10:01:07 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:02.264 10:01:07 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:02.264 10:01:07 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:02.264 10:01:07 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:02.264 10:01:07 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:02.264 10:01:07 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:02.264 10:01:07 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:02.264 10:01:07 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:02.264 10:01:07 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:02.264 10:01:07 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:02.264 10:01:07 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:02.264 10:01:07 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:02.264 10:01:07 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:02.264 10:01:07 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:02.264 10:01:07 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:02.264 10:01:07 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:02.264 10:01:07 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:02.264 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:02.264 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.175 ms 00:15:02.264 00:15:02.264 --- 10.0.0.2 ping statistics --- 00:15:02.264 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:02.264 rtt min/avg/max/mdev = 0.175/0.175/0.175/0.000 ms 00:15:02.264 10:01:07 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:02.264 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:02.264 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.061 ms 00:15:02.264 00:15:02.264 --- 10.0.0.1 ping statistics --- 00:15:02.264 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:02.264 rtt min/avg/max/mdev = 0.061/0.061/0.061/0.000 ms 00:15:02.264 10:01:07 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:02.264 10:01:07 -- nvmf/common.sh@410 -- # return 0 00:15:02.264 10:01:07 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:02.264 10:01:07 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:02.264 10:01:07 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:02.264 10:01:07 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:02.264 10:01:07 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:02.264 10:01:07 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:02.264 10:01:07 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:02.264 10:01:07 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:15:02.264 10:01:07 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:02.264 10:01:07 -- common/autotest_common.sh@712 -- # xtrace_disable 00:15:02.264 10:01:07 -- common/autotest_common.sh@10 -- # set +x 00:15:02.264 10:01:07 -- nvmf/common.sh@469 -- # nvmfpid=2783118 00:15:02.264 10:01:07 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:15:02.264 10:01:07 -- nvmf/common.sh@470 -- # waitforlisten 2783118 00:15:02.264 10:01:07 -- common/autotest_common.sh@819 -- # '[' -z 2783118 ']' 00:15:02.264 10:01:07 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:02.264 10:01:07 -- common/autotest_common.sh@824 -- # local max_retries=100 00:15:02.264 10:01:07 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:02.264 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:02.264 10:01:07 -- common/autotest_common.sh@828 -- # xtrace_disable 00:15:02.264 10:01:07 -- common/autotest_common.sh@10 -- # set +x 00:15:02.264 [2024-07-13 10:01:07.857367] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:15:02.264 [2024-07-13 10:01:07.857436] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:02.264 EAL: No free 2048 kB hugepages reported on node 1 00:15:02.264 [2024-07-13 10:01:07.938079] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:02.264 [2024-07-13 10:01:08.036782] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:02.264 [2024-07-13 10:01:08.037000] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:02.264 [2024-07-13 10:01:08.037049] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:02.264 [2024-07-13 10:01:08.037076] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:02.264 [2024-07-13 10:01:08.037147] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:02.264 [2024-07-13 10:01:08.037221] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:02.264 [2024-07-13 10:01:08.037295] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:02.264 [2024-07-13 10:01:08.037286] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:02.522 10:01:08 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:15:02.522 10:01:08 -- common/autotest_common.sh@852 -- # return 0 00:15:02.522 10:01:08 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:02.522 10:01:08 -- common/autotest_common.sh@718 -- # xtrace_disable 00:15:02.522 10:01:08 -- common/autotest_common.sh@10 -- # set +x 00:15:02.522 10:01:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:02.522 10:01:08 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:02.522 10:01:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:02.522 10:01:08 -- common/autotest_common.sh@10 -- # set +x 00:15:02.522 [2024-07-13 10:01:08.214310] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:02.522 10:01:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:02.522 10:01:08 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:02.522 10:01:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:02.522 10:01:08 -- common/autotest_common.sh@10 -- # set +x 00:15:02.522 Malloc0 00:15:02.522 10:01:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:02.522 10:01:08 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:15:02.522 10:01:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:02.522 10:01:08 -- common/autotest_common.sh@10 -- # set +x 00:15:02.522 Malloc1 00:15:02.522 10:01:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:02.522 10:01:08 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:15:02.522 10:01:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:02.522 10:01:08 -- common/autotest_common.sh@10 -- # set +x 00:15:02.522 10:01:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:02.522 10:01:08 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:02.522 10:01:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:02.522 10:01:08 -- common/autotest_common.sh@10 -- # set +x 00:15:02.522 10:01:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:02.522 10:01:08 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:15:02.522 10:01:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:02.522 10:01:08 -- common/autotest_common.sh@10 -- # set +x 00:15:02.522 10:01:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:02.522 10:01:08 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:02.522 10:01:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:02.522 10:01:08 -- common/autotest_common.sh@10 -- # set +x 00:15:02.522 [2024-07-13 10:01:08.299834] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:02.522 10:01:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:02.522 10:01:08 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:02.522 10:01:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:02.522 10:01:08 -- common/autotest_common.sh@10 -- # set +x 00:15:02.522 10:01:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:02.522 10:01:08 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:15:02.780 00:15:02.780 Discovery Log Number of Records 2, Generation counter 2 00:15:02.780 =====Discovery Log Entry 0====== 00:15:02.780 trtype: tcp 00:15:02.780 adrfam: ipv4 00:15:02.780 subtype: current discovery subsystem 00:15:02.780 treq: not required 00:15:02.780 portid: 0 00:15:02.780 trsvcid: 4420 00:15:02.780 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:15:02.780 traddr: 10.0.0.2 00:15:02.780 eflags: explicit discovery connections, duplicate discovery information 00:15:02.780 sectype: none 00:15:02.780 =====Discovery Log Entry 1====== 00:15:02.780 trtype: tcp 00:15:02.780 adrfam: ipv4 00:15:02.780 subtype: nvme subsystem 00:15:02.780 treq: not required 00:15:02.780 portid: 0 00:15:02.780 trsvcid: 4420 00:15:02.780 subnqn: nqn.2016-06.io.spdk:cnode1 00:15:02.780 traddr: 10.0.0.2 00:15:02.780 eflags: none 00:15:02.780 sectype: none 00:15:02.780 10:01:08 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:15:02.780 10:01:08 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:15:02.780 10:01:08 -- nvmf/common.sh@510 -- # local dev _ 00:15:02.780 10:01:08 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:02.780 10:01:08 -- nvmf/common.sh@509 -- # nvme list 00:15:02.780 10:01:08 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:02.780 10:01:08 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:02.780 10:01:08 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:02.780 10:01:08 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:02.780 10:01:08 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:15:02.780 10:01:08 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:15:03.344 10:01:09 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:15:03.344 10:01:09 -- common/autotest_common.sh@1177 -- # local i=0 00:15:03.344 10:01:09 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:15:03.344 10:01:09 -- common/autotest_common.sh@1179 -- # [[ -n 2 ]] 00:15:03.344 10:01:09 -- common/autotest_common.sh@1180 -- # nvme_device_counter=2 00:15:03.344 10:01:09 -- common/autotest_common.sh@1184 -- # sleep 2 00:15:05.866 10:01:11 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:15:05.866 10:01:11 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:15:05.866 10:01:11 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:15:05.866 10:01:11 -- common/autotest_common.sh@1186 -- # nvme_devices=2 00:15:05.866 10:01:11 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:15:05.866 10:01:11 -- common/autotest_common.sh@1187 -- # return 0 00:15:05.866 10:01:11 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:15:05.866 10:01:11 -- nvmf/common.sh@510 -- # local dev _ 00:15:05.866 10:01:11 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:05.866 10:01:11 -- nvmf/common.sh@509 -- # nvme list 00:15:05.866 10:01:11 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:05.866 10:01:11 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:05.866 10:01:11 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:05.866 10:01:11 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:05.866 10:01:11 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:15:05.866 10:01:11 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:15:05.866 10:01:11 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:05.866 10:01:11 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:15:05.866 10:01:11 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:15:05.866 10:01:11 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:05.866 10:01:11 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n2 00:15:05.866 /dev/nvme0n1 ]] 00:15:05.866 10:01:11 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:15:05.866 10:01:11 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:15:05.866 10:01:11 -- nvmf/common.sh@510 -- # local dev _ 00:15:05.866 10:01:11 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:05.866 10:01:11 -- nvmf/common.sh@509 -- # nvme list 00:15:05.866 10:01:11 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:05.866 10:01:11 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:05.866 10:01:11 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:05.866 10:01:11 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:05.866 10:01:11 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:15:05.866 10:01:11 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:15:05.866 10:01:11 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:05.866 10:01:11 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:15:05.866 10:01:11 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:15:05.866 10:01:11 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:05.866 10:01:11 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:15:05.866 10:01:11 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:15:05.866 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:15:05.866 10:01:11 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:15:05.866 10:01:11 -- common/autotest_common.sh@1198 -- # local i=0 00:15:05.866 10:01:11 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:15:05.866 10:01:11 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:05.866 10:01:11 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:15:05.866 10:01:11 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:05.866 10:01:11 -- common/autotest_common.sh@1210 -- # return 0 00:15:05.866 10:01:11 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:15:05.866 10:01:11 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:05.866 10:01:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:05.866 10:01:11 -- common/autotest_common.sh@10 -- # set +x 00:15:05.866 10:01:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:05.866 10:01:11 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:15:06.124 10:01:11 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:15:06.124 10:01:11 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:06.124 10:01:11 -- nvmf/common.sh@116 -- # sync 00:15:06.124 10:01:11 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:06.124 10:01:11 -- nvmf/common.sh@119 -- # set +e 00:15:06.124 10:01:11 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:06.124 10:01:11 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:06.124 rmmod nvme_tcp 00:15:06.124 rmmod nvme_fabrics 00:15:06.124 rmmod nvme_keyring 00:15:06.124 10:01:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:06.124 10:01:11 -- nvmf/common.sh@123 -- # set -e 00:15:06.124 10:01:11 -- nvmf/common.sh@124 -- # return 0 00:15:06.124 10:01:11 -- nvmf/common.sh@477 -- # '[' -n 2783118 ']' 00:15:06.124 10:01:11 -- nvmf/common.sh@478 -- # killprocess 2783118 00:15:06.124 10:01:11 -- common/autotest_common.sh@926 -- # '[' -z 2783118 ']' 00:15:06.124 10:01:11 -- common/autotest_common.sh@930 -- # kill -0 2783118 00:15:06.124 10:01:11 -- common/autotest_common.sh@931 -- # uname 00:15:06.124 10:01:11 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:15:06.124 10:01:11 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2783118 00:15:06.124 10:01:11 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:15:06.124 10:01:11 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:15:06.124 10:01:11 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2783118' 00:15:06.124 killing process with pid 2783118 00:15:06.124 10:01:11 -- common/autotest_common.sh@945 -- # kill 2783118 00:15:06.124 10:01:11 -- common/autotest_common.sh@950 -- # wait 2783118 00:15:06.382 10:01:12 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:06.382 10:01:12 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:06.382 10:01:12 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:06.382 10:01:12 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:06.382 10:01:12 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:06.382 10:01:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:06.382 10:01:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:06.382 10:01:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:08.280 10:01:14 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:08.281 00:15:08.281 real 0m8.373s 00:15:08.281 user 0m16.294s 00:15:08.281 sys 0m2.236s 00:15:08.281 10:01:14 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:15:08.281 10:01:14 -- common/autotest_common.sh@10 -- # set +x 00:15:08.281 ************************************ 00:15:08.281 END TEST nvmf_nvme_cli 00:15:08.281 ************************************ 00:15:08.281 10:01:14 -- nvmf/nvmf.sh@39 -- # [[ 1 -eq 1 ]] 00:15:08.281 10:01:14 -- nvmf/nvmf.sh@40 -- # run_test nvmf_vfio_user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:15:08.281 10:01:14 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:15:08.281 10:01:14 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:15:08.281 10:01:14 -- common/autotest_common.sh@10 -- # set +x 00:15:08.281 ************************************ 00:15:08.281 START TEST nvmf_vfio_user 00:15:08.281 ************************************ 00:15:08.281 10:01:14 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:15:08.537 * Looking for test storage... 00:15:08.537 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:08.537 10:01:14 -- target/nvmf_vfio_user.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:08.537 10:01:14 -- nvmf/common.sh@7 -- # uname -s 00:15:08.537 10:01:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:08.537 10:01:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:08.537 10:01:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:08.537 10:01:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:08.537 10:01:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:08.537 10:01:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:08.537 10:01:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:08.537 10:01:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:08.537 10:01:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:08.537 10:01:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:08.537 10:01:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:08.537 10:01:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:08.537 10:01:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:08.537 10:01:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:08.537 10:01:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:08.537 10:01:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:08.537 10:01:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:08.537 10:01:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:08.537 10:01:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:08.537 10:01:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:08.537 10:01:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:08.537 10:01:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:08.537 10:01:14 -- paths/export.sh@5 -- # export PATH 00:15:08.537 10:01:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:08.537 10:01:14 -- nvmf/common.sh@46 -- # : 0 00:15:08.537 10:01:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:08.537 10:01:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:08.537 10:01:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:08.537 10:01:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:08.537 10:01:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:08.537 10:01:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:08.537 10:01:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:08.537 10:01:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:08.537 10:01:14 -- target/nvmf_vfio_user.sh@12 -- # MALLOC_BDEV_SIZE=64 00:15:08.537 10:01:14 -- target/nvmf_vfio_user.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:15:08.537 10:01:14 -- target/nvmf_vfio_user.sh@14 -- # NUM_DEVICES=2 00:15:08.537 10:01:14 -- target/nvmf_vfio_user.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:08.537 10:01:14 -- target/nvmf_vfio_user.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:15:08.537 10:01:14 -- target/nvmf_vfio_user.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:15:08.537 10:01:14 -- target/nvmf_vfio_user.sh@47 -- # rm -rf /var/run/vfio-user 00:15:08.537 10:01:14 -- target/nvmf_vfio_user.sh@103 -- # setup_nvmf_vfio_user '' '' 00:15:08.537 10:01:14 -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args= 00:15:08.537 10:01:14 -- target/nvmf_vfio_user.sh@52 -- # local transport_args= 00:15:08.537 10:01:14 -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=2784066 00:15:08.537 10:01:14 -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' 00:15:08.537 10:01:14 -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 2784066' 00:15:08.537 Process pid: 2784066 00:15:08.537 10:01:14 -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:15:08.537 10:01:14 -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 2784066 00:15:08.537 10:01:14 -- common/autotest_common.sh@819 -- # '[' -z 2784066 ']' 00:15:08.537 10:01:14 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:08.537 10:01:14 -- common/autotest_common.sh@824 -- # local max_retries=100 00:15:08.537 10:01:14 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:08.537 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:08.537 10:01:14 -- common/autotest_common.sh@828 -- # xtrace_disable 00:15:08.537 10:01:14 -- common/autotest_common.sh@10 -- # set +x 00:15:08.537 [2024-07-13 10:01:14.198006] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:15:08.537 [2024-07-13 10:01:14.198102] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:08.537 EAL: No free 2048 kB hugepages reported on node 1 00:15:08.537 [2024-07-13 10:01:14.255654] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:08.537 [2024-07-13 10:01:14.339647] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:08.537 [2024-07-13 10:01:14.339804] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:08.537 [2024-07-13 10:01:14.339821] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:08.537 [2024-07-13 10:01:14.339833] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:08.537 [2024-07-13 10:01:14.339903] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:08.537 [2024-07-13 10:01:14.339961] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:08.537 [2024-07-13 10:01:14.339963] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:08.537 [2024-07-13 10:01:14.339931] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:09.468 10:01:15 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:15:09.468 10:01:15 -- common/autotest_common.sh@852 -- # return 0 00:15:09.468 10:01:15 -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:15:10.397 10:01:16 -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER 00:15:10.654 10:01:16 -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:15:10.654 10:01:16 -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:15:10.654 10:01:16 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:10.654 10:01:16 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:15:10.654 10:01:16 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:15:10.912 Malloc1 00:15:10.912 10:01:16 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:15:11.170 10:01:16 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:15:11.428 10:01:17 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:15:11.685 10:01:17 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:11.685 10:01:17 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:15:11.685 10:01:17 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:15:11.941 Malloc2 00:15:11.941 10:01:17 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:15:12.198 10:01:17 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:15:12.455 10:01:18 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:15:12.713 10:01:18 -- target/nvmf_vfio_user.sh@104 -- # run_nvmf_vfio_user 00:15:12.713 10:01:18 -- target/nvmf_vfio_user.sh@80 -- # seq 1 2 00:15:12.713 10:01:18 -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:12.713 10:01:18 -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user1/1 00:15:12.713 10:01:18 -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode1 00:15:12.713 10:01:18 -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -L nvme -L nvme_vfio -L vfio_pci 00:15:12.713 [2024-07-13 10:01:18.376341] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:15:12.713 [2024-07-13 10:01:18.376384] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2784507 ] 00:15:12.713 EAL: No free 2048 kB hugepages reported on node 1 00:15:12.713 [2024-07-13 10:01:18.410196] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user1/1 00:15:12.713 [2024-07-13 10:01:18.418261] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:12.713 [2024-07-13 10:01:18.418289] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7f7e11117000 00:15:12.713 [2024-07-13 10:01:18.419256] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:12.713 [2024-07-13 10:01:18.420251] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:12.714 [2024-07-13 10:01:18.421256] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:12.714 [2024-07-13 10:01:18.422267] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:12.714 [2024-07-13 10:01:18.423270] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:12.714 [2024-07-13 10:01:18.424277] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:12.714 [2024-07-13 10:01:18.425283] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:12.714 [2024-07-13 10:01:18.426287] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:12.714 [2024-07-13 10:01:18.427296] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:12.714 [2024-07-13 10:01:18.427318] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7f7e0fecd000 00:15:12.714 [2024-07-13 10:01:18.428514] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:12.714 [2024-07-13 10:01:18.444542] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user1/1/cntrl Setup Successfully 00:15:12.714 [2024-07-13 10:01:18.444580] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to connect adminq (no timeout) 00:15:12.714 [2024-07-13 10:01:18.449419] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:15:12.714 [2024-07-13 10:01:18.449471] nvme_pcie_common.c: 132:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:15:12.714 [2024-07-13 10:01:18.449578] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for connect adminq (no timeout) 00:15:12.714 [2024-07-13 10:01:18.449611] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs (no timeout) 00:15:12.714 [2024-07-13 10:01:18.449621] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs wait for vs (no timeout) 00:15:12.714 [2024-07-13 10:01:18.450414] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x8, value 0x10300 00:15:12.714 [2024-07-13 10:01:18.450434] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap (no timeout) 00:15:12.714 [2024-07-13 10:01:18.450446] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap wait for cap (no timeout) 00:15:12.714 [2024-07-13 10:01:18.451416] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:15:12.714 [2024-07-13 10:01:18.451435] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en (no timeout) 00:15:12.714 [2024-07-13 10:01:18.451449] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en wait for cc (timeout 15000 ms) 00:15:12.714 [2024-07-13 10:01:18.452420] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x0 00:15:12.714 [2024-07-13 10:01:18.452438] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:15:12.714 [2024-07-13 10:01:18.453424] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x0 00:15:12.714 [2024-07-13 10:01:18.453445] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 0 && CSTS.RDY = 0 00:15:12.714 [2024-07-13 10:01:18.453454] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to controller is disabled (timeout 15000 ms) 00:15:12.714 [2024-07-13 10:01:18.453465] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:15:12.714 [2024-07-13 10:01:18.453574] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Setting CC.EN = 1 00:15:12.714 [2024-07-13 10:01:18.453583] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:15:12.714 [2024-07-13 10:01:18.453591] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x28, value 0x2000003c0000 00:15:12.714 [2024-07-13 10:01:18.454439] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x30, value 0x2000003be000 00:15:12.714 [2024-07-13 10:01:18.455439] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x24, value 0xff00ff 00:15:12.714 [2024-07-13 10:01:18.456447] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:15:12.714 [2024-07-13 10:01:18.457484] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:15:12.714 [2024-07-13 10:01:18.458461] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x1 00:15:12.714 [2024-07-13 10:01:18.458484] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:15:12.714 [2024-07-13 10:01:18.458493] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to reset admin queue (timeout 30000 ms) 00:15:12.714 [2024-07-13 10:01:18.458517] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller (no timeout) 00:15:12.714 [2024-07-13 10:01:18.458536] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify controller (timeout 30000 ms) 00:15:12.714 [2024-07-13 10:01:18.458560] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:12.714 [2024-07-13 10:01:18.458569] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:12.714 [2024-07-13 10:01:18.458604] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:12.714 [2024-07-13 10:01:18.458679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:15:12.714 [2024-07-13 10:01:18.458697] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_xfer_size 131072 00:15:12.714 [2024-07-13 10:01:18.458705] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] MDTS max_xfer_size 131072 00:15:12.714 [2024-07-13 10:01:18.458712] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CNTLID 0x0001 00:15:12.714 [2024-07-13 10:01:18.458720] nvme_ctrlr.c:1990:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:15:12.714 [2024-07-13 10:01:18.458729] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_sges 1 00:15:12.714 [2024-07-13 10:01:18.458737] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] fuses compare and write: 1 00:15:12.714 [2024-07-13 10:01:18.458744] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to configure AER (timeout 30000 ms) 00:15:12.714 [2024-07-13 10:01:18.458762] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for configure aer (timeout 30000 ms) 00:15:12.714 [2024-07-13 10:01:18.458778] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:15:12.714 [2024-07-13 10:01:18.458798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:15:12.714 [2024-07-13 10:01:18.458818] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:15:12.714 [2024-07-13 10:01:18.458832] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:15:12.714 [2024-07-13 10:01:18.458843] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:15:12.714 [2024-07-13 10:01:18.458855] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:15:12.714 [2024-07-13 10:01:18.458863] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set keep alive timeout (timeout 30000 ms) 00:15:12.714 [2024-07-13 10:01:18.458905] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:15:12.714 [2024-07-13 10:01:18.458932] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:15:12.714 [2024-07-13 10:01:18.458948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:15:12.714 [2024-07-13 10:01:18.458959] nvme_ctrlr.c:2878:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Controller adjusted keep alive timeout to 0 ms 00:15:12.714 [2024-07-13 10:01:18.458969] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller iocs specific (timeout 30000 ms) 00:15:12.714 [2024-07-13 10:01:18.458979] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set number of queues (timeout 30000 ms) 00:15:12.715 [2024-07-13 10:01:18.458996] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set number of queues (timeout 30000 ms) 00:15:12.715 [2024-07-13 10:01:18.459011] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:12.715 [2024-07-13 10:01:18.459026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:15:12.715 [2024-07-13 10:01:18.459088] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify active ns (timeout 30000 ms) 00:15:12.715 [2024-07-13 10:01:18.459102] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify active ns (timeout 30000 ms) 00:15:12.715 [2024-07-13 10:01:18.459116] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:15:12.715 [2024-07-13 10:01:18.459124] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:15:12.715 [2024-07-13 10:01:18.459134] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:15:12.715 [2024-07-13 10:01:18.459153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:15:12.715 [2024-07-13 10:01:18.459186] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Namespace 1 was added 00:15:12.715 [2024-07-13 10:01:18.459219] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns (timeout 30000 ms) 00:15:12.715 [2024-07-13 10:01:18.459245] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify ns (timeout 30000 ms) 00:15:12.715 [2024-07-13 10:01:18.459258] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:12.715 [2024-07-13 10:01:18.459266] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:12.715 [2024-07-13 10:01:18.459276] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:12.715 [2024-07-13 10:01:18.459298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:15:12.715 [2024-07-13 10:01:18.459319] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:15:12.715 [2024-07-13 10:01:18.459333] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:15:12.715 [2024-07-13 10:01:18.459344] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:12.715 [2024-07-13 10:01:18.459352] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:12.715 [2024-07-13 10:01:18.459361] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:12.715 [2024-07-13 10:01:18.459372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:15:12.715 [2024-07-13 10:01:18.459390] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns iocs specific (timeout 30000 ms) 00:15:12.715 [2024-07-13 10:01:18.459401] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported log pages (timeout 30000 ms) 00:15:12.715 [2024-07-13 10:01:18.459416] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported features (timeout 30000 ms) 00:15:12.715 [2024-07-13 10:01:18.459425] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set doorbell buffer config (timeout 30000 ms) 00:15:12.715 [2024-07-13 10:01:18.459433] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set host ID (timeout 30000 ms) 00:15:12.715 [2024-07-13 10:01:18.459442] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] NVMe-oF transport - not sending Set Features - Host ID 00:15:12.715 [2024-07-13 10:01:18.459450] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to transport ready (timeout 30000 ms) 00:15:12.715 [2024-07-13 10:01:18.459458] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to ready (no timeout) 00:15:12.715 [2024-07-13 10:01:18.459485] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:15:12.715 [2024-07-13 10:01:18.459503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:15:12.715 [2024-07-13 10:01:18.459521] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:15:12.715 [2024-07-13 10:01:18.459532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:15:12.715 [2024-07-13 10:01:18.459574] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:15:12.715 [2024-07-13 10:01:18.459586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:15:12.715 [2024-07-13 10:01:18.459602] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:12.715 [2024-07-13 10:01:18.459613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:15:12.715 [2024-07-13 10:01:18.459632] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:15:12.715 [2024-07-13 10:01:18.459641] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:15:12.715 [2024-07-13 10:01:18.459647] nvme_pcie_common.c:1235:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:15:12.715 [2024-07-13 10:01:18.459653] nvme_pcie_common.c:1251:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:15:12.715 [2024-07-13 10:01:18.459662] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:15:12.715 [2024-07-13 10:01:18.459673] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:15:12.715 [2024-07-13 10:01:18.459681] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:15:12.715 [2024-07-13 10:01:18.459690] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:15:12.715 [2024-07-13 10:01:18.459700] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:15:12.715 [2024-07-13 10:01:18.459708] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:12.715 [2024-07-13 10:01:18.459720] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:12.715 [2024-07-13 10:01:18.459732] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:15:12.715 [2024-07-13 10:01:18.459740] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:15:12.715 [2024-07-13 10:01:18.459748] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:15:12.715 [2024-07-13 10:01:18.459760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:15:12.715 [2024-07-13 10:01:18.459781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:15:12.715 [2024-07-13 10:01:18.459796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:15:12.715 [2024-07-13 10:01:18.459807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:15:12.715 ===================================================== 00:15:12.715 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:12.715 ===================================================== 00:15:12.715 Controller Capabilities/Features 00:15:12.715 ================================ 00:15:12.715 Vendor ID: 4e58 00:15:12.715 Subsystem Vendor ID: 4e58 00:15:12.715 Serial Number: SPDK1 00:15:12.715 Model Number: SPDK bdev Controller 00:15:12.715 Firmware Version: 24.01.1 00:15:12.715 Recommended Arb Burst: 6 00:15:12.715 IEEE OUI Identifier: 8d 6b 50 00:15:12.715 Multi-path I/O 00:15:12.715 May have multiple subsystem ports: Yes 00:15:12.715 May have multiple controllers: Yes 00:15:12.715 Associated with SR-IOV VF: No 00:15:12.715 Max Data Transfer Size: 131072 00:15:12.715 Max Number of Namespaces: 32 00:15:12.715 Max Number of I/O Queues: 127 00:15:12.715 NVMe Specification Version (VS): 1.3 00:15:12.715 NVMe Specification Version (Identify): 1.3 00:15:12.715 Maximum Queue Entries: 256 00:15:12.715 Contiguous Queues Required: Yes 00:15:12.715 Arbitration Mechanisms Supported 00:15:12.715 Weighted Round Robin: Not Supported 00:15:12.715 Vendor Specific: Not Supported 00:15:12.715 Reset Timeout: 15000 ms 00:15:12.715 Doorbell Stride: 4 bytes 00:15:12.716 NVM Subsystem Reset: Not Supported 00:15:12.716 Command Sets Supported 00:15:12.716 NVM Command Set: Supported 00:15:12.716 Boot Partition: Not Supported 00:15:12.716 Memory Page Size Minimum: 4096 bytes 00:15:12.716 Memory Page Size Maximum: 4096 bytes 00:15:12.716 Persistent Memory Region: Not Supported 00:15:12.716 Optional Asynchronous Events Supported 00:15:12.716 Namespace Attribute Notices: Supported 00:15:12.716 Firmware Activation Notices: Not Supported 00:15:12.716 ANA Change Notices: Not Supported 00:15:12.716 PLE Aggregate Log Change Notices: Not Supported 00:15:12.716 LBA Status Info Alert Notices: Not Supported 00:15:12.716 EGE Aggregate Log Change Notices: Not Supported 00:15:12.716 Normal NVM Subsystem Shutdown event: Not Supported 00:15:12.716 Zone Descriptor Change Notices: Not Supported 00:15:12.716 Discovery Log Change Notices: Not Supported 00:15:12.716 Controller Attributes 00:15:12.716 128-bit Host Identifier: Supported 00:15:12.716 Non-Operational Permissive Mode: Not Supported 00:15:12.716 NVM Sets: Not Supported 00:15:12.716 Read Recovery Levels: Not Supported 00:15:12.716 Endurance Groups: Not Supported 00:15:12.716 Predictable Latency Mode: Not Supported 00:15:12.716 Traffic Based Keep ALive: Not Supported 00:15:12.716 Namespace Granularity: Not Supported 00:15:12.716 SQ Associations: Not Supported 00:15:12.716 UUID List: Not Supported 00:15:12.716 Multi-Domain Subsystem: Not Supported 00:15:12.716 Fixed Capacity Management: Not Supported 00:15:12.716 Variable Capacity Management: Not Supported 00:15:12.716 Delete Endurance Group: Not Supported 00:15:12.716 Delete NVM Set: Not Supported 00:15:12.716 Extended LBA Formats Supported: Not Supported 00:15:12.716 Flexible Data Placement Supported: Not Supported 00:15:12.716 00:15:12.716 Controller Memory Buffer Support 00:15:12.716 ================================ 00:15:12.716 Supported: No 00:15:12.716 00:15:12.716 Persistent Memory Region Support 00:15:12.716 ================================ 00:15:12.716 Supported: No 00:15:12.716 00:15:12.716 Admin Command Set Attributes 00:15:12.716 ============================ 00:15:12.716 Security Send/Receive: Not Supported 00:15:12.716 Format NVM: Not Supported 00:15:12.716 Firmware Activate/Download: Not Supported 00:15:12.716 Namespace Management: Not Supported 00:15:12.716 Device Self-Test: Not Supported 00:15:12.716 Directives: Not Supported 00:15:12.716 NVMe-MI: Not Supported 00:15:12.716 Virtualization Management: Not Supported 00:15:12.716 Doorbell Buffer Config: Not Supported 00:15:12.716 Get LBA Status Capability: Not Supported 00:15:12.716 Command & Feature Lockdown Capability: Not Supported 00:15:12.716 Abort Command Limit: 4 00:15:12.716 Async Event Request Limit: 4 00:15:12.716 Number of Firmware Slots: N/A 00:15:12.716 Firmware Slot 1 Read-Only: N/A 00:15:12.716 Firmware Activation Without Reset: N/A 00:15:12.716 Multiple Update Detection Support: N/A 00:15:12.716 Firmware Update Granularity: No Information Provided 00:15:12.716 Per-Namespace SMART Log: No 00:15:12.716 Asymmetric Namespace Access Log Page: Not Supported 00:15:12.716 Subsystem NQN: nqn.2019-07.io.spdk:cnode1 00:15:12.716 Command Effects Log Page: Supported 00:15:12.716 Get Log Page Extended Data: Supported 00:15:12.716 Telemetry Log Pages: Not Supported 00:15:12.716 Persistent Event Log Pages: Not Supported 00:15:12.716 Supported Log Pages Log Page: May Support 00:15:12.716 Commands Supported & Effects Log Page: Not Supported 00:15:12.716 Feature Identifiers & Effects Log Page:May Support 00:15:12.716 NVMe-MI Commands & Effects Log Page: May Support 00:15:12.716 Data Area 4 for Telemetry Log: Not Supported 00:15:12.716 Error Log Page Entries Supported: 128 00:15:12.716 Keep Alive: Supported 00:15:12.716 Keep Alive Granularity: 10000 ms 00:15:12.716 00:15:12.716 NVM Command Set Attributes 00:15:12.716 ========================== 00:15:12.716 Submission Queue Entry Size 00:15:12.716 Max: 64 00:15:12.716 Min: 64 00:15:12.716 Completion Queue Entry Size 00:15:12.716 Max: 16 00:15:12.716 Min: 16 00:15:12.716 Number of Namespaces: 32 00:15:12.716 Compare Command: Supported 00:15:12.716 Write Uncorrectable Command: Not Supported 00:15:12.716 Dataset Management Command: Supported 00:15:12.716 Write Zeroes Command: Supported 00:15:12.716 Set Features Save Field: Not Supported 00:15:12.716 Reservations: Not Supported 00:15:12.716 Timestamp: Not Supported 00:15:12.716 Copy: Supported 00:15:12.716 Volatile Write Cache: Present 00:15:12.716 Atomic Write Unit (Normal): 1 00:15:12.716 Atomic Write Unit (PFail): 1 00:15:12.716 Atomic Compare & Write Unit: 1 00:15:12.716 Fused Compare & Write: Supported 00:15:12.716 Scatter-Gather List 00:15:12.716 SGL Command Set: Supported (Dword aligned) 00:15:12.716 SGL Keyed: Not Supported 00:15:12.716 SGL Bit Bucket Descriptor: Not Supported 00:15:12.716 SGL Metadata Pointer: Not Supported 00:15:12.716 Oversized SGL: Not Supported 00:15:12.716 SGL Metadata Address: Not Supported 00:15:12.716 SGL Offset: Not Supported 00:15:12.716 Transport SGL Data Block: Not Supported 00:15:12.716 Replay Protected Memory Block: Not Supported 00:15:12.716 00:15:12.716 Firmware Slot Information 00:15:12.716 ========================= 00:15:12.716 Active slot: 1 00:15:12.716 Slot 1 Firmware Revision: 24.01.1 00:15:12.716 00:15:12.716 00:15:12.716 Commands Supported and Effects 00:15:12.716 ============================== 00:15:12.716 Admin Commands 00:15:12.716 -------------- 00:15:12.716 Get Log Page (02h): Supported 00:15:12.716 Identify (06h): Supported 00:15:12.716 Abort (08h): Supported 00:15:12.716 Set Features (09h): Supported 00:15:12.716 Get Features (0Ah): Supported 00:15:12.716 Asynchronous Event Request (0Ch): Supported 00:15:12.716 Keep Alive (18h): Supported 00:15:12.716 I/O Commands 00:15:12.716 ------------ 00:15:12.716 Flush (00h): Supported LBA-Change 00:15:12.716 Write (01h): Supported LBA-Change 00:15:12.716 Read (02h): Supported 00:15:12.716 Compare (05h): Supported 00:15:12.717 Write Zeroes (08h): Supported LBA-Change 00:15:12.717 Dataset Management (09h): Supported LBA-Change 00:15:12.717 Copy (19h): Supported LBA-Change 00:15:12.717 Unknown (79h): Supported LBA-Change 00:15:12.717 Unknown (7Ah): Supported 00:15:12.717 00:15:12.717 Error Log 00:15:12.717 ========= 00:15:12.717 00:15:12.717 Arbitration 00:15:12.717 =========== 00:15:12.717 Arbitration Burst: 1 00:15:12.717 00:15:12.717 Power Management 00:15:12.717 ================ 00:15:12.717 Number of Power States: 1 00:15:12.717 Current Power State: Power State #0 00:15:12.717 Power State #0: 00:15:12.717 Max Power: 0.00 W 00:15:12.717 Non-Operational State: Operational 00:15:12.717 Entry Latency: Not Reported 00:15:12.717 Exit Latency: Not Reported 00:15:12.717 Relative Read Throughput: 0 00:15:12.717 Relative Read Latency: 0 00:15:12.717 Relative Write Throughput: 0 00:15:12.717 Relative Write Latency: 0 00:15:12.717 Idle Power: Not Reported 00:15:12.717 Active Power: Not Reported 00:15:12.717 Non-Operational Permissive Mode: Not Supported 00:15:12.717 00:15:12.717 Health Information 00:15:12.717 ================== 00:15:12.717 Critical Warnings: 00:15:12.717 Available Spare Space: OK 00:15:12.717 Temperature: OK 00:15:12.717 Device Reliability: OK 00:15:12.717 Read Only: No 00:15:12.717 Volatile Memory Backup: OK 00:15:12.717 Current Temperature: 0 Kelvin[2024-07-13 10:01:18.459987] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:15:12.717 [2024-07-13 10:01:18.460003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:15:12.717 [2024-07-13 10:01:18.460042] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Prepare to destruct SSD 00:15:12.717 [2024-07-13 10:01:18.460060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:12.717 [2024-07-13 10:01:18.460071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:12.717 [2024-07-13 10:01:18.460080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:12.717 [2024-07-13 10:01:18.460090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:12.717 [2024-07-13 10:01:18.463878] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:15:12.717 [2024-07-13 10:01:18.463913] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x464001 00:15:12.717 [2024-07-13 10:01:18.464535] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] RTD3E = 0 us 00:15:12.717 [2024-07-13 10:01:18.464549] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown timeout = 10000 ms 00:15:12.717 [2024-07-13 10:01:18.465500] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x9 00:15:12.717 [2024-07-13 10:01:18.465525] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown complete in 0 milliseconds 00:15:12.717 [2024-07-13 10:01:18.465580] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user1/1/cntrl 00:15:12.717 [2024-07-13 10:01:18.467542] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:12.717 (-273 Celsius) 00:15:12.717 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:15:12.717 Available Spare: 0% 00:15:12.717 Available Spare Threshold: 0% 00:15:12.717 Life Percentage Used: 0% 00:15:12.717 Data Units Read: 0 00:15:12.717 Data Units Written: 0 00:15:12.717 Host Read Commands: 0 00:15:12.717 Host Write Commands: 0 00:15:12.717 Controller Busy Time: 0 minutes 00:15:12.717 Power Cycles: 0 00:15:12.717 Power On Hours: 0 hours 00:15:12.717 Unsafe Shutdowns: 0 00:15:12.717 Unrecoverable Media Errors: 0 00:15:12.717 Lifetime Error Log Entries: 0 00:15:12.717 Warning Temperature Time: 0 minutes 00:15:12.717 Critical Temperature Time: 0 minutes 00:15:12.717 00:15:12.717 Number of Queues 00:15:12.717 ================ 00:15:12.717 Number of I/O Submission Queues: 127 00:15:12.717 Number of I/O Completion Queues: 127 00:15:12.717 00:15:12.717 Active Namespaces 00:15:12.717 ================= 00:15:12.717 Namespace ID:1 00:15:12.717 Error Recovery Timeout: Unlimited 00:15:12.717 Command Set Identifier: NVM (00h) 00:15:12.717 Deallocate: Supported 00:15:12.717 Deallocated/Unwritten Error: Not Supported 00:15:12.717 Deallocated Read Value: Unknown 00:15:12.717 Deallocate in Write Zeroes: Not Supported 00:15:12.717 Deallocated Guard Field: 0xFFFF 00:15:12.717 Flush: Supported 00:15:12.717 Reservation: Supported 00:15:12.717 Namespace Sharing Capabilities: Multiple Controllers 00:15:12.717 Size (in LBAs): 131072 (0GiB) 00:15:12.717 Capacity (in LBAs): 131072 (0GiB) 00:15:12.717 Utilization (in LBAs): 131072 (0GiB) 00:15:12.717 NGUID: 1797673242D74484BBFC63F3AA9FDA3D 00:15:12.717 UUID: 17976732-42d7-4484-bbfc-63f3aa9fda3d 00:15:12.717 Thin Provisioning: Not Supported 00:15:12.717 Per-NS Atomic Units: Yes 00:15:12.717 Atomic Boundary Size (Normal): 0 00:15:12.717 Atomic Boundary Size (PFail): 0 00:15:12.717 Atomic Boundary Offset: 0 00:15:12.717 Maximum Single Source Range Length: 65535 00:15:12.717 Maximum Copy Length: 65535 00:15:12.717 Maximum Source Range Count: 1 00:15:12.717 NGUID/EUI64 Never Reused: No 00:15:12.717 Namespace Write Protected: No 00:15:12.717 Number of LBA Formats: 1 00:15:12.717 Current LBA Format: LBA Format #00 00:15:12.717 LBA Format #00: Data Size: 512 Metadata Size: 0 00:15:12.717 00:15:12.717 10:01:18 -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:15:12.978 EAL: No free 2048 kB hugepages reported on node 1 00:15:18.336 Initializing NVMe Controllers 00:15:18.336 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:18.336 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:15:18.336 Initialization complete. Launching workers. 00:15:18.336 ======================================================== 00:15:18.336 Latency(us) 00:15:18.336 Device Information : IOPS MiB/s Average min max 00:15:18.336 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 36878.65 144.06 3470.80 1129.09 7306.48 00:15:18.336 ======================================================== 00:15:18.336 Total : 36878.65 144.06 3470.80 1129.09 7306.48 00:15:18.336 00:15:18.336 10:01:23 -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:15:18.336 EAL: No free 2048 kB hugepages reported on node 1 00:15:23.587 Initializing NVMe Controllers 00:15:23.587 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:23.587 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:15:23.587 Initialization complete. Launching workers. 00:15:23.587 ======================================================== 00:15:23.587 Latency(us) 00:15:23.587 Device Information : IOPS MiB/s Average min max 00:15:23.587 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 16006.42 62.53 8002.01 5988.36 15975.26 00:15:23.587 ======================================================== 00:15:23.587 Total : 16006.42 62.53 8002.01 5988.36 15975.26 00:15:23.587 00:15:23.587 10:01:29 -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:15:23.587 EAL: No free 2048 kB hugepages reported on node 1 00:15:28.846 Initializing NVMe Controllers 00:15:28.846 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:28.846 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:28.846 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 1 00:15:28.846 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 2 00:15:28.846 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 3 00:15:28.846 Initialization complete. Launching workers. 00:15:28.846 Starting thread on core 2 00:15:28.846 Starting thread on core 3 00:15:28.846 Starting thread on core 1 00:15:28.846 10:01:34 -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -d 256 -g 00:15:28.846 EAL: No free 2048 kB hugepages reported on node 1 00:15:32.127 Initializing NVMe Controllers 00:15:32.127 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:32.127 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:32.127 Associating SPDK bdev Controller (SPDK1 ) with lcore 0 00:15:32.127 Associating SPDK bdev Controller (SPDK1 ) with lcore 1 00:15:32.127 Associating SPDK bdev Controller (SPDK1 ) with lcore 2 00:15:32.127 Associating SPDK bdev Controller (SPDK1 ) with lcore 3 00:15:32.127 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:15:32.127 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:15:32.127 Initialization complete. Launching workers. 00:15:32.127 Starting thread on core 1 with urgent priority queue 00:15:32.127 Starting thread on core 2 with urgent priority queue 00:15:32.127 Starting thread on core 3 with urgent priority queue 00:15:32.127 Starting thread on core 0 with urgent priority queue 00:15:32.127 SPDK bdev Controller (SPDK1 ) core 0: 4903.67 IO/s 20.39 secs/100000 ios 00:15:32.127 SPDK bdev Controller (SPDK1 ) core 1: 4548.33 IO/s 21.99 secs/100000 ios 00:15:32.127 SPDK bdev Controller (SPDK1 ) core 2: 5420.33 IO/s 18.45 secs/100000 ios 00:15:32.127 SPDK bdev Controller (SPDK1 ) core 3: 4956.67 IO/s 20.17 secs/100000 ios 00:15:32.127 ======================================================== 00:15:32.127 00:15:32.127 10:01:37 -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:15:32.127 EAL: No free 2048 kB hugepages reported on node 1 00:15:32.384 Initializing NVMe Controllers 00:15:32.384 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:32.384 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:32.384 Namespace ID: 1 size: 0GB 00:15:32.384 Initialization complete. 00:15:32.384 INFO: using host memory buffer for IO 00:15:32.384 Hello world! 00:15:32.384 10:01:38 -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:15:32.384 EAL: No free 2048 kB hugepages reported on node 1 00:15:33.753 Initializing NVMe Controllers 00:15:33.753 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:33.753 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:33.753 Initialization complete. Launching workers. 00:15:33.753 submit (in ns) avg, min, max = 6711.9, 3450.0, 4015185.6 00:15:33.753 complete (in ns) avg, min, max = 25843.2, 2037.8, 4998338.9 00:15:33.753 00:15:33.753 Submit histogram 00:15:33.753 ================ 00:15:33.753 Range in us Cumulative Count 00:15:33.753 3.437 - 3.461: 0.0937% ( 13) 00:15:33.753 3.461 - 3.484: 0.9012% ( 112) 00:15:33.753 3.484 - 3.508: 2.9342% ( 282) 00:15:33.753 3.508 - 3.532: 6.4739% ( 491) 00:15:33.753 3.532 - 3.556: 14.7862% ( 1153) 00:15:33.753 3.556 - 3.579: 23.7474% ( 1243) 00:15:33.753 3.579 - 3.603: 33.1195% ( 1300) 00:15:33.753 3.603 - 3.627: 41.4534% ( 1156) 00:15:33.753 3.627 - 3.650: 49.5206% ( 1119) 00:15:33.753 3.650 - 3.674: 54.9780% ( 757) 00:15:33.753 3.674 - 3.698: 59.1594% ( 580) 00:15:33.753 3.698 - 3.721: 62.9803% ( 530) 00:15:33.753 3.721 - 3.745: 65.8352% ( 396) 00:15:33.753 3.745 - 3.769: 69.0217% ( 442) 00:15:33.753 3.769 - 3.793: 72.8354% ( 529) 00:15:33.753 3.793 - 3.816: 76.6996% ( 536) 00:15:33.753 3.816 - 3.840: 80.4700% ( 523) 00:15:33.753 3.840 - 3.864: 83.8584% ( 470) 00:15:33.753 3.864 - 3.887: 86.2086% ( 326) 00:15:33.753 3.887 - 3.911: 88.1551% ( 270) 00:15:33.753 3.911 - 3.935: 89.7484% ( 221) 00:15:33.753 3.935 - 3.959: 90.8586% ( 154) 00:15:33.753 3.959 - 3.982: 91.9400% ( 150) 00:15:33.753 3.982 - 4.006: 92.8700% ( 129) 00:15:33.753 4.006 - 4.030: 93.6126% ( 103) 00:15:33.753 4.030 - 4.053: 94.3263% ( 99) 00:15:33.753 4.053 - 4.077: 94.9895% ( 92) 00:15:33.753 4.077 - 4.101: 95.4870% ( 69) 00:15:33.753 4.101 - 4.124: 95.8330% ( 48) 00:15:33.753 4.124 - 4.148: 96.0349% ( 28) 00:15:33.753 4.148 - 4.172: 96.2728% ( 33) 00:15:33.753 4.172 - 4.196: 96.4963% ( 31) 00:15:33.753 4.196 - 4.219: 96.6188% ( 17) 00:15:33.753 4.219 - 4.243: 96.7126% ( 13) 00:15:33.753 4.243 - 4.267: 96.8207% ( 15) 00:15:33.753 4.267 - 4.290: 96.8928% ( 10) 00:15:33.753 4.290 - 4.314: 96.9721% ( 11) 00:15:33.753 4.314 - 4.338: 97.0226% ( 7) 00:15:33.753 4.338 - 4.361: 97.0658% ( 6) 00:15:33.753 4.361 - 4.385: 97.1235% ( 8) 00:15:33.753 4.385 - 4.409: 97.1379% ( 2) 00:15:33.753 4.409 - 4.433: 97.1740% ( 5) 00:15:33.753 4.433 - 4.456: 97.2028% ( 4) 00:15:33.753 4.456 - 4.480: 97.2244% ( 3) 00:15:33.753 4.480 - 4.504: 97.2461% ( 3) 00:15:33.753 4.504 - 4.527: 97.2605% ( 2) 00:15:33.753 4.527 - 4.551: 97.2677% ( 1) 00:15:33.753 4.551 - 4.575: 97.2965% ( 4) 00:15:33.753 4.575 - 4.599: 97.3326% ( 5) 00:15:33.753 4.599 - 4.622: 97.3974% ( 9) 00:15:33.753 4.622 - 4.646: 97.4335% ( 5) 00:15:33.753 4.646 - 4.670: 97.4695% ( 5) 00:15:33.753 4.670 - 4.693: 97.4912% ( 3) 00:15:33.753 4.693 - 4.717: 97.5200% ( 4) 00:15:33.753 4.717 - 4.741: 97.5921% ( 10) 00:15:33.753 4.741 - 4.764: 97.6354% ( 6) 00:15:33.753 4.764 - 4.788: 97.6714% ( 5) 00:15:33.753 4.788 - 4.812: 97.7074% ( 5) 00:15:33.753 4.812 - 4.836: 97.7507% ( 6) 00:15:33.753 4.836 - 4.859: 97.7940% ( 6) 00:15:33.753 4.859 - 4.883: 97.8084% ( 2) 00:15:33.753 4.883 - 4.907: 97.8444% ( 5) 00:15:33.753 4.907 - 4.930: 97.8733% ( 4) 00:15:33.753 4.930 - 4.954: 97.9165% ( 6) 00:15:33.753 4.954 - 4.978: 97.9309% ( 2) 00:15:33.753 4.978 - 5.001: 97.9526% ( 3) 00:15:33.753 5.001 - 5.025: 97.9670% ( 2) 00:15:33.753 5.025 - 5.049: 97.9958% ( 4) 00:15:33.753 5.049 - 5.073: 98.0247% ( 4) 00:15:33.753 5.073 - 5.096: 98.0463% ( 3) 00:15:33.753 5.096 - 5.120: 98.0607% ( 2) 00:15:33.754 5.120 - 5.144: 98.0751% ( 2) 00:15:33.754 5.144 - 5.167: 98.1040% ( 4) 00:15:33.754 5.191 - 5.215: 98.1112% ( 1) 00:15:33.754 5.215 - 5.239: 98.1328% ( 3) 00:15:33.754 5.310 - 5.333: 98.1400% ( 1) 00:15:33.754 5.333 - 5.357: 98.1472% ( 1) 00:15:33.754 5.428 - 5.452: 98.1544% ( 1) 00:15:33.754 5.452 - 5.476: 98.1761% ( 3) 00:15:33.754 5.499 - 5.523: 98.1833% ( 1) 00:15:33.754 5.594 - 5.618: 98.1905% ( 1) 00:15:33.754 5.689 - 5.713: 98.2121% ( 3) 00:15:33.754 5.760 - 5.784: 98.2193% ( 1) 00:15:33.754 5.855 - 5.879: 98.2265% ( 1) 00:15:33.754 5.902 - 5.926: 98.2409% ( 2) 00:15:33.754 6.021 - 6.044: 98.2481% ( 1) 00:15:33.754 6.116 - 6.163: 98.2554% ( 1) 00:15:33.754 6.210 - 6.258: 98.2626% ( 1) 00:15:33.754 6.258 - 6.305: 98.2770% ( 2) 00:15:33.754 6.542 - 6.590: 98.2914% ( 2) 00:15:33.754 6.637 - 6.684: 98.2986% ( 1) 00:15:33.754 6.684 - 6.732: 98.3058% ( 1) 00:15:33.754 6.827 - 6.874: 98.3130% ( 1) 00:15:33.754 6.874 - 6.921: 98.3202% ( 1) 00:15:33.754 6.921 - 6.969: 98.3419% ( 3) 00:15:33.754 6.969 - 7.016: 98.3491% ( 1) 00:15:33.754 7.016 - 7.064: 98.3563% ( 1) 00:15:33.754 7.064 - 7.111: 98.3707% ( 2) 00:15:33.754 7.206 - 7.253: 98.3779% ( 1) 00:15:33.754 7.253 - 7.301: 98.3851% ( 1) 00:15:33.754 7.443 - 7.490: 98.3923% ( 1) 00:15:33.754 7.538 - 7.585: 98.3995% ( 1) 00:15:33.754 7.633 - 7.680: 98.4140% ( 2) 00:15:33.754 7.680 - 7.727: 98.4428% ( 4) 00:15:33.754 7.727 - 7.775: 98.4500% ( 1) 00:15:33.754 7.775 - 7.822: 98.4572% ( 1) 00:15:33.754 7.822 - 7.870: 98.4644% ( 1) 00:15:33.754 7.917 - 7.964: 98.4861% ( 3) 00:15:33.754 7.964 - 8.012: 98.4933% ( 1) 00:15:33.754 8.012 - 8.059: 98.5005% ( 1) 00:15:33.754 8.059 - 8.107: 98.5077% ( 1) 00:15:33.754 8.107 - 8.154: 98.5149% ( 1) 00:15:33.754 8.249 - 8.296: 98.5221% ( 1) 00:15:33.754 8.296 - 8.344: 98.5293% ( 1) 00:15:33.754 8.391 - 8.439: 98.5365% ( 1) 00:15:33.754 8.439 - 8.486: 98.5581% ( 3) 00:15:33.754 8.486 - 8.533: 98.5654% ( 1) 00:15:33.754 8.533 - 8.581: 98.5726% ( 1) 00:15:33.754 8.676 - 8.723: 98.5870% ( 2) 00:15:33.754 8.818 - 8.865: 98.5942% ( 1) 00:15:33.754 8.865 - 8.913: 98.6014% ( 1) 00:15:33.754 9.055 - 9.102: 98.6158% ( 2) 00:15:33.754 9.150 - 9.197: 98.6230% ( 1) 00:15:33.754 9.197 - 9.244: 98.6302% ( 1) 00:15:33.754 9.339 - 9.387: 98.6374% ( 1) 00:15:33.754 9.387 - 9.434: 98.6447% ( 1) 00:15:33.754 9.766 - 9.813: 98.6591% ( 2) 00:15:33.754 10.240 - 10.287: 98.6663% ( 1) 00:15:33.754 10.335 - 10.382: 98.6807% ( 2) 00:15:33.754 10.619 - 10.667: 98.6951% ( 2) 00:15:33.754 10.809 - 10.856: 98.7023% ( 1) 00:15:33.754 10.904 - 10.951: 98.7095% ( 1) 00:15:33.754 11.236 - 11.283: 98.7167% ( 1) 00:15:33.754 11.378 - 11.425: 98.7240% ( 1) 00:15:33.754 11.425 - 11.473: 98.7312% ( 1) 00:15:33.754 11.473 - 11.520: 98.7384% ( 1) 00:15:33.754 11.520 - 11.567: 98.7456% ( 1) 00:15:33.754 11.615 - 11.662: 98.7528% ( 1) 00:15:33.754 11.662 - 11.710: 98.7672% ( 2) 00:15:33.754 11.804 - 11.852: 98.7816% ( 2) 00:15:33.754 11.899 - 11.947: 98.7888% ( 1) 00:15:33.754 12.041 - 12.089: 98.7960% ( 1) 00:15:33.754 12.089 - 12.136: 98.8033% ( 1) 00:15:33.754 12.231 - 12.326: 98.8105% ( 1) 00:15:33.754 12.326 - 12.421: 98.8249% ( 2) 00:15:33.754 12.421 - 12.516: 98.8321% ( 1) 00:15:33.754 12.610 - 12.705: 98.8393% ( 1) 00:15:33.754 12.800 - 12.895: 98.8465% ( 1) 00:15:33.754 12.895 - 12.990: 98.8537% ( 1) 00:15:33.754 13.084 - 13.179: 98.8681% ( 2) 00:15:33.754 13.748 - 13.843: 98.8754% ( 1) 00:15:33.754 13.938 - 14.033: 98.8970% ( 3) 00:15:33.754 14.033 - 14.127: 98.9042% ( 1) 00:15:33.754 14.127 - 14.222: 98.9114% ( 1) 00:15:33.754 14.601 - 14.696: 98.9258% ( 2) 00:15:33.754 14.886 - 14.981: 98.9330% ( 1) 00:15:33.754 14.981 - 15.076: 98.9402% ( 1) 00:15:33.754 15.076 - 15.170: 98.9474% ( 1) 00:15:33.754 15.550 - 15.644: 98.9547% ( 1) 00:15:33.754 17.161 - 17.256: 98.9979% ( 6) 00:15:33.754 17.256 - 17.351: 99.0195% ( 3) 00:15:33.754 17.351 - 17.446: 99.0412% ( 3) 00:15:33.754 17.446 - 17.541: 99.0700% ( 4) 00:15:33.754 17.541 - 17.636: 99.0988% ( 4) 00:15:33.754 17.636 - 17.730: 99.1349% ( 5) 00:15:33.754 17.730 - 17.825: 99.1565% ( 3) 00:15:33.754 17.825 - 17.920: 99.1854% ( 4) 00:15:33.754 17.920 - 18.015: 99.2142% ( 4) 00:15:33.754 18.015 - 18.110: 99.2574% ( 6) 00:15:33.754 18.110 - 18.204: 99.3440% ( 12) 00:15:33.754 18.204 - 18.299: 99.4233% ( 11) 00:15:33.754 18.299 - 18.394: 99.4665% ( 6) 00:15:33.754 18.394 - 18.489: 99.5026% ( 5) 00:15:33.754 18.489 - 18.584: 99.5747% ( 10) 00:15:33.754 18.584 - 18.679: 99.6107% ( 5) 00:15:33.754 18.679 - 18.773: 99.6756% ( 9) 00:15:33.754 18.773 - 18.868: 99.6828% ( 1) 00:15:33.754 18.868 - 18.963: 99.7044% ( 3) 00:15:33.754 18.963 - 19.058: 99.7260% ( 3) 00:15:33.754 19.058 - 19.153: 99.7333% ( 1) 00:15:33.754 19.153 - 19.247: 99.7405% ( 1) 00:15:33.754 19.247 - 19.342: 99.7621% ( 3) 00:15:33.754 19.342 - 19.437: 99.7909% ( 4) 00:15:33.754 19.437 - 19.532: 99.8053% ( 2) 00:15:33.754 19.532 - 19.627: 99.8126% ( 1) 00:15:33.754 19.721 - 19.816: 99.8270% ( 2) 00:15:33.754 20.006 - 20.101: 99.8342% ( 1) 00:15:33.754 20.196 - 20.290: 99.8414% ( 1) 00:15:33.754 21.239 - 21.333: 99.8558% ( 2) 00:15:33.754 21.807 - 21.902: 99.8630% ( 1) 00:15:33.754 21.997 - 22.092: 99.8702% ( 1) 00:15:33.754 22.281 - 22.376: 99.8774% ( 1) 00:15:33.754 22.566 - 22.661: 99.8847% ( 1) 00:15:33.754 24.273 - 24.462: 99.8919% ( 1) 00:15:33.754 25.790 - 25.979: 99.8991% ( 1) 00:15:33.754 25.979 - 26.169: 99.9063% ( 1) 00:15:33.754 26.927 - 27.117: 99.9135% ( 1) 00:15:33.754 28.065 - 28.255: 99.9207% ( 1) 00:15:33.754 32.237 - 32.427: 99.9279% ( 1) 00:15:33.754 3009.801 - 3021.938: 99.9351% ( 1) 00:15:33.754 3980.705 - 4004.978: 99.9784% ( 6) 00:15:33.754 4004.978 - 4029.250: 100.0000% ( 3) 00:15:33.754 00:15:33.754 Complete histogram 00:15:33.754 ================== 00:15:33.754 Range in us Cumulative Count 00:15:33.754 2.027 - 2.039: 0.0144% ( 2) 00:15:33.754 2.039 - 2.050: 5.3132% ( 735) 00:15:33.754 2.050 - 2.062: 16.3723% ( 1534) 00:15:33.754 2.062 - 2.074: 19.6381% ( 453) 00:15:33.754 2.074 - 2.086: 41.4029% ( 3019) 00:15:33.754 2.086 - 2.098: 59.6064% ( 2525) 00:15:33.754 2.098 - 2.110: 62.8073% ( 444) 00:15:33.754 2.110 - 2.121: 66.4408% ( 504) 00:15:33.754 2.121 - 2.133: 68.5675% ( 295) 00:15:33.754 2.133 - 2.145: 70.4924% ( 267) 00:15:33.754 2.145 - 2.157: 78.5163% ( 1113) 00:15:33.754 2.157 - 2.169: 82.3373% ( 530) 00:15:33.754 2.169 - 2.181: 83.7575% ( 197) 00:15:33.754 2.181 - 2.193: 85.9131% ( 299) 00:15:33.754 2.193 - 2.204: 86.9296% ( 141) 00:15:33.754 2.204 - 2.216: 88.5589% ( 226) 00:15:33.754 2.216 - 2.228: 92.3509% ( 526) 00:15:33.754 2.228 - 2.240: 93.7856% ( 199) 00:15:33.754 2.240 - 2.252: 94.3768% ( 82) 00:15:33.754 2.252 - 2.264: 94.7949% ( 58) 00:15:33.754 2.264 - 2.276: 94.9463% ( 21) 00:15:33.754 2.276 - 2.287: 95.3284% ( 53) 00:15:33.754 2.287 - 2.299: 95.6168% ( 40) 00:15:33.754 2.299 - 2.311: 95.7177% ( 14) 00:15:33.754 2.311 - 2.323: 95.8402% ( 17) 00:15:33.754 2.323 - 2.335: 96.0277% ( 26) 00:15:33.754 2.335 - 2.347: 96.2007% ( 24) 00:15:33.754 2.347 - 2.359: 96.5612% ( 50) 00:15:33.754 2.359 - 2.370: 96.9937% ( 60) 00:15:33.754 2.370 - 2.382: 97.2316% ( 33) 00:15:33.754 2.382 - 2.394: 97.4191% ( 26) 00:15:33.754 2.394 - 2.406: 97.5561% ( 19) 00:15:33.754 2.406 - 2.418: 97.6930% ( 19) 00:15:33.754 2.418 - 2.430: 97.7795% ( 12) 00:15:33.754 2.430 - 2.441: 97.9742% ( 27) 00:15:33.754 2.441 - 2.453: 98.0174% ( 6) 00:15:33.754 2.453 - 2.465: 98.1112% ( 13) 00:15:33.754 2.465 - 2.477: 98.1761% ( 9) 00:15:33.754 2.477 - 2.489: 98.2121% ( 5) 00:15:33.754 2.489 - 2.501: 98.2193% ( 1) 00:15:33.754 2.501 - 2.513: 98.2409% ( 3) 00:15:33.754 2.513 - 2.524: 98.2626% ( 3) 00:15:33.754 2.536 - 2.548: 98.2698% ( 1) 00:15:33.754 2.548 - 2.560: 98.2770% ( 1) 00:15:33.754 2.572 - 2.584: 98.2842% ( 1) 00:15:33.754 2.584 - 2.596: 98.2914% ( 1) 00:15:33.754 2.596 - 2.607: 98.3058% ( 2) 00:15:33.754 2.631 - 2.643: 98.3130% ( 1) 00:15:33.754 2.643 - 2.655: 98.3202% ( 1) 00:15:33.754 2.667 - 2.679: 98.3347% ( 2) 00:15:33.754 2.679 - 2.690: 98.3563% ( 3) 00:15:33.754 2.714 - 2.726: 98.3707% ( 2) 00:15:33.754 2.726 - 2.738: 98.3779% ( 1) 00:15:33.754 2.738 - 2.750: 98.3851% ( 1) 00:15:33.754 2.833 - 2.844: 98.3923% ( 1) 00:15:33.754 2.880 - 2.892: 98.3995% ( 1) 00:15:33.754 2.892 - 2.904: 98.4067% ( 1) 00:15:33.754 2.951 - 2.963: 98.4140% ( 1) 00:15:33.754 2.963 - 2.975: 98.4212% ( 1) 00:15:33.754 2.975 - 2.987: 98.4284% ( 1) 00:15:33.754 2.999 - 3.010: 98.4356% ( 1) 00:15:33.754 3.034 - 3.058: 98.4572% ( 3) 00:15:33.754 3.058 - 3.081: 98.4644% ( 1) 00:15:33.754 3.105 - 3.129: 98.4861% ( 3) 00:15:33.754 3.129 - 3.153: 98.5005% ( 2) 00:15:33.754 3.153 - 3.176: 98.5077% ( 1) 00:15:33.754 3.176 - 3.200: 98.5221% ( 2) 00:15:33.754 3.224 - 3.247: 98.5293% ( 1) 00:15:33.754 3.271 - 3.295: 98.5365% ( 1) 00:15:33.754 3.295 - 3.319: 98.5509% ( 2) 00:15:33.754 3.319 - 3.342: 98.5654% ( 2) 00:15:33.754 3.342 - 3.366: 98.5726% ( 1) 00:15:33.754 3.366 - 3.390: 98.5870% ( 2) 00:15:33.754 3.390 - 3.413: 98.6014% ( 2) 00:15:33.754 3.413 - 3.437: 98.6158% ( 2) 00:15:33.754 3.437 - 3.461: 98.6230% ( 1) 00:15:33.754 3.461 - 3.484: 98.6302% ( 1) 00:15:33.754 3.508 - 3.532: 98.6374% ( 1) 00:15:33.754 3.532 - 3.556: 98.6519% ( 2) 00:15:33.754 3.579 - 3.603: 98.6591% ( 1) 00:15:33.754 3.603 - 3.627: 98.6735% ( 2) 00:15:33.754 3.627 - 3.650: 98.6879% ( 2) 00:15:33.754 3.721 - 3.745: 98.7095% ( 3) 00:15:33.754 3.793 - 3.816: 98.7167% ( 1) 00:15:33.754 4.124 - 4.148: 98.7240% ( 1) 00:15:33.754 5.025 - 5.049: 98.7312% ( 1) 00:15:33.754 5.144 - 5.167: 98.7384% ( 1) 00:15:33.754 5.167 - 5.191: 98.7456% ( 1) 00:15:33.754 5.239 - 5.262: 98.7528% ( 1) 00:15:33.754 5.381 - 5.404: 98.7600% ( 1) 00:15:33.754 5.476 - 5.499: 98.7672% ( 1) 00:15:33.754 5.499 - 5.523: 98.7744% ( 1) 00:15:33.754 5.523 - 5.547: 98.7816% ( 1) 00:15:33.754 5.547 - 5.570: 98.7888% ( 1) 00:15:33.754 5.570 - 5.594: 98.7960% ( 1) 00:15:33.754 5.594 - 5.618: 98.8033% ( 1) 00:15:33.754 5.618 - 5.641: 98.8105% ( 1) 00:15:33.754 5.784 - 5.807: 98.8177% ( 1) 00:15:33.754 5.950 - 5.973: 98.8321% ( 2) 00:15:33.754 5.973 - 5.997: 98.8393% ( 1) 00:15:33.754 6.068 - 6.116: 98.8465% ( 1) 00:15:33.754 6.116 - 6.163: 98.8609% ( 2) 00:15:33.754 6.163 - 6.210: 98.8754% ( 2) 00:15:33.754 6.258 - 6.305: 98.8826% ( 1) 00:15:33.754 6.353 - 6.400: 98.8898% ( 1) 00:15:33.754 6.590 - 6.637: 98.8970% ( 1) 00:15:33.755 6.684 - 6.732: 98.9042% ( 1) 00:15:33.755 7.633 - 7.680: 98.9114% ( 1) 00:15:33.755 15.550 - 15.644: 98.9186% ( 1) 00:15:33.755 15.644 - 15.739: 98.9474% ( 4) 00:15:33.755 15.739 - 15.834: 98.9547% ( 1) 00:15:33.755 15.834 - 15.929: 98.9691% ( 2) 00:15:33.755 15.929 - 16.024: 98.9835% ( 2) 00:15:33.755 16.024 - 16.119: 99.0051% ( 3) 00:15:33.755 16.119 - 16.213: 99.0195% ( 2) 00:15:33.755 16.213 - 16.308: 99.0556% ( 5) 00:15:33.755 16.308 - 16.403: 99.0844% ( 4) 00:15:33.755 16.403 - 16.498: 99.1277% ( 6) 00:15:33.755 16.498 - 16.593: 99.1854% ( 8) 00:15:33.755 16.593 - 16.687: 99.2214% ( 5) 00:15:33.755 16.687 - 16.782: 99.2574% ( 5) 00:15:33.755 16.782 - 16.877: 99.2863% ( 4) 00:15:33.755 16.877 - 16.972: 99.3223% ( 5) 00:15:33.755 17.067 - 17.161: 99.3440% ( 3) 00:15:33.755 17.161 - 17.256: 99.3512% ( 1) 00:15:33.755 17.256 - 17.351: 99.3584% ( 1) 00:15:33.755 17.351 - 17.446: 99.3656% ( 1) 00:15:33.755 17.446 - 17.541: 99.3728% ( 1) 00:15:33.755 17.541 - 17.636: 99.3800% ( 1) 00:15:33.755 17.636 - 17.730: 99.3872% ( 1) 00:15:33.755 17.825 - 17.920: 99.3944% ( 1) 00:15:33.755 20.954 - 21.049: 99.4016% ( 1) 00:15:33.755 22.661 - 22.756: 99.4088% ( 1) 00:15:33.755 3021.938 - 3034.074: 99.4160% ( 1) 00:15:33.755 3094.756 - 3106.892: 99.4233% ( 1) 00:15:33.755 3713.707 - 3737.979: 99.4305% ( 1) 00:15:33.755 3980.705 - 4004.978: 99.8414% ( 57) 00:15:33.755 4004.978 - 4029.250: 99.9712% ( 18) 00:15:33.755 4029.250 - 4053.523: 99.9856% ( 2) 00:15:33.755 4975.881 - 5000.154: 100.0000% ( 2) 00:15:33.755 00:15:33.755 10:01:39 -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user1/1 nqn.2019-07.io.spdk:cnode1 1 00:15:33.755 10:01:39 -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user1/1 00:15:33.755 10:01:39 -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode1 00:15:33.755 10:01:39 -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc3 00:15:33.755 10:01:39 -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:34.011 [2024-07-13 10:01:39.716170] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:15:34.011 [ 00:15:34.011 { 00:15:34.011 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:34.011 "subtype": "Discovery", 00:15:34.011 "listen_addresses": [], 00:15:34.011 "allow_any_host": true, 00:15:34.011 "hosts": [] 00:15:34.011 }, 00:15:34.011 { 00:15:34.011 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:34.011 "subtype": "NVMe", 00:15:34.011 "listen_addresses": [ 00:15:34.011 { 00:15:34.011 "transport": "VFIOUSER", 00:15:34.011 "trtype": "VFIOUSER", 00:15:34.011 "adrfam": "IPv4", 00:15:34.011 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:34.011 "trsvcid": "0" 00:15:34.011 } 00:15:34.011 ], 00:15:34.011 "allow_any_host": true, 00:15:34.011 "hosts": [], 00:15:34.011 "serial_number": "SPDK1", 00:15:34.011 "model_number": "SPDK bdev Controller", 00:15:34.011 "max_namespaces": 32, 00:15:34.011 "min_cntlid": 1, 00:15:34.011 "max_cntlid": 65519, 00:15:34.011 "namespaces": [ 00:15:34.011 { 00:15:34.011 "nsid": 1, 00:15:34.011 "bdev_name": "Malloc1", 00:15:34.011 "name": "Malloc1", 00:15:34.011 "nguid": "1797673242D74484BBFC63F3AA9FDA3D", 00:15:34.011 "uuid": "17976732-42d7-4484-bbfc-63f3aa9fda3d" 00:15:34.011 } 00:15:34.011 ] 00:15:34.011 }, 00:15:34.011 { 00:15:34.011 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:34.011 "subtype": "NVMe", 00:15:34.011 "listen_addresses": [ 00:15:34.011 { 00:15:34.011 "transport": "VFIOUSER", 00:15:34.011 "trtype": "VFIOUSER", 00:15:34.011 "adrfam": "IPv4", 00:15:34.011 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:34.011 "trsvcid": "0" 00:15:34.011 } 00:15:34.011 ], 00:15:34.011 "allow_any_host": true, 00:15:34.011 "hosts": [], 00:15:34.011 "serial_number": "SPDK2", 00:15:34.011 "model_number": "SPDK bdev Controller", 00:15:34.011 "max_namespaces": 32, 00:15:34.011 "min_cntlid": 1, 00:15:34.011 "max_cntlid": 65519, 00:15:34.011 "namespaces": [ 00:15:34.011 { 00:15:34.011 "nsid": 1, 00:15:34.011 "bdev_name": "Malloc2", 00:15:34.011 "name": "Malloc2", 00:15:34.011 "nguid": "8C581C381B2C42CE826F5B1956643DDD", 00:15:34.011 "uuid": "8c581c38-1b2c-42ce-826f-5b1956643ddd" 00:15:34.011 } 00:15:34.011 ] 00:15:34.011 } 00:15:34.011 ] 00:15:34.011 10:01:39 -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:15:34.011 10:01:39 -- target/nvmf_vfio_user.sh@34 -- # aerpid=2787105 00:15:34.011 10:01:39 -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -n 2 -g -t /tmp/aer_touch_file 00:15:34.011 10:01:39 -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:15:34.011 10:01:39 -- common/autotest_common.sh@1244 -- # local i=0 00:15:34.011 10:01:39 -- common/autotest_common.sh@1245 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:34.011 10:01:39 -- common/autotest_common.sh@1251 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:34.011 10:01:39 -- common/autotest_common.sh@1255 -- # return 0 00:15:34.011 10:01:39 -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:15:34.011 10:01:39 -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc3 00:15:34.011 EAL: No free 2048 kB hugepages reported on node 1 00:15:34.270 Malloc3 00:15:34.270 10:01:40 -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc3 -n 2 00:15:34.528 10:01:40 -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:34.528 Asynchronous Event Request test 00:15:34.528 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:34.528 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:34.528 Registering asynchronous event callbacks... 00:15:34.528 Starting namespace attribute notice tests for all controllers... 00:15:34.528 /var/run/vfio-user/domain/vfio-user1/1: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:15:34.528 aer_cb - Changed Namespace 00:15:34.528 Cleaning up... 00:15:34.784 [ 00:15:34.785 { 00:15:34.785 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:34.785 "subtype": "Discovery", 00:15:34.785 "listen_addresses": [], 00:15:34.785 "allow_any_host": true, 00:15:34.785 "hosts": [] 00:15:34.785 }, 00:15:34.785 { 00:15:34.785 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:34.785 "subtype": "NVMe", 00:15:34.785 "listen_addresses": [ 00:15:34.785 { 00:15:34.785 "transport": "VFIOUSER", 00:15:34.785 "trtype": "VFIOUSER", 00:15:34.785 "adrfam": "IPv4", 00:15:34.785 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:34.785 "trsvcid": "0" 00:15:34.785 } 00:15:34.785 ], 00:15:34.785 "allow_any_host": true, 00:15:34.785 "hosts": [], 00:15:34.785 "serial_number": "SPDK1", 00:15:34.785 "model_number": "SPDK bdev Controller", 00:15:34.785 "max_namespaces": 32, 00:15:34.785 "min_cntlid": 1, 00:15:34.785 "max_cntlid": 65519, 00:15:34.785 "namespaces": [ 00:15:34.785 { 00:15:34.785 "nsid": 1, 00:15:34.785 "bdev_name": "Malloc1", 00:15:34.785 "name": "Malloc1", 00:15:34.785 "nguid": "1797673242D74484BBFC63F3AA9FDA3D", 00:15:34.785 "uuid": "17976732-42d7-4484-bbfc-63f3aa9fda3d" 00:15:34.785 }, 00:15:34.785 { 00:15:34.785 "nsid": 2, 00:15:34.785 "bdev_name": "Malloc3", 00:15:34.785 "name": "Malloc3", 00:15:34.785 "nguid": "5FCD1A128480423185839102EFCBCDED", 00:15:34.785 "uuid": "5fcd1a12-8480-4231-8583-9102efcbcded" 00:15:34.785 } 00:15:34.785 ] 00:15:34.785 }, 00:15:34.785 { 00:15:34.785 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:34.785 "subtype": "NVMe", 00:15:34.785 "listen_addresses": [ 00:15:34.785 { 00:15:34.785 "transport": "VFIOUSER", 00:15:34.785 "trtype": "VFIOUSER", 00:15:34.785 "adrfam": "IPv4", 00:15:34.785 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:34.785 "trsvcid": "0" 00:15:34.785 } 00:15:34.785 ], 00:15:34.785 "allow_any_host": true, 00:15:34.785 "hosts": [], 00:15:34.785 "serial_number": "SPDK2", 00:15:34.785 "model_number": "SPDK bdev Controller", 00:15:34.785 "max_namespaces": 32, 00:15:34.785 "min_cntlid": 1, 00:15:34.785 "max_cntlid": 65519, 00:15:34.785 "namespaces": [ 00:15:34.785 { 00:15:34.785 "nsid": 1, 00:15:34.785 "bdev_name": "Malloc2", 00:15:34.785 "name": "Malloc2", 00:15:34.785 "nguid": "8C581C381B2C42CE826F5B1956643DDD", 00:15:34.785 "uuid": "8c581c38-1b2c-42ce-826f-5b1956643ddd" 00:15:34.785 } 00:15:34.785 ] 00:15:34.785 } 00:15:34.785 ] 00:15:34.785 10:01:40 -- target/nvmf_vfio_user.sh@44 -- # wait 2787105 00:15:34.785 10:01:40 -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:34.785 10:01:40 -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user2/2 00:15:34.785 10:01:40 -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode2 00:15:34.785 10:01:40 -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -L nvme -L nvme_vfio -L vfio_pci 00:15:34.785 [2024-07-13 10:01:40.498663] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:15:34.785 [2024-07-13 10:01:40.498699] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2787245 ] 00:15:34.785 EAL: No free 2048 kB hugepages reported on node 1 00:15:34.785 [2024-07-13 10:01:40.530890] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user2/2 00:15:34.785 [2024-07-13 10:01:40.539170] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:34.785 [2024-07-13 10:01:40.539214] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7f816a934000 00:15:34.785 [2024-07-13 10:01:40.540178] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:34.785 [2024-07-13 10:01:40.541179] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:34.785 [2024-07-13 10:01:40.542184] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:34.785 [2024-07-13 10:01:40.543196] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:34.785 [2024-07-13 10:01:40.544202] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:34.785 [2024-07-13 10:01:40.545196] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:34.785 [2024-07-13 10:01:40.546203] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:34.785 [2024-07-13 10:01:40.547221] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:34.785 [2024-07-13 10:01:40.548231] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:34.785 [2024-07-13 10:01:40.548253] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7f81696ea000 00:15:34.785 [2024-07-13 10:01:40.549373] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:34.785 [2024-07-13 10:01:40.565588] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user2/2/cntrl Setup Successfully 00:15:34.785 [2024-07-13 10:01:40.565619] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to connect adminq (no timeout) 00:15:34.785 [2024-07-13 10:01:40.570735] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:15:34.785 [2024-07-13 10:01:40.570786] nvme_pcie_common.c: 132:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:15:34.785 [2024-07-13 10:01:40.570890] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for connect adminq (no timeout) 00:15:34.785 [2024-07-13 10:01:40.570917] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs (no timeout) 00:15:34.785 [2024-07-13 10:01:40.570928] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs wait for vs (no timeout) 00:15:34.785 [2024-07-13 10:01:40.571737] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x8, value 0x10300 00:15:34.785 [2024-07-13 10:01:40.571757] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap (no timeout) 00:15:34.785 [2024-07-13 10:01:40.571769] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap wait for cap (no timeout) 00:15:34.785 [2024-07-13 10:01:40.572745] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:15:34.785 [2024-07-13 10:01:40.572765] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en (no timeout) 00:15:34.785 [2024-07-13 10:01:40.572778] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en wait for cc (timeout 15000 ms) 00:15:34.785 [2024-07-13 10:01:40.573753] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x0 00:15:34.785 [2024-07-13 10:01:40.573774] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:15:34.785 [2024-07-13 10:01:40.574762] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x0 00:15:34.785 [2024-07-13 10:01:40.574781] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 0 && CSTS.RDY = 0 00:15:34.785 [2024-07-13 10:01:40.574790] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to controller is disabled (timeout 15000 ms) 00:15:34.785 [2024-07-13 10:01:40.574801] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:15:34.785 [2024-07-13 10:01:40.574911] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Setting CC.EN = 1 00:15:34.785 [2024-07-13 10:01:40.574921] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:15:34.785 [2024-07-13 10:01:40.574929] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x28, value 0x2000003c0000 00:15:34.785 [2024-07-13 10:01:40.575771] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x30, value 0x2000003be000 00:15:34.785 [2024-07-13 10:01:40.576781] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x24, value 0xff00ff 00:15:34.785 [2024-07-13 10:01:40.577791] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:15:34.785 [2024-07-13 10:01:40.578818] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:15:34.785 [2024-07-13 10:01:40.579801] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x1 00:15:34.785 [2024-07-13 10:01:40.579820] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:15:34.785 [2024-07-13 10:01:40.579829] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to reset admin queue (timeout 30000 ms) 00:15:34.785 [2024-07-13 10:01:40.579872] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller (no timeout) 00:15:34.785 [2024-07-13 10:01:40.579887] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify controller (timeout 30000 ms) 00:15:34.785 [2024-07-13 10:01:40.579908] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:34.785 [2024-07-13 10:01:40.579926] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:34.785 [2024-07-13 10:01:40.579946] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:34.785 [2024-07-13 10:01:40.587883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:15:34.785 [2024-07-13 10:01:40.587906] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_xfer_size 131072 00:15:34.785 [2024-07-13 10:01:40.587916] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] MDTS max_xfer_size 131072 00:15:34.786 [2024-07-13 10:01:40.587923] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CNTLID 0x0001 00:15:34.786 [2024-07-13 10:01:40.587931] nvme_ctrlr.c:1990:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:15:34.786 [2024-07-13 10:01:40.587939] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_sges 1 00:15:34.786 [2024-07-13 10:01:40.587946] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] fuses compare and write: 1 00:15:34.786 [2024-07-13 10:01:40.587954] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to configure AER (timeout 30000 ms) 00:15:34.786 [2024-07-13 10:01:40.587971] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for configure aer (timeout 30000 ms) 00:15:34.786 [2024-07-13 10:01:40.587988] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:15:34.786 [2024-07-13 10:01:40.595874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:15:34.786 [2024-07-13 10:01:40.595902] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:15:34.786 [2024-07-13 10:01:40.595917] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:15:34.786 [2024-07-13 10:01:40.595928] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:15:34.786 [2024-07-13 10:01:40.595940] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:15:34.786 [2024-07-13 10:01:40.595952] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set keep alive timeout (timeout 30000 ms) 00:15:34.786 [2024-07-13 10:01:40.595968] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:15:34.786 [2024-07-13 10:01:40.595982] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:15:35.045 [2024-07-13 10:01:40.603878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:15:35.045 [2024-07-13 10:01:40.603899] nvme_ctrlr.c:2878:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Controller adjusted keep alive timeout to 0 ms 00:15:35.045 [2024-07-13 10:01:40.603908] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller iocs specific (timeout 30000 ms) 00:15:35.045 [2024-07-13 10:01:40.603920] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set number of queues (timeout 30000 ms) 00:15:35.045 [2024-07-13 10:01:40.603935] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set number of queues (timeout 30000 ms) 00:15:35.045 [2024-07-13 10:01:40.603957] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:35.045 [2024-07-13 10:01:40.611878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:15:35.045 [2024-07-13 10:01:40.611949] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify active ns (timeout 30000 ms) 00:15:35.045 [2024-07-13 10:01:40.611964] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify active ns (timeout 30000 ms) 00:15:35.045 [2024-07-13 10:01:40.611977] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:15:35.045 [2024-07-13 10:01:40.611985] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:15:35.045 [2024-07-13 10:01:40.611995] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:15:35.045 [2024-07-13 10:01:40.619875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:15:35.045 [2024-07-13 10:01:40.619903] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Namespace 1 was added 00:15:35.045 [2024-07-13 10:01:40.619922] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns (timeout 30000 ms) 00:15:35.045 [2024-07-13 10:01:40.619937] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify ns (timeout 30000 ms) 00:15:35.045 [2024-07-13 10:01:40.619949] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:35.045 [2024-07-13 10:01:40.619957] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:35.045 [2024-07-13 10:01:40.619966] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:35.045 [2024-07-13 10:01:40.627891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:15:35.045 [2024-07-13 10:01:40.627918] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify namespace id descriptors (timeout 30000 ms) 00:15:35.045 [2024-07-13 10:01:40.627933] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:15:35.045 [2024-07-13 10:01:40.627950] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:35.045 [2024-07-13 10:01:40.627959] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:35.045 [2024-07-13 10:01:40.627969] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:35.045 [2024-07-13 10:01:40.635874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:15:35.045 [2024-07-13 10:01:40.635895] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns iocs specific (timeout 30000 ms) 00:15:35.045 [2024-07-13 10:01:40.635908] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported log pages (timeout 30000 ms) 00:15:35.045 [2024-07-13 10:01:40.635923] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported features (timeout 30000 ms) 00:15:35.045 [2024-07-13 10:01:40.635934] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set doorbell buffer config (timeout 30000 ms) 00:15:35.045 [2024-07-13 10:01:40.635942] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set host ID (timeout 30000 ms) 00:15:35.045 [2024-07-13 10:01:40.635950] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] NVMe-oF transport - not sending Set Features - Host ID 00:15:35.045 [2024-07-13 10:01:40.635958] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to transport ready (timeout 30000 ms) 00:15:35.045 [2024-07-13 10:01:40.635966] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to ready (no timeout) 00:15:35.045 [2024-07-13 10:01:40.635990] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:15:35.045 [2024-07-13 10:01:40.643878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:15:35.045 [2024-07-13 10:01:40.643903] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:15:35.045 [2024-07-13 10:01:40.651878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:15:35.045 [2024-07-13 10:01:40.651902] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:15:35.045 [2024-07-13 10:01:40.659881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:15:35.045 [2024-07-13 10:01:40.659905] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:35.045 [2024-07-13 10:01:40.667876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:15:35.045 [2024-07-13 10:01:40.667901] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:15:35.045 [2024-07-13 10:01:40.667911] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:15:35.045 [2024-07-13 10:01:40.667917] nvme_pcie_common.c:1235:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:15:35.045 [2024-07-13 10:01:40.667923] nvme_pcie_common.c:1251:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:15:35.045 [2024-07-13 10:01:40.667933] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:15:35.045 [2024-07-13 10:01:40.667944] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:15:35.045 [2024-07-13 10:01:40.667952] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:15:35.045 [2024-07-13 10:01:40.667965] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:15:35.045 [2024-07-13 10:01:40.667977] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:15:35.045 [2024-07-13 10:01:40.667984] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:35.045 [2024-07-13 10:01:40.667993] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:35.045 [2024-07-13 10:01:40.668005] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:15:35.045 [2024-07-13 10:01:40.668012] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:15:35.045 [2024-07-13 10:01:40.668021] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:15:35.045 [2024-07-13 10:01:40.675891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:15:35.045 [2024-07-13 10:01:40.675919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:15:35.045 [2024-07-13 10:01:40.675935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:15:35.045 [2024-07-13 10:01:40.675946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:15:35.045 ===================================================== 00:15:35.045 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:35.045 ===================================================== 00:15:35.045 Controller Capabilities/Features 00:15:35.045 ================================ 00:15:35.045 Vendor ID: 4e58 00:15:35.045 Subsystem Vendor ID: 4e58 00:15:35.045 Serial Number: SPDK2 00:15:35.045 Model Number: SPDK bdev Controller 00:15:35.045 Firmware Version: 24.01.1 00:15:35.045 Recommended Arb Burst: 6 00:15:35.045 IEEE OUI Identifier: 8d 6b 50 00:15:35.045 Multi-path I/O 00:15:35.045 May have multiple subsystem ports: Yes 00:15:35.045 May have multiple controllers: Yes 00:15:35.045 Associated with SR-IOV VF: No 00:15:35.045 Max Data Transfer Size: 131072 00:15:35.045 Max Number of Namespaces: 32 00:15:35.045 Max Number of I/O Queues: 127 00:15:35.045 NVMe Specification Version (VS): 1.3 00:15:35.045 NVMe Specification Version (Identify): 1.3 00:15:35.045 Maximum Queue Entries: 256 00:15:35.045 Contiguous Queues Required: Yes 00:15:35.045 Arbitration Mechanisms Supported 00:15:35.045 Weighted Round Robin: Not Supported 00:15:35.045 Vendor Specific: Not Supported 00:15:35.045 Reset Timeout: 15000 ms 00:15:35.045 Doorbell Stride: 4 bytes 00:15:35.045 NVM Subsystem Reset: Not Supported 00:15:35.045 Command Sets Supported 00:15:35.045 NVM Command Set: Supported 00:15:35.045 Boot Partition: Not Supported 00:15:35.045 Memory Page Size Minimum: 4096 bytes 00:15:35.045 Memory Page Size Maximum: 4096 bytes 00:15:35.045 Persistent Memory Region: Not Supported 00:15:35.045 Optional Asynchronous Events Supported 00:15:35.045 Namespace Attribute Notices: Supported 00:15:35.045 Firmware Activation Notices: Not Supported 00:15:35.045 ANA Change Notices: Not Supported 00:15:35.045 PLE Aggregate Log Change Notices: Not Supported 00:15:35.045 LBA Status Info Alert Notices: Not Supported 00:15:35.045 EGE Aggregate Log Change Notices: Not Supported 00:15:35.045 Normal NVM Subsystem Shutdown event: Not Supported 00:15:35.045 Zone Descriptor Change Notices: Not Supported 00:15:35.045 Discovery Log Change Notices: Not Supported 00:15:35.045 Controller Attributes 00:15:35.045 128-bit Host Identifier: Supported 00:15:35.045 Non-Operational Permissive Mode: Not Supported 00:15:35.045 NVM Sets: Not Supported 00:15:35.045 Read Recovery Levels: Not Supported 00:15:35.045 Endurance Groups: Not Supported 00:15:35.045 Predictable Latency Mode: Not Supported 00:15:35.045 Traffic Based Keep ALive: Not Supported 00:15:35.045 Namespace Granularity: Not Supported 00:15:35.045 SQ Associations: Not Supported 00:15:35.045 UUID List: Not Supported 00:15:35.045 Multi-Domain Subsystem: Not Supported 00:15:35.045 Fixed Capacity Management: Not Supported 00:15:35.045 Variable Capacity Management: Not Supported 00:15:35.045 Delete Endurance Group: Not Supported 00:15:35.045 Delete NVM Set: Not Supported 00:15:35.045 Extended LBA Formats Supported: Not Supported 00:15:35.045 Flexible Data Placement Supported: Not Supported 00:15:35.045 00:15:35.045 Controller Memory Buffer Support 00:15:35.045 ================================ 00:15:35.045 Supported: No 00:15:35.045 00:15:35.045 Persistent Memory Region Support 00:15:35.045 ================================ 00:15:35.045 Supported: No 00:15:35.045 00:15:35.045 Admin Command Set Attributes 00:15:35.045 ============================ 00:15:35.045 Security Send/Receive: Not Supported 00:15:35.045 Format NVM: Not Supported 00:15:35.045 Firmware Activate/Download: Not Supported 00:15:35.045 Namespace Management: Not Supported 00:15:35.045 Device Self-Test: Not Supported 00:15:35.045 Directives: Not Supported 00:15:35.045 NVMe-MI: Not Supported 00:15:35.045 Virtualization Management: Not Supported 00:15:35.045 Doorbell Buffer Config: Not Supported 00:15:35.045 Get LBA Status Capability: Not Supported 00:15:35.045 Command & Feature Lockdown Capability: Not Supported 00:15:35.045 Abort Command Limit: 4 00:15:35.045 Async Event Request Limit: 4 00:15:35.045 Number of Firmware Slots: N/A 00:15:35.045 Firmware Slot 1 Read-Only: N/A 00:15:35.045 Firmware Activation Without Reset: N/A 00:15:35.045 Multiple Update Detection Support: N/A 00:15:35.045 Firmware Update Granularity: No Information Provided 00:15:35.045 Per-Namespace SMART Log: No 00:15:35.046 Asymmetric Namespace Access Log Page: Not Supported 00:15:35.046 Subsystem NQN: nqn.2019-07.io.spdk:cnode2 00:15:35.046 Command Effects Log Page: Supported 00:15:35.046 Get Log Page Extended Data: Supported 00:15:35.046 Telemetry Log Pages: Not Supported 00:15:35.046 Persistent Event Log Pages: Not Supported 00:15:35.046 Supported Log Pages Log Page: May Support 00:15:35.046 Commands Supported & Effects Log Page: Not Supported 00:15:35.046 Feature Identifiers & Effects Log Page:May Support 00:15:35.046 NVMe-MI Commands & Effects Log Page: May Support 00:15:35.046 Data Area 4 for Telemetry Log: Not Supported 00:15:35.046 Error Log Page Entries Supported: 128 00:15:35.046 Keep Alive: Supported 00:15:35.046 Keep Alive Granularity: 10000 ms 00:15:35.046 00:15:35.046 NVM Command Set Attributes 00:15:35.046 ========================== 00:15:35.046 Submission Queue Entry Size 00:15:35.046 Max: 64 00:15:35.046 Min: 64 00:15:35.046 Completion Queue Entry Size 00:15:35.046 Max: 16 00:15:35.046 Min: 16 00:15:35.046 Number of Namespaces: 32 00:15:35.046 Compare Command: Supported 00:15:35.046 Write Uncorrectable Command: Not Supported 00:15:35.046 Dataset Management Command: Supported 00:15:35.046 Write Zeroes Command: Supported 00:15:35.046 Set Features Save Field: Not Supported 00:15:35.046 Reservations: Not Supported 00:15:35.046 Timestamp: Not Supported 00:15:35.046 Copy: Supported 00:15:35.046 Volatile Write Cache: Present 00:15:35.046 Atomic Write Unit (Normal): 1 00:15:35.046 Atomic Write Unit (PFail): 1 00:15:35.046 Atomic Compare & Write Unit: 1 00:15:35.046 Fused Compare & Write: Supported 00:15:35.046 Scatter-Gather List 00:15:35.046 SGL Command Set: Supported (Dword aligned) 00:15:35.046 SGL Keyed: Not Supported 00:15:35.046 SGL Bit Bucket Descriptor: Not Supported 00:15:35.046 SGL Metadata Pointer: Not Supported 00:15:35.046 Oversized SGL: Not Supported 00:15:35.046 SGL Metadata Address: Not Supported 00:15:35.046 SGL Offset: Not Supported 00:15:35.046 Transport SGL Data Block: Not Supported 00:15:35.046 Replay Protected Memory Block: Not Supported 00:15:35.046 00:15:35.046 Firmware Slot Information 00:15:35.046 ========================= 00:15:35.046 Active slot: 1 00:15:35.046 Slot 1 Firmware Revision: 24.01.1 00:15:35.046 00:15:35.046 00:15:35.046 Commands Supported and Effects 00:15:35.046 ============================== 00:15:35.046 Admin Commands 00:15:35.046 -------------- 00:15:35.046 Get Log Page (02h): Supported 00:15:35.046 Identify (06h): Supported 00:15:35.046 Abort (08h): Supported 00:15:35.046 Set Features (09h): Supported 00:15:35.046 Get Features (0Ah): Supported 00:15:35.046 Asynchronous Event Request (0Ch): Supported 00:15:35.046 Keep Alive (18h): Supported 00:15:35.046 I/O Commands 00:15:35.046 ------------ 00:15:35.046 Flush (00h): Supported LBA-Change 00:15:35.046 Write (01h): Supported LBA-Change 00:15:35.046 Read (02h): Supported 00:15:35.046 Compare (05h): Supported 00:15:35.046 Write Zeroes (08h): Supported LBA-Change 00:15:35.046 Dataset Management (09h): Supported LBA-Change 00:15:35.046 Copy (19h): Supported LBA-Change 00:15:35.046 Unknown (79h): Supported LBA-Change 00:15:35.046 Unknown (7Ah): Supported 00:15:35.046 00:15:35.046 Error Log 00:15:35.046 ========= 00:15:35.046 00:15:35.046 Arbitration 00:15:35.046 =========== 00:15:35.046 Arbitration Burst: 1 00:15:35.046 00:15:35.046 Power Management 00:15:35.046 ================ 00:15:35.046 Number of Power States: 1 00:15:35.046 Current Power State: Power State #0 00:15:35.046 Power State #0: 00:15:35.046 Max Power: 0.00 W 00:15:35.046 Non-Operational State: Operational 00:15:35.046 Entry Latency: Not Reported 00:15:35.046 Exit Latency: Not Reported 00:15:35.046 Relative Read Throughput: 0 00:15:35.046 Relative Read Latency: 0 00:15:35.046 Relative Write Throughput: 0 00:15:35.046 Relative Write Latency: 0 00:15:35.046 Idle Power: Not Reported 00:15:35.046 Active Power: Not Reported 00:15:35.046 Non-Operational Permissive Mode: Not Supported 00:15:35.046 00:15:35.046 Health Information 00:15:35.046 ================== 00:15:35.046 Critical Warnings: 00:15:35.046 Available Spare Space: OK 00:15:35.046 Temperature: OK 00:15:35.046 Device Reliability: OK 00:15:35.046 Read Only: No 00:15:35.046 Volatile Memory Backup: OK 00:15:35.046 Current Temperature: 0 Kelvin[2024-07-13 10:01:40.676071] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:15:35.046 [2024-07-13 10:01:40.691891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:15:35.046 [2024-07-13 10:01:40.691949] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Prepare to destruct SSD 00:15:35.046 [2024-07-13 10:01:40.691966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:35.046 [2024-07-13 10:01:40.691977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:35.046 [2024-07-13 10:01:40.691987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:35.046 [2024-07-13 10:01:40.691996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:35.046 [2024-07-13 10:01:40.692076] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:15:35.046 [2024-07-13 10:01:40.692097] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x464001 00:15:35.046 [2024-07-13 10:01:40.693124] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] RTD3E = 0 us 00:15:35.046 [2024-07-13 10:01:40.693140] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown timeout = 10000 ms 00:15:35.046 [2024-07-13 10:01:40.694092] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x9 00:15:35.046 [2024-07-13 10:01:40.694117] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown complete in 0 milliseconds 00:15:35.046 [2024-07-13 10:01:40.694168] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user2/2/cntrl 00:15:35.046 [2024-07-13 10:01:40.695356] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:35.046 (-273 Celsius) 00:15:35.046 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:15:35.046 Available Spare: 0% 00:15:35.046 Available Spare Threshold: 0% 00:15:35.046 Life Percentage Used: 0% 00:15:35.046 Data Units Read: 0 00:15:35.046 Data Units Written: 0 00:15:35.046 Host Read Commands: 0 00:15:35.046 Host Write Commands: 0 00:15:35.046 Controller Busy Time: 0 minutes 00:15:35.046 Power Cycles: 0 00:15:35.046 Power On Hours: 0 hours 00:15:35.046 Unsafe Shutdowns: 0 00:15:35.046 Unrecoverable Media Errors: 0 00:15:35.046 Lifetime Error Log Entries: 0 00:15:35.046 Warning Temperature Time: 0 minutes 00:15:35.046 Critical Temperature Time: 0 minutes 00:15:35.046 00:15:35.046 Number of Queues 00:15:35.046 ================ 00:15:35.046 Number of I/O Submission Queues: 127 00:15:35.046 Number of I/O Completion Queues: 127 00:15:35.046 00:15:35.046 Active Namespaces 00:15:35.046 ================= 00:15:35.046 Namespace ID:1 00:15:35.046 Error Recovery Timeout: Unlimited 00:15:35.046 Command Set Identifier: NVM (00h) 00:15:35.046 Deallocate: Supported 00:15:35.046 Deallocated/Unwritten Error: Not Supported 00:15:35.046 Deallocated Read Value: Unknown 00:15:35.046 Deallocate in Write Zeroes: Not Supported 00:15:35.046 Deallocated Guard Field: 0xFFFF 00:15:35.046 Flush: Supported 00:15:35.046 Reservation: Supported 00:15:35.046 Namespace Sharing Capabilities: Multiple Controllers 00:15:35.046 Size (in LBAs): 131072 (0GiB) 00:15:35.046 Capacity (in LBAs): 131072 (0GiB) 00:15:35.046 Utilization (in LBAs): 131072 (0GiB) 00:15:35.046 NGUID: 8C581C381B2C42CE826F5B1956643DDD 00:15:35.046 UUID: 8c581c38-1b2c-42ce-826f-5b1956643ddd 00:15:35.046 Thin Provisioning: Not Supported 00:15:35.046 Per-NS Atomic Units: Yes 00:15:35.046 Atomic Boundary Size (Normal): 0 00:15:35.046 Atomic Boundary Size (PFail): 0 00:15:35.046 Atomic Boundary Offset: 0 00:15:35.046 Maximum Single Source Range Length: 65535 00:15:35.046 Maximum Copy Length: 65535 00:15:35.046 Maximum Source Range Count: 1 00:15:35.046 NGUID/EUI64 Never Reused: No 00:15:35.046 Namespace Write Protected: No 00:15:35.046 Number of LBA Formats: 1 00:15:35.046 Current LBA Format: LBA Format #00 00:15:35.046 LBA Format #00: Data Size: 512 Metadata Size: 0 00:15:35.046 00:15:35.046 10:01:40 -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:15:35.046 EAL: No free 2048 kB hugepages reported on node 1 00:15:40.314 Initializing NVMe Controllers 00:15:40.314 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:40.314 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:15:40.314 Initialization complete. Launching workers. 00:15:40.314 ======================================================== 00:15:40.314 Latency(us) 00:15:40.314 Device Information : IOPS MiB/s Average min max 00:15:40.314 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 37234.24 145.45 3437.13 1155.32 9492.70 00:15:40.314 ======================================================== 00:15:40.314 Total : 37234.24 145.45 3437.13 1155.32 9492.70 00:15:40.314 00:15:40.314 10:01:46 -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:15:40.314 EAL: No free 2048 kB hugepages reported on node 1 00:15:45.575 Initializing NVMe Controllers 00:15:45.575 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:45.575 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:15:45.575 Initialization complete. Launching workers. 00:15:45.575 ======================================================== 00:15:45.575 Latency(us) 00:15:45.575 Device Information : IOPS MiB/s Average min max 00:15:45.575 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 36059.84 140.86 3549.10 1169.16 9773.04 00:15:45.575 ======================================================== 00:15:45.575 Total : 36059.84 140.86 3549.10 1169.16 9773.04 00:15:45.575 00:15:45.575 10:01:51 -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:15:45.575 EAL: No free 2048 kB hugepages reported on node 1 00:15:52.145 Initializing NVMe Controllers 00:15:52.145 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:52.145 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:52.145 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 1 00:15:52.145 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 2 00:15:52.145 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 3 00:15:52.145 Initialization complete. Launching workers. 00:15:52.145 Starting thread on core 2 00:15:52.145 Starting thread on core 3 00:15:52.145 Starting thread on core 1 00:15:52.145 10:01:56 -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -d 256 -g 00:15:52.145 EAL: No free 2048 kB hugepages reported on node 1 00:15:54.672 Initializing NVMe Controllers 00:15:54.672 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:15:54.672 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:15:54.672 Associating SPDK bdev Controller (SPDK2 ) with lcore 0 00:15:54.672 Associating SPDK bdev Controller (SPDK2 ) with lcore 1 00:15:54.672 Associating SPDK bdev Controller (SPDK2 ) with lcore 2 00:15:54.672 Associating SPDK bdev Controller (SPDK2 ) with lcore 3 00:15:54.672 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:15:54.672 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:15:54.672 Initialization complete. Launching workers. 00:15:54.672 Starting thread on core 1 with urgent priority queue 00:15:54.672 Starting thread on core 2 with urgent priority queue 00:15:54.672 Starting thread on core 3 with urgent priority queue 00:15:54.672 Starting thread on core 0 with urgent priority queue 00:15:54.672 SPDK bdev Controller (SPDK2 ) core 0: 5960.67 IO/s 16.78 secs/100000 ios 00:15:54.672 SPDK bdev Controller (SPDK2 ) core 1: 6059.33 IO/s 16.50 secs/100000 ios 00:15:54.672 SPDK bdev Controller (SPDK2 ) core 2: 6030.67 IO/s 16.58 secs/100000 ios 00:15:54.672 SPDK bdev Controller (SPDK2 ) core 3: 6024.00 IO/s 16.60 secs/100000 ios 00:15:54.672 ======================================================== 00:15:54.672 00:15:54.672 10:02:00 -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:15:54.672 EAL: No free 2048 kB hugepages reported on node 1 00:15:54.672 Initializing NVMe Controllers 00:15:54.672 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:15:54.672 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:15:54.672 Namespace ID: 1 size: 0GB 00:15:54.672 Initialization complete. 00:15:54.672 INFO: using host memory buffer for IO 00:15:54.672 Hello world! 00:15:54.672 10:02:00 -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:15:54.672 EAL: No free 2048 kB hugepages reported on node 1 00:15:56.041 Initializing NVMe Controllers 00:15:56.042 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:15:56.042 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:15:56.042 Initialization complete. Launching workers. 00:15:56.042 submit (in ns) avg, min, max = 8232.6, 3461.1, 4016163.3 00:15:56.042 complete (in ns) avg, min, max = 24526.0, 2036.7, 6993443.3 00:15:56.042 00:15:56.042 Submit histogram 00:15:56.042 ================ 00:15:56.042 Range in us Cumulative Count 00:15:56.042 3.461 - 3.484: 0.3833% ( 53) 00:15:56.042 3.484 - 3.508: 1.4536% ( 148) 00:15:56.042 3.508 - 3.532: 3.8762% ( 335) 00:15:56.042 3.532 - 3.556: 8.8878% ( 693) 00:15:56.042 3.556 - 3.579: 18.5855% ( 1341) 00:15:56.042 3.579 - 3.603: 28.3121% ( 1345) 00:15:56.042 3.603 - 3.627: 39.0874% ( 1490) 00:15:56.042 3.627 - 3.650: 47.0712% ( 1104) 00:15:56.042 3.650 - 3.674: 53.3700% ( 871) 00:15:56.042 3.674 - 3.698: 57.2462% ( 536) 00:15:56.042 3.698 - 3.721: 61.3032% ( 561) 00:15:56.042 3.721 - 3.745: 64.2609% ( 409) 00:15:56.042 3.745 - 3.769: 67.2115% ( 408) 00:15:56.042 3.769 - 3.793: 70.6393% ( 474) 00:15:56.042 3.793 - 3.816: 74.2841% ( 504) 00:15:56.042 3.816 - 3.840: 78.7966% ( 624) 00:15:56.042 3.840 - 3.864: 82.7741% ( 550) 00:15:56.042 3.864 - 3.887: 85.4281% ( 367) 00:15:56.042 3.887 - 3.911: 87.7061% ( 315) 00:15:56.042 3.911 - 3.935: 89.2175% ( 209) 00:15:56.042 3.935 - 3.959: 90.5482% ( 184) 00:15:56.042 3.959 - 3.982: 91.4449% ( 124) 00:15:56.042 3.982 - 4.006: 92.2982% ( 118) 00:15:56.042 4.006 - 4.030: 93.1371% ( 116) 00:15:56.042 4.030 - 4.053: 93.8241% ( 95) 00:15:56.042 4.053 - 4.077: 94.6702% ( 117) 00:15:56.042 4.077 - 4.101: 95.2488% ( 80) 00:15:56.042 4.101 - 4.124: 95.6104% ( 50) 00:15:56.042 4.124 - 4.148: 95.8707% ( 36) 00:15:56.042 4.148 - 4.172: 96.0515% ( 25) 00:15:56.042 4.172 - 4.196: 96.3118% ( 36) 00:15:56.042 4.196 - 4.219: 96.4131% ( 14) 00:15:56.042 4.219 - 4.243: 96.5216% ( 15) 00:15:56.042 4.243 - 4.267: 96.6373% ( 16) 00:15:56.042 4.267 - 4.290: 96.7530% ( 16) 00:15:56.042 4.290 - 4.314: 96.7964% ( 6) 00:15:56.042 4.314 - 4.338: 96.8542% ( 8) 00:15:56.042 4.338 - 4.361: 96.9193% ( 9) 00:15:56.042 4.361 - 4.385: 96.9844% ( 9) 00:15:56.042 4.385 - 4.409: 97.0567% ( 10) 00:15:56.042 4.409 - 4.433: 97.0856% ( 4) 00:15:56.042 4.433 - 4.456: 97.1001% ( 2) 00:15:56.042 4.456 - 4.480: 97.1146% ( 2) 00:15:56.042 4.480 - 4.504: 97.1362% ( 3) 00:15:56.042 4.504 - 4.527: 97.1579% ( 3) 00:15:56.042 4.527 - 4.551: 97.1796% ( 3) 00:15:56.042 4.551 - 4.575: 97.1869% ( 1) 00:15:56.042 4.599 - 4.622: 97.2086% ( 3) 00:15:56.042 4.622 - 4.646: 97.2230% ( 2) 00:15:56.042 4.693 - 4.717: 97.2592% ( 5) 00:15:56.042 4.717 - 4.741: 97.3243% ( 9) 00:15:56.042 4.741 - 4.764: 97.3677% ( 6) 00:15:56.042 4.764 - 4.788: 97.4183% ( 7) 00:15:56.042 4.788 - 4.812: 97.4689% ( 7) 00:15:56.042 4.812 - 4.836: 97.4906% ( 3) 00:15:56.042 4.836 - 4.859: 97.5774% ( 12) 00:15:56.042 4.859 - 4.883: 97.6208% ( 6) 00:15:56.042 4.883 - 4.907: 97.6931% ( 10) 00:15:56.042 4.907 - 4.930: 97.7003% ( 1) 00:15:56.042 4.930 - 4.954: 97.7799% ( 11) 00:15:56.042 4.954 - 4.978: 97.8233% ( 6) 00:15:56.042 4.978 - 5.001: 97.8594% ( 5) 00:15:56.042 5.001 - 5.025: 97.8956% ( 5) 00:15:56.042 5.025 - 5.049: 97.9100% ( 2) 00:15:56.042 5.049 - 5.073: 97.9534% ( 6) 00:15:56.042 5.073 - 5.096: 97.9824% ( 4) 00:15:56.042 5.096 - 5.120: 98.0040% ( 3) 00:15:56.042 5.120 - 5.144: 98.0185% ( 2) 00:15:56.042 5.144 - 5.167: 98.0402% ( 3) 00:15:56.042 5.167 - 5.191: 98.0474% ( 1) 00:15:56.042 5.215 - 5.239: 98.0691% ( 3) 00:15:56.042 5.239 - 5.262: 98.0764% ( 1) 00:15:56.042 5.286 - 5.310: 98.0836% ( 1) 00:15:56.042 5.310 - 5.333: 98.0908% ( 1) 00:15:56.042 5.381 - 5.404: 98.1125% ( 3) 00:15:56.042 5.428 - 5.452: 98.1342% ( 3) 00:15:56.042 5.452 - 5.476: 98.1415% ( 1) 00:15:56.042 5.476 - 5.499: 98.1487% ( 1) 00:15:56.042 5.523 - 5.547: 98.1559% ( 1) 00:15:56.042 5.547 - 5.570: 98.1704% ( 2) 00:15:56.042 5.594 - 5.618: 98.1848% ( 2) 00:15:56.042 5.641 - 5.665: 98.2138% ( 4) 00:15:56.042 5.784 - 5.807: 98.2210% ( 1) 00:15:56.042 5.807 - 5.831: 98.2282% ( 1) 00:15:56.042 5.879 - 5.902: 98.2355% ( 1) 00:15:56.042 5.926 - 5.950: 98.2427% ( 1) 00:15:56.042 5.950 - 5.973: 98.2499% ( 1) 00:15:56.042 5.973 - 5.997: 98.2572% ( 1) 00:15:56.042 6.116 - 6.163: 98.2716% ( 2) 00:15:56.042 6.163 - 6.210: 98.2861% ( 2) 00:15:56.042 6.210 - 6.258: 98.2933% ( 1) 00:15:56.042 6.258 - 6.305: 98.3005% ( 1) 00:15:56.042 6.305 - 6.353: 98.3078% ( 1) 00:15:56.042 6.495 - 6.542: 98.3150% ( 1) 00:15:56.042 6.542 - 6.590: 98.3295% ( 2) 00:15:56.042 6.590 - 6.637: 98.3439% ( 2) 00:15:56.042 6.684 - 6.732: 98.3512% ( 1) 00:15:56.042 6.732 - 6.779: 98.3584% ( 1) 00:15:56.042 6.779 - 6.827: 98.3656% ( 1) 00:15:56.042 6.874 - 6.921: 98.3801% ( 2) 00:15:56.042 6.921 - 6.969: 98.3873% ( 1) 00:15:56.042 7.016 - 7.064: 98.3946% ( 1) 00:15:56.042 7.064 - 7.111: 98.4018% ( 1) 00:15:56.042 7.111 - 7.159: 98.4090% ( 1) 00:15:56.042 7.206 - 7.253: 98.4235% ( 2) 00:15:56.042 7.253 - 7.301: 98.4307% ( 1) 00:15:56.042 7.348 - 7.396: 98.4380% ( 1) 00:15:56.042 7.396 - 7.443: 98.4524% ( 2) 00:15:56.042 7.443 - 7.490: 98.4669% ( 2) 00:15:56.042 7.585 - 7.633: 98.4741% ( 1) 00:15:56.042 7.633 - 7.680: 98.4813% ( 1) 00:15:56.042 7.680 - 7.727: 98.4886% ( 1) 00:15:56.042 7.727 - 7.775: 98.5103% ( 3) 00:15:56.042 7.822 - 7.870: 98.5175% ( 1) 00:15:56.042 7.870 - 7.917: 98.5392% ( 3) 00:15:56.042 8.107 - 8.154: 98.5464% ( 1) 00:15:56.042 8.154 - 8.201: 98.5609% ( 2) 00:15:56.042 8.296 - 8.344: 98.5681% ( 1) 00:15:56.042 8.344 - 8.391: 98.5754% ( 1) 00:15:56.042 8.391 - 8.439: 98.5826% ( 1) 00:15:56.042 8.439 - 8.486: 98.5970% ( 2) 00:15:56.042 8.533 - 8.581: 98.6043% ( 1) 00:15:56.042 8.628 - 8.676: 98.6115% ( 1) 00:15:56.042 8.676 - 8.723: 98.6187% ( 1) 00:15:56.042 8.723 - 8.770: 98.6260% ( 1) 00:15:56.042 8.770 - 8.818: 98.6404% ( 2) 00:15:56.042 8.960 - 9.007: 98.6477% ( 1) 00:15:56.042 9.007 - 9.055: 98.6549% ( 1) 00:15:56.042 9.102 - 9.150: 98.6621% ( 1) 00:15:56.042 9.197 - 9.244: 98.6694% ( 1) 00:15:56.042 9.292 - 9.339: 98.6911% ( 3) 00:15:56.042 9.434 - 9.481: 98.6983% ( 1) 00:15:56.042 9.481 - 9.529: 98.7055% ( 1) 00:15:56.042 9.529 - 9.576: 98.7128% ( 1) 00:15:56.042 9.719 - 9.766: 98.7200% ( 1) 00:15:56.042 9.766 - 9.813: 98.7272% ( 1) 00:15:56.042 9.813 - 9.861: 98.7345% ( 1) 00:15:56.042 9.956 - 10.003: 98.7489% ( 2) 00:15:56.042 10.003 - 10.050: 98.7561% ( 1) 00:15:56.042 10.050 - 10.098: 98.7634% ( 1) 00:15:56.042 10.145 - 10.193: 98.7706% ( 1) 00:15:56.042 10.193 - 10.240: 98.7778% ( 1) 00:15:56.042 10.240 - 10.287: 98.7851% ( 1) 00:15:56.042 10.430 - 10.477: 98.7923% ( 1) 00:15:56.042 10.477 - 10.524: 98.7995% ( 1) 00:15:56.042 10.809 - 10.856: 98.8068% ( 1) 00:15:56.042 10.856 - 10.904: 98.8140% ( 1) 00:15:56.042 11.093 - 11.141: 98.8212% ( 1) 00:15:56.042 11.283 - 11.330: 98.8285% ( 1) 00:15:56.042 11.520 - 11.567: 98.8357% ( 1) 00:15:56.042 11.567 - 11.615: 98.8429% ( 1) 00:15:56.042 11.615 - 11.662: 98.8574% ( 2) 00:15:56.042 11.757 - 11.804: 98.8646% ( 1) 00:15:56.042 11.852 - 11.899: 98.8719% ( 1) 00:15:56.042 11.947 - 11.994: 98.8791% ( 1) 00:15:56.042 12.041 - 12.089: 98.8863% ( 1) 00:15:56.042 12.089 - 12.136: 98.8935% ( 1) 00:15:56.042 12.136 - 12.231: 98.9008% ( 1) 00:15:56.042 12.421 - 12.516: 98.9152% ( 2) 00:15:56.042 12.516 - 12.610: 98.9225% ( 1) 00:15:56.042 12.610 - 12.705: 98.9297% ( 1) 00:15:56.042 12.705 - 12.800: 98.9369% ( 1) 00:15:56.042 12.895 - 12.990: 98.9514% ( 2) 00:15:56.042 13.179 - 13.274: 98.9586% ( 1) 00:15:56.042 13.274 - 13.369: 98.9659% ( 1) 00:15:56.042 13.559 - 13.653: 98.9731% ( 1) 00:15:56.042 13.748 - 13.843: 98.9803% ( 1) 00:15:56.042 13.843 - 13.938: 98.9876% ( 1) 00:15:56.042 14.033 - 14.127: 98.9948% ( 1) 00:15:56.042 14.127 - 14.222: 99.0020% ( 1) 00:15:56.042 14.317 - 14.412: 99.0093% ( 1) 00:15:56.042 14.507 - 14.601: 99.0165% ( 1) 00:15:56.042 14.601 - 14.696: 99.0237% ( 1) 00:15:56.042 15.265 - 15.360: 99.0310% ( 1) 00:15:56.042 16.972 - 17.067: 99.0382% ( 1) 00:15:56.042 17.067 - 17.161: 99.0454% ( 1) 00:15:56.042 17.161 - 17.256: 99.0599% ( 2) 00:15:56.042 17.351 - 17.446: 99.0960% ( 5) 00:15:56.042 17.446 - 17.541: 99.1250% ( 4) 00:15:56.042 17.541 - 17.636: 99.1900% ( 9) 00:15:56.042 17.636 - 17.730: 99.2334% ( 6) 00:15:56.042 17.730 - 17.825: 99.2551% ( 3) 00:15:56.042 17.825 - 17.920: 99.2841% ( 4) 00:15:56.042 17.920 - 18.015: 99.3275% ( 6) 00:15:56.042 18.015 - 18.110: 99.3564% ( 4) 00:15:56.042 18.110 - 18.204: 99.4865% ( 18) 00:15:56.042 18.204 - 18.299: 99.5806% ( 13) 00:15:56.043 18.299 - 18.394: 99.6456% ( 9) 00:15:56.043 18.394 - 18.489: 99.6890% ( 6) 00:15:56.043 18.489 - 18.584: 99.7107% ( 3) 00:15:56.043 18.584 - 18.679: 99.7252% ( 2) 00:15:56.043 18.679 - 18.773: 99.7397% ( 2) 00:15:56.043 18.868 - 18.963: 99.7614% ( 3) 00:15:56.043 18.963 - 19.058: 99.7830% ( 3) 00:15:56.043 19.058 - 19.153: 99.8047% ( 3) 00:15:56.043 19.153 - 19.247: 99.8120% ( 1) 00:15:56.043 19.247 - 19.342: 99.8264% ( 2) 00:15:56.043 19.532 - 19.627: 99.8409% ( 2) 00:15:56.043 19.816 - 19.911: 99.8481% ( 1) 00:15:56.043 21.997 - 22.092: 99.8554% ( 1) 00:15:56.043 23.135 - 23.230: 99.8626% ( 1) 00:15:56.043 23.609 - 23.704: 99.8698% ( 1) 00:15:56.043 24.462 - 24.652: 99.8771% ( 1) 00:15:56.043 26.927 - 27.117: 99.8843% ( 1) 00:15:56.043 27.117 - 27.307: 99.8915% ( 1) 00:15:56.043 3980.705 - 4004.978: 99.9783% ( 12) 00:15:56.043 4004.978 - 4029.250: 100.0000% ( 3) 00:15:56.043 00:15:56.043 Complete histogram 00:15:56.043 ================== 00:15:56.043 Range in us Cumulative Count 00:15:56.043 2.027 - 2.039: 0.0289% ( 4) 00:15:56.043 2.039 - 2.050: 7.3329% ( 1010) 00:15:56.043 2.050 - 2.062: 15.4180% ( 1118) 00:15:56.043 2.062 - 2.074: 18.1226% ( 374) 00:15:56.043 2.074 - 2.086: 45.9936% ( 3854) 00:15:56.043 2.086 - 2.098: 61.4695% ( 2140) 00:15:56.043 2.098 - 2.110: 63.2774% ( 250) 00:15:56.043 2.110 - 2.121: 66.6474% ( 466) 00:15:56.043 2.121 - 2.133: 67.9419% ( 179) 00:15:56.043 2.133 - 2.145: 70.3283% ( 330) 00:15:56.043 2.145 - 2.157: 79.5126% ( 1270) 00:15:56.043 2.157 - 2.169: 82.7379% ( 446) 00:15:56.043 2.169 - 2.181: 83.9962% ( 174) 00:15:56.043 2.181 - 2.193: 85.8620% ( 258) 00:15:56.043 2.193 - 2.204: 86.7515% ( 123) 00:15:56.043 2.204 - 2.216: 88.5161% ( 244) 00:15:56.043 2.216 - 2.228: 92.5658% ( 560) 00:15:56.043 2.228 - 2.240: 93.7735% ( 167) 00:15:56.043 2.240 - 2.252: 94.2508% ( 66) 00:15:56.043 2.252 - 2.264: 94.5184% ( 37) 00:15:56.043 2.264 - 2.276: 94.8366% ( 44) 00:15:56.043 2.276 - 2.287: 95.2777% ( 61) 00:15:56.043 2.287 - 2.299: 95.4079% ( 18) 00:15:56.043 2.299 - 2.311: 95.4657% ( 8) 00:15:56.043 2.311 - 2.323: 95.5814% ( 16) 00:15:56.043 2.323 - 2.335: 95.7261% ( 20) 00:15:56.043 2.335 - 2.347: 95.8273% ( 14) 00:15:56.043 2.347 - 2.359: 96.0298% ( 28) 00:15:56.043 2.359 - 2.370: 96.2684% ( 33) 00:15:56.043 2.370 - 2.382: 96.4348% ( 23) 00:15:56.043 2.382 - 2.394: 96.6806% ( 34) 00:15:56.043 2.394 - 2.406: 96.9555% ( 38) 00:15:56.043 2.406 - 2.418: 97.1579% ( 28) 00:15:56.043 2.418 - 2.430: 97.3604% ( 28) 00:15:56.043 2.430 - 2.441: 97.5629% ( 28) 00:15:56.043 2.441 - 2.453: 97.6931% ( 18) 00:15:56.043 2.453 - 2.465: 97.7799% ( 12) 00:15:56.043 2.465 - 2.477: 97.8739% ( 13) 00:15:56.043 2.477 - 2.489: 97.9534% ( 11) 00:15:56.043 2.489 - 2.501: 98.0547% ( 14) 00:15:56.043 2.501 - 2.513: 98.1053% ( 7) 00:15:56.043 2.513 - 2.524: 98.1631% ( 8) 00:15:56.043 2.536 - 2.548: 98.1704% ( 1) 00:15:56.043 2.548 - 2.560: 98.1776% ( 1) 00:15:56.043 2.560 - 2.572: 98.1921% ( 2) 00:15:56.043 2.572 - 2.584: 98.1993% ( 1) 00:15:56.043 2.584 - 2.596: 98.2138% ( 2) 00:15:56.043 2.607 - 2.619: 98.2210% ( 1) 00:15:56.043 2.619 - 2.631: 98.2355% ( 2) 00:15:56.043 2.643 - 2.655: 98.2427% ( 1) 00:15:56.043 2.655 - 2.667: 98.2499% ( 1) 00:15:56.043 2.679 - 2.690: 98.2572% ( 1) 00:15:56.043 2.690 - 2.702: 98.2644% ( 1) 00:15:56.043 2.750 - 2.761: 98.2716% ( 1) 00:15:56.043 2.844 - 2.856: 98.2861% ( 2) 00:15:56.043 2.880 - 2.892: 98.2933% ( 1) 00:15:56.043 2.892 - 2.904: 98.3078% ( 2) 00:15:56.043 2.963 - 2.975: 98.3150% ( 1) 00:15:56.043 3.034 - 3.058: 98.3367% ( 3) 00:15:56.043 3.081 - 3.105: 98.3512% ( 2) 00:15:56.043 3.105 - 3.129: 98.3656% ( 2) 00:15:56.043 3.153 - 3.176: 98.3946% ( 4) 00:15:56.043 3.176 - 3.200: 98.4018% ( 1) 00:15:56.043 3.224 - 3.247: 98.4090% ( 1) 00:15:56.043 3.342 - 3.366: 98.4163% ( 1) 00:15:56.043 3.390 - 3.413: 98.4235% ( 1) 00:15:56.043 3.413 - 3.437: 98.4380% ( 2) 00:15:56.043 3.437 - 3.461: 98.4524% ( 2) 00:15:56.043 3.461 - 3.484: 98.4669% ( 2) 00:15:56.043 3.484 - 3.508: 98.4886% ( 3) 00:15:56.043 3.508 - 3.532: 98.5103% ( 3) 00:15:56.043 3.532 - 3.556: 98.5247% ( 2) 00:15:56.043 3.556 - 3.579: 98.5464% ( 3) 00:15:56.043 3.579 - 3.603: 98.5609% ( 2) 00:15:56.043 3.627 - 3.650: 98.5754% ( 2) 00:15:56.043 3.674 - 3.698: 98.5970% ( 3) 00:15:56.043 3.721 - 3.745: 98.6043% ( 1) 00:15:56.043 3.745 - 3.769: 98.6115% ( 1) 00:15:56.043 3.769 - 3.793: 98.6332% ( 3) 00:15:56.043 3.793 - 3.816: 98.6404% ( 1) 00:15:56.043 3.911 - 3.935: 98.6477% ( 1) 00:15:56.043 3.935 - 3.959: 98.6549% ( 1) 00:15:56.043 3.959 - 3.982: 98.6694% ( 2) 00:15:56.043 4.148 - 4.172: 98.6766% ( 1) 00:15:56.043 4.788 - 4.812: 98.6838% ( 1) 00:15:56.043 5.310 - 5.333: 98.6911% ( 1) 00:15:56.043 5.333 - 5.357: 98.6983% ( 1) 00:15:56.043 6.044 - 6.068: 98.7055% ( 1) 00:15:56.043 6.163 - 6.210: 98.7128% ( 1) 00:15:56.043 6.305 - 6.353: 98.7200% ( 1) 00:15:56.043 6.353 - 6.400: 98.7272% ( 1) 00:15:56.043 6.495 - 6.542: 98.7345% ( 1) 00:15:56.043 6.542 - 6.590: 98.7417% ( 1) 00:15:56.043 6.684 - 6.732: 98.7489% ( 1) 00:15:56.043 6.732 - 6.779: 98.7706% ( 3) 00:15:56.043 7.111 - 7.159: 98.7778% ( 1) 00:15:56.043 8.107 - 8.154: 98.7851% ( 1) 00:15:56.043 8.154 - 8.201: 98.7923% ( 1) 00:15:56.043 10.240 - 10.287: 98.7995% ( 1) 00:15:56.043 10.951 - 10.999: 98.8068% ( 1) 00:15:56.043 15.455 - 15.550: 98.8140% ( 1) 00:15:56.043 15.550 - 15.644: 98.8285% ( 2) 00:15:56.043 15.644 - 15.739: 98.8357% ( 1) 00:15:56.043 15.739 - 15.834: 98.8791% ( 6) 00:15:56.043 15.834 - 15.929: 98.9008% ( 3) 00:15:56.043 15.929 - 16.024: 98.9297% ( 4) 00:15:56.043 16.024 - 16.119: 98.9586% ( 4) 00:15:56.043 16.119 - 16.213: 98.9731% ( 2) 00:15:56.043 16.213 - 16.308: 99.0165% ( 6) 00:15:56.043 16.308 - 16.403: 99.0816% ( 9) 00:15:56.043 16.403 - 16.498: 99.0888% ( 1) 00:15:56.043 16.498 - 16.593: 99.2045% ( 16) 00:15:56.043 16.593 - 16.687: 99.2262% ( 3) 00:15:56.043 16.687 - 16.782: 99.2624% ( 5) 00:15:56.043 16.782 - 16.877: 99.2913% ( 4) 00:15:56.043 16.877 - 16.972: 99.2985% ( 1) 00:15:56.043 16.972 - 17.067: 99.3491% ( 7) 00:15:56.043 17.067 - 17.161: 99.3636% ( 2) 00:15:56.043 17.256 - 17.351: 99.3708% ( 1) 00:15:56.043 17.446 - 17.541: 99.3853% ( 2) 00:15:56.043 17.636 - 17.730: 99.3998% ( 2) 00:15:56.043 18.110 - 18.204: 99.4070% ( 1) 00:15:56.043 18.299 - 18.394: 99.4215% ( 2) 00:15:56.043 18.489 - 18.584: 99.4287% ( 1) 00:15:56.043 18.868 - 18.963: 99.4359% ( 1) 00:15:56.043 24.462 - 24.652: 99.4432% ( 1) 00:15:56.043 1025.517 - 1031.585: 99.4504% ( 1) 00:15:56.043 3009.801 - 3021.938: 99.4576% ( 1) 00:15:56.043 3349.618 - 3373.890: 99.4649% ( 1) 00:15:56.043 3980.705 - 4004.978: 99.8771% ( 57) 00:15:56.043 4004.978 - 4029.250: 99.9783% ( 14) 00:15:56.043 4975.881 - 5000.154: 99.9928% ( 2) 00:15:56.043 6990.507 - 7039.052: 100.0000% ( 1) 00:15:56.043 00:15:56.043 10:02:01 -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user2/2 nqn.2019-07.io.spdk:cnode2 2 00:15:56.043 10:02:01 -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user2/2 00:15:56.043 10:02:01 -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode2 00:15:56.043 10:02:01 -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc4 00:15:56.043 10:02:01 -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:56.301 [ 00:15:56.301 { 00:15:56.301 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:56.301 "subtype": "Discovery", 00:15:56.301 "listen_addresses": [], 00:15:56.301 "allow_any_host": true, 00:15:56.301 "hosts": [] 00:15:56.301 }, 00:15:56.301 { 00:15:56.301 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:56.301 "subtype": "NVMe", 00:15:56.301 "listen_addresses": [ 00:15:56.301 { 00:15:56.301 "transport": "VFIOUSER", 00:15:56.301 "trtype": "VFIOUSER", 00:15:56.301 "adrfam": "IPv4", 00:15:56.301 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:56.301 "trsvcid": "0" 00:15:56.301 } 00:15:56.301 ], 00:15:56.301 "allow_any_host": true, 00:15:56.301 "hosts": [], 00:15:56.301 "serial_number": "SPDK1", 00:15:56.301 "model_number": "SPDK bdev Controller", 00:15:56.301 "max_namespaces": 32, 00:15:56.301 "min_cntlid": 1, 00:15:56.301 "max_cntlid": 65519, 00:15:56.301 "namespaces": [ 00:15:56.301 { 00:15:56.301 "nsid": 1, 00:15:56.301 "bdev_name": "Malloc1", 00:15:56.301 "name": "Malloc1", 00:15:56.301 "nguid": "1797673242D74484BBFC63F3AA9FDA3D", 00:15:56.301 "uuid": "17976732-42d7-4484-bbfc-63f3aa9fda3d" 00:15:56.301 }, 00:15:56.301 { 00:15:56.301 "nsid": 2, 00:15:56.301 "bdev_name": "Malloc3", 00:15:56.301 "name": "Malloc3", 00:15:56.301 "nguid": "5FCD1A128480423185839102EFCBCDED", 00:15:56.301 "uuid": "5fcd1a12-8480-4231-8583-9102efcbcded" 00:15:56.301 } 00:15:56.301 ] 00:15:56.301 }, 00:15:56.301 { 00:15:56.301 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:56.301 "subtype": "NVMe", 00:15:56.301 "listen_addresses": [ 00:15:56.301 { 00:15:56.301 "transport": "VFIOUSER", 00:15:56.301 "trtype": "VFIOUSER", 00:15:56.301 "adrfam": "IPv4", 00:15:56.301 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:56.301 "trsvcid": "0" 00:15:56.301 } 00:15:56.301 ], 00:15:56.301 "allow_any_host": true, 00:15:56.301 "hosts": [], 00:15:56.301 "serial_number": "SPDK2", 00:15:56.301 "model_number": "SPDK bdev Controller", 00:15:56.301 "max_namespaces": 32, 00:15:56.301 "min_cntlid": 1, 00:15:56.301 "max_cntlid": 65519, 00:15:56.301 "namespaces": [ 00:15:56.301 { 00:15:56.301 "nsid": 1, 00:15:56.301 "bdev_name": "Malloc2", 00:15:56.301 "name": "Malloc2", 00:15:56.301 "nguid": "8C581C381B2C42CE826F5B1956643DDD", 00:15:56.301 "uuid": "8c581c38-1b2c-42ce-826f-5b1956643ddd" 00:15:56.301 } 00:15:56.301 ] 00:15:56.301 } 00:15:56.301 ] 00:15:56.301 10:02:02 -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:15:56.301 10:02:02 -- target/nvmf_vfio_user.sh@34 -- # aerpid=2789835 00:15:56.301 10:02:02 -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -n 2 -g -t /tmp/aer_touch_file 00:15:56.301 10:02:02 -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:15:56.301 10:02:02 -- common/autotest_common.sh@1244 -- # local i=0 00:15:56.301 10:02:02 -- common/autotest_common.sh@1245 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:56.301 10:02:02 -- common/autotest_common.sh@1251 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:56.301 10:02:02 -- common/autotest_common.sh@1255 -- # return 0 00:15:56.301 10:02:02 -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:15:56.301 10:02:02 -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc4 00:15:56.301 EAL: No free 2048 kB hugepages reported on node 1 00:15:56.558 Malloc4 00:15:56.558 10:02:02 -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc4 -n 2 00:15:56.815 10:02:02 -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:56.815 Asynchronous Event Request test 00:15:56.815 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:15:56.815 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:15:56.815 Registering asynchronous event callbacks... 00:15:56.815 Starting namespace attribute notice tests for all controllers... 00:15:56.815 /var/run/vfio-user/domain/vfio-user2/2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:15:56.815 aer_cb - Changed Namespace 00:15:56.815 Cleaning up... 00:15:57.080 [ 00:15:57.080 { 00:15:57.080 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:57.080 "subtype": "Discovery", 00:15:57.080 "listen_addresses": [], 00:15:57.080 "allow_any_host": true, 00:15:57.080 "hosts": [] 00:15:57.080 }, 00:15:57.080 { 00:15:57.080 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:57.080 "subtype": "NVMe", 00:15:57.080 "listen_addresses": [ 00:15:57.080 { 00:15:57.080 "transport": "VFIOUSER", 00:15:57.080 "trtype": "VFIOUSER", 00:15:57.081 "adrfam": "IPv4", 00:15:57.081 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:57.081 "trsvcid": "0" 00:15:57.081 } 00:15:57.081 ], 00:15:57.081 "allow_any_host": true, 00:15:57.081 "hosts": [], 00:15:57.081 "serial_number": "SPDK1", 00:15:57.081 "model_number": "SPDK bdev Controller", 00:15:57.081 "max_namespaces": 32, 00:15:57.081 "min_cntlid": 1, 00:15:57.081 "max_cntlid": 65519, 00:15:57.081 "namespaces": [ 00:15:57.081 { 00:15:57.081 "nsid": 1, 00:15:57.081 "bdev_name": "Malloc1", 00:15:57.081 "name": "Malloc1", 00:15:57.081 "nguid": "1797673242D74484BBFC63F3AA9FDA3D", 00:15:57.081 "uuid": "17976732-42d7-4484-bbfc-63f3aa9fda3d" 00:15:57.081 }, 00:15:57.081 { 00:15:57.081 "nsid": 2, 00:15:57.081 "bdev_name": "Malloc3", 00:15:57.081 "name": "Malloc3", 00:15:57.081 "nguid": "5FCD1A128480423185839102EFCBCDED", 00:15:57.081 "uuid": "5fcd1a12-8480-4231-8583-9102efcbcded" 00:15:57.081 } 00:15:57.081 ] 00:15:57.081 }, 00:15:57.081 { 00:15:57.081 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:57.081 "subtype": "NVMe", 00:15:57.081 "listen_addresses": [ 00:15:57.081 { 00:15:57.081 "transport": "VFIOUSER", 00:15:57.081 "trtype": "VFIOUSER", 00:15:57.081 "adrfam": "IPv4", 00:15:57.081 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:57.081 "trsvcid": "0" 00:15:57.081 } 00:15:57.081 ], 00:15:57.081 "allow_any_host": true, 00:15:57.081 "hosts": [], 00:15:57.081 "serial_number": "SPDK2", 00:15:57.081 "model_number": "SPDK bdev Controller", 00:15:57.081 "max_namespaces": 32, 00:15:57.081 "min_cntlid": 1, 00:15:57.081 "max_cntlid": 65519, 00:15:57.081 "namespaces": [ 00:15:57.081 { 00:15:57.081 "nsid": 1, 00:15:57.081 "bdev_name": "Malloc2", 00:15:57.081 "name": "Malloc2", 00:15:57.081 "nguid": "8C581C381B2C42CE826F5B1956643DDD", 00:15:57.081 "uuid": "8c581c38-1b2c-42ce-826f-5b1956643ddd" 00:15:57.081 }, 00:15:57.081 { 00:15:57.081 "nsid": 2, 00:15:57.081 "bdev_name": "Malloc4", 00:15:57.081 "name": "Malloc4", 00:15:57.081 "nguid": "FFD323B66C784BA5882C7BD7B88F5CD3", 00:15:57.081 "uuid": "ffd323b6-6c78-4ba5-882c-7bd7b88f5cd3" 00:15:57.081 } 00:15:57.081 ] 00:15:57.081 } 00:15:57.081 ] 00:15:57.081 10:02:02 -- target/nvmf_vfio_user.sh@44 -- # wait 2789835 00:15:57.081 10:02:02 -- target/nvmf_vfio_user.sh@105 -- # stop_nvmf_vfio_user 00:15:57.081 10:02:02 -- target/nvmf_vfio_user.sh@95 -- # killprocess 2784066 00:15:57.081 10:02:02 -- common/autotest_common.sh@926 -- # '[' -z 2784066 ']' 00:15:57.081 10:02:02 -- common/autotest_common.sh@930 -- # kill -0 2784066 00:15:57.081 10:02:02 -- common/autotest_common.sh@931 -- # uname 00:15:57.081 10:02:02 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:15:57.081 10:02:02 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2784066 00:15:57.081 10:02:02 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:15:57.081 10:02:02 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:15:57.081 10:02:02 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2784066' 00:15:57.081 killing process with pid 2784066 00:15:57.081 10:02:02 -- common/autotest_common.sh@945 -- # kill 2784066 00:15:57.081 [2024-07-13 10:02:02.813756] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:15:57.081 10:02:02 -- common/autotest_common.sh@950 -- # wait 2784066 00:15:57.645 10:02:03 -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:15:57.645 10:02:03 -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:15:57.645 10:02:03 -- target/nvmf_vfio_user.sh@108 -- # setup_nvmf_vfio_user --interrupt-mode '-M -I' 00:15:57.646 10:02:03 -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args=--interrupt-mode 00:15:57.646 10:02:03 -- target/nvmf_vfio_user.sh@52 -- # local 'transport_args=-M -I' 00:15:57.646 10:02:03 -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=2789977 00:15:57.646 10:02:03 -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' --interrupt-mode 00:15:57.646 10:02:03 -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 2789977' 00:15:57.646 Process pid: 2789977 00:15:57.646 10:02:03 -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:15:57.646 10:02:03 -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 2789977 00:15:57.646 10:02:03 -- common/autotest_common.sh@819 -- # '[' -z 2789977 ']' 00:15:57.646 10:02:03 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:57.646 10:02:03 -- common/autotest_common.sh@824 -- # local max_retries=100 00:15:57.646 10:02:03 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:57.646 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:57.646 10:02:03 -- common/autotest_common.sh@828 -- # xtrace_disable 00:15:57.646 10:02:03 -- common/autotest_common.sh@10 -- # set +x 00:15:57.646 [2024-07-13 10:02:03.202997] thread.c:2927:spdk_interrupt_mode_enable: *NOTICE*: Set SPDK running in interrupt mode. 00:15:57.646 [2024-07-13 10:02:03.204025] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:15:57.646 [2024-07-13 10:02:03.204086] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:57.646 EAL: No free 2048 kB hugepages reported on node 1 00:15:57.646 [2024-07-13 10:02:03.267373] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:57.646 [2024-07-13 10:02:03.361053] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:57.646 [2024-07-13 10:02:03.361220] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:57.646 [2024-07-13 10:02:03.361238] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:57.646 [2024-07-13 10:02:03.361251] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:57.646 [2024-07-13 10:02:03.361303] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:57.646 [2024-07-13 10:02:03.361357] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:57.646 [2024-07-13 10:02:03.361429] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:57.646 [2024-07-13 10:02:03.361432] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:57.646 [2024-07-13 10:02:03.455140] thread.c:2085:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_0) to intr mode from intr mode. 00:15:57.646 [2024-07-13 10:02:03.455400] thread.c:2085:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_1) to intr mode from intr mode. 00:15:57.646 [2024-07-13 10:02:03.455647] thread.c:2085:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_2) to intr mode from intr mode. 00:15:57.646 [2024-07-13 10:02:03.456338] thread.c:2085:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (app_thread) to intr mode from intr mode. 00:15:57.646 [2024-07-13 10:02:03.456433] thread.c:2085:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_3) to intr mode from intr mode. 00:15:58.574 10:02:04 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:15:58.574 10:02:04 -- common/autotest_common.sh@852 -- # return 0 00:15:58.574 10:02:04 -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:15:59.501 10:02:05 -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER -M -I 00:15:59.759 10:02:05 -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:15:59.759 10:02:05 -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:15:59.759 10:02:05 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:59.759 10:02:05 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:15:59.759 10:02:05 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:16:00.018 Malloc1 00:16:00.018 10:02:05 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:16:00.276 10:02:05 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:16:00.534 10:02:06 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:16:00.791 10:02:06 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:16:00.791 10:02:06 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:16:00.791 10:02:06 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:16:01.049 Malloc2 00:16:01.049 10:02:06 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:16:01.305 10:02:06 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:16:01.563 10:02:07 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:16:01.821 10:02:07 -- target/nvmf_vfio_user.sh@109 -- # stop_nvmf_vfio_user 00:16:01.821 10:02:07 -- target/nvmf_vfio_user.sh@95 -- # killprocess 2789977 00:16:01.821 10:02:07 -- common/autotest_common.sh@926 -- # '[' -z 2789977 ']' 00:16:01.821 10:02:07 -- common/autotest_common.sh@930 -- # kill -0 2789977 00:16:01.821 10:02:07 -- common/autotest_common.sh@931 -- # uname 00:16:01.821 10:02:07 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:16:01.821 10:02:07 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2789977 00:16:01.821 10:02:07 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:16:01.821 10:02:07 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:16:01.821 10:02:07 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2789977' 00:16:01.821 killing process with pid 2789977 00:16:01.821 10:02:07 -- common/autotest_common.sh@945 -- # kill 2789977 00:16:01.821 10:02:07 -- common/autotest_common.sh@950 -- # wait 2789977 00:16:02.080 10:02:07 -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:16:02.080 10:02:07 -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:16:02.080 00:16:02.080 real 0m53.616s 00:16:02.080 user 3m31.611s 00:16:02.080 sys 0m4.661s 00:16:02.080 10:02:07 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:16:02.080 10:02:07 -- common/autotest_common.sh@10 -- # set +x 00:16:02.080 ************************************ 00:16:02.080 END TEST nvmf_vfio_user 00:16:02.080 ************************************ 00:16:02.080 10:02:07 -- nvmf/nvmf.sh@41 -- # run_test nvmf_vfio_user_nvme_compliance /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:16:02.080 10:02:07 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:16:02.080 10:02:07 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:16:02.080 10:02:07 -- common/autotest_common.sh@10 -- # set +x 00:16:02.080 ************************************ 00:16:02.080 START TEST nvmf_vfio_user_nvme_compliance 00:16:02.080 ************************************ 00:16:02.080 10:02:07 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:16:02.080 * Looking for test storage... 00:16:02.080 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance 00:16:02.080 10:02:07 -- compliance/compliance.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:02.080 10:02:07 -- nvmf/common.sh@7 -- # uname -s 00:16:02.080 10:02:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:02.080 10:02:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:02.080 10:02:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:02.080 10:02:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:02.080 10:02:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:02.080 10:02:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:02.080 10:02:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:02.080 10:02:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:02.080 10:02:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:02.080 10:02:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:02.080 10:02:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:02.080 10:02:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:02.080 10:02:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:02.080 10:02:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:02.080 10:02:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:02.080 10:02:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:02.080 10:02:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:02.080 10:02:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:02.080 10:02:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:02.080 10:02:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:02.080 10:02:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:02.080 10:02:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:02.080 10:02:07 -- paths/export.sh@5 -- # export PATH 00:16:02.080 10:02:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:02.080 10:02:07 -- nvmf/common.sh@46 -- # : 0 00:16:02.080 10:02:07 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:02.080 10:02:07 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:02.080 10:02:07 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:02.080 10:02:07 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:02.080 10:02:07 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:02.080 10:02:07 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:02.080 10:02:07 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:02.080 10:02:07 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:02.080 10:02:07 -- compliance/compliance.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:02.080 10:02:07 -- compliance/compliance.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:02.080 10:02:07 -- compliance/compliance.sh@14 -- # export TEST_TRANSPORT=VFIOUSER 00:16:02.080 10:02:07 -- compliance/compliance.sh@14 -- # TEST_TRANSPORT=VFIOUSER 00:16:02.080 10:02:07 -- compliance/compliance.sh@16 -- # rm -rf /var/run/vfio-user 00:16:02.080 10:02:07 -- compliance/compliance.sh@20 -- # nvmfpid=2790600 00:16:02.080 10:02:07 -- compliance/compliance.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:16:02.080 10:02:07 -- compliance/compliance.sh@21 -- # echo 'Process pid: 2790600' 00:16:02.080 Process pid: 2790600 00:16:02.080 10:02:07 -- compliance/compliance.sh@23 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:02.080 10:02:07 -- compliance/compliance.sh@24 -- # waitforlisten 2790600 00:16:02.080 10:02:07 -- common/autotest_common.sh@819 -- # '[' -z 2790600 ']' 00:16:02.080 10:02:07 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:02.080 10:02:07 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:02.080 10:02:07 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:02.080 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:02.080 10:02:07 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:02.080 10:02:07 -- common/autotest_common.sh@10 -- # set +x 00:16:02.080 [2024-07-13 10:02:07.829604] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:16:02.080 [2024-07-13 10:02:07.829687] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:02.080 EAL: No free 2048 kB hugepages reported on node 1 00:16:02.080 [2024-07-13 10:02:07.886633] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:02.339 [2024-07-13 10:02:07.970924] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:02.339 [2024-07-13 10:02:07.971079] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:02.339 [2024-07-13 10:02:07.971096] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:02.339 [2024-07-13 10:02:07.971108] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:02.339 [2024-07-13 10:02:07.971175] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:02.339 [2024-07-13 10:02:07.971259] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:02.339 [2024-07-13 10:02:07.971261] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:03.300 10:02:08 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:03.300 10:02:08 -- common/autotest_common.sh@852 -- # return 0 00:16:03.300 10:02:08 -- compliance/compliance.sh@26 -- # sleep 1 00:16:04.232 10:02:09 -- compliance/compliance.sh@28 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:16:04.232 10:02:09 -- compliance/compliance.sh@29 -- # traddr=/var/run/vfio-user 00:16:04.232 10:02:09 -- compliance/compliance.sh@31 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:16:04.232 10:02:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:04.232 10:02:09 -- common/autotest_common.sh@10 -- # set +x 00:16:04.232 10:02:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:04.232 10:02:09 -- compliance/compliance.sh@33 -- # mkdir -p /var/run/vfio-user 00:16:04.232 10:02:09 -- compliance/compliance.sh@35 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:16:04.232 10:02:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:04.232 10:02:09 -- common/autotest_common.sh@10 -- # set +x 00:16:04.232 malloc0 00:16:04.232 10:02:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:04.232 10:02:09 -- compliance/compliance.sh@36 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk -m 32 00:16:04.232 10:02:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:04.232 10:02:09 -- common/autotest_common.sh@10 -- # set +x 00:16:04.232 10:02:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:04.232 10:02:09 -- compliance/compliance.sh@37 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:16:04.232 10:02:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:04.232 10:02:09 -- common/autotest_common.sh@10 -- # set +x 00:16:04.232 10:02:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:04.232 10:02:09 -- compliance/compliance.sh@38 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:16:04.232 10:02:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:04.232 10:02:09 -- common/autotest_common.sh@10 -- # set +x 00:16:04.232 10:02:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:04.232 10:02:09 -- compliance/compliance.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/nvme_compliance -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user subnqn:nqn.2021-09.io.spdk:cnode0' 00:16:04.232 EAL: No free 2048 kB hugepages reported on node 1 00:16:04.232 00:16:04.232 00:16:04.232 CUnit - A unit testing framework for C - Version 2.1-3 00:16:04.232 http://cunit.sourceforge.net/ 00:16:04.232 00:16:04.232 00:16:04.232 Suite: nvme_compliance 00:16:04.232 Test: admin_identify_ctrlr_verify_dptr ...[2024-07-13 10:02:09.997226] vfio_user.c: 789:nvme_cmd_map_prps: *ERROR*: no PRP2, 3072 remaining 00:16:04.232 [2024-07-13 10:02:09.997271] vfio_user.c:5484:map_admin_cmd_req: *ERROR*: /var/run/vfio-user: map Admin Opc 6 failed 00:16:04.232 [2024-07-13 10:02:09.997284] vfio_user.c:5576:handle_cmd_req: *ERROR*: /var/run/vfio-user: process NVMe command opc 0x6 failed 00:16:04.232 passed 00:16:04.490 Test: admin_identify_ctrlr_verify_fused ...passed 00:16:04.490 Test: admin_identify_ns ...[2024-07-13 10:02:10.233881] ctrlr.c:2598:_nvmf_subsystem_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 0 00:16:04.490 [2024-07-13 10:02:10.241887] ctrlr.c:2598:_nvmf_subsystem_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 4294967295 00:16:04.490 passed 00:16:04.748 Test: admin_get_features_mandatory_features ...passed 00:16:04.748 Test: admin_get_features_optional_features ...passed 00:16:05.006 Test: admin_set_features_number_of_queues ...passed 00:16:05.006 Test: admin_get_log_page_mandatory_logs ...passed 00:16:05.263 Test: admin_get_log_page_with_lpo ...[2024-07-13 10:02:10.862886] ctrlr.c:2546:nvmf_ctrlr_get_log_page: *ERROR*: Get log page: offset (516) > len (512) 00:16:05.263 passed 00:16:05.263 Test: fabric_property_get ...passed 00:16:05.263 Test: admin_delete_io_sq_use_admin_qid ...[2024-07-13 10:02:11.049280] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:0 does not exist 00:16:05.521 passed 00:16:05.521 Test: admin_delete_io_sq_delete_sq_twice ...[2024-07-13 10:02:11.219889] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:05.521 [2024-07-13 10:02:11.235889] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:05.521 passed 00:16:05.521 Test: admin_delete_io_cq_use_admin_qid ...[2024-07-13 10:02:11.325886] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O cqid:0 does not exist 00:16:05.778 passed 00:16:05.778 Test: admin_delete_io_cq_delete_cq_first ...[2024-07-13 10:02:11.483874] vfio_user.c:2310:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:16:05.778 [2024-07-13 10:02:11.507892] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:05.779 passed 00:16:06.035 Test: admin_create_io_cq_verify_iv_pc ...[2024-07-13 10:02:11.597771] vfio_user.c:2150:handle_create_io_cq: *ERROR*: /var/run/vfio-user: IV is too big 00:16:06.035 [2024-07-13 10:02:11.597830] vfio_user.c:2144:handle_create_io_cq: *ERROR*: /var/run/vfio-user: non-PC CQ not supported 00:16:06.035 passed 00:16:06.036 Test: admin_create_io_sq_verify_qsize_cqid ...[2024-07-13 10:02:11.774876] vfio_user.c:2231:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 1 00:16:06.036 [2024-07-13 10:02:11.782913] vfio_user.c:2231:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 257 00:16:06.036 [2024-07-13 10:02:11.790879] vfio_user.c:2031:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:0 00:16:06.036 [2024-07-13 10:02:11.798891] vfio_user.c:2031:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:128 00:16:06.293 passed 00:16:06.293 Test: admin_create_io_sq_verify_pc ...[2024-07-13 10:02:11.928887] vfio_user.c:2044:handle_create_io_sq: *ERROR*: /var/run/vfio-user: non-PC SQ not supported 00:16:06.293 passed 00:16:07.662 Test: admin_create_io_qp_max_qps ...[2024-07-13 10:02:13.124881] nvme_ctrlr.c:5318:spdk_nvme_ctrlr_alloc_qid: *ERROR*: [/var/run/vfio-user] No free I/O queue IDs 00:16:07.919 passed 00:16:07.919 Test: admin_create_io_sq_shared_cq ...[2024-07-13 10:02:13.724892] vfio_user.c:2310:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:16:08.176 passed 00:16:08.176 00:16:08.176 Run Summary: Type Total Ran Passed Failed Inactive 00:16:08.176 suites 1 1 n/a 0 0 00:16:08.176 tests 18 18 18 0 0 00:16:08.176 asserts 360 360 360 0 n/a 00:16:08.176 00:16:08.176 Elapsed time = 1.555 seconds 00:16:08.176 10:02:13 -- compliance/compliance.sh@42 -- # killprocess 2790600 00:16:08.176 10:02:13 -- common/autotest_common.sh@926 -- # '[' -z 2790600 ']' 00:16:08.176 10:02:13 -- common/autotest_common.sh@930 -- # kill -0 2790600 00:16:08.176 10:02:13 -- common/autotest_common.sh@931 -- # uname 00:16:08.176 10:02:13 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:16:08.176 10:02:13 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2790600 00:16:08.176 10:02:13 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:16:08.176 10:02:13 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:16:08.176 10:02:13 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2790600' 00:16:08.176 killing process with pid 2790600 00:16:08.176 10:02:13 -- common/autotest_common.sh@945 -- # kill 2790600 00:16:08.176 10:02:13 -- common/autotest_common.sh@950 -- # wait 2790600 00:16:08.433 10:02:14 -- compliance/compliance.sh@44 -- # rm -rf /var/run/vfio-user 00:16:08.433 10:02:14 -- compliance/compliance.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:16:08.433 00:16:08.433 real 0m6.348s 00:16:08.433 user 0m18.229s 00:16:08.433 sys 0m0.553s 00:16:08.433 10:02:14 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:16:08.433 10:02:14 -- common/autotest_common.sh@10 -- # set +x 00:16:08.433 ************************************ 00:16:08.433 END TEST nvmf_vfio_user_nvme_compliance 00:16:08.433 ************************************ 00:16:08.433 10:02:14 -- nvmf/nvmf.sh@42 -- # run_test nvmf_vfio_user_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:16:08.433 10:02:14 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:16:08.433 10:02:14 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:16:08.433 10:02:14 -- common/autotest_common.sh@10 -- # set +x 00:16:08.433 ************************************ 00:16:08.433 START TEST nvmf_vfio_user_fuzz 00:16:08.433 ************************************ 00:16:08.433 10:02:14 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:16:08.433 * Looking for test storage... 00:16:08.433 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:08.433 10:02:14 -- target/vfio_user_fuzz.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:08.433 10:02:14 -- nvmf/common.sh@7 -- # uname -s 00:16:08.433 10:02:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:08.433 10:02:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:08.433 10:02:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:08.433 10:02:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:08.433 10:02:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:08.433 10:02:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:08.433 10:02:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:08.433 10:02:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:08.433 10:02:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:08.433 10:02:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:08.433 10:02:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:08.433 10:02:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:08.433 10:02:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:08.433 10:02:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:08.433 10:02:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:08.433 10:02:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:08.433 10:02:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:08.433 10:02:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:08.433 10:02:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:08.433 10:02:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:08.433 10:02:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:08.433 10:02:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:08.433 10:02:14 -- paths/export.sh@5 -- # export PATH 00:16:08.433 10:02:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:08.433 10:02:14 -- nvmf/common.sh@46 -- # : 0 00:16:08.433 10:02:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:08.433 10:02:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:08.433 10:02:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:08.433 10:02:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:08.433 10:02:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:08.433 10:02:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:08.433 10:02:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:08.433 10:02:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:08.433 10:02:14 -- target/vfio_user_fuzz.sh@12 -- # MALLOC_BDEV_SIZE=64 00:16:08.433 10:02:14 -- target/vfio_user_fuzz.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:16:08.433 10:02:14 -- target/vfio_user_fuzz.sh@15 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:16:08.433 10:02:14 -- target/vfio_user_fuzz.sh@16 -- # traddr=/var/run/vfio-user 00:16:08.433 10:02:14 -- target/vfio_user_fuzz.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:16:08.433 10:02:14 -- target/vfio_user_fuzz.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:16:08.433 10:02:14 -- target/vfio_user_fuzz.sh@20 -- # rm -rf /var/run/vfio-user 00:16:08.433 10:02:14 -- target/vfio_user_fuzz.sh@24 -- # nvmfpid=2791469 00:16:08.433 10:02:14 -- target/vfio_user_fuzz.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:16:08.433 10:02:14 -- target/vfio_user_fuzz.sh@25 -- # echo 'Process pid: 2791469' 00:16:08.433 Process pid: 2791469 00:16:08.433 10:02:14 -- target/vfio_user_fuzz.sh@27 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:08.433 10:02:14 -- target/vfio_user_fuzz.sh@28 -- # waitforlisten 2791469 00:16:08.433 10:02:14 -- common/autotest_common.sh@819 -- # '[' -z 2791469 ']' 00:16:08.433 10:02:14 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:08.433 10:02:14 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:08.433 10:02:14 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:08.433 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:08.433 10:02:14 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:08.433 10:02:14 -- common/autotest_common.sh@10 -- # set +x 00:16:09.366 10:02:15 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:09.366 10:02:15 -- common/autotest_common.sh@852 -- # return 0 00:16:09.366 10:02:15 -- target/vfio_user_fuzz.sh@30 -- # sleep 1 00:16:10.740 10:02:16 -- target/vfio_user_fuzz.sh@32 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:16:10.740 10:02:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:10.740 10:02:16 -- common/autotest_common.sh@10 -- # set +x 00:16:10.740 10:02:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:10.740 10:02:16 -- target/vfio_user_fuzz.sh@34 -- # mkdir -p /var/run/vfio-user 00:16:10.740 10:02:16 -- target/vfio_user_fuzz.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:16:10.740 10:02:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:10.740 10:02:16 -- common/autotest_common.sh@10 -- # set +x 00:16:10.740 malloc0 00:16:10.740 10:02:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:10.740 10:02:16 -- target/vfio_user_fuzz.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk 00:16:10.740 10:02:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:10.740 10:02:16 -- common/autotest_common.sh@10 -- # set +x 00:16:10.740 10:02:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:10.740 10:02:16 -- target/vfio_user_fuzz.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:16:10.740 10:02:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:10.740 10:02:16 -- common/autotest_common.sh@10 -- # set +x 00:16:10.740 10:02:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:10.740 10:02:16 -- target/vfio_user_fuzz.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:16:10.740 10:02:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:10.740 10:02:16 -- common/autotest_common.sh@10 -- # set +x 00:16:10.740 10:02:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:10.740 10:02:16 -- target/vfio_user_fuzz.sh@41 -- # trid='trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' 00:16:10.740 10:02:16 -- target/vfio_user_fuzz.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/vfio_user_fuzz -t 30 -S 123456 -F 'trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' -N -a 00:16:42.798 Fuzzing completed. Shutting down the fuzz application 00:16:42.798 00:16:42.798 Dumping successful admin opcodes: 00:16:42.798 8, 9, 10, 24, 00:16:42.798 Dumping successful io opcodes: 00:16:42.798 0, 00:16:42.798 NS: 0x200003a1ef00 I/O qp, Total commands completed: 599726, total successful commands: 2320, random_seed: 886038976 00:16:42.798 NS: 0x200003a1ef00 admin qp, Total commands completed: 149208, total successful commands: 1201, random_seed: 197821632 00:16:42.798 10:02:46 -- target/vfio_user_fuzz.sh@44 -- # rpc_cmd nvmf_delete_subsystem nqn.2021-09.io.spdk:cnode0 00:16:42.798 10:02:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:42.798 10:02:46 -- common/autotest_common.sh@10 -- # set +x 00:16:42.798 10:02:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:42.798 10:02:46 -- target/vfio_user_fuzz.sh@46 -- # killprocess 2791469 00:16:42.798 10:02:46 -- common/autotest_common.sh@926 -- # '[' -z 2791469 ']' 00:16:42.798 10:02:46 -- common/autotest_common.sh@930 -- # kill -0 2791469 00:16:42.798 10:02:46 -- common/autotest_common.sh@931 -- # uname 00:16:42.798 10:02:46 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:16:42.798 10:02:46 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2791469 00:16:42.798 10:02:46 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:16:42.798 10:02:46 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:16:42.798 10:02:46 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2791469' 00:16:42.798 killing process with pid 2791469 00:16:42.798 10:02:46 -- common/autotest_common.sh@945 -- # kill 2791469 00:16:42.798 10:02:46 -- common/autotest_common.sh@950 -- # wait 2791469 00:16:42.798 10:02:46 -- target/vfio_user_fuzz.sh@48 -- # rm -rf /var/run/vfio-user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_log.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_tgt_output.txt 00:16:42.798 10:02:46 -- target/vfio_user_fuzz.sh@50 -- # trap - SIGINT SIGTERM EXIT 00:16:42.798 00:16:42.798 real 0m32.888s 00:16:42.798 user 0m34.591s 00:16:42.798 sys 0m27.741s 00:16:42.798 10:02:46 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:16:42.798 10:02:46 -- common/autotest_common.sh@10 -- # set +x 00:16:42.798 ************************************ 00:16:42.798 END TEST nvmf_vfio_user_fuzz 00:16:42.798 ************************************ 00:16:42.798 10:02:47 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:16:42.798 10:02:47 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:16:42.798 10:02:47 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:16:42.798 10:02:47 -- common/autotest_common.sh@10 -- # set +x 00:16:42.798 ************************************ 00:16:42.798 START TEST nvmf_host_management 00:16:42.798 ************************************ 00:16:42.798 10:02:47 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:16:42.798 * Looking for test storage... 00:16:42.798 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:42.798 10:02:47 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:42.798 10:02:47 -- nvmf/common.sh@7 -- # uname -s 00:16:42.798 10:02:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:42.798 10:02:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:42.798 10:02:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:42.798 10:02:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:42.798 10:02:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:42.798 10:02:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:42.798 10:02:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:42.798 10:02:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:42.798 10:02:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:42.798 10:02:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:42.798 10:02:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:42.798 10:02:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:42.798 10:02:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:42.798 10:02:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:42.798 10:02:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:42.798 10:02:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:42.798 10:02:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:42.798 10:02:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:42.798 10:02:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:42.798 10:02:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:42.798 10:02:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:42.798 10:02:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:42.798 10:02:47 -- paths/export.sh@5 -- # export PATH 00:16:42.798 10:02:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:42.798 10:02:47 -- nvmf/common.sh@46 -- # : 0 00:16:42.798 10:02:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:42.798 10:02:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:42.798 10:02:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:42.798 10:02:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:42.798 10:02:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:42.798 10:02:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:42.798 10:02:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:42.798 10:02:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:42.798 10:02:47 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:42.798 10:02:47 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:42.798 10:02:47 -- target/host_management.sh@104 -- # nvmftestinit 00:16:42.798 10:02:47 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:42.798 10:02:47 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:42.798 10:02:47 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:42.798 10:02:47 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:42.798 10:02:47 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:42.798 10:02:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:42.798 10:02:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:42.798 10:02:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:42.798 10:02:47 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:42.798 10:02:47 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:42.799 10:02:47 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:42.799 10:02:47 -- common/autotest_common.sh@10 -- # set +x 00:16:43.365 10:02:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:43.365 10:02:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:43.365 10:02:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:43.365 10:02:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:43.365 10:02:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:43.365 10:02:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:43.365 10:02:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:43.365 10:02:48 -- nvmf/common.sh@294 -- # net_devs=() 00:16:43.365 10:02:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:43.365 10:02:48 -- nvmf/common.sh@295 -- # e810=() 00:16:43.365 10:02:48 -- nvmf/common.sh@295 -- # local -ga e810 00:16:43.365 10:02:48 -- nvmf/common.sh@296 -- # x722=() 00:16:43.365 10:02:48 -- nvmf/common.sh@296 -- # local -ga x722 00:16:43.365 10:02:48 -- nvmf/common.sh@297 -- # mlx=() 00:16:43.365 10:02:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:43.365 10:02:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:43.365 10:02:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:43.365 10:02:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:43.365 10:02:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:43.365 10:02:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:43.365 10:02:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:43.365 10:02:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:43.365 10:02:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:43.365 10:02:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:43.365 10:02:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:43.365 10:02:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:43.365 10:02:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:43.365 10:02:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:43.365 10:02:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:43.365 10:02:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:43.365 10:02:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:43.365 10:02:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:43.365 10:02:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:43.365 10:02:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:43.365 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:43.365 10:02:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:43.365 10:02:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:43.365 10:02:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:43.365 10:02:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:43.365 10:02:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:43.365 10:02:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:43.365 10:02:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:43.365 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:43.365 10:02:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:43.365 10:02:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:43.365 10:02:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:43.365 10:02:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:43.365 10:02:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:43.365 10:02:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:43.365 10:02:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:43.365 10:02:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:43.365 10:02:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:43.365 10:02:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:43.365 10:02:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:43.365 10:02:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:43.365 10:02:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:43.365 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:43.365 10:02:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:43.365 10:02:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:43.365 10:02:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:43.365 10:02:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:43.365 10:02:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:43.366 10:02:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:43.366 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:43.366 10:02:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:43.366 10:02:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:43.366 10:02:48 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:43.366 10:02:48 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:43.366 10:02:48 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:43.366 10:02:48 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:43.366 10:02:48 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:43.366 10:02:48 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:43.366 10:02:48 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:43.366 10:02:48 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:43.366 10:02:48 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:43.366 10:02:48 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:43.366 10:02:48 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:43.366 10:02:48 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:43.366 10:02:48 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:43.366 10:02:48 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:43.366 10:02:48 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:43.366 10:02:48 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:43.366 10:02:48 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:43.366 10:02:48 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:43.366 10:02:48 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:43.366 10:02:48 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:43.366 10:02:48 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:43.366 10:02:49 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:43.366 10:02:49 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:43.366 10:02:49 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:43.366 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:43.366 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.184 ms 00:16:43.366 00:16:43.366 --- 10.0.0.2 ping statistics --- 00:16:43.366 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:43.366 rtt min/avg/max/mdev = 0.184/0.184/0.184/0.000 ms 00:16:43.366 10:02:49 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:43.366 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:43.366 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.156 ms 00:16:43.366 00:16:43.366 --- 10.0.0.1 ping statistics --- 00:16:43.366 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:43.366 rtt min/avg/max/mdev = 0.156/0.156/0.156/0.000 ms 00:16:43.366 10:02:49 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:43.366 10:02:49 -- nvmf/common.sh@410 -- # return 0 00:16:43.366 10:02:49 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:43.366 10:02:49 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:43.366 10:02:49 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:43.366 10:02:49 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:43.366 10:02:49 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:43.366 10:02:49 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:43.366 10:02:49 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:43.366 10:02:49 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:16:43.366 10:02:49 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:16:43.366 10:02:49 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:16:43.366 10:02:49 -- common/autotest_common.sh@10 -- # set +x 00:16:43.366 ************************************ 00:16:43.366 START TEST nvmf_host_management 00:16:43.366 ************************************ 00:16:43.366 10:02:49 -- common/autotest_common.sh@1104 -- # nvmf_host_management 00:16:43.366 10:02:49 -- target/host_management.sh@69 -- # starttarget 00:16:43.366 10:02:49 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:16:43.366 10:02:49 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:43.366 10:02:49 -- common/autotest_common.sh@712 -- # xtrace_disable 00:16:43.366 10:02:49 -- common/autotest_common.sh@10 -- # set +x 00:16:43.366 10:02:49 -- nvmf/common.sh@469 -- # nvmfpid=2797037 00:16:43.366 10:02:49 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:16:43.366 10:02:49 -- nvmf/common.sh@470 -- # waitforlisten 2797037 00:16:43.366 10:02:49 -- common/autotest_common.sh@819 -- # '[' -z 2797037 ']' 00:16:43.366 10:02:49 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:43.366 10:02:49 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:43.366 10:02:49 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:43.366 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:43.366 10:02:49 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:43.366 10:02:49 -- common/autotest_common.sh@10 -- # set +x 00:16:43.366 [2024-07-13 10:02:49.098497] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:16:43.366 [2024-07-13 10:02:49.098567] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:43.366 EAL: No free 2048 kB hugepages reported on node 1 00:16:43.366 [2024-07-13 10:02:49.171232] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:43.624 [2024-07-13 10:02:49.267992] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:43.624 [2024-07-13 10:02:49.268151] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:43.624 [2024-07-13 10:02:49.268184] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:43.624 [2024-07-13 10:02:49.268196] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:43.624 [2024-07-13 10:02:49.268292] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:43.624 [2024-07-13 10:02:49.268410] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:43.624 [2024-07-13 10:02:49.268475] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:16:43.624 [2024-07-13 10:02:49.268477] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:44.586 10:02:50 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:44.586 10:02:50 -- common/autotest_common.sh@852 -- # return 0 00:16:44.586 10:02:50 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:44.586 10:02:50 -- common/autotest_common.sh@718 -- # xtrace_disable 00:16:44.586 10:02:50 -- common/autotest_common.sh@10 -- # set +x 00:16:44.586 10:02:50 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:44.586 10:02:50 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:44.586 10:02:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:44.586 10:02:50 -- common/autotest_common.sh@10 -- # set +x 00:16:44.586 [2024-07-13 10:02:50.100434] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:44.586 10:02:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:44.586 10:02:50 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:16:44.586 10:02:50 -- common/autotest_common.sh@712 -- # xtrace_disable 00:16:44.586 10:02:50 -- common/autotest_common.sh@10 -- # set +x 00:16:44.586 10:02:50 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:16:44.586 10:02:50 -- target/host_management.sh@23 -- # cat 00:16:44.586 10:02:50 -- target/host_management.sh@30 -- # rpc_cmd 00:16:44.586 10:02:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:44.586 10:02:50 -- common/autotest_common.sh@10 -- # set +x 00:16:44.586 Malloc0 00:16:44.586 [2024-07-13 10:02:50.161478] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:44.586 10:02:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:44.586 10:02:50 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:16:44.586 10:02:50 -- common/autotest_common.sh@718 -- # xtrace_disable 00:16:44.586 10:02:50 -- common/autotest_common.sh@10 -- # set +x 00:16:44.586 10:02:50 -- target/host_management.sh@73 -- # perfpid=2797224 00:16:44.586 10:02:50 -- target/host_management.sh@74 -- # waitforlisten 2797224 /var/tmp/bdevperf.sock 00:16:44.586 10:02:50 -- common/autotest_common.sh@819 -- # '[' -z 2797224 ']' 00:16:44.586 10:02:50 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:16:44.586 10:02:50 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:16:44.586 10:02:50 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:44.586 10:02:50 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:44.586 10:02:50 -- nvmf/common.sh@520 -- # config=() 00:16:44.586 10:02:50 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:44.586 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:44.586 10:02:50 -- nvmf/common.sh@520 -- # local subsystem config 00:16:44.586 10:02:50 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:44.586 10:02:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:44.586 10:02:50 -- common/autotest_common.sh@10 -- # set +x 00:16:44.586 10:02:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:44.586 { 00:16:44.586 "params": { 00:16:44.586 "name": "Nvme$subsystem", 00:16:44.586 "trtype": "$TEST_TRANSPORT", 00:16:44.586 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:44.586 "adrfam": "ipv4", 00:16:44.586 "trsvcid": "$NVMF_PORT", 00:16:44.586 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:44.586 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:44.586 "hdgst": ${hdgst:-false}, 00:16:44.586 "ddgst": ${ddgst:-false} 00:16:44.586 }, 00:16:44.586 "method": "bdev_nvme_attach_controller" 00:16:44.586 } 00:16:44.586 EOF 00:16:44.586 )") 00:16:44.586 10:02:50 -- nvmf/common.sh@542 -- # cat 00:16:44.586 10:02:50 -- nvmf/common.sh@544 -- # jq . 00:16:44.586 10:02:50 -- nvmf/common.sh@545 -- # IFS=, 00:16:44.586 10:02:50 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:44.586 "params": { 00:16:44.586 "name": "Nvme0", 00:16:44.586 "trtype": "tcp", 00:16:44.586 "traddr": "10.0.0.2", 00:16:44.586 "adrfam": "ipv4", 00:16:44.586 "trsvcid": "4420", 00:16:44.586 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:16:44.586 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:16:44.586 "hdgst": false, 00:16:44.586 "ddgst": false 00:16:44.586 }, 00:16:44.586 "method": "bdev_nvme_attach_controller" 00:16:44.586 }' 00:16:44.586 [2024-07-13 10:02:50.234192] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:16:44.586 [2024-07-13 10:02:50.234298] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2797224 ] 00:16:44.586 EAL: No free 2048 kB hugepages reported on node 1 00:16:44.586 [2024-07-13 10:02:50.296551] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:44.586 [2024-07-13 10:02:50.381246] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:45.165 Running I/O for 10 seconds... 00:16:45.425 10:02:51 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:45.425 10:02:51 -- common/autotest_common.sh@852 -- # return 0 00:16:45.425 10:02:51 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:16:45.425 10:02:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:45.425 10:02:51 -- common/autotest_common.sh@10 -- # set +x 00:16:45.425 10:02:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:45.425 10:02:51 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:16:45.425 10:02:51 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:16:45.425 10:02:51 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:16:45.425 10:02:51 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:16:45.425 10:02:51 -- target/host_management.sh@52 -- # local ret=1 00:16:45.425 10:02:51 -- target/host_management.sh@53 -- # local i 00:16:45.425 10:02:51 -- target/host_management.sh@54 -- # (( i = 10 )) 00:16:45.425 10:02:51 -- target/host_management.sh@54 -- # (( i != 0 )) 00:16:45.425 10:02:51 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:16:45.425 10:02:51 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:16:45.425 10:02:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:45.425 10:02:51 -- common/autotest_common.sh@10 -- # set +x 00:16:45.425 10:02:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:45.425 10:02:51 -- target/host_management.sh@55 -- # read_io_count=1141 00:16:45.425 10:02:51 -- target/host_management.sh@58 -- # '[' 1141 -ge 100 ']' 00:16:45.425 10:02:51 -- target/host_management.sh@59 -- # ret=0 00:16:45.425 10:02:51 -- target/host_management.sh@60 -- # break 00:16:45.426 10:02:51 -- target/host_management.sh@64 -- # return 0 00:16:45.426 10:02:51 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:16:45.426 10:02:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:45.426 10:02:51 -- common/autotest_common.sh@10 -- # set +x 00:16:45.426 [2024-07-13 10:02:51.205292] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa0d370 is same with the state(5) to be set 00:16:45.426 [2024-07-13 10:02:51.205403] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa0d370 is same with the state(5) to be set 00:16:45.426 [2024-07-13 10:02:51.205423] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa0d370 is same with the state(5) to be set 00:16:45.426 [2024-07-13 10:02:51.205435] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa0d370 is same with the state(5) to be set 00:16:45.426 [2024-07-13 10:02:51.205447] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa0d370 is same with the state(5) to be set 00:16:45.426 [2024-07-13 10:02:51.205460] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa0d370 is same with the state(5) to be set 00:16:45.426 [2024-07-13 10:02:51.205471] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa0d370 is same with the state(5) to be set 00:16:45.426 [2024-07-13 10:02:51.205484] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa0d370 is same with the state(5) to be set 00:16:45.426 [2024-07-13 10:02:51.205495] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa0d370 is same with the state(5) to be set 00:16:45.426 [2024-07-13 10:02:51.205509] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa0d370 is same with the state(5) to be set 00:16:45.426 [2024-07-13 10:02:51.205521] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa0d370 is same with the state(5) to be set 00:16:45.426 [2024-07-13 10:02:51.205534] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa0d370 is same with the state(5) to be set 00:16:45.426 [2024-07-13 10:02:51.205546] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa0d370 is same with the state(5) to be set 00:16:45.426 [2024-07-13 10:02:51.205560] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa0d370 is same with the state(5) to be set 00:16:45.426 [2024-07-13 10:02:51.205572] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa0d370 is same with the state(5) to be set 00:16:45.426 [2024-07-13 10:02:51.205584] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa0d370 is same with the state(5) to be set 00:16:45.426 [2024-07-13 10:02:51.205596] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa0d370 is same with the state(5) to be set 00:16:45.426 [2024-07-13 10:02:51.205610] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa0d370 is same with the state(5) to be set 00:16:45.426 [2024-07-13 10:02:51.205622] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa0d370 is same with the state(5) to be set 00:16:45.426 [2024-07-13 10:02:51.205649] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa0d370 is same with the state(5) to be set 00:16:45.426 [2024-07-13 10:02:51.205663] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa0d370 is same with the state(5) to be set 00:16:45.426 [2024-07-13 10:02:51.205675] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa0d370 is same with the state(5) to be set 00:16:45.426 [2024-07-13 10:02:51.205687] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa0d370 is same with the state(5) to be set 00:16:45.426 [2024-07-13 10:02:51.205699] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa0d370 is same with the state(5) to be set 00:16:45.426 [2024-07-13 10:02:51.205721] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa0d370 is same with the state(5) to be set 00:16:45.426 [2024-07-13 10:02:51.205734] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa0d370 is same with the state(5) to be set 00:16:45.426 [2024-07-13 10:02:51.205746] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa0d370 is same with the state(5) to be set 00:16:45.426 [2024-07-13 10:02:51.205760] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa0d370 is same with the state(5) to be set 00:16:45.426 [2024-07-13 10:02:51.205771] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa0d370 is same with the state(5) to be set 00:16:45.426 [2024-07-13 10:02:51.205783] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa0d370 is same with the state(5) to be set 00:16:45.426 [2024-07-13 10:02:51.205795] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa0d370 is same with the state(5) to be set 00:16:45.426 [2024-07-13 10:02:51.205808] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa0d370 is same with the state(5) to be set 00:16:45.426 [2024-07-13 10:02:51.205821] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa0d370 is same with the state(5) to be set 00:16:45.426 [2024-07-13 10:02:51.205835] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa0d370 is same with the state(5) to be set 00:16:45.426 [2024-07-13 10:02:51.205847] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa0d370 is same with the state(5) to be set 00:16:45.426 [2024-07-13 10:02:51.205872] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa0d370 is same with the state(5) to be set 00:16:45.426 [2024-07-13 10:02:51.205902] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa0d370 is same with the state(5) to be set 00:16:45.426 [2024-07-13 10:02:51.205918] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa0d370 is same with the state(5) to be set 00:16:45.426 [2024-07-13 10:02:51.205930] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa0d370 is same with the state(5) to be set 00:16:45.426 [2024-07-13 10:02:51.205943] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa0d370 is same with the state(5) to be set 00:16:45.426 [2024-07-13 10:02:51.205957] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa0d370 is same with the state(5) to be set 00:16:45.426 [2024-07-13 10:02:51.205971] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa0d370 is same with the state(5) to be set 00:16:45.426 [2024-07-13 10:02:51.206679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.426 [2024-07-13 10:02:51.206721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.426 [2024-07-13 10:02:51.206756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.426 [2024-07-13 10:02:51.206772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.426 [2024-07-13 10:02:51.206789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.426 [2024-07-13 10:02:51.206805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.426 [2024-07-13 10:02:51.206821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.426 [2024-07-13 10:02:51.206838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.426 [2024-07-13 10:02:51.206881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.426 [2024-07-13 10:02:51.206900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.426 [2024-07-13 10:02:51.206917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.426 [2024-07-13 10:02:51.206932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.426 [2024-07-13 10:02:51.206948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.426 [2024-07-13 10:02:51.206964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.426 [2024-07-13 10:02:51.206981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.426 [2024-07-13 10:02:51.206996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.426 [2024-07-13 10:02:51.207012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.426 [2024-07-13 10:02:51.207028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.426 [2024-07-13 10:02:51.207044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.426 [2024-07-13 10:02:51.207060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.426 [2024-07-13 10:02:51.207076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.426 [2024-07-13 10:02:51.207092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.426 [2024-07-13 10:02:51.207108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.426 [2024-07-13 10:02:51.207123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.426 [2024-07-13 10:02:51.207140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.426 [2024-07-13 10:02:51.207164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.426 [2024-07-13 10:02:51.207181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.426 [2024-07-13 10:02:51.207196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.426 [2024-07-13 10:02:51.207213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.426 [2024-07-13 10:02:51.207228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.426 [2024-07-13 10:02:51.207245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.426 [2024-07-13 10:02:51.207260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.426 [2024-07-13 10:02:51.207276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.426 [2024-07-13 10:02:51.207296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.426 [2024-07-13 10:02:51.207314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.426 [2024-07-13 10:02:51.207329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.426 [2024-07-13 10:02:51.207346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.426 [2024-07-13 10:02:51.207362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.426 [2024-07-13 10:02:51.207379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.426 [2024-07-13 10:02:51.207410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.426 [2024-07-13 10:02:51.207427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.427 [2024-07-13 10:02:51.207442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.427 [2024-07-13 10:02:51.207459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.427 [2024-07-13 10:02:51.207474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.427 [2024-07-13 10:02:51.207490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.427 [2024-07-13 10:02:51.207505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.427 [2024-07-13 10:02:51.207522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.427 [2024-07-13 10:02:51.207537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.427 [2024-07-13 10:02:51.207553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.427 [2024-07-13 10:02:51.207568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.427 [2024-07-13 10:02:51.207585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.427 [2024-07-13 10:02:51.207599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.427 [2024-07-13 10:02:51.207616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.427 [2024-07-13 10:02:51.207630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.427 [2024-07-13 10:02:51.207647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.427 [2024-07-13 10:02:51.207662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.427 [2024-07-13 10:02:51.207678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.427 [2024-07-13 10:02:51.207693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.427 [2024-07-13 10:02:51.207713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.427 [2024-07-13 10:02:51.207730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.427 [2024-07-13 10:02:51.207746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.427 [2024-07-13 10:02:51.207761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.427 [2024-07-13 10:02:51.207778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.427 [2024-07-13 10:02:51.207793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.427 [2024-07-13 10:02:51.207810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.427 [2024-07-13 10:02:51.207825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.427 [2024-07-13 10:02:51.207857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.427 [2024-07-13 10:02:51.207881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.427 [2024-07-13 10:02:51.207900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.427 [2024-07-13 10:02:51.207916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.427 [2024-07-13 10:02:51.207933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.427 [2024-07-13 10:02:51.207949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.427 [2024-07-13 10:02:51.207966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.427 [2024-07-13 10:02:51.207981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.427 [2024-07-13 10:02:51.207999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.427 [2024-07-13 10:02:51.208014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.427 [2024-07-13 10:02:51.208031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.427 [2024-07-13 10:02:51.208047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.427 [2024-07-13 10:02:51.208064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.427 [2024-07-13 10:02:51.208080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.427 [2024-07-13 10:02:51.208097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.427 [2024-07-13 10:02:51.208113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.427 [2024-07-13 10:02:51.208130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.427 [2024-07-13 10:02:51.208149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.427 [2024-07-13 10:02:51.208192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.427 [2024-07-13 10:02:51.208208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.427 [2024-07-13 10:02:51.208225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.427 [2024-07-13 10:02:51.208240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.427 [2024-07-13 10:02:51.208256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.427 [2024-07-13 10:02:51.208271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.427 [2024-07-13 10:02:51.208288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.427 [2024-07-13 10:02:51.208303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.427 [2024-07-13 10:02:51.208320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.427 [2024-07-13 10:02:51.208335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.427 [2024-07-13 10:02:51.208351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.427 [2024-07-13 10:02:51.208366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.427 [2024-07-13 10:02:51.208382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.427 [2024-07-13 10:02:51.208398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.427 [2024-07-13 10:02:51.208414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.427 [2024-07-13 10:02:51.208429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.427 [2024-07-13 10:02:51.208446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.427 [2024-07-13 10:02:51.208461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.427 [2024-07-13 10:02:51.208478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.427 [2024-07-13 10:02:51.208493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.427 [2024-07-13 10:02:51.208509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.427 [2024-07-13 10:02:51.208524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.427 [2024-07-13 10:02:51.208540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.427 [2024-07-13 10:02:51.208556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.427 [2024-07-13 10:02:51.208575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.427 [2024-07-13 10:02:51.208591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.427 [2024-07-13 10:02:51.208607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.427 [2024-07-13 10:02:51.208623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.427 [2024-07-13 10:02:51.208639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.427 [2024-07-13 10:02:51.208654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.427 [2024-07-13 10:02:51.208671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.427 [2024-07-13 10:02:51.208686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.427 [2024-07-13 10:02:51.208702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.427 [2024-07-13 10:02:51.208717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.427 [2024-07-13 10:02:51.208734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.427 [2024-07-13 10:02:51.208749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.427 [2024-07-13 10:02:51.208765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.427 [2024-07-13 10:02:51.208780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.427 [2024-07-13 10:02:51.208797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.427 [2024-07-13 10:02:51.208812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.427 [2024-07-13 10:02:51.208828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.428 [2024-07-13 10:02:51.208843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.428 [2024-07-13 10:02:51.208882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:45.428 [2024-07-13 10:02:51.208898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:45.428 [2024-07-13 10:02:51.208915] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x93f080 is same with the state(5) to be set 00:16:45.428 [2024-07-13 10:02:51.208990] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x93f080 was disconnected and freed. reset controller. 00:16:45.428 10:02:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:45.428 10:02:51 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:16:45.428 10:02:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:45.428 10:02:51 -- common/autotest_common.sh@10 -- # set +x 00:16:45.428 [2024-07-13 10:02:51.210156] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:16:45.428 task offset: 28416 on job bdev=Nvme0n1 fails 00:16:45.428 00:16:45.428 Latency(us) 00:16:45.428 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:45.428 Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:16:45.428 Job: Nvme0n1 ended in about 0.49 seconds with error 00:16:45.428 Verification LBA range: start 0x0 length 0x400 00:16:45.428 Nvme0n1 : 0.49 2497.28 156.08 130.36 0.00 24015.15 6456.51 28738.75 00:16:45.428 =================================================================================================================== 00:16:45.428 Total : 2497.28 156.08 130.36 0.00 24015.15 6456.51 28738.75 00:16:45.428 [2024-07-13 10:02:51.212097] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:16:45.428 [2024-07-13 10:02:51.212130] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x944c20 (9): Bad file descriptor 00:16:45.428 10:02:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:45.428 10:02:51 -- target/host_management.sh@87 -- # sleep 1 00:16:45.428 [2024-07-13 10:02:51.217974] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:16:46.803 10:02:52 -- target/host_management.sh@91 -- # kill -9 2797224 00:16:46.803 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (2797224) - No such process 00:16:46.803 10:02:52 -- target/host_management.sh@91 -- # true 00:16:46.803 10:02:52 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:16:46.803 10:02:52 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:16:46.803 10:02:52 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:16:46.803 10:02:52 -- nvmf/common.sh@520 -- # config=() 00:16:46.803 10:02:52 -- nvmf/common.sh@520 -- # local subsystem config 00:16:46.803 10:02:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:46.803 10:02:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:46.803 { 00:16:46.803 "params": { 00:16:46.803 "name": "Nvme$subsystem", 00:16:46.803 "trtype": "$TEST_TRANSPORT", 00:16:46.803 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:46.803 "adrfam": "ipv4", 00:16:46.803 "trsvcid": "$NVMF_PORT", 00:16:46.803 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:46.803 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:46.803 "hdgst": ${hdgst:-false}, 00:16:46.803 "ddgst": ${ddgst:-false} 00:16:46.803 }, 00:16:46.803 "method": "bdev_nvme_attach_controller" 00:16:46.803 } 00:16:46.803 EOF 00:16:46.803 )") 00:16:46.803 10:02:52 -- nvmf/common.sh@542 -- # cat 00:16:46.803 10:02:52 -- nvmf/common.sh@544 -- # jq . 00:16:46.803 10:02:52 -- nvmf/common.sh@545 -- # IFS=, 00:16:46.803 10:02:52 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:46.803 "params": { 00:16:46.803 "name": "Nvme0", 00:16:46.803 "trtype": "tcp", 00:16:46.803 "traddr": "10.0.0.2", 00:16:46.803 "adrfam": "ipv4", 00:16:46.803 "trsvcid": "4420", 00:16:46.803 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:16:46.803 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:16:46.803 "hdgst": false, 00:16:46.803 "ddgst": false 00:16:46.803 }, 00:16:46.803 "method": "bdev_nvme_attach_controller" 00:16:46.803 }' 00:16:46.803 [2024-07-13 10:02:52.262734] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:16:46.803 [2024-07-13 10:02:52.262808] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2797505 ] 00:16:46.803 EAL: No free 2048 kB hugepages reported on node 1 00:16:46.803 [2024-07-13 10:02:52.325729] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:46.803 [2024-07-13 10:02:52.410065] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:47.062 Running I/O for 1 seconds... 00:16:47.993 00:16:47.993 Latency(us) 00:16:47.993 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:47.993 Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:16:47.993 Verification LBA range: start 0x0 length 0x400 00:16:47.993 Nvme0n1 : 1.01 2695.39 168.46 0.00 0.00 23422.90 2038.90 28156.21 00:16:47.993 =================================================================================================================== 00:16:47.993 Total : 2695.39 168.46 0.00 0.00 23422.90 2038.90 28156.21 00:16:48.251 10:02:53 -- target/host_management.sh@101 -- # stoptarget 00:16:48.251 10:02:53 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:16:48.251 10:02:53 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:16:48.251 10:02:53 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:16:48.251 10:02:53 -- target/host_management.sh@40 -- # nvmftestfini 00:16:48.251 10:02:53 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:48.251 10:02:53 -- nvmf/common.sh@116 -- # sync 00:16:48.251 10:02:53 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:48.251 10:02:53 -- nvmf/common.sh@119 -- # set +e 00:16:48.251 10:02:53 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:48.251 10:02:53 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:48.251 rmmod nvme_tcp 00:16:48.251 rmmod nvme_fabrics 00:16:48.251 rmmod nvme_keyring 00:16:48.251 10:02:53 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:48.251 10:02:53 -- nvmf/common.sh@123 -- # set -e 00:16:48.251 10:02:53 -- nvmf/common.sh@124 -- # return 0 00:16:48.251 10:02:53 -- nvmf/common.sh@477 -- # '[' -n 2797037 ']' 00:16:48.251 10:02:53 -- nvmf/common.sh@478 -- # killprocess 2797037 00:16:48.251 10:02:53 -- common/autotest_common.sh@926 -- # '[' -z 2797037 ']' 00:16:48.251 10:02:53 -- common/autotest_common.sh@930 -- # kill -0 2797037 00:16:48.251 10:02:53 -- common/autotest_common.sh@931 -- # uname 00:16:48.251 10:02:53 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:16:48.251 10:02:53 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2797037 00:16:48.251 10:02:53 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:16:48.251 10:02:53 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:16:48.251 10:02:53 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2797037' 00:16:48.251 killing process with pid 2797037 00:16:48.251 10:02:53 -- common/autotest_common.sh@945 -- # kill 2797037 00:16:48.251 10:02:53 -- common/autotest_common.sh@950 -- # wait 2797037 00:16:48.509 [2024-07-13 10:02:54.147383] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:16:48.509 10:02:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:48.509 10:02:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:48.509 10:02:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:48.509 10:02:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:48.509 10:02:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:48.509 10:02:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:48.509 10:02:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:48.509 10:02:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:50.412 10:02:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:50.412 00:16:50.412 real 0m7.158s 00:16:50.412 user 0m21.841s 00:16:50.412 sys 0m1.332s 00:16:50.412 10:02:56 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:16:50.412 10:02:56 -- common/autotest_common.sh@10 -- # set +x 00:16:50.412 ************************************ 00:16:50.412 END TEST nvmf_host_management 00:16:50.412 ************************************ 00:16:50.671 10:02:56 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:16:50.671 00:16:50.671 real 0m9.222s 00:16:50.671 user 0m22.591s 00:16:50.671 sys 0m2.673s 00:16:50.671 10:02:56 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:16:50.671 10:02:56 -- common/autotest_common.sh@10 -- # set +x 00:16:50.671 ************************************ 00:16:50.671 END TEST nvmf_host_management 00:16:50.671 ************************************ 00:16:50.671 10:02:56 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:16:50.671 10:02:56 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:16:50.671 10:02:56 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:16:50.671 10:02:56 -- common/autotest_common.sh@10 -- # set +x 00:16:50.671 ************************************ 00:16:50.671 START TEST nvmf_lvol 00:16:50.671 ************************************ 00:16:50.671 10:02:56 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:16:50.671 * Looking for test storage... 00:16:50.671 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:50.671 10:02:56 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:50.671 10:02:56 -- nvmf/common.sh@7 -- # uname -s 00:16:50.671 10:02:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:50.671 10:02:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:50.671 10:02:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:50.671 10:02:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:50.671 10:02:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:50.671 10:02:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:50.671 10:02:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:50.671 10:02:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:50.671 10:02:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:50.671 10:02:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:50.671 10:02:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:50.671 10:02:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:50.671 10:02:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:50.671 10:02:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:50.671 10:02:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:50.671 10:02:56 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:50.671 10:02:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:50.671 10:02:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:50.671 10:02:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:50.671 10:02:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:50.671 10:02:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:50.671 10:02:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:50.671 10:02:56 -- paths/export.sh@5 -- # export PATH 00:16:50.671 10:02:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:50.671 10:02:56 -- nvmf/common.sh@46 -- # : 0 00:16:50.671 10:02:56 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:50.671 10:02:56 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:50.671 10:02:56 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:50.671 10:02:56 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:50.671 10:02:56 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:50.671 10:02:56 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:50.671 10:02:56 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:50.671 10:02:56 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:50.671 10:02:56 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:50.671 10:02:56 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:50.671 10:02:56 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:16:50.671 10:02:56 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:16:50.671 10:02:56 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:50.671 10:02:56 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:16:50.671 10:02:56 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:50.671 10:02:56 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:50.671 10:02:56 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:50.671 10:02:56 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:50.671 10:02:56 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:50.671 10:02:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:50.671 10:02:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:50.671 10:02:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:50.671 10:02:56 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:50.671 10:02:56 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:50.671 10:02:56 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:50.671 10:02:56 -- common/autotest_common.sh@10 -- # set +x 00:16:52.573 10:02:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:52.573 10:02:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:52.573 10:02:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:52.573 10:02:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:52.573 10:02:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:52.574 10:02:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:52.574 10:02:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:52.574 10:02:58 -- nvmf/common.sh@294 -- # net_devs=() 00:16:52.574 10:02:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:52.574 10:02:58 -- nvmf/common.sh@295 -- # e810=() 00:16:52.574 10:02:58 -- nvmf/common.sh@295 -- # local -ga e810 00:16:52.574 10:02:58 -- nvmf/common.sh@296 -- # x722=() 00:16:52.574 10:02:58 -- nvmf/common.sh@296 -- # local -ga x722 00:16:52.574 10:02:58 -- nvmf/common.sh@297 -- # mlx=() 00:16:52.574 10:02:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:52.574 10:02:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:52.574 10:02:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:52.574 10:02:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:52.574 10:02:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:52.574 10:02:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:52.574 10:02:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:52.574 10:02:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:52.574 10:02:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:52.574 10:02:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:52.574 10:02:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:52.574 10:02:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:52.574 10:02:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:52.574 10:02:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:52.574 10:02:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:52.574 10:02:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:52.574 10:02:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:52.574 10:02:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:52.574 10:02:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:52.574 10:02:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:52.574 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:52.574 10:02:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:52.574 10:02:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:52.574 10:02:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:52.574 10:02:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:52.574 10:02:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:52.574 10:02:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:52.574 10:02:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:52.574 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:52.574 10:02:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:52.574 10:02:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:52.574 10:02:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:52.574 10:02:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:52.574 10:02:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:52.574 10:02:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:52.574 10:02:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:52.574 10:02:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:52.574 10:02:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:52.574 10:02:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:52.574 10:02:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:52.574 10:02:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:52.574 10:02:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:52.574 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:52.574 10:02:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:52.574 10:02:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:52.574 10:02:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:52.574 10:02:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:52.574 10:02:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:52.574 10:02:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:52.574 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:52.574 10:02:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:52.574 10:02:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:52.574 10:02:58 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:52.574 10:02:58 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:52.574 10:02:58 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:52.574 10:02:58 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:52.574 10:02:58 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:52.574 10:02:58 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:52.574 10:02:58 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:52.574 10:02:58 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:52.574 10:02:58 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:52.574 10:02:58 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:52.574 10:02:58 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:52.574 10:02:58 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:52.574 10:02:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:52.574 10:02:58 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:52.574 10:02:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:52.574 10:02:58 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:52.574 10:02:58 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:52.574 10:02:58 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:52.574 10:02:58 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:52.833 10:02:58 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:52.833 10:02:58 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:52.833 10:02:58 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:52.833 10:02:58 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:52.833 10:02:58 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:52.833 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:52.833 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.303 ms 00:16:52.833 00:16:52.833 --- 10.0.0.2 ping statistics --- 00:16:52.833 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:52.833 rtt min/avg/max/mdev = 0.303/0.303/0.303/0.000 ms 00:16:52.833 10:02:58 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:52.833 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:52.833 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.186 ms 00:16:52.833 00:16:52.833 --- 10.0.0.1 ping statistics --- 00:16:52.833 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:52.833 rtt min/avg/max/mdev = 0.186/0.186/0.186/0.000 ms 00:16:52.833 10:02:58 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:52.833 10:02:58 -- nvmf/common.sh@410 -- # return 0 00:16:52.833 10:02:58 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:52.833 10:02:58 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:52.833 10:02:58 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:52.833 10:02:58 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:52.833 10:02:58 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:52.833 10:02:58 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:52.833 10:02:58 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:52.833 10:02:58 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:16:52.833 10:02:58 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:52.833 10:02:58 -- common/autotest_common.sh@712 -- # xtrace_disable 00:16:52.833 10:02:58 -- common/autotest_common.sh@10 -- # set +x 00:16:52.833 10:02:58 -- nvmf/common.sh@469 -- # nvmfpid=2799619 00:16:52.833 10:02:58 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:16:52.833 10:02:58 -- nvmf/common.sh@470 -- # waitforlisten 2799619 00:16:52.833 10:02:58 -- common/autotest_common.sh@819 -- # '[' -z 2799619 ']' 00:16:52.833 10:02:58 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:52.833 10:02:58 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:52.833 10:02:58 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:52.833 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:52.833 10:02:58 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:52.833 10:02:58 -- common/autotest_common.sh@10 -- # set +x 00:16:52.833 [2024-07-13 10:02:58.517899] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:16:52.833 [2024-07-13 10:02:58.517982] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:52.833 EAL: No free 2048 kB hugepages reported on node 1 00:16:52.833 [2024-07-13 10:02:58.585523] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:53.093 [2024-07-13 10:02:58.680958] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:53.093 [2024-07-13 10:02:58.681133] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:53.093 [2024-07-13 10:02:58.681153] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:53.093 [2024-07-13 10:02:58.681167] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:53.093 [2024-07-13 10:02:58.681230] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:53.093 [2024-07-13 10:02:58.681261] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:53.093 [2024-07-13 10:02:58.681266] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:54.026 10:02:59 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:54.026 10:02:59 -- common/autotest_common.sh@852 -- # return 0 00:16:54.026 10:02:59 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:54.026 10:02:59 -- common/autotest_common.sh@718 -- # xtrace_disable 00:16:54.026 10:02:59 -- common/autotest_common.sh@10 -- # set +x 00:16:54.026 10:02:59 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:54.026 10:02:59 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:16:54.026 [2024-07-13 10:02:59.746443] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:54.026 10:02:59 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:54.284 10:03:00 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:16:54.284 10:03:00 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:54.543 10:03:00 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:16:54.543 10:03:00 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:16:54.800 10:03:00 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:16:55.058 10:03:00 -- target/nvmf_lvol.sh@29 -- # lvs=4bb6e5ae-80d7-4702-9a1a-de45e7740d9e 00:16:55.058 10:03:00 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 4bb6e5ae-80d7-4702-9a1a-de45e7740d9e lvol 20 00:16:55.316 10:03:01 -- target/nvmf_lvol.sh@32 -- # lvol=3797994f-ab77-4cf2-89d3-bf00d9a04eab 00:16:55.316 10:03:01 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:16:55.574 10:03:01 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 3797994f-ab77-4cf2-89d3-bf00d9a04eab 00:16:55.832 10:03:01 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:16:56.090 [2024-07-13 10:03:01.817045] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:56.090 10:03:01 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:16:56.348 10:03:02 -- target/nvmf_lvol.sh@42 -- # perf_pid=2800172 00:16:56.348 10:03:02 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:16:56.348 10:03:02 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:16:56.348 EAL: No free 2048 kB hugepages reported on node 1 00:16:57.281 10:03:03 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot 3797994f-ab77-4cf2-89d3-bf00d9a04eab MY_SNAPSHOT 00:16:57.847 10:03:03 -- target/nvmf_lvol.sh@47 -- # snapshot=de9d03aa-2d94-4dd0-8d2c-5fa1062deac4 00:16:57.847 10:03:03 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize 3797994f-ab77-4cf2-89d3-bf00d9a04eab 30 00:16:57.847 10:03:03 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone de9d03aa-2d94-4dd0-8d2c-5fa1062deac4 MY_CLONE 00:16:58.413 10:03:03 -- target/nvmf_lvol.sh@49 -- # clone=3ad225fd-7f84-4e7d-aac1-57f5502873b6 00:16:58.413 10:03:03 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate 3ad225fd-7f84-4e7d-aac1-57f5502873b6 00:16:58.671 10:03:04 -- target/nvmf_lvol.sh@53 -- # wait 2800172 00:17:06.814 Initializing NVMe Controllers 00:17:06.814 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:17:06.814 Controller IO queue size 128, less than required. 00:17:06.814 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:17:06.814 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:17:06.814 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:17:06.814 Initialization complete. Launching workers. 00:17:06.814 ======================================================== 00:17:06.814 Latency(us) 00:17:06.814 Device Information : IOPS MiB/s Average min max 00:17:06.814 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 10826.90 42.29 11826.55 2053.59 76809.12 00:17:06.814 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10735.90 41.94 11928.07 2035.59 76994.38 00:17:06.814 ======================================================== 00:17:06.814 Total : 21562.80 84.23 11877.09 2035.59 76994.38 00:17:06.814 00:17:06.814 10:03:12 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:07.071 10:03:12 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 3797994f-ab77-4cf2-89d3-bf00d9a04eab 00:17:07.327 10:03:13 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 4bb6e5ae-80d7-4702-9a1a-de45e7740d9e 00:17:07.584 10:03:13 -- target/nvmf_lvol.sh@60 -- # rm -f 00:17:07.584 10:03:13 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:17:07.584 10:03:13 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:17:07.584 10:03:13 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:07.584 10:03:13 -- nvmf/common.sh@116 -- # sync 00:17:07.584 10:03:13 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:07.584 10:03:13 -- nvmf/common.sh@119 -- # set +e 00:17:07.584 10:03:13 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:07.584 10:03:13 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:07.584 rmmod nvme_tcp 00:17:07.584 rmmod nvme_fabrics 00:17:07.584 rmmod nvme_keyring 00:17:07.584 10:03:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:07.584 10:03:13 -- nvmf/common.sh@123 -- # set -e 00:17:07.584 10:03:13 -- nvmf/common.sh@124 -- # return 0 00:17:07.584 10:03:13 -- nvmf/common.sh@477 -- # '[' -n 2799619 ']' 00:17:07.584 10:03:13 -- nvmf/common.sh@478 -- # killprocess 2799619 00:17:07.584 10:03:13 -- common/autotest_common.sh@926 -- # '[' -z 2799619 ']' 00:17:07.584 10:03:13 -- common/autotest_common.sh@930 -- # kill -0 2799619 00:17:07.584 10:03:13 -- common/autotest_common.sh@931 -- # uname 00:17:07.584 10:03:13 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:07.584 10:03:13 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2799619 00:17:07.584 10:03:13 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:17:07.584 10:03:13 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:17:07.584 10:03:13 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2799619' 00:17:07.584 killing process with pid 2799619 00:17:07.584 10:03:13 -- common/autotest_common.sh@945 -- # kill 2799619 00:17:07.584 10:03:13 -- common/autotest_common.sh@950 -- # wait 2799619 00:17:07.842 10:03:13 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:07.842 10:03:13 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:07.842 10:03:13 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:07.842 10:03:13 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:07.842 10:03:13 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:07.842 10:03:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:07.842 10:03:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:07.842 10:03:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:10.372 10:03:15 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:10.372 00:17:10.372 real 0m19.382s 00:17:10.372 user 1m6.356s 00:17:10.372 sys 0m5.456s 00:17:10.372 10:03:15 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:17:10.372 10:03:15 -- common/autotest_common.sh@10 -- # set +x 00:17:10.372 ************************************ 00:17:10.372 END TEST nvmf_lvol 00:17:10.372 ************************************ 00:17:10.372 10:03:15 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:17:10.372 10:03:15 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:17:10.372 10:03:15 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:17:10.372 10:03:15 -- common/autotest_common.sh@10 -- # set +x 00:17:10.372 ************************************ 00:17:10.372 START TEST nvmf_lvs_grow 00:17:10.372 ************************************ 00:17:10.372 10:03:15 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:17:10.372 * Looking for test storage... 00:17:10.372 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:10.372 10:03:15 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:10.372 10:03:15 -- nvmf/common.sh@7 -- # uname -s 00:17:10.372 10:03:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:10.372 10:03:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:10.372 10:03:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:10.372 10:03:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:10.372 10:03:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:10.372 10:03:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:10.372 10:03:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:10.372 10:03:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:10.372 10:03:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:10.372 10:03:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:10.372 10:03:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:10.372 10:03:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:10.372 10:03:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:10.372 10:03:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:10.372 10:03:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:10.372 10:03:15 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:10.372 10:03:15 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:10.372 10:03:15 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:10.372 10:03:15 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:10.372 10:03:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:10.372 10:03:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:10.372 10:03:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:10.372 10:03:15 -- paths/export.sh@5 -- # export PATH 00:17:10.372 10:03:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:10.372 10:03:15 -- nvmf/common.sh@46 -- # : 0 00:17:10.372 10:03:15 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:10.372 10:03:15 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:10.372 10:03:15 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:10.372 10:03:15 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:10.372 10:03:15 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:10.372 10:03:15 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:10.372 10:03:15 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:10.372 10:03:15 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:10.372 10:03:15 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:10.372 10:03:15 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:10.372 10:03:15 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:17:10.372 10:03:15 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:10.372 10:03:15 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:10.372 10:03:15 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:10.372 10:03:15 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:10.372 10:03:15 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:10.372 10:03:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:10.372 10:03:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:10.372 10:03:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:10.372 10:03:15 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:10.372 10:03:15 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:10.372 10:03:15 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:10.372 10:03:15 -- common/autotest_common.sh@10 -- # set +x 00:17:12.275 10:03:17 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:12.275 10:03:17 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:12.275 10:03:17 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:12.275 10:03:17 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:12.275 10:03:17 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:12.275 10:03:17 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:12.275 10:03:17 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:12.275 10:03:17 -- nvmf/common.sh@294 -- # net_devs=() 00:17:12.275 10:03:17 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:12.275 10:03:17 -- nvmf/common.sh@295 -- # e810=() 00:17:12.275 10:03:17 -- nvmf/common.sh@295 -- # local -ga e810 00:17:12.275 10:03:17 -- nvmf/common.sh@296 -- # x722=() 00:17:12.275 10:03:17 -- nvmf/common.sh@296 -- # local -ga x722 00:17:12.275 10:03:17 -- nvmf/common.sh@297 -- # mlx=() 00:17:12.275 10:03:17 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:12.275 10:03:17 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:12.275 10:03:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:12.275 10:03:17 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:12.275 10:03:17 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:12.275 10:03:17 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:12.275 10:03:17 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:12.275 10:03:17 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:12.275 10:03:17 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:12.275 10:03:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:12.275 10:03:17 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:12.275 10:03:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:12.275 10:03:17 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:12.275 10:03:17 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:12.275 10:03:17 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:12.275 10:03:17 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:12.275 10:03:17 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:12.275 10:03:17 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:12.275 10:03:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:12.275 10:03:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:12.275 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:12.275 10:03:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:12.275 10:03:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:12.275 10:03:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:12.275 10:03:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:12.275 10:03:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:12.275 10:03:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:12.275 10:03:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:12.275 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:12.275 10:03:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:12.275 10:03:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:12.275 10:03:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:12.275 10:03:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:12.275 10:03:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:12.275 10:03:17 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:12.275 10:03:17 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:12.275 10:03:17 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:12.275 10:03:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:12.275 10:03:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:12.275 10:03:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:12.275 10:03:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:12.275 10:03:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:12.275 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:12.275 10:03:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:12.275 10:03:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:12.275 10:03:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:12.275 10:03:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:12.275 10:03:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:12.275 10:03:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:12.275 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:12.275 10:03:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:12.275 10:03:17 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:12.275 10:03:17 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:12.275 10:03:17 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:12.275 10:03:17 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:12.275 10:03:17 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:12.275 10:03:17 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:12.275 10:03:17 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:12.275 10:03:17 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:12.275 10:03:17 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:12.275 10:03:17 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:12.275 10:03:17 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:12.275 10:03:17 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:12.275 10:03:17 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:12.275 10:03:17 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:12.275 10:03:17 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:12.275 10:03:17 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:12.275 10:03:17 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:12.275 10:03:17 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:12.275 10:03:17 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:12.275 10:03:17 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:12.275 10:03:17 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:12.275 10:03:17 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:12.275 10:03:17 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:12.275 10:03:17 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:12.275 10:03:17 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:12.275 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:12.275 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.136 ms 00:17:12.275 00:17:12.275 --- 10.0.0.2 ping statistics --- 00:17:12.275 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:12.275 rtt min/avg/max/mdev = 0.136/0.136/0.136/0.000 ms 00:17:12.275 10:03:17 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:12.275 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:12.275 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.099 ms 00:17:12.275 00:17:12.275 --- 10.0.0.1 ping statistics --- 00:17:12.275 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:12.275 rtt min/avg/max/mdev = 0.099/0.099/0.099/0.000 ms 00:17:12.275 10:03:17 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:12.275 10:03:17 -- nvmf/common.sh@410 -- # return 0 00:17:12.275 10:03:17 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:12.275 10:03:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:12.275 10:03:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:12.275 10:03:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:12.275 10:03:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:12.276 10:03:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:12.276 10:03:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:12.276 10:03:17 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:17:12.276 10:03:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:12.276 10:03:17 -- common/autotest_common.sh@712 -- # xtrace_disable 00:17:12.276 10:03:17 -- common/autotest_common.sh@10 -- # set +x 00:17:12.276 10:03:17 -- nvmf/common.sh@469 -- # nvmfpid=2804071 00:17:12.276 10:03:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:17:12.276 10:03:17 -- nvmf/common.sh@470 -- # waitforlisten 2804071 00:17:12.276 10:03:17 -- common/autotest_common.sh@819 -- # '[' -z 2804071 ']' 00:17:12.276 10:03:17 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:12.276 10:03:17 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:12.276 10:03:17 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:12.276 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:12.276 10:03:17 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:12.276 10:03:17 -- common/autotest_common.sh@10 -- # set +x 00:17:12.276 [2024-07-13 10:03:17.945573] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:17:12.276 [2024-07-13 10:03:17.945658] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:12.276 EAL: No free 2048 kB hugepages reported on node 1 00:17:12.276 [2024-07-13 10:03:18.014983] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:12.534 [2024-07-13 10:03:18.100808] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:12.534 [2024-07-13 10:03:18.101008] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:12.534 [2024-07-13 10:03:18.101026] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:12.534 [2024-07-13 10:03:18.101039] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:12.534 [2024-07-13 10:03:18.101065] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:13.099 10:03:18 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:13.099 10:03:18 -- common/autotest_common.sh@852 -- # return 0 00:17:13.099 10:03:18 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:13.099 10:03:18 -- common/autotest_common.sh@718 -- # xtrace_disable 00:17:13.099 10:03:18 -- common/autotest_common.sh@10 -- # set +x 00:17:13.099 10:03:18 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:13.099 10:03:18 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:17:13.357 [2024-07-13 10:03:19.117239] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:13.357 10:03:19 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:17:13.357 10:03:19 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:17:13.357 10:03:19 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:17:13.357 10:03:19 -- common/autotest_common.sh@10 -- # set +x 00:17:13.357 ************************************ 00:17:13.357 START TEST lvs_grow_clean 00:17:13.357 ************************************ 00:17:13.357 10:03:19 -- common/autotest_common.sh@1104 -- # lvs_grow 00:17:13.357 10:03:19 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:17:13.357 10:03:19 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:17:13.357 10:03:19 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:17:13.357 10:03:19 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:17:13.357 10:03:19 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:17:13.357 10:03:19 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:17:13.357 10:03:19 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:13.357 10:03:19 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:13.357 10:03:19 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:13.615 10:03:19 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:17:13.615 10:03:19 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:17:13.873 10:03:19 -- target/nvmf_lvs_grow.sh@28 -- # lvs=327aa794-9557-47b4-abc0-534dbdeebce7 00:17:13.873 10:03:19 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 327aa794-9557-47b4-abc0-534dbdeebce7 00:17:13.873 10:03:19 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:17:14.131 10:03:19 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:17:14.131 10:03:19 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:17:14.131 10:03:19 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 327aa794-9557-47b4-abc0-534dbdeebce7 lvol 150 00:17:14.389 10:03:20 -- target/nvmf_lvs_grow.sh@33 -- # lvol=5d60d270-034a-4918-847e-e02bc7b76c20 00:17:14.389 10:03:20 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:14.389 10:03:20 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:17:14.646 [2024-07-13 10:03:20.373120] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:17:14.646 [2024-07-13 10:03:20.373225] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:17:14.646 true 00:17:14.646 10:03:20 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 327aa794-9557-47b4-abc0-534dbdeebce7 00:17:14.646 10:03:20 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:17:14.904 10:03:20 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:17:14.904 10:03:20 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:15.162 10:03:20 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 5d60d270-034a-4918-847e-e02bc7b76c20 00:17:15.420 10:03:21 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:15.680 [2024-07-13 10:03:21.388334] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:15.680 10:03:21 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:15.938 10:03:21 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=2804567 00:17:15.938 10:03:21 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:17:15.938 10:03:21 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:15.938 10:03:21 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 2804567 /var/tmp/bdevperf.sock 00:17:15.938 10:03:21 -- common/autotest_common.sh@819 -- # '[' -z 2804567 ']' 00:17:15.938 10:03:21 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:15.938 10:03:21 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:15.938 10:03:21 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:15.938 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:15.938 10:03:21 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:15.938 10:03:21 -- common/autotest_common.sh@10 -- # set +x 00:17:15.938 [2024-07-13 10:03:21.713056] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:17:15.938 [2024-07-13 10:03:21.713124] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2804567 ] 00:17:15.938 EAL: No free 2048 kB hugepages reported on node 1 00:17:16.196 [2024-07-13 10:03:21.774428] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:16.196 [2024-07-13 10:03:21.863486] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:17.129 10:03:22 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:17.129 10:03:22 -- common/autotest_common.sh@852 -- # return 0 00:17:17.129 10:03:22 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:17:17.384 Nvme0n1 00:17:17.385 10:03:23 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:17:17.641 [ 00:17:17.641 { 00:17:17.641 "name": "Nvme0n1", 00:17:17.641 "aliases": [ 00:17:17.641 "5d60d270-034a-4918-847e-e02bc7b76c20" 00:17:17.641 ], 00:17:17.641 "product_name": "NVMe disk", 00:17:17.641 "block_size": 4096, 00:17:17.641 "num_blocks": 38912, 00:17:17.641 "uuid": "5d60d270-034a-4918-847e-e02bc7b76c20", 00:17:17.641 "assigned_rate_limits": { 00:17:17.641 "rw_ios_per_sec": 0, 00:17:17.641 "rw_mbytes_per_sec": 0, 00:17:17.641 "r_mbytes_per_sec": 0, 00:17:17.641 "w_mbytes_per_sec": 0 00:17:17.641 }, 00:17:17.641 "claimed": false, 00:17:17.641 "zoned": false, 00:17:17.641 "supported_io_types": { 00:17:17.641 "read": true, 00:17:17.641 "write": true, 00:17:17.641 "unmap": true, 00:17:17.641 "write_zeroes": true, 00:17:17.641 "flush": true, 00:17:17.641 "reset": true, 00:17:17.641 "compare": true, 00:17:17.641 "compare_and_write": true, 00:17:17.641 "abort": true, 00:17:17.641 "nvme_admin": true, 00:17:17.641 "nvme_io": true 00:17:17.641 }, 00:17:17.641 "driver_specific": { 00:17:17.641 "nvme": [ 00:17:17.641 { 00:17:17.641 "trid": { 00:17:17.641 "trtype": "TCP", 00:17:17.641 "adrfam": "IPv4", 00:17:17.641 "traddr": "10.0.0.2", 00:17:17.641 "trsvcid": "4420", 00:17:17.641 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:17:17.641 }, 00:17:17.641 "ctrlr_data": { 00:17:17.641 "cntlid": 1, 00:17:17.641 "vendor_id": "0x8086", 00:17:17.641 "model_number": "SPDK bdev Controller", 00:17:17.641 "serial_number": "SPDK0", 00:17:17.641 "firmware_revision": "24.01.1", 00:17:17.641 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:17.641 "oacs": { 00:17:17.641 "security": 0, 00:17:17.641 "format": 0, 00:17:17.641 "firmware": 0, 00:17:17.641 "ns_manage": 0 00:17:17.641 }, 00:17:17.641 "multi_ctrlr": true, 00:17:17.641 "ana_reporting": false 00:17:17.641 }, 00:17:17.641 "vs": { 00:17:17.641 "nvme_version": "1.3" 00:17:17.641 }, 00:17:17.641 "ns_data": { 00:17:17.641 "id": 1, 00:17:17.641 "can_share": true 00:17:17.641 } 00:17:17.641 } 00:17:17.641 ], 00:17:17.641 "mp_policy": "active_passive" 00:17:17.641 } 00:17:17.641 } 00:17:17.641 ] 00:17:17.641 10:03:23 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=2804713 00:17:17.641 10:03:23 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:17:17.641 10:03:23 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:17.898 Running I/O for 10 seconds... 00:17:18.830 Latency(us) 00:17:18.831 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:18.831 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:18.831 Nvme0n1 : 1.00 14786.00 57.76 0.00 0.00 0.00 0.00 0.00 00:17:18.831 =================================================================================================================== 00:17:18.831 Total : 14786.00 57.76 0.00 0.00 0.00 0.00 0.00 00:17:18.831 00:17:19.761 10:03:25 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 327aa794-9557-47b4-abc0-534dbdeebce7 00:17:19.761 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:19.761 Nvme0n1 : 2.00 14880.50 58.13 0.00 0.00 0.00 0.00 0.00 00:17:19.761 =================================================================================================================== 00:17:19.761 Total : 14880.50 58.13 0.00 0.00 0.00 0.00 0.00 00:17:19.761 00:17:20.018 true 00:17:20.018 10:03:25 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 327aa794-9557-47b4-abc0-534dbdeebce7 00:17:20.018 10:03:25 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:17:20.274 10:03:25 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:17:20.274 10:03:25 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:17:20.274 10:03:25 -- target/nvmf_lvs_grow.sh@65 -- # wait 2804713 00:17:20.838 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:20.838 Nvme0n1 : 3.00 14934.00 58.34 0.00 0.00 0.00 0.00 0.00 00:17:20.838 =================================================================================================================== 00:17:20.838 Total : 14934.00 58.34 0.00 0.00 0.00 0.00 0.00 00:17:20.838 00:17:21.773 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:21.773 Nvme0n1 : 4.00 14992.25 58.56 0.00 0.00 0.00 0.00 0.00 00:17:21.773 =================================================================================================================== 00:17:21.773 Total : 14992.25 58.56 0.00 0.00 0.00 0.00 0.00 00:17:21.773 00:17:22.743 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:22.743 Nvme0n1 : 5.00 15027.60 58.70 0.00 0.00 0.00 0.00 0.00 00:17:22.743 =================================================================================================================== 00:17:22.743 Total : 15027.60 58.70 0.00 0.00 0.00 0.00 0.00 00:17:22.743 00:17:24.116 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:24.116 Nvme0n1 : 6.00 15061.67 58.83 0.00 0.00 0.00 0.00 0.00 00:17:24.116 =================================================================================================================== 00:17:24.116 Total : 15061.67 58.83 0.00 0.00 0.00 0.00 0.00 00:17:24.116 00:17:24.682 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:24.682 Nvme0n1 : 7.00 15095.14 58.97 0.00 0.00 0.00 0.00 0.00 00:17:24.683 =================================================================================================================== 00:17:24.683 Total : 15095.14 58.97 0.00 0.00 0.00 0.00 0.00 00:17:24.683 00:17:26.055 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:26.055 Nvme0n1 : 8.00 15160.12 59.22 0.00 0.00 0.00 0.00 0.00 00:17:26.055 =================================================================================================================== 00:17:26.055 Total : 15160.12 59.22 0.00 0.00 0.00 0.00 0.00 00:17:26.055 00:17:26.986 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:26.986 Nvme0n1 : 9.00 15182.33 59.31 0.00 0.00 0.00 0.00 0.00 00:17:26.986 =================================================================================================================== 00:17:26.986 Total : 15182.33 59.31 0.00 0.00 0.00 0.00 0.00 00:17:26.986 00:17:27.918 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:27.918 Nvme0n1 : 10.00 15200.00 59.38 0.00 0.00 0.00 0.00 0.00 00:17:27.918 =================================================================================================================== 00:17:27.918 Total : 15200.00 59.38 0.00 0.00 0.00 0.00 0.00 00:17:27.918 00:17:27.918 00:17:27.918 Latency(us) 00:17:27.918 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:27.918 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:27.918 Nvme0n1 : 10.01 15203.67 59.39 0.00 0.00 8413.41 3082.62 12524.66 00:17:27.918 =================================================================================================================== 00:17:27.918 Total : 15203.67 59.39 0.00 0.00 8413.41 3082.62 12524.66 00:17:27.918 0 00:17:27.918 10:03:33 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 2804567 00:17:27.918 10:03:33 -- common/autotest_common.sh@926 -- # '[' -z 2804567 ']' 00:17:27.918 10:03:33 -- common/autotest_common.sh@930 -- # kill -0 2804567 00:17:27.918 10:03:33 -- common/autotest_common.sh@931 -- # uname 00:17:27.918 10:03:33 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:27.918 10:03:33 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2804567 00:17:27.918 10:03:33 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:17:27.918 10:03:33 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:17:27.918 10:03:33 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2804567' 00:17:27.918 killing process with pid 2804567 00:17:27.918 10:03:33 -- common/autotest_common.sh@945 -- # kill 2804567 00:17:27.918 Received shutdown signal, test time was about 10.000000 seconds 00:17:27.918 00:17:27.918 Latency(us) 00:17:27.918 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:27.918 =================================================================================================================== 00:17:27.918 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:27.918 10:03:33 -- common/autotest_common.sh@950 -- # wait 2804567 00:17:28.174 10:03:33 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:28.431 10:03:34 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 327aa794-9557-47b4-abc0-534dbdeebce7 00:17:28.431 10:03:34 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:17:28.690 10:03:34 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:17:28.690 10:03:34 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:17:28.690 10:03:34 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:28.690 [2024-07-13 10:03:34.491476] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:17:28.947 10:03:34 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 327aa794-9557-47b4-abc0-534dbdeebce7 00:17:28.947 10:03:34 -- common/autotest_common.sh@640 -- # local es=0 00:17:28.947 10:03:34 -- common/autotest_common.sh@642 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 327aa794-9557-47b4-abc0-534dbdeebce7 00:17:28.947 10:03:34 -- common/autotest_common.sh@628 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:28.947 10:03:34 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:28.947 10:03:34 -- common/autotest_common.sh@632 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:28.947 10:03:34 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:28.947 10:03:34 -- common/autotest_common.sh@634 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:28.947 10:03:34 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:28.947 10:03:34 -- common/autotest_common.sh@634 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:28.947 10:03:34 -- common/autotest_common.sh@634 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:17:28.947 10:03:34 -- common/autotest_common.sh@643 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 327aa794-9557-47b4-abc0-534dbdeebce7 00:17:28.947 request: 00:17:28.947 { 00:17:28.947 "uuid": "327aa794-9557-47b4-abc0-534dbdeebce7", 00:17:28.947 "method": "bdev_lvol_get_lvstores", 00:17:28.947 "req_id": 1 00:17:28.947 } 00:17:28.947 Got JSON-RPC error response 00:17:28.947 response: 00:17:28.947 { 00:17:28.947 "code": -19, 00:17:28.947 "message": "No such device" 00:17:28.947 } 00:17:28.947 10:03:34 -- common/autotest_common.sh@643 -- # es=1 00:17:28.947 10:03:34 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:17:28.947 10:03:34 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:17:28.947 10:03:34 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:17:28.947 10:03:34 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:29.206 aio_bdev 00:17:29.206 10:03:34 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 5d60d270-034a-4918-847e-e02bc7b76c20 00:17:29.206 10:03:34 -- common/autotest_common.sh@887 -- # local bdev_name=5d60d270-034a-4918-847e-e02bc7b76c20 00:17:29.206 10:03:34 -- common/autotest_common.sh@888 -- # local bdev_timeout= 00:17:29.206 10:03:34 -- common/autotest_common.sh@889 -- # local i 00:17:29.206 10:03:34 -- common/autotest_common.sh@890 -- # [[ -z '' ]] 00:17:29.206 10:03:34 -- common/autotest_common.sh@890 -- # bdev_timeout=2000 00:17:29.206 10:03:34 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:17:29.464 10:03:35 -- common/autotest_common.sh@894 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 5d60d270-034a-4918-847e-e02bc7b76c20 -t 2000 00:17:29.722 [ 00:17:29.722 { 00:17:29.722 "name": "5d60d270-034a-4918-847e-e02bc7b76c20", 00:17:29.722 "aliases": [ 00:17:29.722 "lvs/lvol" 00:17:29.722 ], 00:17:29.722 "product_name": "Logical Volume", 00:17:29.722 "block_size": 4096, 00:17:29.722 "num_blocks": 38912, 00:17:29.722 "uuid": "5d60d270-034a-4918-847e-e02bc7b76c20", 00:17:29.722 "assigned_rate_limits": { 00:17:29.722 "rw_ios_per_sec": 0, 00:17:29.722 "rw_mbytes_per_sec": 0, 00:17:29.722 "r_mbytes_per_sec": 0, 00:17:29.722 "w_mbytes_per_sec": 0 00:17:29.722 }, 00:17:29.722 "claimed": false, 00:17:29.722 "zoned": false, 00:17:29.722 "supported_io_types": { 00:17:29.722 "read": true, 00:17:29.722 "write": true, 00:17:29.722 "unmap": true, 00:17:29.722 "write_zeroes": true, 00:17:29.722 "flush": false, 00:17:29.722 "reset": true, 00:17:29.722 "compare": false, 00:17:29.722 "compare_and_write": false, 00:17:29.722 "abort": false, 00:17:29.722 "nvme_admin": false, 00:17:29.722 "nvme_io": false 00:17:29.722 }, 00:17:29.722 "driver_specific": { 00:17:29.722 "lvol": { 00:17:29.722 "lvol_store_uuid": "327aa794-9557-47b4-abc0-534dbdeebce7", 00:17:29.722 "base_bdev": "aio_bdev", 00:17:29.722 "thin_provision": false, 00:17:29.722 "snapshot": false, 00:17:29.722 "clone": false, 00:17:29.722 "esnap_clone": false 00:17:29.722 } 00:17:29.722 } 00:17:29.722 } 00:17:29.722 ] 00:17:29.980 10:03:35 -- common/autotest_common.sh@895 -- # return 0 00:17:29.980 10:03:35 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 327aa794-9557-47b4-abc0-534dbdeebce7 00:17:29.980 10:03:35 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:17:29.980 10:03:35 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:17:29.980 10:03:35 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 327aa794-9557-47b4-abc0-534dbdeebce7 00:17:29.980 10:03:35 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:17:30.238 10:03:36 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:17:30.238 10:03:36 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 5d60d270-034a-4918-847e-e02bc7b76c20 00:17:30.497 10:03:36 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 327aa794-9557-47b4-abc0-534dbdeebce7 00:17:30.755 10:03:36 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:31.013 10:03:36 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:31.271 00:17:31.271 real 0m17.709s 00:17:31.271 user 0m17.441s 00:17:31.271 sys 0m1.853s 00:17:31.271 10:03:36 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:17:31.271 10:03:36 -- common/autotest_common.sh@10 -- # set +x 00:17:31.271 ************************************ 00:17:31.271 END TEST lvs_grow_clean 00:17:31.271 ************************************ 00:17:31.271 10:03:36 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:17:31.271 10:03:36 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:17:31.271 10:03:36 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:17:31.271 10:03:36 -- common/autotest_common.sh@10 -- # set +x 00:17:31.271 ************************************ 00:17:31.271 START TEST lvs_grow_dirty 00:17:31.271 ************************************ 00:17:31.271 10:03:36 -- common/autotest_common.sh@1104 -- # lvs_grow dirty 00:17:31.271 10:03:36 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:17:31.271 10:03:36 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:17:31.271 10:03:36 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:17:31.271 10:03:36 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:17:31.271 10:03:36 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:17:31.271 10:03:36 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:17:31.271 10:03:36 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:31.271 10:03:36 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:31.271 10:03:36 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:31.528 10:03:37 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:17:31.528 10:03:37 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:17:31.786 10:03:37 -- target/nvmf_lvs_grow.sh@28 -- # lvs=5735d05f-292c-4e29-b1fc-4b14ae532d45 00:17:31.786 10:03:37 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 5735d05f-292c-4e29-b1fc-4b14ae532d45 00:17:31.786 10:03:37 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:17:32.044 10:03:37 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:17:32.044 10:03:37 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:17:32.044 10:03:37 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 5735d05f-292c-4e29-b1fc-4b14ae532d45 lvol 150 00:17:32.302 10:03:37 -- target/nvmf_lvs_grow.sh@33 -- # lvol=4ec52d45-2023-48dd-91ad-de3d0905c93f 00:17:32.302 10:03:37 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:32.302 10:03:37 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:17:32.560 [2024-07-13 10:03:38.157240] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:17:32.560 [2024-07-13 10:03:38.157332] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:17:32.560 true 00:17:32.560 10:03:38 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 5735d05f-292c-4e29-b1fc-4b14ae532d45 00:17:32.560 10:03:38 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:17:32.818 10:03:38 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:17:32.818 10:03:38 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:33.076 10:03:38 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 4ec52d45-2023-48dd-91ad-de3d0905c93f 00:17:33.334 10:03:38 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:33.592 10:03:39 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:33.592 10:03:39 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=2806728 00:17:33.593 10:03:39 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:17:33.593 10:03:39 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:33.593 10:03:39 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 2806728 /var/tmp/bdevperf.sock 00:17:33.593 10:03:39 -- common/autotest_common.sh@819 -- # '[' -z 2806728 ']' 00:17:33.593 10:03:39 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:33.593 10:03:39 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:33.593 10:03:39 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:33.593 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:33.593 10:03:39 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:33.593 10:03:39 -- common/autotest_common.sh@10 -- # set +x 00:17:33.851 [2024-07-13 10:03:39.441470] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:17:33.852 [2024-07-13 10:03:39.441553] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2806728 ] 00:17:33.852 EAL: No free 2048 kB hugepages reported on node 1 00:17:33.852 [2024-07-13 10:03:39.507729] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:33.852 [2024-07-13 10:03:39.596411] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:34.786 10:03:40 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:34.786 10:03:40 -- common/autotest_common.sh@852 -- # return 0 00:17:34.786 10:03:40 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:17:35.351 Nvme0n1 00:17:35.351 10:03:40 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:17:35.610 [ 00:17:35.610 { 00:17:35.610 "name": "Nvme0n1", 00:17:35.610 "aliases": [ 00:17:35.610 "4ec52d45-2023-48dd-91ad-de3d0905c93f" 00:17:35.610 ], 00:17:35.610 "product_name": "NVMe disk", 00:17:35.610 "block_size": 4096, 00:17:35.610 "num_blocks": 38912, 00:17:35.610 "uuid": "4ec52d45-2023-48dd-91ad-de3d0905c93f", 00:17:35.610 "assigned_rate_limits": { 00:17:35.610 "rw_ios_per_sec": 0, 00:17:35.610 "rw_mbytes_per_sec": 0, 00:17:35.610 "r_mbytes_per_sec": 0, 00:17:35.610 "w_mbytes_per_sec": 0 00:17:35.610 }, 00:17:35.610 "claimed": false, 00:17:35.610 "zoned": false, 00:17:35.610 "supported_io_types": { 00:17:35.610 "read": true, 00:17:35.610 "write": true, 00:17:35.610 "unmap": true, 00:17:35.610 "write_zeroes": true, 00:17:35.610 "flush": true, 00:17:35.610 "reset": true, 00:17:35.610 "compare": true, 00:17:35.610 "compare_and_write": true, 00:17:35.610 "abort": true, 00:17:35.610 "nvme_admin": true, 00:17:35.610 "nvme_io": true 00:17:35.610 }, 00:17:35.610 "driver_specific": { 00:17:35.610 "nvme": [ 00:17:35.610 { 00:17:35.610 "trid": { 00:17:35.610 "trtype": "TCP", 00:17:35.610 "adrfam": "IPv4", 00:17:35.610 "traddr": "10.0.0.2", 00:17:35.610 "trsvcid": "4420", 00:17:35.610 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:17:35.610 }, 00:17:35.610 "ctrlr_data": { 00:17:35.610 "cntlid": 1, 00:17:35.610 "vendor_id": "0x8086", 00:17:35.610 "model_number": "SPDK bdev Controller", 00:17:35.610 "serial_number": "SPDK0", 00:17:35.610 "firmware_revision": "24.01.1", 00:17:35.610 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:35.610 "oacs": { 00:17:35.610 "security": 0, 00:17:35.610 "format": 0, 00:17:35.610 "firmware": 0, 00:17:35.610 "ns_manage": 0 00:17:35.610 }, 00:17:35.610 "multi_ctrlr": true, 00:17:35.610 "ana_reporting": false 00:17:35.610 }, 00:17:35.610 "vs": { 00:17:35.610 "nvme_version": "1.3" 00:17:35.610 }, 00:17:35.610 "ns_data": { 00:17:35.610 "id": 1, 00:17:35.610 "can_share": true 00:17:35.610 } 00:17:35.610 } 00:17:35.610 ], 00:17:35.610 "mp_policy": "active_passive" 00:17:35.610 } 00:17:35.610 } 00:17:35.610 ] 00:17:35.610 10:03:41 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=2806962 00:17:35.610 10:03:41 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:17:35.610 10:03:41 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:35.610 Running I/O for 10 seconds... 00:17:36.547 Latency(us) 00:17:36.547 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:36.547 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:36.547 Nvme0n1 : 1.00 14664.00 57.28 0.00 0.00 0.00 0.00 0.00 00:17:36.547 =================================================================================================================== 00:17:36.547 Total : 14664.00 57.28 0.00 0.00 0.00 0.00 0.00 00:17:36.547 00:17:37.484 10:03:43 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 5735d05f-292c-4e29-b1fc-4b14ae532d45 00:17:37.795 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:37.795 Nvme0n1 : 2.00 14817.00 57.88 0.00 0.00 0.00 0.00 0.00 00:17:37.795 =================================================================================================================== 00:17:37.795 Total : 14817.00 57.88 0.00 0.00 0.00 0.00 0.00 00:17:37.795 00:17:37.795 true 00:17:37.795 10:03:43 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 5735d05f-292c-4e29-b1fc-4b14ae532d45 00:17:37.795 10:03:43 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:17:38.052 10:03:43 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:17:38.052 10:03:43 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:17:38.052 10:03:43 -- target/nvmf_lvs_grow.sh@65 -- # wait 2806962 00:17:38.617 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:38.617 Nvme0n1 : 3.00 14893.33 58.18 0.00 0.00 0.00 0.00 0.00 00:17:38.617 =================================================================================================================== 00:17:38.617 Total : 14893.33 58.18 0.00 0.00 0.00 0.00 0.00 00:17:38.617 00:17:39.552 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:39.552 Nvme0n1 : 4.00 14976.50 58.50 0.00 0.00 0.00 0.00 0.00 00:17:39.552 =================================================================================================================== 00:17:39.552 Total : 14976.50 58.50 0.00 0.00 0.00 0.00 0.00 00:17:39.552 00:17:40.927 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:40.927 Nvme0n1 : 5.00 15040.40 58.75 0.00 0.00 0.00 0.00 0.00 00:17:40.927 =================================================================================================================== 00:17:40.927 Total : 15040.40 58.75 0.00 0.00 0.00 0.00 0.00 00:17:40.927 00:17:41.863 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:41.863 Nvme0n1 : 6.00 15084.00 58.92 0.00 0.00 0.00 0.00 0.00 00:17:41.863 =================================================================================================================== 00:17:41.863 Total : 15084.00 58.92 0.00 0.00 0.00 0.00 0.00 00:17:41.863 00:17:42.797 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:42.797 Nvme0n1 : 7.00 15106.57 59.01 0.00 0.00 0.00 0.00 0.00 00:17:42.797 =================================================================================================================== 00:17:42.797 Total : 15106.57 59.01 0.00 0.00 0.00 0.00 0.00 00:17:42.797 00:17:43.731 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:43.731 Nvme0n1 : 8.00 15112.25 59.03 0.00 0.00 0.00 0.00 0.00 00:17:43.731 =================================================================================================================== 00:17:43.731 Total : 15112.25 59.03 0.00 0.00 0.00 0.00 0.00 00:17:43.731 00:17:44.667 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:44.667 Nvme0n1 : 9.00 15111.33 59.03 0.00 0.00 0.00 0.00 0.00 00:17:44.667 =================================================================================================================== 00:17:44.667 Total : 15111.33 59.03 0.00 0.00 0.00 0.00 0.00 00:17:44.667 00:17:45.601 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:45.601 Nvme0n1 : 10.00 15110.60 59.03 0.00 0.00 0.00 0.00 0.00 00:17:45.601 =================================================================================================================== 00:17:45.601 Total : 15110.60 59.03 0.00 0.00 0.00 0.00 0.00 00:17:45.601 00:17:45.601 00:17:45.601 Latency(us) 00:17:45.601 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:45.601 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:45.601 Nvme0n1 : 10.01 15110.30 59.02 0.00 0.00 8465.21 3155.44 14660.65 00:17:45.601 =================================================================================================================== 00:17:45.601 Total : 15110.30 59.02 0.00 0.00 8465.21 3155.44 14660.65 00:17:45.601 0 00:17:45.601 10:03:51 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 2806728 00:17:45.601 10:03:51 -- common/autotest_common.sh@926 -- # '[' -z 2806728 ']' 00:17:45.601 10:03:51 -- common/autotest_common.sh@930 -- # kill -0 2806728 00:17:45.601 10:03:51 -- common/autotest_common.sh@931 -- # uname 00:17:45.601 10:03:51 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:45.601 10:03:51 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2806728 00:17:45.601 10:03:51 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:17:45.601 10:03:51 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:17:45.601 10:03:51 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2806728' 00:17:45.601 killing process with pid 2806728 00:17:45.601 10:03:51 -- common/autotest_common.sh@945 -- # kill 2806728 00:17:45.601 Received shutdown signal, test time was about 10.000000 seconds 00:17:45.601 00:17:45.601 Latency(us) 00:17:45.601 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:45.601 =================================================================================================================== 00:17:45.601 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:45.601 10:03:51 -- common/autotest_common.sh@950 -- # wait 2806728 00:17:45.859 10:03:51 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:46.117 10:03:51 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 5735d05f-292c-4e29-b1fc-4b14ae532d45 00:17:46.117 10:03:51 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:17:46.375 10:03:52 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:17:46.375 10:03:52 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:17:46.375 10:03:52 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 2804071 00:17:46.375 10:03:52 -- target/nvmf_lvs_grow.sh@74 -- # wait 2804071 00:17:46.633 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 2804071 Killed "${NVMF_APP[@]}" "$@" 00:17:46.633 10:03:52 -- target/nvmf_lvs_grow.sh@74 -- # true 00:17:46.633 10:03:52 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:17:46.633 10:03:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:46.633 10:03:52 -- common/autotest_common.sh@712 -- # xtrace_disable 00:17:46.633 10:03:52 -- common/autotest_common.sh@10 -- # set +x 00:17:46.633 10:03:52 -- nvmf/common.sh@469 -- # nvmfpid=2808331 00:17:46.633 10:03:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:17:46.633 10:03:52 -- nvmf/common.sh@470 -- # waitforlisten 2808331 00:17:46.633 10:03:52 -- common/autotest_common.sh@819 -- # '[' -z 2808331 ']' 00:17:46.633 10:03:52 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:46.633 10:03:52 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:46.633 10:03:52 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:46.633 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:46.633 10:03:52 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:46.633 10:03:52 -- common/autotest_common.sh@10 -- # set +x 00:17:46.633 [2024-07-13 10:03:52.244182] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:17:46.633 [2024-07-13 10:03:52.244268] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:46.633 EAL: No free 2048 kB hugepages reported on node 1 00:17:46.633 [2024-07-13 10:03:52.312621] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:46.633 [2024-07-13 10:03:52.400690] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:46.633 [2024-07-13 10:03:52.400855] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:46.633 [2024-07-13 10:03:52.400897] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:46.633 [2024-07-13 10:03:52.400913] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:46.633 [2024-07-13 10:03:52.400942] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:47.565 10:03:53 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:47.565 10:03:53 -- common/autotest_common.sh@852 -- # return 0 00:17:47.565 10:03:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:47.565 10:03:53 -- common/autotest_common.sh@718 -- # xtrace_disable 00:17:47.565 10:03:53 -- common/autotest_common.sh@10 -- # set +x 00:17:47.565 10:03:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:47.565 10:03:53 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:47.823 [2024-07-13 10:03:53.484597] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:17:47.823 [2024-07-13 10:03:53.484746] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:17:47.823 [2024-07-13 10:03:53.484804] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:17:47.823 10:03:53 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:17:47.823 10:03:53 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev 4ec52d45-2023-48dd-91ad-de3d0905c93f 00:17:47.823 10:03:53 -- common/autotest_common.sh@887 -- # local bdev_name=4ec52d45-2023-48dd-91ad-de3d0905c93f 00:17:47.823 10:03:53 -- common/autotest_common.sh@888 -- # local bdev_timeout= 00:17:47.823 10:03:53 -- common/autotest_common.sh@889 -- # local i 00:17:47.823 10:03:53 -- common/autotest_common.sh@890 -- # [[ -z '' ]] 00:17:47.823 10:03:53 -- common/autotest_common.sh@890 -- # bdev_timeout=2000 00:17:47.823 10:03:53 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:17:48.080 10:03:53 -- common/autotest_common.sh@894 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 4ec52d45-2023-48dd-91ad-de3d0905c93f -t 2000 00:17:48.338 [ 00:17:48.338 { 00:17:48.338 "name": "4ec52d45-2023-48dd-91ad-de3d0905c93f", 00:17:48.338 "aliases": [ 00:17:48.338 "lvs/lvol" 00:17:48.338 ], 00:17:48.338 "product_name": "Logical Volume", 00:17:48.338 "block_size": 4096, 00:17:48.338 "num_blocks": 38912, 00:17:48.338 "uuid": "4ec52d45-2023-48dd-91ad-de3d0905c93f", 00:17:48.338 "assigned_rate_limits": { 00:17:48.338 "rw_ios_per_sec": 0, 00:17:48.338 "rw_mbytes_per_sec": 0, 00:17:48.338 "r_mbytes_per_sec": 0, 00:17:48.338 "w_mbytes_per_sec": 0 00:17:48.338 }, 00:17:48.338 "claimed": false, 00:17:48.338 "zoned": false, 00:17:48.338 "supported_io_types": { 00:17:48.338 "read": true, 00:17:48.338 "write": true, 00:17:48.338 "unmap": true, 00:17:48.338 "write_zeroes": true, 00:17:48.338 "flush": false, 00:17:48.338 "reset": true, 00:17:48.338 "compare": false, 00:17:48.338 "compare_and_write": false, 00:17:48.338 "abort": false, 00:17:48.338 "nvme_admin": false, 00:17:48.338 "nvme_io": false 00:17:48.338 }, 00:17:48.338 "driver_specific": { 00:17:48.338 "lvol": { 00:17:48.338 "lvol_store_uuid": "5735d05f-292c-4e29-b1fc-4b14ae532d45", 00:17:48.338 "base_bdev": "aio_bdev", 00:17:48.338 "thin_provision": false, 00:17:48.338 "snapshot": false, 00:17:48.338 "clone": false, 00:17:48.338 "esnap_clone": false 00:17:48.338 } 00:17:48.338 } 00:17:48.338 } 00:17:48.338 ] 00:17:48.338 10:03:54 -- common/autotest_common.sh@895 -- # return 0 00:17:48.338 10:03:54 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 5735d05f-292c-4e29-b1fc-4b14ae532d45 00:17:48.338 10:03:54 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:17:48.596 10:03:54 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:17:48.596 10:03:54 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 5735d05f-292c-4e29-b1fc-4b14ae532d45 00:17:48.596 10:03:54 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:17:48.854 10:03:54 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:17:48.854 10:03:54 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:49.111 [2024-07-13 10:03:54.733512] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:17:49.111 10:03:54 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 5735d05f-292c-4e29-b1fc-4b14ae532d45 00:17:49.111 10:03:54 -- common/autotest_common.sh@640 -- # local es=0 00:17:49.111 10:03:54 -- common/autotest_common.sh@642 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 5735d05f-292c-4e29-b1fc-4b14ae532d45 00:17:49.111 10:03:54 -- common/autotest_common.sh@628 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:49.111 10:03:54 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:49.111 10:03:54 -- common/autotest_common.sh@632 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:49.111 10:03:54 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:49.111 10:03:54 -- common/autotest_common.sh@634 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:49.111 10:03:54 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:49.111 10:03:54 -- common/autotest_common.sh@634 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:49.111 10:03:54 -- common/autotest_common.sh@634 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:17:49.111 10:03:54 -- common/autotest_common.sh@643 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 5735d05f-292c-4e29-b1fc-4b14ae532d45 00:17:49.369 request: 00:17:49.369 { 00:17:49.369 "uuid": "5735d05f-292c-4e29-b1fc-4b14ae532d45", 00:17:49.369 "method": "bdev_lvol_get_lvstores", 00:17:49.369 "req_id": 1 00:17:49.369 } 00:17:49.369 Got JSON-RPC error response 00:17:49.369 response: 00:17:49.369 { 00:17:49.369 "code": -19, 00:17:49.369 "message": "No such device" 00:17:49.369 } 00:17:49.369 10:03:55 -- common/autotest_common.sh@643 -- # es=1 00:17:49.369 10:03:55 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:17:49.369 10:03:55 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:17:49.369 10:03:55 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:17:49.369 10:03:55 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:49.626 aio_bdev 00:17:49.626 10:03:55 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 4ec52d45-2023-48dd-91ad-de3d0905c93f 00:17:49.626 10:03:55 -- common/autotest_common.sh@887 -- # local bdev_name=4ec52d45-2023-48dd-91ad-de3d0905c93f 00:17:49.626 10:03:55 -- common/autotest_common.sh@888 -- # local bdev_timeout= 00:17:49.626 10:03:55 -- common/autotest_common.sh@889 -- # local i 00:17:49.626 10:03:55 -- common/autotest_common.sh@890 -- # [[ -z '' ]] 00:17:49.626 10:03:55 -- common/autotest_common.sh@890 -- # bdev_timeout=2000 00:17:49.626 10:03:55 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:17:49.884 10:03:55 -- common/autotest_common.sh@894 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 4ec52d45-2023-48dd-91ad-de3d0905c93f -t 2000 00:17:50.141 [ 00:17:50.141 { 00:17:50.141 "name": "4ec52d45-2023-48dd-91ad-de3d0905c93f", 00:17:50.141 "aliases": [ 00:17:50.141 "lvs/lvol" 00:17:50.141 ], 00:17:50.141 "product_name": "Logical Volume", 00:17:50.141 "block_size": 4096, 00:17:50.141 "num_blocks": 38912, 00:17:50.141 "uuid": "4ec52d45-2023-48dd-91ad-de3d0905c93f", 00:17:50.141 "assigned_rate_limits": { 00:17:50.141 "rw_ios_per_sec": 0, 00:17:50.141 "rw_mbytes_per_sec": 0, 00:17:50.141 "r_mbytes_per_sec": 0, 00:17:50.141 "w_mbytes_per_sec": 0 00:17:50.141 }, 00:17:50.141 "claimed": false, 00:17:50.141 "zoned": false, 00:17:50.141 "supported_io_types": { 00:17:50.141 "read": true, 00:17:50.141 "write": true, 00:17:50.141 "unmap": true, 00:17:50.141 "write_zeroes": true, 00:17:50.141 "flush": false, 00:17:50.141 "reset": true, 00:17:50.141 "compare": false, 00:17:50.141 "compare_and_write": false, 00:17:50.141 "abort": false, 00:17:50.141 "nvme_admin": false, 00:17:50.141 "nvme_io": false 00:17:50.141 }, 00:17:50.141 "driver_specific": { 00:17:50.141 "lvol": { 00:17:50.141 "lvol_store_uuid": "5735d05f-292c-4e29-b1fc-4b14ae532d45", 00:17:50.141 "base_bdev": "aio_bdev", 00:17:50.141 "thin_provision": false, 00:17:50.141 "snapshot": false, 00:17:50.141 "clone": false, 00:17:50.141 "esnap_clone": false 00:17:50.141 } 00:17:50.141 } 00:17:50.141 } 00:17:50.141 ] 00:17:50.141 10:03:55 -- common/autotest_common.sh@895 -- # return 0 00:17:50.141 10:03:55 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 5735d05f-292c-4e29-b1fc-4b14ae532d45 00:17:50.141 10:03:55 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:17:50.398 10:03:56 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:17:50.398 10:03:56 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 5735d05f-292c-4e29-b1fc-4b14ae532d45 00:17:50.398 10:03:56 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:17:50.656 10:03:56 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:17:50.656 10:03:56 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 4ec52d45-2023-48dd-91ad-de3d0905c93f 00:17:50.913 10:03:56 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 5735d05f-292c-4e29-b1fc-4b14ae532d45 00:17:51.170 10:03:56 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:51.428 10:03:57 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:51.428 00:17:51.428 real 0m20.217s 00:17:51.428 user 0m50.483s 00:17:51.428 sys 0m4.720s 00:17:51.428 10:03:57 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:17:51.428 10:03:57 -- common/autotest_common.sh@10 -- # set +x 00:17:51.428 ************************************ 00:17:51.428 END TEST lvs_grow_dirty 00:17:51.428 ************************************ 00:17:51.428 10:03:57 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:17:51.428 10:03:57 -- common/autotest_common.sh@796 -- # type=--id 00:17:51.428 10:03:57 -- common/autotest_common.sh@797 -- # id=0 00:17:51.428 10:03:57 -- common/autotest_common.sh@798 -- # '[' --id = --pid ']' 00:17:51.428 10:03:57 -- common/autotest_common.sh@802 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:17:51.428 10:03:57 -- common/autotest_common.sh@802 -- # shm_files=nvmf_trace.0 00:17:51.428 10:03:57 -- common/autotest_common.sh@804 -- # [[ -z nvmf_trace.0 ]] 00:17:51.428 10:03:57 -- common/autotest_common.sh@808 -- # for n in $shm_files 00:17:51.428 10:03:57 -- common/autotest_common.sh@809 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:17:51.428 nvmf_trace.0 00:17:51.428 10:03:57 -- common/autotest_common.sh@811 -- # return 0 00:17:51.428 10:03:57 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:17:51.428 10:03:57 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:51.428 10:03:57 -- nvmf/common.sh@116 -- # sync 00:17:51.428 10:03:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:51.428 10:03:57 -- nvmf/common.sh@119 -- # set +e 00:17:51.428 10:03:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:51.428 10:03:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:51.428 rmmod nvme_tcp 00:17:51.428 rmmod nvme_fabrics 00:17:51.428 rmmod nvme_keyring 00:17:51.428 10:03:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:51.428 10:03:57 -- nvmf/common.sh@123 -- # set -e 00:17:51.428 10:03:57 -- nvmf/common.sh@124 -- # return 0 00:17:51.428 10:03:57 -- nvmf/common.sh@477 -- # '[' -n 2808331 ']' 00:17:51.428 10:03:57 -- nvmf/common.sh@478 -- # killprocess 2808331 00:17:51.428 10:03:57 -- common/autotest_common.sh@926 -- # '[' -z 2808331 ']' 00:17:51.428 10:03:57 -- common/autotest_common.sh@930 -- # kill -0 2808331 00:17:51.428 10:03:57 -- common/autotest_common.sh@931 -- # uname 00:17:51.428 10:03:57 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:51.428 10:03:57 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2808331 00:17:51.428 10:03:57 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:17:51.428 10:03:57 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:17:51.428 10:03:57 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2808331' 00:17:51.428 killing process with pid 2808331 00:17:51.428 10:03:57 -- common/autotest_common.sh@945 -- # kill 2808331 00:17:51.428 10:03:57 -- common/autotest_common.sh@950 -- # wait 2808331 00:17:51.686 10:03:57 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:51.686 10:03:57 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:51.686 10:03:57 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:51.686 10:03:57 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:51.686 10:03:57 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:51.686 10:03:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:51.686 10:03:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:51.686 10:03:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:54.250 10:03:59 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:54.250 00:17:54.250 real 0m43.828s 00:17:54.250 user 1m14.373s 00:17:54.250 sys 0m8.473s 00:17:54.250 10:03:59 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:17:54.250 10:03:59 -- common/autotest_common.sh@10 -- # set +x 00:17:54.250 ************************************ 00:17:54.250 END TEST nvmf_lvs_grow 00:17:54.250 ************************************ 00:17:54.250 10:03:59 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:17:54.250 10:03:59 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:17:54.250 10:03:59 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:17:54.250 10:03:59 -- common/autotest_common.sh@10 -- # set +x 00:17:54.250 ************************************ 00:17:54.250 START TEST nvmf_bdev_io_wait 00:17:54.250 ************************************ 00:17:54.250 10:03:59 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:17:54.250 * Looking for test storage... 00:17:54.250 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:54.250 10:03:59 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:54.250 10:03:59 -- nvmf/common.sh@7 -- # uname -s 00:17:54.250 10:03:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:54.250 10:03:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:54.250 10:03:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:54.250 10:03:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:54.250 10:03:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:54.250 10:03:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:54.250 10:03:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:54.250 10:03:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:54.250 10:03:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:54.250 10:03:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:54.250 10:03:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:54.250 10:03:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:54.250 10:03:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:54.250 10:03:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:54.250 10:03:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:54.250 10:03:59 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:54.250 10:03:59 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:54.250 10:03:59 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:54.250 10:03:59 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:54.250 10:03:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:54.251 10:03:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:54.251 10:03:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:54.251 10:03:59 -- paths/export.sh@5 -- # export PATH 00:17:54.251 10:03:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:54.251 10:03:59 -- nvmf/common.sh@46 -- # : 0 00:17:54.251 10:03:59 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:54.251 10:03:59 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:54.251 10:03:59 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:54.251 10:03:59 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:54.251 10:03:59 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:54.251 10:03:59 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:54.251 10:03:59 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:54.251 10:03:59 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:54.251 10:03:59 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:54.251 10:03:59 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:54.251 10:03:59 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:17:54.251 10:03:59 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:54.251 10:03:59 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:54.251 10:03:59 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:54.251 10:03:59 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:54.251 10:03:59 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:54.251 10:03:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:54.251 10:03:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:54.251 10:03:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:54.251 10:03:59 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:54.251 10:03:59 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:54.251 10:03:59 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:54.251 10:03:59 -- common/autotest_common.sh@10 -- # set +x 00:17:56.155 10:04:01 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:56.155 10:04:01 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:56.155 10:04:01 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:56.155 10:04:01 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:56.155 10:04:01 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:56.155 10:04:01 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:56.155 10:04:01 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:56.155 10:04:01 -- nvmf/common.sh@294 -- # net_devs=() 00:17:56.155 10:04:01 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:56.155 10:04:01 -- nvmf/common.sh@295 -- # e810=() 00:17:56.155 10:04:01 -- nvmf/common.sh@295 -- # local -ga e810 00:17:56.155 10:04:01 -- nvmf/common.sh@296 -- # x722=() 00:17:56.155 10:04:01 -- nvmf/common.sh@296 -- # local -ga x722 00:17:56.155 10:04:01 -- nvmf/common.sh@297 -- # mlx=() 00:17:56.155 10:04:01 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:56.155 10:04:01 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:56.155 10:04:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:56.155 10:04:01 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:56.155 10:04:01 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:56.155 10:04:01 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:56.155 10:04:01 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:56.155 10:04:01 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:56.155 10:04:01 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:56.155 10:04:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:56.155 10:04:01 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:56.155 10:04:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:56.155 10:04:01 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:56.155 10:04:01 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:56.155 10:04:01 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:56.155 10:04:01 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:56.155 10:04:01 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:56.155 10:04:01 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:56.155 10:04:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:56.155 10:04:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:56.155 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:56.155 10:04:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:56.155 10:04:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:56.155 10:04:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:56.155 10:04:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:56.155 10:04:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:56.155 10:04:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:56.155 10:04:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:56.155 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:56.155 10:04:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:56.155 10:04:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:56.155 10:04:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:56.155 10:04:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:56.155 10:04:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:56.155 10:04:01 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:56.155 10:04:01 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:56.155 10:04:01 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:56.155 10:04:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:56.155 10:04:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:56.155 10:04:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:56.155 10:04:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:56.155 10:04:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:56.155 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:56.155 10:04:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:56.155 10:04:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:56.155 10:04:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:56.155 10:04:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:56.155 10:04:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:56.155 10:04:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:56.155 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:56.155 10:04:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:56.155 10:04:01 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:56.155 10:04:01 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:56.155 10:04:01 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:56.155 10:04:01 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:56.155 10:04:01 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:56.155 10:04:01 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:56.155 10:04:01 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:56.155 10:04:01 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:56.155 10:04:01 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:56.155 10:04:01 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:56.155 10:04:01 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:56.155 10:04:01 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:56.155 10:04:01 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:56.155 10:04:01 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:56.155 10:04:01 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:56.155 10:04:01 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:56.155 10:04:01 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:56.155 10:04:01 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:56.155 10:04:01 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:56.155 10:04:01 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:56.155 10:04:01 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:56.155 10:04:01 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:56.155 10:04:01 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:56.155 10:04:01 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:56.155 10:04:01 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:56.155 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:56.155 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.188 ms 00:17:56.155 00:17:56.155 --- 10.0.0.2 ping statistics --- 00:17:56.155 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:56.155 rtt min/avg/max/mdev = 0.188/0.188/0.188/0.000 ms 00:17:56.155 10:04:01 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:56.155 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:56.155 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.131 ms 00:17:56.155 00:17:56.155 --- 10.0.0.1 ping statistics --- 00:17:56.155 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:56.155 rtt min/avg/max/mdev = 0.131/0.131/0.131/0.000 ms 00:17:56.155 10:04:01 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:56.155 10:04:01 -- nvmf/common.sh@410 -- # return 0 00:17:56.155 10:04:01 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:56.155 10:04:01 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:56.155 10:04:01 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:56.155 10:04:01 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:56.155 10:04:01 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:56.155 10:04:01 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:56.155 10:04:01 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:56.155 10:04:01 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:17:56.155 10:04:01 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:56.155 10:04:01 -- common/autotest_common.sh@712 -- # xtrace_disable 00:17:56.155 10:04:01 -- common/autotest_common.sh@10 -- # set +x 00:17:56.155 10:04:01 -- nvmf/common.sh@469 -- # nvmfpid=2810883 00:17:56.155 10:04:01 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:17:56.155 10:04:01 -- nvmf/common.sh@470 -- # waitforlisten 2810883 00:17:56.155 10:04:01 -- common/autotest_common.sh@819 -- # '[' -z 2810883 ']' 00:17:56.155 10:04:01 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:56.155 10:04:01 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:56.155 10:04:01 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:56.155 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:56.155 10:04:01 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:56.155 10:04:01 -- common/autotest_common.sh@10 -- # set +x 00:17:56.155 [2024-07-13 10:04:01.707718] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:17:56.155 [2024-07-13 10:04:01.707784] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:56.155 EAL: No free 2048 kB hugepages reported on node 1 00:17:56.155 [2024-07-13 10:04:01.774240] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:56.155 [2024-07-13 10:04:01.867470] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:56.155 [2024-07-13 10:04:01.867650] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:56.156 [2024-07-13 10:04:01.867669] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:56.156 [2024-07-13 10:04:01.867690] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:56.156 [2024-07-13 10:04:01.867770] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:56.156 [2024-07-13 10:04:01.867833] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:56.156 [2024-07-13 10:04:01.867906] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:56.156 [2024-07-13 10:04:01.867910] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:56.156 10:04:01 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:56.156 10:04:01 -- common/autotest_common.sh@852 -- # return 0 00:17:56.156 10:04:01 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:56.156 10:04:01 -- common/autotest_common.sh@718 -- # xtrace_disable 00:17:56.156 10:04:01 -- common/autotest_common.sh@10 -- # set +x 00:17:56.156 10:04:01 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:56.156 10:04:01 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:17:56.156 10:04:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:56.156 10:04:01 -- common/autotest_common.sh@10 -- # set +x 00:17:56.156 10:04:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:56.156 10:04:01 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:17:56.156 10:04:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:56.156 10:04:01 -- common/autotest_common.sh@10 -- # set +x 00:17:56.415 10:04:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:56.415 10:04:01 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:56.415 10:04:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:56.415 10:04:01 -- common/autotest_common.sh@10 -- # set +x 00:17:56.415 [2024-07-13 10:04:01.994248] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:56.415 10:04:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:56.415 10:04:02 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:56.415 10:04:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:56.415 10:04:02 -- common/autotest_common.sh@10 -- # set +x 00:17:56.415 Malloc0 00:17:56.415 10:04:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:56.415 10:04:02 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:56.415 10:04:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:56.415 10:04:02 -- common/autotest_common.sh@10 -- # set +x 00:17:56.415 10:04:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:56.415 10:04:02 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:56.415 10:04:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:56.415 10:04:02 -- common/autotest_common.sh@10 -- # set +x 00:17:56.415 10:04:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:56.415 10:04:02 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:56.415 10:04:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:56.415 10:04:02 -- common/autotest_common.sh@10 -- # set +x 00:17:56.415 [2024-07-13 10:04:02.060338] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:56.415 10:04:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:56.415 10:04:02 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=2810986 00:17:56.415 10:04:02 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:17:56.415 10:04:02 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:17:56.415 10:04:02 -- target/bdev_io_wait.sh@30 -- # READ_PID=2810988 00:17:56.415 10:04:02 -- nvmf/common.sh@520 -- # config=() 00:17:56.415 10:04:02 -- nvmf/common.sh@520 -- # local subsystem config 00:17:56.415 10:04:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:56.415 10:04:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:56.415 { 00:17:56.415 "params": { 00:17:56.415 "name": "Nvme$subsystem", 00:17:56.415 "trtype": "$TEST_TRANSPORT", 00:17:56.415 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:56.415 "adrfam": "ipv4", 00:17:56.415 "trsvcid": "$NVMF_PORT", 00:17:56.415 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:56.415 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:56.415 "hdgst": ${hdgst:-false}, 00:17:56.415 "ddgst": ${ddgst:-false} 00:17:56.415 }, 00:17:56.415 "method": "bdev_nvme_attach_controller" 00:17:56.415 } 00:17:56.415 EOF 00:17:56.415 )") 00:17:56.415 10:04:02 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:17:56.415 10:04:02 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:17:56.415 10:04:02 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=2810990 00:17:56.415 10:04:02 -- nvmf/common.sh@520 -- # config=() 00:17:56.415 10:04:02 -- nvmf/common.sh@520 -- # local subsystem config 00:17:56.415 10:04:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:56.415 10:04:02 -- nvmf/common.sh@542 -- # cat 00:17:56.415 10:04:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:56.415 { 00:17:56.415 "params": { 00:17:56.415 "name": "Nvme$subsystem", 00:17:56.415 "trtype": "$TEST_TRANSPORT", 00:17:56.415 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:56.415 "adrfam": "ipv4", 00:17:56.415 "trsvcid": "$NVMF_PORT", 00:17:56.415 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:56.415 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:56.415 "hdgst": ${hdgst:-false}, 00:17:56.415 "ddgst": ${ddgst:-false} 00:17:56.415 }, 00:17:56.415 "method": "bdev_nvme_attach_controller" 00:17:56.415 } 00:17:56.415 EOF 00:17:56.415 )") 00:17:56.415 10:04:02 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:17:56.415 10:04:02 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:17:56.415 10:04:02 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=2810993 00:17:56.415 10:04:02 -- target/bdev_io_wait.sh@35 -- # sync 00:17:56.415 10:04:02 -- nvmf/common.sh@520 -- # config=() 00:17:56.415 10:04:02 -- nvmf/common.sh@520 -- # local subsystem config 00:17:56.415 10:04:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:56.415 10:04:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:56.415 { 00:17:56.415 "params": { 00:17:56.415 "name": "Nvme$subsystem", 00:17:56.415 "trtype": "$TEST_TRANSPORT", 00:17:56.415 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:56.415 "adrfam": "ipv4", 00:17:56.415 "trsvcid": "$NVMF_PORT", 00:17:56.415 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:56.415 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:56.415 "hdgst": ${hdgst:-false}, 00:17:56.415 "ddgst": ${ddgst:-false} 00:17:56.415 }, 00:17:56.415 "method": "bdev_nvme_attach_controller" 00:17:56.415 } 00:17:56.415 EOF 00:17:56.415 )") 00:17:56.415 10:04:02 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:17:56.415 10:04:02 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:17:56.415 10:04:02 -- nvmf/common.sh@520 -- # config=() 00:17:56.415 10:04:02 -- nvmf/common.sh@542 -- # cat 00:17:56.415 10:04:02 -- nvmf/common.sh@520 -- # local subsystem config 00:17:56.415 10:04:02 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:56.415 10:04:02 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:56.415 { 00:17:56.415 "params": { 00:17:56.415 "name": "Nvme$subsystem", 00:17:56.415 "trtype": "$TEST_TRANSPORT", 00:17:56.415 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:56.415 "adrfam": "ipv4", 00:17:56.415 "trsvcid": "$NVMF_PORT", 00:17:56.415 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:56.415 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:56.415 "hdgst": ${hdgst:-false}, 00:17:56.415 "ddgst": ${ddgst:-false} 00:17:56.415 }, 00:17:56.415 "method": "bdev_nvme_attach_controller" 00:17:56.415 } 00:17:56.415 EOF 00:17:56.415 )") 00:17:56.415 10:04:02 -- nvmf/common.sh@542 -- # cat 00:17:56.415 10:04:02 -- nvmf/common.sh@544 -- # jq . 00:17:56.415 10:04:02 -- target/bdev_io_wait.sh@37 -- # wait 2810986 00:17:56.416 10:04:02 -- nvmf/common.sh@542 -- # cat 00:17:56.416 10:04:02 -- nvmf/common.sh@544 -- # jq . 00:17:56.416 10:04:02 -- nvmf/common.sh@545 -- # IFS=, 00:17:56.416 10:04:02 -- nvmf/common.sh@544 -- # jq . 00:17:56.416 10:04:02 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:56.416 "params": { 00:17:56.416 "name": "Nvme1", 00:17:56.416 "trtype": "tcp", 00:17:56.416 "traddr": "10.0.0.2", 00:17:56.416 "adrfam": "ipv4", 00:17:56.416 "trsvcid": "4420", 00:17:56.416 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:56.416 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:56.416 "hdgst": false, 00:17:56.416 "ddgst": false 00:17:56.416 }, 00:17:56.416 "method": "bdev_nvme_attach_controller" 00:17:56.416 }' 00:17:56.416 10:04:02 -- nvmf/common.sh@544 -- # jq . 00:17:56.416 10:04:02 -- nvmf/common.sh@545 -- # IFS=, 00:17:56.416 10:04:02 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:56.416 "params": { 00:17:56.416 "name": "Nvme1", 00:17:56.416 "trtype": "tcp", 00:17:56.416 "traddr": "10.0.0.2", 00:17:56.416 "adrfam": "ipv4", 00:17:56.416 "trsvcid": "4420", 00:17:56.416 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:56.416 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:56.416 "hdgst": false, 00:17:56.416 "ddgst": false 00:17:56.416 }, 00:17:56.416 "method": "bdev_nvme_attach_controller" 00:17:56.416 }' 00:17:56.416 10:04:02 -- nvmf/common.sh@545 -- # IFS=, 00:17:56.416 10:04:02 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:56.416 "params": { 00:17:56.416 "name": "Nvme1", 00:17:56.416 "trtype": "tcp", 00:17:56.416 "traddr": "10.0.0.2", 00:17:56.416 "adrfam": "ipv4", 00:17:56.416 "trsvcid": "4420", 00:17:56.416 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:56.416 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:56.416 "hdgst": false, 00:17:56.416 "ddgst": false 00:17:56.416 }, 00:17:56.416 "method": "bdev_nvme_attach_controller" 00:17:56.416 }' 00:17:56.416 10:04:02 -- nvmf/common.sh@545 -- # IFS=, 00:17:56.416 10:04:02 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:56.416 "params": { 00:17:56.416 "name": "Nvme1", 00:17:56.416 "trtype": "tcp", 00:17:56.416 "traddr": "10.0.0.2", 00:17:56.416 "adrfam": "ipv4", 00:17:56.416 "trsvcid": "4420", 00:17:56.416 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:56.416 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:56.416 "hdgst": false, 00:17:56.416 "ddgst": false 00:17:56.416 }, 00:17:56.416 "method": "bdev_nvme_attach_controller" 00:17:56.416 }' 00:17:56.416 [2024-07-13 10:04:02.103991] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:17:56.416 [2024-07-13 10:04:02.104000] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:17:56.416 [2024-07-13 10:04:02.103998] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:17:56.416 [2024-07-13 10:04:02.103998] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:17:56.416 [2024-07-13 10:04:02.104090] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-07-13 10:04:02.104091] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-07-13 10:04:02.104092] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-07-13 10:04:02.104092] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:17:56.416 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:17:56.416 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:17:56.416 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:17:56.416 EAL: No free 2048 kB hugepages reported on node 1 00:17:56.675 EAL: No free 2048 kB hugepages reported on node 1 00:17:56.675 [2024-07-13 10:04:02.281722] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:56.675 EAL: No free 2048 kB hugepages reported on node 1 00:17:56.675 [2024-07-13 10:04:02.354810] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:56.675 [2024-07-13 10:04:02.380576] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:56.675 EAL: No free 2048 kB hugepages reported on node 1 00:17:56.675 [2024-07-13 10:04:02.454940] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:17:56.675 [2024-07-13 10:04:02.458421] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:56.933 [2024-07-13 10:04:02.524285] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:17:56.933 [2024-07-13 10:04:02.555459] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:56.933 [2024-07-13 10:04:02.632498] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:17:57.196 Running I/O for 1 seconds... 00:17:57.196 Running I/O for 1 seconds... 00:17:57.196 Running I/O for 1 seconds... 00:17:57.196 Running I/O for 1 seconds... 00:17:58.142 00:17:58.142 Latency(us) 00:17:58.142 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:58.142 Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:17:58.142 Nvme1n1 : 1.01 8165.28 31.90 0.00 0.00 15599.24 8980.86 28544.57 00:17:58.142 =================================================================================================================== 00:17:58.142 Total : 8165.28 31.90 0.00 0.00 15599.24 8980.86 28544.57 00:17:58.142 00:17:58.142 Latency(us) 00:17:58.142 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:58.142 Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:17:58.142 Nvme1n1 : 1.01 7142.05 27.90 0.00 0.00 17812.06 8446.86 25826.04 00:17:58.142 =================================================================================================================== 00:17:58.142 Total : 7142.05 27.90 0.00 0.00 17812.06 8446.86 25826.04 00:17:58.142 00:17:58.142 Latency(us) 00:17:58.142 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:58.142 Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:17:58.142 Nvme1n1 : 1.00 198437.52 775.15 0.00 0.00 642.46 260.93 873.81 00:17:58.142 =================================================================================================================== 00:17:58.142 Total : 198437.52 775.15 0.00 0.00 642.46 260.93 873.81 00:17:58.142 00:17:58.142 Latency(us) 00:17:58.142 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:58.142 Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:17:58.142 Nvme1n1 : 1.01 7432.55 29.03 0.00 0.00 17162.45 6116.69 37088.52 00:17:58.142 =================================================================================================================== 00:17:58.142 Total : 7432.55 29.03 0.00 0.00 17162.45 6116.69 37088.52 00:17:58.399 10:04:04 -- target/bdev_io_wait.sh@38 -- # wait 2810988 00:17:58.655 10:04:04 -- target/bdev_io_wait.sh@39 -- # wait 2810990 00:17:58.655 10:04:04 -- target/bdev_io_wait.sh@40 -- # wait 2810993 00:17:58.655 10:04:04 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:58.655 10:04:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:58.655 10:04:04 -- common/autotest_common.sh@10 -- # set +x 00:17:58.655 10:04:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:58.655 10:04:04 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:17:58.655 10:04:04 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:17:58.655 10:04:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:58.655 10:04:04 -- nvmf/common.sh@116 -- # sync 00:17:58.655 10:04:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:58.655 10:04:04 -- nvmf/common.sh@119 -- # set +e 00:17:58.655 10:04:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:58.655 10:04:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:58.655 rmmod nvme_tcp 00:17:58.655 rmmod nvme_fabrics 00:17:58.655 rmmod nvme_keyring 00:17:58.655 10:04:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:58.655 10:04:04 -- nvmf/common.sh@123 -- # set -e 00:17:58.655 10:04:04 -- nvmf/common.sh@124 -- # return 0 00:17:58.655 10:04:04 -- nvmf/common.sh@477 -- # '[' -n 2810883 ']' 00:17:58.655 10:04:04 -- nvmf/common.sh@478 -- # killprocess 2810883 00:17:58.655 10:04:04 -- common/autotest_common.sh@926 -- # '[' -z 2810883 ']' 00:17:58.655 10:04:04 -- common/autotest_common.sh@930 -- # kill -0 2810883 00:17:58.655 10:04:04 -- common/autotest_common.sh@931 -- # uname 00:17:58.655 10:04:04 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:58.655 10:04:04 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2810883 00:17:58.655 10:04:04 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:17:58.655 10:04:04 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:17:58.655 10:04:04 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2810883' 00:17:58.655 killing process with pid 2810883 00:17:58.655 10:04:04 -- common/autotest_common.sh@945 -- # kill 2810883 00:17:58.655 10:04:04 -- common/autotest_common.sh@950 -- # wait 2810883 00:17:58.912 10:04:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:58.912 10:04:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:58.912 10:04:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:58.912 10:04:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:58.912 10:04:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:58.912 10:04:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:58.912 10:04:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:58.912 10:04:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:00.822 10:04:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:00.822 00:18:00.822 real 0m7.053s 00:18:00.822 user 0m16.434s 00:18:00.822 sys 0m3.381s 00:18:00.822 10:04:06 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:18:00.822 10:04:06 -- common/autotest_common.sh@10 -- # set +x 00:18:00.822 ************************************ 00:18:00.822 END TEST nvmf_bdev_io_wait 00:18:00.822 ************************************ 00:18:00.822 10:04:06 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:18:00.822 10:04:06 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:18:00.822 10:04:06 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:18:00.822 10:04:06 -- common/autotest_common.sh@10 -- # set +x 00:18:00.822 ************************************ 00:18:00.822 START TEST nvmf_queue_depth 00:18:00.822 ************************************ 00:18:00.822 10:04:06 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:18:01.081 * Looking for test storage... 00:18:01.081 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:01.081 10:04:06 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:01.081 10:04:06 -- nvmf/common.sh@7 -- # uname -s 00:18:01.081 10:04:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:01.081 10:04:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:01.081 10:04:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:01.081 10:04:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:01.081 10:04:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:01.081 10:04:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:01.081 10:04:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:01.081 10:04:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:01.081 10:04:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:01.081 10:04:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:01.081 10:04:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:01.081 10:04:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:01.081 10:04:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:01.081 10:04:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:01.081 10:04:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:01.081 10:04:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:01.081 10:04:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:01.081 10:04:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:01.081 10:04:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:01.081 10:04:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:01.081 10:04:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:01.081 10:04:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:01.081 10:04:06 -- paths/export.sh@5 -- # export PATH 00:18:01.081 10:04:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:01.081 10:04:06 -- nvmf/common.sh@46 -- # : 0 00:18:01.081 10:04:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:01.081 10:04:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:01.081 10:04:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:01.081 10:04:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:01.081 10:04:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:01.081 10:04:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:01.081 10:04:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:01.081 10:04:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:01.081 10:04:06 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:18:01.081 10:04:06 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:18:01.081 10:04:06 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:01.081 10:04:06 -- target/queue_depth.sh@19 -- # nvmftestinit 00:18:01.081 10:04:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:01.081 10:04:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:01.081 10:04:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:01.081 10:04:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:01.081 10:04:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:01.081 10:04:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:01.081 10:04:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:01.081 10:04:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:01.081 10:04:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:01.081 10:04:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:01.081 10:04:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:01.081 10:04:06 -- common/autotest_common.sh@10 -- # set +x 00:18:02.983 10:04:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:02.983 10:04:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:02.983 10:04:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:02.983 10:04:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:02.983 10:04:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:02.983 10:04:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:02.983 10:04:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:02.983 10:04:08 -- nvmf/common.sh@294 -- # net_devs=() 00:18:02.983 10:04:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:02.983 10:04:08 -- nvmf/common.sh@295 -- # e810=() 00:18:02.983 10:04:08 -- nvmf/common.sh@295 -- # local -ga e810 00:18:02.983 10:04:08 -- nvmf/common.sh@296 -- # x722=() 00:18:02.983 10:04:08 -- nvmf/common.sh@296 -- # local -ga x722 00:18:02.983 10:04:08 -- nvmf/common.sh@297 -- # mlx=() 00:18:02.983 10:04:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:02.983 10:04:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:02.983 10:04:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:02.983 10:04:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:02.983 10:04:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:02.983 10:04:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:02.983 10:04:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:02.983 10:04:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:02.983 10:04:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:02.983 10:04:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:02.983 10:04:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:02.983 10:04:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:02.983 10:04:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:02.983 10:04:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:02.983 10:04:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:02.983 10:04:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:02.983 10:04:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:02.983 10:04:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:02.983 10:04:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:02.983 10:04:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:02.983 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:02.983 10:04:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:02.983 10:04:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:02.983 10:04:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:02.983 10:04:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:02.983 10:04:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:02.983 10:04:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:02.983 10:04:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:02.983 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:02.983 10:04:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:02.983 10:04:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:02.983 10:04:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:02.983 10:04:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:02.983 10:04:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:02.983 10:04:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:02.983 10:04:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:02.983 10:04:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:02.983 10:04:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:02.983 10:04:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:02.983 10:04:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:02.983 10:04:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:02.983 10:04:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:02.983 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:02.983 10:04:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:02.983 10:04:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:02.983 10:04:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:02.983 10:04:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:02.983 10:04:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:02.983 10:04:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:02.983 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:02.983 10:04:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:02.983 10:04:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:02.983 10:04:08 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:02.983 10:04:08 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:02.983 10:04:08 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:02.983 10:04:08 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:02.983 10:04:08 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:02.983 10:04:08 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:02.983 10:04:08 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:02.983 10:04:08 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:02.983 10:04:08 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:02.983 10:04:08 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:02.983 10:04:08 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:02.983 10:04:08 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:02.983 10:04:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:02.983 10:04:08 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:02.983 10:04:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:02.983 10:04:08 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:02.983 10:04:08 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:02.983 10:04:08 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:02.983 10:04:08 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:02.983 10:04:08 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:02.983 10:04:08 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:02.983 10:04:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:02.983 10:04:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:02.983 10:04:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:02.983 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:02.983 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.195 ms 00:18:02.983 00:18:02.983 --- 10.0.0.2 ping statistics --- 00:18:02.983 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:02.983 rtt min/avg/max/mdev = 0.195/0.195/0.195/0.000 ms 00:18:02.983 10:04:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:02.984 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:02.984 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.176 ms 00:18:02.984 00:18:02.984 --- 10.0.0.1 ping statistics --- 00:18:02.984 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:02.984 rtt min/avg/max/mdev = 0.176/0.176/0.176/0.000 ms 00:18:02.984 10:04:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:02.984 10:04:08 -- nvmf/common.sh@410 -- # return 0 00:18:02.984 10:04:08 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:02.984 10:04:08 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:02.984 10:04:08 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:02.984 10:04:08 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:02.984 10:04:08 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:02.984 10:04:08 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:02.984 10:04:08 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:02.984 10:04:08 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:18:02.984 10:04:08 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:02.984 10:04:08 -- common/autotest_common.sh@712 -- # xtrace_disable 00:18:02.984 10:04:08 -- common/autotest_common.sh@10 -- # set +x 00:18:02.984 10:04:08 -- nvmf/common.sh@469 -- # nvmfpid=2813157 00:18:02.984 10:04:08 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:02.984 10:04:08 -- nvmf/common.sh@470 -- # waitforlisten 2813157 00:18:02.984 10:04:08 -- common/autotest_common.sh@819 -- # '[' -z 2813157 ']' 00:18:02.984 10:04:08 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:02.984 10:04:08 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:02.984 10:04:08 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:02.984 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:02.984 10:04:08 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:02.984 10:04:08 -- common/autotest_common.sh@10 -- # set +x 00:18:03.242 [2024-07-13 10:04:08.819474] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:18:03.242 [2024-07-13 10:04:08.819563] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:03.242 EAL: No free 2048 kB hugepages reported on node 1 00:18:03.242 [2024-07-13 10:04:08.888240] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:03.242 [2024-07-13 10:04:08.979983] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:03.242 [2024-07-13 10:04:08.980172] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:03.242 [2024-07-13 10:04:08.980192] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:03.242 [2024-07-13 10:04:08.980208] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:03.242 [2024-07-13 10:04:08.980239] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:04.178 10:04:09 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:04.178 10:04:09 -- common/autotest_common.sh@852 -- # return 0 00:18:04.178 10:04:09 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:04.178 10:04:09 -- common/autotest_common.sh@718 -- # xtrace_disable 00:18:04.178 10:04:09 -- common/autotest_common.sh@10 -- # set +x 00:18:04.178 10:04:09 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:04.178 10:04:09 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:04.178 10:04:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:04.178 10:04:09 -- common/autotest_common.sh@10 -- # set +x 00:18:04.178 [2024-07-13 10:04:09.762511] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:04.178 10:04:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:04.178 10:04:09 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:04.178 10:04:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:04.178 10:04:09 -- common/autotest_common.sh@10 -- # set +x 00:18:04.178 Malloc0 00:18:04.178 10:04:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:04.178 10:04:09 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:04.178 10:04:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:04.178 10:04:09 -- common/autotest_common.sh@10 -- # set +x 00:18:04.178 10:04:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:04.178 10:04:09 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:04.178 10:04:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:04.178 10:04:09 -- common/autotest_common.sh@10 -- # set +x 00:18:04.178 10:04:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:04.178 10:04:09 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:04.178 10:04:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:04.178 10:04:09 -- common/autotest_common.sh@10 -- # set +x 00:18:04.178 [2024-07-13 10:04:09.818604] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:04.178 10:04:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:04.178 10:04:09 -- target/queue_depth.sh@30 -- # bdevperf_pid=2813311 00:18:04.178 10:04:09 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:18:04.178 10:04:09 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:04.178 10:04:09 -- target/queue_depth.sh@33 -- # waitforlisten 2813311 /var/tmp/bdevperf.sock 00:18:04.178 10:04:09 -- common/autotest_common.sh@819 -- # '[' -z 2813311 ']' 00:18:04.178 10:04:09 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:04.178 10:04:09 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:04.178 10:04:09 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:04.178 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:04.178 10:04:09 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:04.178 10:04:09 -- common/autotest_common.sh@10 -- # set +x 00:18:04.178 [2024-07-13 10:04:09.858468] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:18:04.178 [2024-07-13 10:04:09.858526] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2813311 ] 00:18:04.178 EAL: No free 2048 kB hugepages reported on node 1 00:18:04.178 [2024-07-13 10:04:09.919237] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:04.437 [2024-07-13 10:04:10.012274] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:05.368 10:04:10 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:05.368 10:04:10 -- common/autotest_common.sh@852 -- # return 0 00:18:05.368 10:04:10 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:18:05.368 10:04:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:05.368 10:04:10 -- common/autotest_common.sh@10 -- # set +x 00:18:05.368 NVMe0n1 00:18:05.369 10:04:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:05.369 10:04:11 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:05.369 Running I/O for 10 seconds... 00:18:17.562 00:18:17.562 Latency(us) 00:18:17.562 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:17.562 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:18:17.562 Verification LBA range: start 0x0 length 0x4000 00:18:17.562 NVMe0n1 : 10.07 12575.92 49.12 0.00 0.00 81110.99 14175.19 62526.20 00:18:17.562 =================================================================================================================== 00:18:17.562 Total : 12575.92 49.12 0.00 0.00 81110.99 14175.19 62526.20 00:18:17.562 0 00:18:17.562 10:04:21 -- target/queue_depth.sh@39 -- # killprocess 2813311 00:18:17.562 10:04:21 -- common/autotest_common.sh@926 -- # '[' -z 2813311 ']' 00:18:17.562 10:04:21 -- common/autotest_common.sh@930 -- # kill -0 2813311 00:18:17.562 10:04:21 -- common/autotest_common.sh@931 -- # uname 00:18:17.562 10:04:21 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:17.562 10:04:21 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2813311 00:18:17.562 10:04:21 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:18:17.562 10:04:21 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:18:17.562 10:04:21 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2813311' 00:18:17.562 killing process with pid 2813311 00:18:17.562 10:04:21 -- common/autotest_common.sh@945 -- # kill 2813311 00:18:17.562 Received shutdown signal, test time was about 10.000000 seconds 00:18:17.562 00:18:17.562 Latency(us) 00:18:17.562 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:17.562 =================================================================================================================== 00:18:17.562 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:17.562 10:04:21 -- common/autotest_common.sh@950 -- # wait 2813311 00:18:17.562 10:04:21 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:18:17.562 10:04:21 -- target/queue_depth.sh@43 -- # nvmftestfini 00:18:17.562 10:04:21 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:17.562 10:04:21 -- nvmf/common.sh@116 -- # sync 00:18:17.562 10:04:21 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:17.562 10:04:21 -- nvmf/common.sh@119 -- # set +e 00:18:17.562 10:04:21 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:17.562 10:04:21 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:17.562 rmmod nvme_tcp 00:18:17.562 rmmod nvme_fabrics 00:18:17.562 rmmod nvme_keyring 00:18:17.562 10:04:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:17.562 10:04:21 -- nvmf/common.sh@123 -- # set -e 00:18:17.562 10:04:21 -- nvmf/common.sh@124 -- # return 0 00:18:17.562 10:04:21 -- nvmf/common.sh@477 -- # '[' -n 2813157 ']' 00:18:17.562 10:04:21 -- nvmf/common.sh@478 -- # killprocess 2813157 00:18:17.562 10:04:21 -- common/autotest_common.sh@926 -- # '[' -z 2813157 ']' 00:18:17.562 10:04:21 -- common/autotest_common.sh@930 -- # kill -0 2813157 00:18:17.562 10:04:21 -- common/autotest_common.sh@931 -- # uname 00:18:17.562 10:04:21 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:17.562 10:04:21 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2813157 00:18:17.562 10:04:21 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:18:17.562 10:04:21 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:18:17.562 10:04:21 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2813157' 00:18:17.562 killing process with pid 2813157 00:18:17.562 10:04:21 -- common/autotest_common.sh@945 -- # kill 2813157 00:18:17.562 10:04:21 -- common/autotest_common.sh@950 -- # wait 2813157 00:18:17.562 10:04:21 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:17.562 10:04:21 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:17.562 10:04:21 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:17.562 10:04:21 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:17.563 10:04:21 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:17.563 10:04:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:17.563 10:04:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:17.563 10:04:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:18.127 10:04:23 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:18.127 00:18:18.127 real 0m17.302s 00:18:18.127 user 0m24.959s 00:18:18.127 sys 0m3.089s 00:18:18.127 10:04:23 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:18:18.127 10:04:23 -- common/autotest_common.sh@10 -- # set +x 00:18:18.127 ************************************ 00:18:18.127 END TEST nvmf_queue_depth 00:18:18.127 ************************************ 00:18:18.127 10:04:23 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:18:18.127 10:04:23 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:18:18.127 10:04:23 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:18:18.127 10:04:23 -- common/autotest_common.sh@10 -- # set +x 00:18:18.127 ************************************ 00:18:18.127 START TEST nvmf_multipath 00:18:18.127 ************************************ 00:18:18.127 10:04:23 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:18:18.385 * Looking for test storage... 00:18:18.385 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:18.385 10:04:23 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:18.385 10:04:23 -- nvmf/common.sh@7 -- # uname -s 00:18:18.385 10:04:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:18.385 10:04:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:18.385 10:04:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:18.385 10:04:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:18.385 10:04:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:18.385 10:04:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:18.385 10:04:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:18.385 10:04:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:18.385 10:04:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:18.385 10:04:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:18.385 10:04:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:18.385 10:04:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:18.385 10:04:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:18.385 10:04:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:18.385 10:04:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:18.385 10:04:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:18.385 10:04:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:18.385 10:04:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:18.385 10:04:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:18.385 10:04:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:18.385 10:04:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:18.385 10:04:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:18.385 10:04:23 -- paths/export.sh@5 -- # export PATH 00:18:18.385 10:04:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:18.385 10:04:23 -- nvmf/common.sh@46 -- # : 0 00:18:18.385 10:04:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:18.385 10:04:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:18.385 10:04:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:18.385 10:04:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:18.385 10:04:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:18.385 10:04:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:18.385 10:04:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:18.385 10:04:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:18.385 10:04:23 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:18.385 10:04:24 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:18.385 10:04:24 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:18:18.385 10:04:24 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:18.385 10:04:24 -- target/multipath.sh@43 -- # nvmftestinit 00:18:18.385 10:04:24 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:18.385 10:04:24 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:18.385 10:04:24 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:18.385 10:04:24 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:18.385 10:04:24 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:18.385 10:04:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:18.385 10:04:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:18.385 10:04:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:18.385 10:04:24 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:18.385 10:04:24 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:18.385 10:04:24 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:18.385 10:04:24 -- common/autotest_common.sh@10 -- # set +x 00:18:20.317 10:04:26 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:20.317 10:04:26 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:20.317 10:04:26 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:20.317 10:04:26 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:20.317 10:04:26 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:20.317 10:04:26 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:20.317 10:04:26 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:20.317 10:04:26 -- nvmf/common.sh@294 -- # net_devs=() 00:18:20.317 10:04:26 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:20.317 10:04:26 -- nvmf/common.sh@295 -- # e810=() 00:18:20.317 10:04:26 -- nvmf/common.sh@295 -- # local -ga e810 00:18:20.317 10:04:26 -- nvmf/common.sh@296 -- # x722=() 00:18:20.317 10:04:26 -- nvmf/common.sh@296 -- # local -ga x722 00:18:20.317 10:04:26 -- nvmf/common.sh@297 -- # mlx=() 00:18:20.317 10:04:26 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:20.317 10:04:26 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:20.317 10:04:26 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:20.317 10:04:26 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:20.317 10:04:26 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:20.317 10:04:26 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:20.317 10:04:26 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:20.317 10:04:26 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:20.317 10:04:26 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:20.317 10:04:26 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:20.317 10:04:26 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:20.317 10:04:26 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:20.317 10:04:26 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:20.317 10:04:26 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:20.317 10:04:26 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:20.317 10:04:26 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:20.317 10:04:26 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:20.317 10:04:26 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:20.317 10:04:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:20.317 10:04:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:20.317 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:20.317 10:04:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:20.317 10:04:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:20.317 10:04:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:20.317 10:04:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:20.317 10:04:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:20.317 10:04:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:20.317 10:04:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:20.317 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:20.317 10:04:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:20.317 10:04:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:20.317 10:04:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:20.317 10:04:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:20.317 10:04:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:20.317 10:04:26 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:20.317 10:04:26 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:20.317 10:04:26 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:20.317 10:04:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:20.317 10:04:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:20.317 10:04:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:20.317 10:04:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:20.317 10:04:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:20.317 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:20.317 10:04:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:20.317 10:04:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:20.317 10:04:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:20.317 10:04:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:20.317 10:04:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:20.317 10:04:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:20.317 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:20.317 10:04:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:20.317 10:04:26 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:20.317 10:04:26 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:20.317 10:04:26 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:20.317 10:04:26 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:20.317 10:04:26 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:20.317 10:04:26 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:20.317 10:04:26 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:20.317 10:04:26 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:20.317 10:04:26 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:20.317 10:04:26 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:20.317 10:04:26 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:20.317 10:04:26 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:20.318 10:04:26 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:20.318 10:04:26 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:20.318 10:04:26 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:20.318 10:04:26 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:20.318 10:04:26 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:20.318 10:04:26 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:20.318 10:04:26 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:20.318 10:04:26 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:20.318 10:04:26 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:20.576 10:04:26 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:20.576 10:04:26 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:20.576 10:04:26 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:20.576 10:04:26 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:20.576 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:20.576 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.140 ms 00:18:20.576 00:18:20.576 --- 10.0.0.2 ping statistics --- 00:18:20.576 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:20.576 rtt min/avg/max/mdev = 0.140/0.140/0.140/0.000 ms 00:18:20.576 10:04:26 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:20.576 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:20.576 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.117 ms 00:18:20.576 00:18:20.576 --- 10.0.0.1 ping statistics --- 00:18:20.576 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:20.576 rtt min/avg/max/mdev = 0.117/0.117/0.117/0.000 ms 00:18:20.576 10:04:26 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:20.576 10:04:26 -- nvmf/common.sh@410 -- # return 0 00:18:20.576 10:04:26 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:20.576 10:04:26 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:20.576 10:04:26 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:20.576 10:04:26 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:20.576 10:04:26 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:20.576 10:04:26 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:20.576 10:04:26 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:20.576 10:04:26 -- target/multipath.sh@45 -- # '[' -z ']' 00:18:20.576 10:04:26 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:18:20.576 only one NIC for nvmf test 00:18:20.576 10:04:26 -- target/multipath.sh@47 -- # nvmftestfini 00:18:20.576 10:04:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:20.576 10:04:26 -- nvmf/common.sh@116 -- # sync 00:18:20.576 10:04:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:20.576 10:04:26 -- nvmf/common.sh@119 -- # set +e 00:18:20.576 10:04:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:20.576 10:04:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:20.576 rmmod nvme_tcp 00:18:20.576 rmmod nvme_fabrics 00:18:20.576 rmmod nvme_keyring 00:18:20.576 10:04:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:20.576 10:04:26 -- nvmf/common.sh@123 -- # set -e 00:18:20.576 10:04:26 -- nvmf/common.sh@124 -- # return 0 00:18:20.576 10:04:26 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:18:20.576 10:04:26 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:20.576 10:04:26 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:20.576 10:04:26 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:20.576 10:04:26 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:20.576 10:04:26 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:20.576 10:04:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:20.576 10:04:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:20.576 10:04:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:23.112 10:04:28 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:23.112 10:04:28 -- target/multipath.sh@48 -- # exit 0 00:18:23.112 10:04:28 -- target/multipath.sh@1 -- # nvmftestfini 00:18:23.112 10:04:28 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:23.112 10:04:28 -- nvmf/common.sh@116 -- # sync 00:18:23.112 10:04:28 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:23.112 10:04:28 -- nvmf/common.sh@119 -- # set +e 00:18:23.112 10:04:28 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:23.112 10:04:28 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:23.112 10:04:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:23.112 10:04:28 -- nvmf/common.sh@123 -- # set -e 00:18:23.112 10:04:28 -- nvmf/common.sh@124 -- # return 0 00:18:23.112 10:04:28 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:18:23.112 10:04:28 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:23.112 10:04:28 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:23.112 10:04:28 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:23.112 10:04:28 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:23.112 10:04:28 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:23.112 10:04:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:23.112 10:04:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:23.112 10:04:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:23.112 10:04:28 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:23.112 00:18:23.112 real 0m4.381s 00:18:23.112 user 0m0.841s 00:18:23.112 sys 0m1.532s 00:18:23.112 10:04:28 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:18:23.112 10:04:28 -- common/autotest_common.sh@10 -- # set +x 00:18:23.112 ************************************ 00:18:23.112 END TEST nvmf_multipath 00:18:23.112 ************************************ 00:18:23.112 10:04:28 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:18:23.112 10:04:28 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:18:23.112 10:04:28 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:18:23.112 10:04:28 -- common/autotest_common.sh@10 -- # set +x 00:18:23.112 ************************************ 00:18:23.112 START TEST nvmf_zcopy 00:18:23.112 ************************************ 00:18:23.112 10:04:28 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:18:23.112 * Looking for test storage... 00:18:23.112 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:23.112 10:04:28 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:23.112 10:04:28 -- nvmf/common.sh@7 -- # uname -s 00:18:23.112 10:04:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:23.112 10:04:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:23.112 10:04:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:23.113 10:04:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:23.113 10:04:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:23.113 10:04:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:23.113 10:04:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:23.113 10:04:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:23.113 10:04:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:23.113 10:04:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:23.113 10:04:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:23.113 10:04:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:23.113 10:04:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:23.113 10:04:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:23.113 10:04:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:23.113 10:04:28 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:23.113 10:04:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:23.113 10:04:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:23.113 10:04:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:23.113 10:04:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:23.113 10:04:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:23.113 10:04:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:23.113 10:04:28 -- paths/export.sh@5 -- # export PATH 00:18:23.113 10:04:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:23.113 10:04:28 -- nvmf/common.sh@46 -- # : 0 00:18:23.113 10:04:28 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:23.113 10:04:28 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:23.113 10:04:28 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:23.113 10:04:28 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:23.113 10:04:28 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:23.113 10:04:28 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:23.113 10:04:28 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:23.113 10:04:28 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:23.113 10:04:28 -- target/zcopy.sh@12 -- # nvmftestinit 00:18:23.113 10:04:28 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:23.113 10:04:28 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:23.113 10:04:28 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:23.113 10:04:28 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:23.113 10:04:28 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:23.113 10:04:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:23.113 10:04:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:23.113 10:04:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:23.113 10:04:28 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:23.113 10:04:28 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:23.113 10:04:28 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:23.113 10:04:28 -- common/autotest_common.sh@10 -- # set +x 00:18:25.015 10:04:30 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:25.015 10:04:30 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:25.015 10:04:30 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:25.015 10:04:30 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:25.015 10:04:30 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:25.015 10:04:30 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:25.015 10:04:30 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:25.015 10:04:30 -- nvmf/common.sh@294 -- # net_devs=() 00:18:25.015 10:04:30 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:25.015 10:04:30 -- nvmf/common.sh@295 -- # e810=() 00:18:25.015 10:04:30 -- nvmf/common.sh@295 -- # local -ga e810 00:18:25.015 10:04:30 -- nvmf/common.sh@296 -- # x722=() 00:18:25.015 10:04:30 -- nvmf/common.sh@296 -- # local -ga x722 00:18:25.015 10:04:30 -- nvmf/common.sh@297 -- # mlx=() 00:18:25.015 10:04:30 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:25.015 10:04:30 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:25.015 10:04:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:25.015 10:04:30 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:25.015 10:04:30 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:25.015 10:04:30 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:25.015 10:04:30 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:25.015 10:04:30 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:25.015 10:04:30 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:25.015 10:04:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:25.015 10:04:30 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:25.015 10:04:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:25.015 10:04:30 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:25.015 10:04:30 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:25.015 10:04:30 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:25.015 10:04:30 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:25.015 10:04:30 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:25.015 10:04:30 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:25.015 10:04:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:25.015 10:04:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:25.015 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:25.015 10:04:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:25.015 10:04:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:25.015 10:04:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:25.015 10:04:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:25.015 10:04:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:25.015 10:04:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:25.015 10:04:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:25.015 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:25.015 10:04:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:25.015 10:04:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:25.015 10:04:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:25.015 10:04:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:25.015 10:04:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:25.015 10:04:30 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:25.015 10:04:30 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:25.015 10:04:30 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:25.015 10:04:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:25.015 10:04:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:25.015 10:04:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:25.015 10:04:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:25.015 10:04:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:25.015 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:25.015 10:04:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:25.015 10:04:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:25.015 10:04:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:25.015 10:04:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:25.015 10:04:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:25.015 10:04:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:25.015 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:25.015 10:04:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:25.015 10:04:30 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:25.015 10:04:30 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:25.015 10:04:30 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:25.015 10:04:30 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:25.015 10:04:30 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:25.015 10:04:30 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:25.015 10:04:30 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:25.015 10:04:30 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:25.015 10:04:30 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:25.015 10:04:30 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:25.015 10:04:30 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:25.015 10:04:30 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:25.015 10:04:30 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:25.015 10:04:30 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:25.015 10:04:30 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:25.015 10:04:30 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:25.015 10:04:30 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:25.015 10:04:30 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:25.015 10:04:30 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:25.015 10:04:30 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:25.015 10:04:30 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:25.015 10:04:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:25.015 10:04:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:25.015 10:04:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:25.015 10:04:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:25.015 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:25.015 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.266 ms 00:18:25.015 00:18:25.015 --- 10.0.0.2 ping statistics --- 00:18:25.015 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:25.015 rtt min/avg/max/mdev = 0.266/0.266/0.266/0.000 ms 00:18:25.015 10:04:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:25.015 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:25.016 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.159 ms 00:18:25.016 00:18:25.016 --- 10.0.0.1 ping statistics --- 00:18:25.016 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:25.016 rtt min/avg/max/mdev = 0.159/0.159/0.159/0.000 ms 00:18:25.016 10:04:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:25.016 10:04:30 -- nvmf/common.sh@410 -- # return 0 00:18:25.016 10:04:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:25.016 10:04:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:25.016 10:04:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:25.016 10:04:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:25.016 10:04:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:25.016 10:04:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:25.016 10:04:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:25.016 10:04:30 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:18:25.016 10:04:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:25.016 10:04:30 -- common/autotest_common.sh@712 -- # xtrace_disable 00:18:25.016 10:04:30 -- common/autotest_common.sh@10 -- # set +x 00:18:25.016 10:04:30 -- nvmf/common.sh@469 -- # nvmfpid=2818679 00:18:25.016 10:04:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:25.016 10:04:30 -- nvmf/common.sh@470 -- # waitforlisten 2818679 00:18:25.016 10:04:30 -- common/autotest_common.sh@819 -- # '[' -z 2818679 ']' 00:18:25.016 10:04:30 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:25.016 10:04:30 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:25.016 10:04:30 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:25.016 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:25.016 10:04:30 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:25.016 10:04:30 -- common/autotest_common.sh@10 -- # set +x 00:18:25.016 [2024-07-13 10:04:30.588522] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:18:25.016 [2024-07-13 10:04:30.588610] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:25.016 EAL: No free 2048 kB hugepages reported on node 1 00:18:25.016 [2024-07-13 10:04:30.667343] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:25.016 [2024-07-13 10:04:30.761646] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:25.016 [2024-07-13 10:04:30.761810] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:25.016 [2024-07-13 10:04:30.761830] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:25.016 [2024-07-13 10:04:30.761844] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:25.016 [2024-07-13 10:04:30.761885] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:25.951 10:04:31 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:25.951 10:04:31 -- common/autotest_common.sh@852 -- # return 0 00:18:25.951 10:04:31 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:25.951 10:04:31 -- common/autotest_common.sh@718 -- # xtrace_disable 00:18:25.951 10:04:31 -- common/autotest_common.sh@10 -- # set +x 00:18:25.951 10:04:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:25.951 10:04:31 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:18:25.951 10:04:31 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:18:25.951 10:04:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:25.951 10:04:31 -- common/autotest_common.sh@10 -- # set +x 00:18:25.951 [2024-07-13 10:04:31.616729] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:25.951 10:04:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:25.951 10:04:31 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:18:25.951 10:04:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:25.951 10:04:31 -- common/autotest_common.sh@10 -- # set +x 00:18:25.951 10:04:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:25.951 10:04:31 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:25.951 10:04:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:25.951 10:04:31 -- common/autotest_common.sh@10 -- # set +x 00:18:25.951 [2024-07-13 10:04:31.632906] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:25.951 10:04:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:25.951 10:04:31 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:18:25.952 10:04:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:25.952 10:04:31 -- common/autotest_common.sh@10 -- # set +x 00:18:25.952 10:04:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:25.952 10:04:31 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:18:25.952 10:04:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:25.952 10:04:31 -- common/autotest_common.sh@10 -- # set +x 00:18:25.952 malloc0 00:18:25.952 10:04:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:25.952 10:04:31 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:25.952 10:04:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:25.952 10:04:31 -- common/autotest_common.sh@10 -- # set +x 00:18:25.952 10:04:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:25.952 10:04:31 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:18:25.952 10:04:31 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:18:25.952 10:04:31 -- nvmf/common.sh@520 -- # config=() 00:18:25.952 10:04:31 -- nvmf/common.sh@520 -- # local subsystem config 00:18:25.952 10:04:31 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:25.952 10:04:31 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:25.952 { 00:18:25.952 "params": { 00:18:25.952 "name": "Nvme$subsystem", 00:18:25.952 "trtype": "$TEST_TRANSPORT", 00:18:25.952 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:25.952 "adrfam": "ipv4", 00:18:25.952 "trsvcid": "$NVMF_PORT", 00:18:25.952 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:25.952 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:25.952 "hdgst": ${hdgst:-false}, 00:18:25.952 "ddgst": ${ddgst:-false} 00:18:25.952 }, 00:18:25.952 "method": "bdev_nvme_attach_controller" 00:18:25.952 } 00:18:25.952 EOF 00:18:25.952 )") 00:18:25.952 10:04:31 -- nvmf/common.sh@542 -- # cat 00:18:25.952 10:04:31 -- nvmf/common.sh@544 -- # jq . 00:18:25.952 10:04:31 -- nvmf/common.sh@545 -- # IFS=, 00:18:25.952 10:04:31 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:25.952 "params": { 00:18:25.952 "name": "Nvme1", 00:18:25.952 "trtype": "tcp", 00:18:25.952 "traddr": "10.0.0.2", 00:18:25.952 "adrfam": "ipv4", 00:18:25.952 "trsvcid": "4420", 00:18:25.952 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:25.952 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:25.952 "hdgst": false, 00:18:25.952 "ddgst": false 00:18:25.952 }, 00:18:25.952 "method": "bdev_nvme_attach_controller" 00:18:25.952 }' 00:18:25.952 [2024-07-13 10:04:31.711975] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:18:25.952 [2024-07-13 10:04:31.712056] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2818837 ] 00:18:25.952 EAL: No free 2048 kB hugepages reported on node 1 00:18:26.210 [2024-07-13 10:04:31.776155] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:26.210 [2024-07-13 10:04:31.870471] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:26.468 Running I/O for 10 seconds... 00:18:36.433 00:18:36.433 Latency(us) 00:18:36.433 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:36.433 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:18:36.433 Verification LBA range: start 0x0 length 0x1000 00:18:36.433 Nvme1n1 : 10.01 8816.47 68.88 0.00 0.00 14483.70 1304.65 21942.42 00:18:36.433 =================================================================================================================== 00:18:36.433 Total : 8816.47 68.88 0.00 0.00 14483.70 1304.65 21942.42 00:18:36.692 10:04:42 -- target/zcopy.sh@39 -- # perfpid=2820060 00:18:36.692 10:04:42 -- target/zcopy.sh@41 -- # xtrace_disable 00:18:36.692 10:04:42 -- common/autotest_common.sh@10 -- # set +x 00:18:36.692 10:04:42 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:18:36.692 10:04:42 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:18:36.692 10:04:42 -- nvmf/common.sh@520 -- # config=() 00:18:36.692 10:04:42 -- nvmf/common.sh@520 -- # local subsystem config 00:18:36.692 10:04:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:36.692 10:04:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:36.692 { 00:18:36.692 "params": { 00:18:36.692 "name": "Nvme$subsystem", 00:18:36.692 "trtype": "$TEST_TRANSPORT", 00:18:36.692 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:36.692 "adrfam": "ipv4", 00:18:36.692 "trsvcid": "$NVMF_PORT", 00:18:36.692 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:36.692 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:36.692 "hdgst": ${hdgst:-false}, 00:18:36.692 "ddgst": ${ddgst:-false} 00:18:36.692 }, 00:18:36.692 "method": "bdev_nvme_attach_controller" 00:18:36.692 } 00:18:36.692 EOF 00:18:36.692 )") 00:18:36.692 10:04:42 -- nvmf/common.sh@542 -- # cat 00:18:36.692 [2024-07-13 10:04:42.307051] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.692 [2024-07-13 10:04:42.307095] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.692 10:04:42 -- nvmf/common.sh@544 -- # jq . 00:18:36.692 10:04:42 -- nvmf/common.sh@545 -- # IFS=, 00:18:36.692 10:04:42 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:36.692 "params": { 00:18:36.692 "name": "Nvme1", 00:18:36.692 "trtype": "tcp", 00:18:36.692 "traddr": "10.0.0.2", 00:18:36.692 "adrfam": "ipv4", 00:18:36.692 "trsvcid": "4420", 00:18:36.692 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:36.692 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:36.692 "hdgst": false, 00:18:36.692 "ddgst": false 00:18:36.692 }, 00:18:36.692 "method": "bdev_nvme_attach_controller" 00:18:36.692 }' 00:18:36.692 [2024-07-13 10:04:42.314991] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.692 [2024-07-13 10:04:42.315015] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.692 [2024-07-13 10:04:42.323011] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.692 [2024-07-13 10:04:42.323035] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.692 [2024-07-13 10:04:42.331030] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.692 [2024-07-13 10:04:42.331053] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.692 [2024-07-13 10:04:42.339052] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.692 [2024-07-13 10:04:42.339074] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.692 [2024-07-13 10:04:42.344300] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:18:36.692 [2024-07-13 10:04:42.344362] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2820060 ] 00:18:36.692 [2024-07-13 10:04:42.347085] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.692 [2024-07-13 10:04:42.347110] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.692 [2024-07-13 10:04:42.355109] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.692 [2024-07-13 10:04:42.355134] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.692 [2024-07-13 10:04:42.363130] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.692 [2024-07-13 10:04:42.363155] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.692 [2024-07-13 10:04:42.371152] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.692 [2024-07-13 10:04:42.371181] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.692 EAL: No free 2048 kB hugepages reported on node 1 00:18:36.692 [2024-07-13 10:04:42.379175] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.692 [2024-07-13 10:04:42.379199] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.692 [2024-07-13 10:04:42.387201] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.692 [2024-07-13 10:04:42.387244] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.692 [2024-07-13 10:04:42.395238] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.692 [2024-07-13 10:04:42.395265] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.692 [2024-07-13 10:04:42.403266] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.692 [2024-07-13 10:04:42.403291] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.692 [2024-07-13 10:04:42.411289] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.692 [2024-07-13 10:04:42.411314] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.692 [2024-07-13 10:04:42.414547] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:36.692 [2024-07-13 10:04:42.419296] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.692 [2024-07-13 10:04:42.419321] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.692 [2024-07-13 10:04:42.427360] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.692 [2024-07-13 10:04:42.427398] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.692 [2024-07-13 10:04:42.435344] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.692 [2024-07-13 10:04:42.435370] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.692 [2024-07-13 10:04:42.443363] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.692 [2024-07-13 10:04:42.443394] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.692 [2024-07-13 10:04:42.451385] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.692 [2024-07-13 10:04:42.451422] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.692 [2024-07-13 10:04:42.459408] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.692 [2024-07-13 10:04:42.459433] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.692 [2024-07-13 10:04:42.467455] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.692 [2024-07-13 10:04:42.467493] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.692 [2024-07-13 10:04:42.475473] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.692 [2024-07-13 10:04:42.475507] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.692 [2024-07-13 10:04:42.483478] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.692 [2024-07-13 10:04:42.483504] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.692 [2024-07-13 10:04:42.491499] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.692 [2024-07-13 10:04:42.491525] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.692 [2024-07-13 10:04:42.499523] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.692 [2024-07-13 10:04:42.499548] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.692 [2024-07-13 10:04:42.506290] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:36.692 [2024-07-13 10:04:42.507547] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.692 [2024-07-13 10:04:42.507572] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.951 [2024-07-13 10:04:42.515567] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.951 [2024-07-13 10:04:42.515591] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.951 [2024-07-13 10:04:42.523615] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.951 [2024-07-13 10:04:42.523651] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.951 [2024-07-13 10:04:42.531634] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.951 [2024-07-13 10:04:42.531672] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.951 [2024-07-13 10:04:42.539654] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.951 [2024-07-13 10:04:42.539692] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.951 [2024-07-13 10:04:42.547683] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.951 [2024-07-13 10:04:42.547722] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.951 [2024-07-13 10:04:42.555705] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.951 [2024-07-13 10:04:42.555746] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.951 [2024-07-13 10:04:42.563725] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.951 [2024-07-13 10:04:42.563765] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.951 [2024-07-13 10:04:42.571748] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.951 [2024-07-13 10:04:42.571789] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.951 [2024-07-13 10:04:42.579740] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.951 [2024-07-13 10:04:42.579765] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.951 [2024-07-13 10:04:42.587787] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.951 [2024-07-13 10:04:42.587825] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.951 [2024-07-13 10:04:42.595809] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.951 [2024-07-13 10:04:42.595849] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.951 [2024-07-13 10:04:42.603818] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.951 [2024-07-13 10:04:42.603847] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.951 [2024-07-13 10:04:42.611831] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.951 [2024-07-13 10:04:42.611856] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.951 [2024-07-13 10:04:42.619875] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.951 [2024-07-13 10:04:42.619904] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.951 [2024-07-13 10:04:42.627913] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.951 [2024-07-13 10:04:42.627939] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.951 [2024-07-13 10:04:42.635934] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.951 [2024-07-13 10:04:42.635958] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.951 [2024-07-13 10:04:42.643936] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.951 [2024-07-13 10:04:42.643962] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.951 [2024-07-13 10:04:42.651996] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.951 [2024-07-13 10:04:42.652022] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.951 [2024-07-13 10:04:42.660020] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.951 [2024-07-13 10:04:42.660042] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.951 [2024-07-13 10:04:42.668042] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.951 [2024-07-13 10:04:42.668064] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.951 [2024-07-13 10:04:42.676049] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.951 [2024-07-13 10:04:42.676071] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.951 [2024-07-13 10:04:42.684085] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.951 [2024-07-13 10:04:42.684107] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.951 [2024-07-13 10:04:42.692113] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.951 [2024-07-13 10:04:42.692138] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.951 [2024-07-13 10:04:42.700134] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.951 [2024-07-13 10:04:42.700174] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.951 [2024-07-13 10:04:42.708156] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.951 [2024-07-13 10:04:42.708195] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.951 [2024-07-13 10:04:42.716180] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.951 [2024-07-13 10:04:42.716218] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.951 [2024-07-13 10:04:42.724199] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.951 [2024-07-13 10:04:42.724236] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.951 [2024-07-13 10:04:42.732235] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.951 [2024-07-13 10:04:42.732260] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.951 [2024-07-13 10:04:42.740261] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.951 [2024-07-13 10:04:42.740288] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.951 [2024-07-13 10:04:42.748290] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.951 [2024-07-13 10:04:42.748326] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.951 [2024-07-13 10:04:42.756316] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.951 [2024-07-13 10:04:42.756341] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:36.951 [2024-07-13 10:04:42.764336] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:36.951 [2024-07-13 10:04:42.764361] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.211 [2024-07-13 10:04:42.772361] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.211 [2024-07-13 10:04:42.772386] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.211 [2024-07-13 10:04:42.780382] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.211 [2024-07-13 10:04:42.780407] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.211 [2024-07-13 10:04:42.788412] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.211 [2024-07-13 10:04:42.788440] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.211 [2024-07-13 10:04:42.796432] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.211 [2024-07-13 10:04:42.796458] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.211 [2024-07-13 10:04:42.804457] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.211 [2024-07-13 10:04:42.804483] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.211 [2024-07-13 10:04:42.812479] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.211 [2024-07-13 10:04:42.812504] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.211 [2024-07-13 10:04:42.820500] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.211 [2024-07-13 10:04:42.820526] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.211 [2024-07-13 10:04:42.828527] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.211 [2024-07-13 10:04:42.828554] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.211 [2024-07-13 10:04:42.836548] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.211 [2024-07-13 10:04:42.836574] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.211 [2024-07-13 10:04:42.844580] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.211 [2024-07-13 10:04:42.844619] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.211 [2024-07-13 10:04:42.852614] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.211 [2024-07-13 10:04:42.852642] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.211 Running I/O for 5 seconds... 00:18:37.211 [2024-07-13 10:04:42.865077] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.211 [2024-07-13 10:04:42.865110] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.211 [2024-07-13 10:04:42.880041] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.211 [2024-07-13 10:04:42.880071] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.211 [2024-07-13 10:04:42.898056] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.211 [2024-07-13 10:04:42.898084] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.211 [2024-07-13 10:04:42.915738] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.211 [2024-07-13 10:04:42.915781] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.211 [2024-07-13 10:04:42.932910] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.211 [2024-07-13 10:04:42.932945] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.211 [2024-07-13 10:04:42.950488] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.211 [2024-07-13 10:04:42.950540] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.211 [2024-07-13 10:04:42.967183] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.211 [2024-07-13 10:04:42.967211] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.211 [2024-07-13 10:04:42.984047] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.211 [2024-07-13 10:04:42.984077] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.211 [2024-07-13 10:04:43.000485] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.211 [2024-07-13 10:04:43.000517] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.211 [2024-07-13 10:04:43.016981] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.211 [2024-07-13 10:04:43.017009] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.469 [2024-07-13 10:04:43.032839] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.469 [2024-07-13 10:04:43.032889] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.469 [2024-07-13 10:04:43.047749] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.469 [2024-07-13 10:04:43.047794] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.469 [2024-07-13 10:04:43.064366] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.469 [2024-07-13 10:04:43.064413] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.469 [2024-07-13 10:04:43.081655] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.469 [2024-07-13 10:04:43.081699] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.469 [2024-07-13 10:04:43.099081] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.469 [2024-07-13 10:04:43.099110] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.469 [2024-07-13 10:04:43.115843] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.469 [2024-07-13 10:04:43.115893] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.469 [2024-07-13 10:04:43.131778] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.469 [2024-07-13 10:04:43.131810] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.469 [2024-07-13 10:04:43.148206] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.469 [2024-07-13 10:04:43.148252] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.469 [2024-07-13 10:04:43.165142] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.469 [2024-07-13 10:04:43.165174] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.469 [2024-07-13 10:04:43.182360] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.469 [2024-07-13 10:04:43.182387] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.469 [2024-07-13 10:04:43.198257] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.469 [2024-07-13 10:04:43.198285] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.469 [2024-07-13 10:04:43.214358] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.469 [2024-07-13 10:04:43.214385] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.469 [2024-07-13 10:04:43.231365] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.469 [2024-07-13 10:04:43.231392] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.469 [2024-07-13 10:04:43.247076] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.469 [2024-07-13 10:04:43.247104] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.469 [2024-07-13 10:04:43.260046] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.469 [2024-07-13 10:04:43.260085] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.469 [2024-07-13 10:04:43.276682] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.469 [2024-07-13 10:04:43.276725] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.727 [2024-07-13 10:04:43.293058] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.727 [2024-07-13 10:04:43.293086] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.727 [2024-07-13 10:04:43.306652] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.727 [2024-07-13 10:04:43.306684] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.727 [2024-07-13 10:04:43.322883] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.727 [2024-07-13 10:04:43.322910] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.727 [2024-07-13 10:04:43.339810] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.727 [2024-07-13 10:04:43.339852] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.727 [2024-07-13 10:04:43.356089] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.727 [2024-07-13 10:04:43.356116] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.727 [2024-07-13 10:04:43.370022] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.727 [2024-07-13 10:04:43.370049] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.727 [2024-07-13 10:04:43.386055] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.727 [2024-07-13 10:04:43.386082] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.727 [2024-07-13 10:04:43.401205] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.727 [2024-07-13 10:04:43.401236] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.727 [2024-07-13 10:04:43.417564] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.727 [2024-07-13 10:04:43.417591] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.727 [2024-07-13 10:04:43.434792] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.727 [2024-07-13 10:04:43.434836] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.727 [2024-07-13 10:04:43.451828] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.727 [2024-07-13 10:04:43.451860] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.727 [2024-07-13 10:04:43.468357] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.727 [2024-07-13 10:04:43.468390] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.727 [2024-07-13 10:04:43.484957] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.727 [2024-07-13 10:04:43.484986] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.727 [2024-07-13 10:04:43.501548] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.727 [2024-07-13 10:04:43.501575] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.727 [2024-07-13 10:04:43.519416] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.727 [2024-07-13 10:04:43.519447] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.727 [2024-07-13 10:04:43.536807] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.727 [2024-07-13 10:04:43.536853] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.984 [2024-07-13 10:04:43.554273] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.984 [2024-07-13 10:04:43.554305] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.984 [2024-07-13 10:04:43.570924] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.984 [2024-07-13 10:04:43.570964] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.984 [2024-07-13 10:04:43.586942] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.984 [2024-07-13 10:04:43.586971] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.984 [2024-07-13 10:04:43.600306] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.984 [2024-07-13 10:04:43.600337] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.984 [2024-07-13 10:04:43.616463] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.984 [2024-07-13 10:04:43.616495] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.984 [2024-07-13 10:04:43.632929] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.984 [2024-07-13 10:04:43.632956] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.984 [2024-07-13 10:04:43.649236] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.984 [2024-07-13 10:04:43.649281] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.984 [2024-07-13 10:04:43.665358] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.984 [2024-07-13 10:04:43.665390] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.984 [2024-07-13 10:04:43.679609] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.984 [2024-07-13 10:04:43.679636] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.985 [2024-07-13 10:04:43.696893] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.985 [2024-07-13 10:04:43.696937] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.985 [2024-07-13 10:04:43.714499] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.985 [2024-07-13 10:04:43.714531] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.985 [2024-07-13 10:04:43.732188] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.985 [2024-07-13 10:04:43.732219] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.985 [2024-07-13 10:04:43.748987] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.985 [2024-07-13 10:04:43.749018] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.985 [2024-07-13 10:04:43.766304] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.985 [2024-07-13 10:04:43.766337] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:37.985 [2024-07-13 10:04:43.784117] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:37.985 [2024-07-13 10:04:43.784149] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.243 [2024-07-13 10:04:43.801877] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.243 [2024-07-13 10:04:43.801907] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.243 [2024-07-13 10:04:43.819095] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.243 [2024-07-13 10:04:43.819126] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.243 [2024-07-13 10:04:43.836271] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.243 [2024-07-13 10:04:43.836302] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.243 [2024-07-13 10:04:43.853946] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.243 [2024-07-13 10:04:43.853978] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.243 [2024-07-13 10:04:43.870838] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.243 [2024-07-13 10:04:43.870877] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.243 [2024-07-13 10:04:43.887996] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.243 [2024-07-13 10:04:43.888028] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.243 [2024-07-13 10:04:43.903827] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.243 [2024-07-13 10:04:43.903858] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.243 [2024-07-13 10:04:43.920332] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.243 [2024-07-13 10:04:43.920363] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.243 [2024-07-13 10:04:43.938642] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.243 [2024-07-13 10:04:43.938674] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.243 [2024-07-13 10:04:43.957180] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.243 [2024-07-13 10:04:43.957213] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.243 [2024-07-13 10:04:43.974514] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.243 [2024-07-13 10:04:43.974546] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.243 [2024-07-13 10:04:43.992565] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.243 [2024-07-13 10:04:43.992596] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.243 [2024-07-13 10:04:44.010403] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.243 [2024-07-13 10:04:44.010437] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.243 [2024-07-13 10:04:44.027833] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.243 [2024-07-13 10:04:44.027877] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.243 [2024-07-13 10:04:44.044816] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.243 [2024-07-13 10:04:44.044847] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.501 [2024-07-13 10:04:44.063027] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.501 [2024-07-13 10:04:44.063058] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.501 [2024-07-13 10:04:44.081272] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.501 [2024-07-13 10:04:44.081304] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.501 [2024-07-13 10:04:44.099288] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.501 [2024-07-13 10:04:44.099319] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.501 [2024-07-13 10:04:44.116739] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.501 [2024-07-13 10:04:44.116769] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.501 [2024-07-13 10:04:44.134555] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.501 [2024-07-13 10:04:44.134585] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.501 [2024-07-13 10:04:44.151941] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.501 [2024-07-13 10:04:44.151971] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.501 [2024-07-13 10:04:44.168880] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.501 [2024-07-13 10:04:44.168910] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.501 [2024-07-13 10:04:44.186636] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.501 [2024-07-13 10:04:44.186667] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.502 [2024-07-13 10:04:44.203684] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.502 [2024-07-13 10:04:44.203715] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.502 [2024-07-13 10:04:44.220760] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.502 [2024-07-13 10:04:44.220790] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.502 [2024-07-13 10:04:44.238449] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.502 [2024-07-13 10:04:44.238479] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.502 [2024-07-13 10:04:44.256864] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.502 [2024-07-13 10:04:44.256902] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.502 [2024-07-13 10:04:44.274264] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.502 [2024-07-13 10:04:44.274295] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.502 [2024-07-13 10:04:44.292152] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.502 [2024-07-13 10:04:44.292183] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.502 [2024-07-13 10:04:44.309602] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.502 [2024-07-13 10:04:44.309632] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.759 [2024-07-13 10:04:44.325847] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.759 [2024-07-13 10:04:44.325887] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.759 [2024-07-13 10:04:44.342824] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.759 [2024-07-13 10:04:44.342855] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.759 [2024-07-13 10:04:44.358846] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.759 [2024-07-13 10:04:44.358886] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.759 [2024-07-13 10:04:44.375965] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.759 [2024-07-13 10:04:44.375995] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.759 [2024-07-13 10:04:44.392793] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.759 [2024-07-13 10:04:44.392824] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.759 [2024-07-13 10:04:44.410020] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.760 [2024-07-13 10:04:44.410051] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.760 [2024-07-13 10:04:44.427216] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.760 [2024-07-13 10:04:44.427247] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.760 [2024-07-13 10:04:44.443477] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.760 [2024-07-13 10:04:44.443508] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.760 [2024-07-13 10:04:44.461371] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.760 [2024-07-13 10:04:44.461402] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.760 [2024-07-13 10:04:44.479015] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.760 [2024-07-13 10:04:44.479046] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.760 [2024-07-13 10:04:44.496374] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.760 [2024-07-13 10:04:44.496405] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.760 [2024-07-13 10:04:44.513440] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.760 [2024-07-13 10:04:44.513471] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.760 [2024-07-13 10:04:44.530601] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.760 [2024-07-13 10:04:44.530632] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.760 [2024-07-13 10:04:44.548488] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.760 [2024-07-13 10:04:44.548518] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.760 [2024-07-13 10:04:44.564777] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.760 [2024-07-13 10:04:44.564808] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.017 [2024-07-13 10:04:44.580904] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.017 [2024-07-13 10:04:44.580936] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.017 [2024-07-13 10:04:44.597488] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.017 [2024-07-13 10:04:44.597518] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.017 [2024-07-13 10:04:44.613852] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.017 [2024-07-13 10:04:44.613891] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.017 [2024-07-13 10:04:44.629371] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.017 [2024-07-13 10:04:44.629402] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.017 [2024-07-13 10:04:44.647448] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.017 [2024-07-13 10:04:44.647479] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.017 [2024-07-13 10:04:44.665302] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.017 [2024-07-13 10:04:44.665333] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.017 [2024-07-13 10:04:44.682003] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.017 [2024-07-13 10:04:44.682033] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.017 [2024-07-13 10:04:44.699682] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.017 [2024-07-13 10:04:44.699714] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.017 [2024-07-13 10:04:44.717790] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.017 [2024-07-13 10:04:44.717821] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.017 [2024-07-13 10:04:44.734382] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.017 [2024-07-13 10:04:44.734412] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.017 [2024-07-13 10:04:44.751448] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.017 [2024-07-13 10:04:44.751479] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.017 [2024-07-13 10:04:44.767541] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.017 [2024-07-13 10:04:44.767573] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.017 [2024-07-13 10:04:44.783861] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.017 [2024-07-13 10:04:44.783900] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.017 [2024-07-13 10:04:44.800950] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.017 [2024-07-13 10:04:44.800981] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.017 [2024-07-13 10:04:44.819203] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.017 [2024-07-13 10:04:44.819233] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.274 [2024-07-13 10:04:44.836961] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.274 [2024-07-13 10:04:44.836992] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.274 [2024-07-13 10:04:44.855608] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.274 [2024-07-13 10:04:44.855658] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.274 [2024-07-13 10:04:44.873350] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.274 [2024-07-13 10:04:44.873381] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.274 [2024-07-13 10:04:44.892221] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.274 [2024-07-13 10:04:44.892252] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.274 [2024-07-13 10:04:44.910052] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.274 [2024-07-13 10:04:44.910083] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.274 [2024-07-13 10:04:44.927607] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.274 [2024-07-13 10:04:44.927637] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.274 [2024-07-13 10:04:44.945962] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.274 [2024-07-13 10:04:44.945993] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.274 [2024-07-13 10:04:44.963975] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.274 [2024-07-13 10:04:44.964006] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.274 [2024-07-13 10:04:44.981533] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.274 [2024-07-13 10:04:44.981563] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.274 [2024-07-13 10:04:44.998815] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.274 [2024-07-13 10:04:44.998845] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.274 [2024-07-13 10:04:45.015673] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.274 [2024-07-13 10:04:45.015705] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.274 [2024-07-13 10:04:45.032232] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.274 [2024-07-13 10:04:45.032263] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.274 [2024-07-13 10:04:45.047217] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.274 [2024-07-13 10:04:45.047248] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.274 [2024-07-13 10:04:45.064979] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.274 [2024-07-13 10:04:45.065009] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.274 [2024-07-13 10:04:45.082136] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.274 [2024-07-13 10:04:45.082167] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.532 [2024-07-13 10:04:45.100278] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.532 [2024-07-13 10:04:45.100310] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.532 [2024-07-13 10:04:45.116685] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.532 [2024-07-13 10:04:45.116716] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.532 [2024-07-13 10:04:45.133575] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.532 [2024-07-13 10:04:45.133605] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.532 [2024-07-13 10:04:45.150761] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.532 [2024-07-13 10:04:45.150792] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.532 [2024-07-13 10:04:45.169557] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.532 [2024-07-13 10:04:45.169590] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.532 [2024-07-13 10:04:45.187092] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.532 [2024-07-13 10:04:45.187136] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.532 [2024-07-13 10:04:45.203879] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.532 [2024-07-13 10:04:45.203910] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.532 [2024-07-13 10:04:45.221384] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.532 [2024-07-13 10:04:45.221415] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.532 [2024-07-13 10:04:45.238380] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.532 [2024-07-13 10:04:45.238411] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.532 [2024-07-13 10:04:45.255489] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.532 [2024-07-13 10:04:45.255520] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.532 [2024-07-13 10:04:45.273073] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.532 [2024-07-13 10:04:45.273104] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.532 [2024-07-13 10:04:45.290320] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.532 [2024-07-13 10:04:45.290351] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.532 [2024-07-13 10:04:45.307395] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.532 [2024-07-13 10:04:45.307426] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.532 [2024-07-13 10:04:45.324230] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.532 [2024-07-13 10:04:45.324261] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.532 [2024-07-13 10:04:45.340963] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.532 [2024-07-13 10:04:45.340994] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.802 [2024-07-13 10:04:45.358615] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.802 [2024-07-13 10:04:45.358646] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.802 [2024-07-13 10:04:45.376288] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.802 [2024-07-13 10:04:45.376318] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.802 [2024-07-13 10:04:45.393795] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.802 [2024-07-13 10:04:45.393825] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.802 [2024-07-13 10:04:45.410788] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.802 [2024-07-13 10:04:45.410818] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.802 [2024-07-13 10:04:45.429888] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.802 [2024-07-13 10:04:45.429931] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.802 [2024-07-13 10:04:45.446973] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.802 [2024-07-13 10:04:45.447004] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.802 [2024-07-13 10:04:45.464581] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.802 [2024-07-13 10:04:45.464614] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.802 [2024-07-13 10:04:45.482192] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.802 [2024-07-13 10:04:45.482223] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.802 [2024-07-13 10:04:45.499526] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.802 [2024-07-13 10:04:45.499557] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.802 [2024-07-13 10:04:45.516517] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.802 [2024-07-13 10:04:45.516563] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.802 [2024-07-13 10:04:45.533184] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.802 [2024-07-13 10:04:45.533214] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.802 [2024-07-13 10:04:45.550476] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.802 [2024-07-13 10:04:45.550507] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.802 [2024-07-13 10:04:45.568523] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.802 [2024-07-13 10:04:45.568553] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.802 [2024-07-13 10:04:45.585863] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.802 [2024-07-13 10:04:45.585902] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.802 [2024-07-13 10:04:45.604203] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.802 [2024-07-13 10:04:45.604234] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.059 [2024-07-13 10:04:45.621176] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.059 [2024-07-13 10:04:45.621206] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.059 [2024-07-13 10:04:45.638348] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.059 [2024-07-13 10:04:45.638378] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.059 [2024-07-13 10:04:45.656270] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.059 [2024-07-13 10:04:45.656300] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.059 [2024-07-13 10:04:45.672392] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.059 [2024-07-13 10:04:45.672423] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.059 [2024-07-13 10:04:45.690204] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.059 [2024-07-13 10:04:45.690235] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.059 [2024-07-13 10:04:45.707537] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.059 [2024-07-13 10:04:45.707567] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.059 [2024-07-13 10:04:45.725032] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.059 [2024-07-13 10:04:45.725063] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.059 [2024-07-13 10:04:45.742354] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.059 [2024-07-13 10:04:45.742385] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.059 [2024-07-13 10:04:45.759014] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.059 [2024-07-13 10:04:45.759046] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.059 [2024-07-13 10:04:45.776416] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.059 [2024-07-13 10:04:45.776447] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.059 [2024-07-13 10:04:45.793903] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.059 [2024-07-13 10:04:45.793934] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.059 [2024-07-13 10:04:45.812105] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.059 [2024-07-13 10:04:45.812135] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.059 [2024-07-13 10:04:45.829797] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.059 [2024-07-13 10:04:45.829828] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.059 [2024-07-13 10:04:45.848235] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.059 [2024-07-13 10:04:45.848282] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.059 [2024-07-13 10:04:45.866463] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.059 [2024-07-13 10:04:45.866494] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.317 [2024-07-13 10:04:45.883592] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.317 [2024-07-13 10:04:45.883622] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.317 [2024-07-13 10:04:45.900599] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.317 [2024-07-13 10:04:45.900629] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.317 [2024-07-13 10:04:45.917272] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.317 [2024-07-13 10:04:45.917303] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.317 [2024-07-13 10:04:45.934796] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.317 [2024-07-13 10:04:45.934827] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.317 [2024-07-13 10:04:45.952832] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.317 [2024-07-13 10:04:45.952862] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.317 [2024-07-13 10:04:45.970173] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.317 [2024-07-13 10:04:45.970204] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.317 [2024-07-13 10:04:45.988005] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.317 [2024-07-13 10:04:45.988036] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.317 [2024-07-13 10:04:46.005377] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.317 [2024-07-13 10:04:46.005407] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.317 [2024-07-13 10:04:46.023216] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.317 [2024-07-13 10:04:46.023247] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.317 [2024-07-13 10:04:46.040679] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.317 [2024-07-13 10:04:46.040709] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.317 [2024-07-13 10:04:46.058585] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.317 [2024-07-13 10:04:46.058616] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.317 [2024-07-13 10:04:46.075927] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.317 [2024-07-13 10:04:46.075958] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.317 [2024-07-13 10:04:46.094074] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.317 [2024-07-13 10:04:46.094105] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.317 [2024-07-13 10:04:46.111917] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.317 [2024-07-13 10:04:46.111948] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.317 [2024-07-13 10:04:46.129862] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.317 [2024-07-13 10:04:46.129899] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.575 [2024-07-13 10:04:46.146821] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.575 [2024-07-13 10:04:46.146852] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.575 [2024-07-13 10:04:46.163529] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.575 [2024-07-13 10:04:46.163559] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.575 [2024-07-13 10:04:46.181396] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.575 [2024-07-13 10:04:46.181442] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.575 [2024-07-13 10:04:46.198991] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.575 [2024-07-13 10:04:46.199022] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.575 [2024-07-13 10:04:46.216619] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.575 [2024-07-13 10:04:46.216651] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.575 [2024-07-13 10:04:46.233398] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.575 [2024-07-13 10:04:46.233429] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.575 [2024-07-13 10:04:46.248308] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.575 [2024-07-13 10:04:46.248339] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.575 [2024-07-13 10:04:46.265247] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.575 [2024-07-13 10:04:46.265278] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.575 [2024-07-13 10:04:46.281725] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.575 [2024-07-13 10:04:46.281757] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.575 [2024-07-13 10:04:46.299485] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.575 [2024-07-13 10:04:46.299516] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.575 [2024-07-13 10:04:46.317594] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.575 [2024-07-13 10:04:46.317625] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.575 [2024-07-13 10:04:46.334778] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.575 [2024-07-13 10:04:46.334810] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.575 [2024-07-13 10:04:46.351942] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.575 [2024-07-13 10:04:46.351973] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.575 [2024-07-13 10:04:46.370061] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.575 [2024-07-13 10:04:46.370092] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.575 [2024-07-13 10:04:46.387609] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.575 [2024-07-13 10:04:46.387640] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.832 [2024-07-13 10:04:46.404719] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.832 [2024-07-13 10:04:46.404750] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.832 [2024-07-13 10:04:46.422995] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.832 [2024-07-13 10:04:46.423026] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.832 [2024-07-13 10:04:46.440489] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.832 [2024-07-13 10:04:46.440519] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.832 [2024-07-13 10:04:46.458159] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.832 [2024-07-13 10:04:46.458189] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.832 [2024-07-13 10:04:46.476081] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.832 [2024-07-13 10:04:46.476112] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.832 [2024-07-13 10:04:46.494505] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.832 [2024-07-13 10:04:46.494536] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.832 [2024-07-13 10:04:46.513072] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.832 [2024-07-13 10:04:46.513102] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.832 [2024-07-13 10:04:46.529904] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.832 [2024-07-13 10:04:46.529935] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.832 [2024-07-13 10:04:46.547773] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.832 [2024-07-13 10:04:46.547804] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.832 [2024-07-13 10:04:46.566580] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.832 [2024-07-13 10:04:46.566611] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.832 [2024-07-13 10:04:46.584709] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.832 [2024-07-13 10:04:46.584739] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.832 [2024-07-13 10:04:46.602629] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.832 [2024-07-13 10:04:46.602659] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.832 [2024-07-13 10:04:46.621199] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.832 [2024-07-13 10:04:46.621229] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.832 [2024-07-13 10:04:46.638755] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.832 [2024-07-13 10:04:46.638785] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.090 [2024-07-13 10:04:46.657064] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.090 [2024-07-13 10:04:46.657094] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.090 [2024-07-13 10:04:46.673476] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.090 [2024-07-13 10:04:46.673507] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.090 [2024-07-13 10:04:46.690681] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.090 [2024-07-13 10:04:46.690712] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.090 [2024-07-13 10:04:46.707804] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.090 [2024-07-13 10:04:46.707835] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.090 [2024-07-13 10:04:46.725403] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.090 [2024-07-13 10:04:46.725433] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.090 [2024-07-13 10:04:46.741927] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.090 [2024-07-13 10:04:46.741958] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.090 [2024-07-13 10:04:46.759182] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.090 [2024-07-13 10:04:46.759212] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.090 [2024-07-13 10:04:46.776724] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.090 [2024-07-13 10:04:46.776755] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.090 [2024-07-13 10:04:46.794459] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.090 [2024-07-13 10:04:46.794490] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.090 [2024-07-13 10:04:46.812846] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.090 [2024-07-13 10:04:46.812885] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.090 [2024-07-13 10:04:46.830961] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.090 [2024-07-13 10:04:46.830992] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.090 [2024-07-13 10:04:46.848543] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.090 [2024-07-13 10:04:46.848575] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.090 [2024-07-13 10:04:46.866083] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.090 [2024-07-13 10:04:46.866113] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.090 [2024-07-13 10:04:46.884295] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.090 [2024-07-13 10:04:46.884325] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.090 [2024-07-13 10:04:46.901550] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.090 [2024-07-13 10:04:46.901580] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.348 [2024-07-13 10:04:46.918599] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.348 [2024-07-13 10:04:46.918629] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.348 [2024-07-13 10:04:46.936064] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.348 [2024-07-13 10:04:46.936095] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.348 [2024-07-13 10:04:46.954256] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.348 [2024-07-13 10:04:46.954287] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.348 [2024-07-13 10:04:46.972541] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.348 [2024-07-13 10:04:46.972571] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.348 [2024-07-13 10:04:46.990623] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.348 [2024-07-13 10:04:46.990654] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.348 [2024-07-13 10:04:47.007385] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.348 [2024-07-13 10:04:47.007416] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.348 [2024-07-13 10:04:47.024030] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.348 [2024-07-13 10:04:47.024060] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.348 [2024-07-13 10:04:47.041891] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.348 [2024-07-13 10:04:47.041931] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.348 [2024-07-13 10:04:47.059444] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.348 [2024-07-13 10:04:47.059474] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.348 [2024-07-13 10:04:47.076846] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.348 [2024-07-13 10:04:47.076886] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.348 [2024-07-13 10:04:47.094044] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.348 [2024-07-13 10:04:47.094074] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.348 [2024-07-13 10:04:47.111337] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.348 [2024-07-13 10:04:47.111368] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.348 [2024-07-13 10:04:47.129830] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.348 [2024-07-13 10:04:47.129861] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.348 [2024-07-13 10:04:47.147379] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.348 [2024-07-13 10:04:47.147410] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.607 [2024-07-13 10:04:47.165755] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.607 [2024-07-13 10:04:47.165785] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.607 [2024-07-13 10:04:47.183234] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.607 [2024-07-13 10:04:47.183265] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.607 [2024-07-13 10:04:47.200593] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.607 [2024-07-13 10:04:47.200624] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.607 [2024-07-13 10:04:47.217383] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.607 [2024-07-13 10:04:47.217413] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.607 [2024-07-13 10:04:47.234462] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.607 [2024-07-13 10:04:47.234494] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.607 [2024-07-13 10:04:47.251011] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.607 [2024-07-13 10:04:47.251042] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.607 [2024-07-13 10:04:47.268546] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.607 [2024-07-13 10:04:47.268576] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.607 [2024-07-13 10:04:47.286165] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.607 [2024-07-13 10:04:47.286196] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.607 [2024-07-13 10:04:47.304190] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.607 [2024-07-13 10:04:47.304221] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.607 [2024-07-13 10:04:47.322312] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.607 [2024-07-13 10:04:47.322343] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.607 [2024-07-13 10:04:47.339892] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.607 [2024-07-13 10:04:47.339923] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.607 [2024-07-13 10:04:47.356250] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.607 [2024-07-13 10:04:47.356282] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.607 [2024-07-13 10:04:47.372702] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.607 [2024-07-13 10:04:47.372733] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.607 [2024-07-13 10:04:47.390160] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.607 [2024-07-13 10:04:47.390191] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.607 [2024-07-13 10:04:47.407440] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.607 [2024-07-13 10:04:47.407471] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.866 [2024-07-13 10:04:47.424226] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.866 [2024-07-13 10:04:47.424257] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.866 [2024-07-13 10:04:47.442039] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.866 [2024-07-13 10:04:47.442070] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.866 [2024-07-13 10:04:47.460207] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.866 [2024-07-13 10:04:47.460238] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.866 [2024-07-13 10:04:47.477286] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.866 [2024-07-13 10:04:47.477317] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.866 [2024-07-13 10:04:47.493639] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.866 [2024-07-13 10:04:47.493680] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.866 [2024-07-13 10:04:47.511839] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.866 [2024-07-13 10:04:47.511878] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.866 [2024-07-13 10:04:47.528941] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.866 [2024-07-13 10:04:47.528972] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.866 [2024-07-13 10:04:47.546309] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.866 [2024-07-13 10:04:47.546340] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.866 [2024-07-13 10:04:47.562947] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.866 [2024-07-13 10:04:47.562978] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.866 [2024-07-13 10:04:47.580735] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.866 [2024-07-13 10:04:47.580766] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.867 [2024-07-13 10:04:47.597173] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.867 [2024-07-13 10:04:47.597204] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.867 [2024-07-13 10:04:47.613854] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.867 [2024-07-13 10:04:47.613892] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.867 [2024-07-13 10:04:47.629895] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.867 [2024-07-13 10:04:47.629925] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.867 [2024-07-13 10:04:47.646239] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.867 [2024-07-13 10:04:47.646270] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.867 [2024-07-13 10:04:47.662271] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.867 [2024-07-13 10:04:47.662301] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.867 [2024-07-13 10:04:47.679601] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.867 [2024-07-13 10:04:47.679632] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.161 [2024-07-13 10:04:47.696959] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.161 [2024-07-13 10:04:47.696991] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.161 [2024-07-13 10:04:47.714604] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.161 [2024-07-13 10:04:47.714634] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.161 [2024-07-13 10:04:47.731540] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.161 [2024-07-13 10:04:47.731570] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.161 [2024-07-13 10:04:47.748885] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.161 [2024-07-13 10:04:47.748915] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.161 [2024-07-13 10:04:47.765897] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.161 [2024-07-13 10:04:47.765928] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.161 [2024-07-13 10:04:47.784729] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.161 [2024-07-13 10:04:47.784759] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.161 [2024-07-13 10:04:47.802447] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.161 [2024-07-13 10:04:47.802479] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.161 [2024-07-13 10:04:47.820730] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.161 [2024-07-13 10:04:47.820777] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.161 [2024-07-13 10:04:47.837854] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.161 [2024-07-13 10:04:47.837894] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.161 [2024-07-13 10:04:47.855666] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.161 [2024-07-13 10:04:47.855696] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.161 [2024-07-13 10:04:47.873086] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.161 [2024-07-13 10:04:47.873116] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.161 [2024-07-13 10:04:47.883619] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.161 [2024-07-13 10:04:47.883648] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.161 00:18:42.161 Latency(us) 00:18:42.161 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:42.161 Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:18:42.161 Nvme1n1 : 5.02 7335.70 57.31 0.00 0.00 17416.97 6796.33 26991.12 00:18:42.161 =================================================================================================================== 00:18:42.161 Total : 7335.70 57.31 0.00 0.00 17416.97 6796.33 26991.12 00:18:42.161 [2024-07-13 10:04:47.888630] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.161 [2024-07-13 10:04:47.888658] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.161 [2024-07-13 10:04:47.896651] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.161 [2024-07-13 10:04:47.896679] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.161 [2024-07-13 10:04:47.904688] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.161 [2024-07-13 10:04:47.904722] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.161 [2024-07-13 10:04:47.912733] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.161 [2024-07-13 10:04:47.912780] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.161 [2024-07-13 10:04:47.920761] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.161 [2024-07-13 10:04:47.920810] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.161 [2024-07-13 10:04:47.928778] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.161 [2024-07-13 10:04:47.928825] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.161 [2024-07-13 10:04:47.936802] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.161 [2024-07-13 10:04:47.936848] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.161 [2024-07-13 10:04:47.944822] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.161 [2024-07-13 10:04:47.944874] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.161 [2024-07-13 10:04:47.952851] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.161 [2024-07-13 10:04:47.952919] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.420 [2024-07-13 10:04:47.960884] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.420 [2024-07-13 10:04:47.960926] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.420 [2024-07-13 10:04:47.968906] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.420 [2024-07-13 10:04:47.968951] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.420 [2024-07-13 10:04:47.976931] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.420 [2024-07-13 10:04:47.977002] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.420 [2024-07-13 10:04:47.984950] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.420 [2024-07-13 10:04:47.984998] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.420 [2024-07-13 10:04:47.992977] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.420 [2024-07-13 10:04:47.993025] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.420 [2024-07-13 10:04:48.001001] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.420 [2024-07-13 10:04:48.001049] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.420 [2024-07-13 10:04:48.009014] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.420 [2024-07-13 10:04:48.009060] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.420 [2024-07-13 10:04:48.017032] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.420 [2024-07-13 10:04:48.017079] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.420 [2024-07-13 10:04:48.025022] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.420 [2024-07-13 10:04:48.025055] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.420 [2024-07-13 10:04:48.033030] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.420 [2024-07-13 10:04:48.033056] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.420 [2024-07-13 10:04:48.041101] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.420 [2024-07-13 10:04:48.041145] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.420 [2024-07-13 10:04:48.049129] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.420 [2024-07-13 10:04:48.049175] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.420 [2024-07-13 10:04:48.057129] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.420 [2024-07-13 10:04:48.057170] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.420 [2024-07-13 10:04:48.065119] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.420 [2024-07-13 10:04:48.065144] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.420 [2024-07-13 10:04:48.073176] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.420 [2024-07-13 10:04:48.073218] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.420 [2024-07-13 10:04:48.081212] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.420 [2024-07-13 10:04:48.081257] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.420 [2024-07-13 10:04:48.089224] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.420 [2024-07-13 10:04:48.089263] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.420 [2024-07-13 10:04:48.097214] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.420 [2024-07-13 10:04:48.097250] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.420 [2024-07-13 10:04:48.105237] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.420 [2024-07-13 10:04:48.105262] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.420 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (2820060) - No such process 00:18:42.420 10:04:48 -- target/zcopy.sh@49 -- # wait 2820060 00:18:42.420 10:04:48 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:18:42.420 10:04:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:42.420 10:04:48 -- common/autotest_common.sh@10 -- # set +x 00:18:42.420 10:04:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:42.420 10:04:48 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:18:42.420 10:04:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:42.420 10:04:48 -- common/autotest_common.sh@10 -- # set +x 00:18:42.420 delay0 00:18:42.420 10:04:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:42.420 10:04:48 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:18:42.420 10:04:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:42.420 10:04:48 -- common/autotest_common.sh@10 -- # set +x 00:18:42.420 10:04:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:42.420 10:04:48 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:18:42.420 EAL: No free 2048 kB hugepages reported on node 1 00:18:42.420 [2024-07-13 10:04:48.227291] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:18:48.974 Initializing NVMe Controllers 00:18:48.974 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:18:48.974 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:18:48.974 Initialization complete. Launching workers. 00:18:48.974 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 320, failed: 85 00:18:48.974 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 372, failed to submit 33 00:18:48.974 success 172, unsuccess 200, failed 0 00:18:48.975 10:04:54 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:18:48.975 10:04:54 -- target/zcopy.sh@60 -- # nvmftestfini 00:18:48.975 10:04:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:48.975 10:04:54 -- nvmf/common.sh@116 -- # sync 00:18:48.975 10:04:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:48.975 10:04:54 -- nvmf/common.sh@119 -- # set +e 00:18:48.975 10:04:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:48.975 10:04:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:48.975 rmmod nvme_tcp 00:18:48.975 rmmod nvme_fabrics 00:18:48.975 rmmod nvme_keyring 00:18:48.975 10:04:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:48.975 10:04:54 -- nvmf/common.sh@123 -- # set -e 00:18:48.975 10:04:54 -- nvmf/common.sh@124 -- # return 0 00:18:48.975 10:04:54 -- nvmf/common.sh@477 -- # '[' -n 2818679 ']' 00:18:48.975 10:04:54 -- nvmf/common.sh@478 -- # killprocess 2818679 00:18:48.975 10:04:54 -- common/autotest_common.sh@926 -- # '[' -z 2818679 ']' 00:18:48.975 10:04:54 -- common/autotest_common.sh@930 -- # kill -0 2818679 00:18:48.975 10:04:54 -- common/autotest_common.sh@931 -- # uname 00:18:48.975 10:04:54 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:48.975 10:04:54 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2818679 00:18:48.975 10:04:54 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:18:48.975 10:04:54 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:18:48.975 10:04:54 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2818679' 00:18:48.975 killing process with pid 2818679 00:18:48.975 10:04:54 -- common/autotest_common.sh@945 -- # kill 2818679 00:18:48.975 10:04:54 -- common/autotest_common.sh@950 -- # wait 2818679 00:18:48.975 10:04:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:48.975 10:04:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:48.975 10:04:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:48.975 10:04:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:48.975 10:04:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:48.975 10:04:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:48.975 10:04:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:48.975 10:04:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:51.508 10:04:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:51.508 00:18:51.508 real 0m28.458s 00:18:51.508 user 0m39.741s 00:18:51.508 sys 0m8.605s 00:18:51.508 10:04:56 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:18:51.508 10:04:56 -- common/autotest_common.sh@10 -- # set +x 00:18:51.508 ************************************ 00:18:51.508 END TEST nvmf_zcopy 00:18:51.509 ************************************ 00:18:51.509 10:04:56 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:18:51.509 10:04:56 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:18:51.509 10:04:56 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:18:51.509 10:04:56 -- common/autotest_common.sh@10 -- # set +x 00:18:51.509 ************************************ 00:18:51.509 START TEST nvmf_nmic 00:18:51.509 ************************************ 00:18:51.509 10:04:56 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:18:51.509 * Looking for test storage... 00:18:51.509 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:51.509 10:04:56 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:51.509 10:04:56 -- nvmf/common.sh@7 -- # uname -s 00:18:51.509 10:04:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:51.509 10:04:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:51.509 10:04:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:51.509 10:04:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:51.509 10:04:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:51.509 10:04:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:51.509 10:04:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:51.509 10:04:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:51.509 10:04:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:51.509 10:04:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:51.509 10:04:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:51.509 10:04:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:51.509 10:04:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:51.509 10:04:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:51.509 10:04:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:51.509 10:04:56 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:51.509 10:04:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:51.509 10:04:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:51.509 10:04:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:51.509 10:04:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:51.509 10:04:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:51.509 10:04:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:51.509 10:04:56 -- paths/export.sh@5 -- # export PATH 00:18:51.509 10:04:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:51.509 10:04:56 -- nvmf/common.sh@46 -- # : 0 00:18:51.509 10:04:56 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:51.509 10:04:56 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:51.509 10:04:56 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:51.509 10:04:56 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:51.509 10:04:56 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:51.509 10:04:56 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:51.509 10:04:56 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:51.509 10:04:56 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:51.509 10:04:56 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:51.509 10:04:56 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:51.509 10:04:56 -- target/nmic.sh@14 -- # nvmftestinit 00:18:51.509 10:04:56 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:51.509 10:04:56 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:51.509 10:04:56 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:51.509 10:04:56 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:51.509 10:04:56 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:51.509 10:04:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:51.509 10:04:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:51.509 10:04:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:51.509 10:04:56 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:51.509 10:04:56 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:51.509 10:04:56 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:51.509 10:04:56 -- common/autotest_common.sh@10 -- # set +x 00:18:53.412 10:04:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:53.412 10:04:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:53.412 10:04:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:53.412 10:04:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:53.413 10:04:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:53.413 10:04:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:53.413 10:04:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:53.413 10:04:58 -- nvmf/common.sh@294 -- # net_devs=() 00:18:53.413 10:04:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:53.413 10:04:58 -- nvmf/common.sh@295 -- # e810=() 00:18:53.413 10:04:58 -- nvmf/common.sh@295 -- # local -ga e810 00:18:53.413 10:04:58 -- nvmf/common.sh@296 -- # x722=() 00:18:53.413 10:04:58 -- nvmf/common.sh@296 -- # local -ga x722 00:18:53.413 10:04:58 -- nvmf/common.sh@297 -- # mlx=() 00:18:53.413 10:04:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:53.413 10:04:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:53.413 10:04:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:53.413 10:04:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:53.413 10:04:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:53.413 10:04:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:53.413 10:04:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:53.413 10:04:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:53.413 10:04:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:53.413 10:04:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:53.413 10:04:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:53.413 10:04:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:53.413 10:04:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:53.413 10:04:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:53.413 10:04:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:53.413 10:04:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:53.413 10:04:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:53.413 10:04:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:53.413 10:04:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:53.413 10:04:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:53.413 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:53.413 10:04:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:53.413 10:04:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:53.413 10:04:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:53.413 10:04:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:53.413 10:04:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:53.413 10:04:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:53.413 10:04:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:53.413 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:53.413 10:04:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:53.413 10:04:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:53.413 10:04:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:53.413 10:04:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:53.413 10:04:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:53.413 10:04:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:53.413 10:04:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:53.413 10:04:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:53.413 10:04:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:53.413 10:04:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:53.413 10:04:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:53.413 10:04:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:53.413 10:04:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:53.413 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:53.413 10:04:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:53.413 10:04:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:53.413 10:04:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:53.413 10:04:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:53.413 10:04:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:53.413 10:04:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:53.413 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:53.413 10:04:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:53.413 10:04:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:53.413 10:04:58 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:53.413 10:04:58 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:53.413 10:04:58 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:53.413 10:04:58 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:53.413 10:04:58 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:53.413 10:04:58 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:53.413 10:04:58 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:53.413 10:04:58 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:53.413 10:04:58 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:53.413 10:04:58 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:53.413 10:04:58 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:53.413 10:04:58 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:53.413 10:04:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:53.413 10:04:58 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:53.413 10:04:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:53.413 10:04:58 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:53.413 10:04:58 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:53.413 10:04:58 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:53.413 10:04:58 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:53.413 10:04:58 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:53.413 10:04:58 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:53.413 10:04:58 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:53.413 10:04:58 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:53.413 10:04:58 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:53.413 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:53.413 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.244 ms 00:18:53.413 00:18:53.413 --- 10.0.0.2 ping statistics --- 00:18:53.413 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:53.413 rtt min/avg/max/mdev = 0.244/0.244/0.244/0.000 ms 00:18:53.413 10:04:58 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:53.413 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:53.413 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.190 ms 00:18:53.413 00:18:53.413 --- 10.0.0.1 ping statistics --- 00:18:53.413 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:53.413 rtt min/avg/max/mdev = 0.190/0.190/0.190/0.000 ms 00:18:53.413 10:04:58 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:53.413 10:04:58 -- nvmf/common.sh@410 -- # return 0 00:18:53.413 10:04:58 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:53.413 10:04:58 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:53.413 10:04:58 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:53.413 10:04:58 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:53.413 10:04:58 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:53.413 10:04:58 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:53.413 10:04:58 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:53.413 10:04:58 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:18:53.413 10:04:58 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:53.413 10:04:58 -- common/autotest_common.sh@712 -- # xtrace_disable 00:18:53.413 10:04:58 -- common/autotest_common.sh@10 -- # set +x 00:18:53.413 10:04:58 -- nvmf/common.sh@469 -- # nvmfpid=2823501 00:18:53.413 10:04:58 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:18:53.413 10:04:58 -- nvmf/common.sh@470 -- # waitforlisten 2823501 00:18:53.413 10:04:58 -- common/autotest_common.sh@819 -- # '[' -z 2823501 ']' 00:18:53.413 10:04:58 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:53.413 10:04:58 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:53.413 10:04:58 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:53.413 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:53.413 10:04:58 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:53.413 10:04:58 -- common/autotest_common.sh@10 -- # set +x 00:18:53.413 [2024-07-13 10:04:59.032115] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:18:53.413 [2024-07-13 10:04:59.032201] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:53.413 EAL: No free 2048 kB hugepages reported on node 1 00:18:53.413 [2024-07-13 10:04:59.096011] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:53.413 [2024-07-13 10:04:59.180772] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:53.413 [2024-07-13 10:04:59.180955] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:53.413 [2024-07-13 10:04:59.180973] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:53.413 [2024-07-13 10:04:59.180985] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:53.413 [2024-07-13 10:04:59.181034] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:53.413 [2024-07-13 10:04:59.181243] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:53.413 [2024-07-13 10:04:59.181301] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:53.413 [2024-07-13 10:04:59.181303] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:54.346 10:05:00 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:54.346 10:05:00 -- common/autotest_common.sh@852 -- # return 0 00:18:54.346 10:05:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:54.346 10:05:00 -- common/autotest_common.sh@718 -- # xtrace_disable 00:18:54.346 10:05:00 -- common/autotest_common.sh@10 -- # set +x 00:18:54.346 10:05:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:54.346 10:05:00 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:54.346 10:05:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.346 10:05:00 -- common/autotest_common.sh@10 -- # set +x 00:18:54.346 [2024-07-13 10:05:00.031635] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:54.346 10:05:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.346 10:05:00 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:54.346 10:05:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.346 10:05:00 -- common/autotest_common.sh@10 -- # set +x 00:18:54.346 Malloc0 00:18:54.346 10:05:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.347 10:05:00 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:18:54.347 10:05:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.347 10:05:00 -- common/autotest_common.sh@10 -- # set +x 00:18:54.347 10:05:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.347 10:05:00 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:54.347 10:05:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.347 10:05:00 -- common/autotest_common.sh@10 -- # set +x 00:18:54.347 10:05:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.347 10:05:00 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:54.347 10:05:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.347 10:05:00 -- common/autotest_common.sh@10 -- # set +x 00:18:54.347 [2024-07-13 10:05:00.084043] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:54.347 10:05:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.347 10:05:00 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:18:54.347 test case1: single bdev can't be used in multiple subsystems 00:18:54.347 10:05:00 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:18:54.347 10:05:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.347 10:05:00 -- common/autotest_common.sh@10 -- # set +x 00:18:54.347 10:05:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.347 10:05:00 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:18:54.347 10:05:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.347 10:05:00 -- common/autotest_common.sh@10 -- # set +x 00:18:54.347 10:05:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.347 10:05:00 -- target/nmic.sh@28 -- # nmic_status=0 00:18:54.347 10:05:00 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:18:54.347 10:05:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.347 10:05:00 -- common/autotest_common.sh@10 -- # set +x 00:18:54.347 [2024-07-13 10:05:00.107908] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:18:54.347 [2024-07-13 10:05:00.107939] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:18:54.347 [2024-07-13 10:05:00.107954] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:54.347 request: 00:18:54.347 { 00:18:54.347 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:18:54.347 "namespace": { 00:18:54.347 "bdev_name": "Malloc0" 00:18:54.347 }, 00:18:54.347 "method": "nvmf_subsystem_add_ns", 00:18:54.347 "req_id": 1 00:18:54.347 } 00:18:54.347 Got JSON-RPC error response 00:18:54.347 response: 00:18:54.347 { 00:18:54.347 "code": -32602, 00:18:54.347 "message": "Invalid parameters" 00:18:54.347 } 00:18:54.347 10:05:00 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:18:54.347 10:05:00 -- target/nmic.sh@29 -- # nmic_status=1 00:18:54.347 10:05:00 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:18:54.347 10:05:00 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:18:54.347 Adding namespace failed - expected result. 00:18:54.347 10:05:00 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:18:54.347 test case2: host connect to nvmf target in multiple paths 00:18:54.347 10:05:00 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:18:54.347 10:05:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.347 10:05:00 -- common/autotest_common.sh@10 -- # set +x 00:18:54.347 [2024-07-13 10:05:00.116015] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:18:54.347 10:05:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.347 10:05:00 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:18:54.912 10:05:00 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:18:55.844 10:05:01 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:18:55.844 10:05:01 -- common/autotest_common.sh@1177 -- # local i=0 00:18:55.844 10:05:01 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:18:55.844 10:05:01 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:18:55.844 10:05:01 -- common/autotest_common.sh@1184 -- # sleep 2 00:18:57.736 10:05:03 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:18:57.736 10:05:03 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:18:57.736 10:05:03 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:18:57.736 10:05:03 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:18:57.736 10:05:03 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:18:57.736 10:05:03 -- common/autotest_common.sh@1187 -- # return 0 00:18:57.736 10:05:03 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:18:57.737 [global] 00:18:57.737 thread=1 00:18:57.737 invalidate=1 00:18:57.737 rw=write 00:18:57.737 time_based=1 00:18:57.737 runtime=1 00:18:57.737 ioengine=libaio 00:18:57.737 direct=1 00:18:57.737 bs=4096 00:18:57.737 iodepth=1 00:18:57.737 norandommap=0 00:18:57.737 numjobs=1 00:18:57.737 00:18:57.737 verify_dump=1 00:18:57.737 verify_backlog=512 00:18:57.737 verify_state_save=0 00:18:57.737 do_verify=1 00:18:57.737 verify=crc32c-intel 00:18:57.737 [job0] 00:18:57.737 filename=/dev/nvme0n1 00:18:57.737 Could not set queue depth (nvme0n1) 00:18:57.994 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:18:57.994 fio-3.35 00:18:57.994 Starting 1 thread 00:18:59.363 00:18:59.363 job0: (groupid=0, jobs=1): err= 0: pid=2824160: Sat Jul 13 10:05:04 2024 00:18:59.363 read: IOPS=21, BW=85.4KiB/s (87.4kB/s)(88.0KiB/1031msec) 00:18:59.363 slat (nsec): min=9119, max=36522, avg=25818.64, stdev=9500.31 00:18:59.363 clat (usec): min=40852, max=42055, avg=41192.39, stdev=437.72 00:18:59.363 lat (usec): min=40887, max=42073, avg=41218.21, stdev=438.67 00:18:59.363 clat percentiles (usec): 00:18:59.363 | 1.00th=[40633], 5.00th=[40633], 10.00th=[41157], 20.00th=[41157], 00:18:59.363 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:18:59.363 | 70.00th=[41157], 80.00th=[41681], 90.00th=[42206], 95.00th=[42206], 00:18:59.363 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:18:59.363 | 99.99th=[42206] 00:18:59.363 write: IOPS=496, BW=1986KiB/s (2034kB/s)(2048KiB/1031msec); 0 zone resets 00:18:59.363 slat (nsec): min=8682, max=48883, avg=20190.73, stdev=4791.03 00:18:59.363 clat (usec): min=171, max=392, avg=215.61, stdev=17.01 00:18:59.363 lat (usec): min=180, max=429, avg=235.80, stdev=20.23 00:18:59.363 clat percentiles (usec): 00:18:59.363 | 1.00th=[ 178], 5.00th=[ 186], 10.00th=[ 194], 20.00th=[ 208], 00:18:59.363 | 30.00th=[ 210], 40.00th=[ 215], 50.00th=[ 217], 60.00th=[ 219], 00:18:59.363 | 70.00th=[ 221], 80.00th=[ 225], 90.00th=[ 231], 95.00th=[ 239], 00:18:59.363 | 99.00th=[ 265], 99.50th=[ 273], 99.90th=[ 392], 99.95th=[ 392], 00:18:59.363 | 99.99th=[ 392] 00:18:59.363 bw ( KiB/s): min= 4096, max= 4096, per=100.00%, avg=4096.00, stdev= 0.00, samples=1 00:18:59.363 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:18:59.363 lat (usec) : 250=93.82%, 500=2.06% 00:18:59.363 lat (msec) : 50=4.12% 00:18:59.363 cpu : usr=0.78%, sys=1.26%, ctx=534, majf=0, minf=2 00:18:59.363 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:18:59.363 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:59.363 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:59.363 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:59.363 latency : target=0, window=0, percentile=100.00%, depth=1 00:18:59.363 00:18:59.363 Run status group 0 (all jobs): 00:18:59.363 READ: bw=85.4KiB/s (87.4kB/s), 85.4KiB/s-85.4KiB/s (87.4kB/s-87.4kB/s), io=88.0KiB (90.1kB), run=1031-1031msec 00:18:59.363 WRITE: bw=1986KiB/s (2034kB/s), 1986KiB/s-1986KiB/s (2034kB/s-2034kB/s), io=2048KiB (2097kB), run=1031-1031msec 00:18:59.363 00:18:59.363 Disk stats (read/write): 00:18:59.363 nvme0n1: ios=68/512, merge=0/0, ticks=772/98, in_queue=870, util=91.98% 00:18:59.363 10:05:04 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:18:59.363 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:18:59.363 10:05:04 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:18:59.363 10:05:04 -- common/autotest_common.sh@1198 -- # local i=0 00:18:59.363 10:05:04 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:18:59.363 10:05:04 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:18:59.363 10:05:04 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:18:59.363 10:05:04 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:18:59.363 10:05:04 -- common/autotest_common.sh@1210 -- # return 0 00:18:59.363 10:05:04 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:18:59.363 10:05:04 -- target/nmic.sh@53 -- # nvmftestfini 00:18:59.363 10:05:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:59.363 10:05:04 -- nvmf/common.sh@116 -- # sync 00:18:59.363 10:05:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:59.363 10:05:04 -- nvmf/common.sh@119 -- # set +e 00:18:59.363 10:05:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:59.363 10:05:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:59.363 rmmod nvme_tcp 00:18:59.363 rmmod nvme_fabrics 00:18:59.363 rmmod nvme_keyring 00:18:59.363 10:05:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:59.363 10:05:05 -- nvmf/common.sh@123 -- # set -e 00:18:59.363 10:05:05 -- nvmf/common.sh@124 -- # return 0 00:18:59.363 10:05:05 -- nvmf/common.sh@477 -- # '[' -n 2823501 ']' 00:18:59.363 10:05:05 -- nvmf/common.sh@478 -- # killprocess 2823501 00:18:59.363 10:05:05 -- common/autotest_common.sh@926 -- # '[' -z 2823501 ']' 00:18:59.363 10:05:05 -- common/autotest_common.sh@930 -- # kill -0 2823501 00:18:59.363 10:05:05 -- common/autotest_common.sh@931 -- # uname 00:18:59.363 10:05:05 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:59.363 10:05:05 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2823501 00:18:59.363 10:05:05 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:18:59.363 10:05:05 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:18:59.363 10:05:05 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2823501' 00:18:59.363 killing process with pid 2823501 00:18:59.363 10:05:05 -- common/autotest_common.sh@945 -- # kill 2823501 00:18:59.363 10:05:05 -- common/autotest_common.sh@950 -- # wait 2823501 00:18:59.622 10:05:05 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:59.622 10:05:05 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:59.622 10:05:05 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:59.622 10:05:05 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:59.622 10:05:05 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:59.622 10:05:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:59.622 10:05:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:59.622 10:05:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:01.524 10:05:07 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:01.524 00:19:01.524 real 0m10.468s 00:19:01.524 user 0m25.274s 00:19:01.524 sys 0m2.285s 00:19:01.524 10:05:07 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:19:01.524 10:05:07 -- common/autotest_common.sh@10 -- # set +x 00:19:01.524 ************************************ 00:19:01.524 END TEST nvmf_nmic 00:19:01.524 ************************************ 00:19:01.524 10:05:07 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:19:01.524 10:05:07 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:19:01.524 10:05:07 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:19:01.524 10:05:07 -- common/autotest_common.sh@10 -- # set +x 00:19:01.524 ************************************ 00:19:01.524 START TEST nvmf_fio_target 00:19:01.524 ************************************ 00:19:01.524 10:05:07 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:19:01.783 * Looking for test storage... 00:19:01.783 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:01.783 10:05:07 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:01.783 10:05:07 -- nvmf/common.sh@7 -- # uname -s 00:19:01.783 10:05:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:01.783 10:05:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:01.783 10:05:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:01.783 10:05:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:01.783 10:05:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:01.783 10:05:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:01.783 10:05:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:01.783 10:05:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:01.783 10:05:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:01.783 10:05:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:01.783 10:05:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:01.783 10:05:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:01.783 10:05:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:01.783 10:05:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:01.783 10:05:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:01.783 10:05:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:01.783 10:05:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:01.783 10:05:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:01.783 10:05:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:01.783 10:05:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:01.783 10:05:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:01.783 10:05:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:01.783 10:05:07 -- paths/export.sh@5 -- # export PATH 00:19:01.783 10:05:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:01.783 10:05:07 -- nvmf/common.sh@46 -- # : 0 00:19:01.783 10:05:07 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:01.783 10:05:07 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:01.783 10:05:07 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:01.783 10:05:07 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:01.783 10:05:07 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:01.783 10:05:07 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:01.783 10:05:07 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:01.783 10:05:07 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:01.783 10:05:07 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:01.783 10:05:07 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:01.783 10:05:07 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:19:01.784 10:05:07 -- target/fio.sh@16 -- # nvmftestinit 00:19:01.784 10:05:07 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:01.784 10:05:07 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:01.784 10:05:07 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:01.784 10:05:07 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:01.784 10:05:07 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:01.784 10:05:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:01.784 10:05:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:01.784 10:05:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:01.784 10:05:07 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:01.784 10:05:07 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:01.784 10:05:07 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:01.784 10:05:07 -- common/autotest_common.sh@10 -- # set +x 00:19:03.685 10:05:09 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:03.685 10:05:09 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:03.685 10:05:09 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:03.685 10:05:09 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:03.685 10:05:09 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:03.685 10:05:09 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:03.685 10:05:09 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:03.685 10:05:09 -- nvmf/common.sh@294 -- # net_devs=() 00:19:03.685 10:05:09 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:03.685 10:05:09 -- nvmf/common.sh@295 -- # e810=() 00:19:03.685 10:05:09 -- nvmf/common.sh@295 -- # local -ga e810 00:19:03.685 10:05:09 -- nvmf/common.sh@296 -- # x722=() 00:19:03.685 10:05:09 -- nvmf/common.sh@296 -- # local -ga x722 00:19:03.685 10:05:09 -- nvmf/common.sh@297 -- # mlx=() 00:19:03.685 10:05:09 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:03.685 10:05:09 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:03.685 10:05:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:03.685 10:05:09 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:03.685 10:05:09 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:03.685 10:05:09 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:03.685 10:05:09 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:03.685 10:05:09 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:03.685 10:05:09 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:03.685 10:05:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:03.685 10:05:09 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:03.685 10:05:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:03.685 10:05:09 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:03.685 10:05:09 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:03.685 10:05:09 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:03.685 10:05:09 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:03.685 10:05:09 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:03.685 10:05:09 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:03.685 10:05:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:03.685 10:05:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:03.685 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:03.685 10:05:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:03.685 10:05:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:03.685 10:05:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:03.685 10:05:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:03.685 10:05:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:03.685 10:05:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:03.685 10:05:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:03.685 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:03.685 10:05:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:03.685 10:05:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:03.685 10:05:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:03.685 10:05:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:03.685 10:05:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:03.685 10:05:09 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:03.685 10:05:09 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:03.685 10:05:09 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:03.685 10:05:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:03.685 10:05:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:03.685 10:05:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:03.685 10:05:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:03.685 10:05:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:03.685 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:03.685 10:05:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:03.685 10:05:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:03.685 10:05:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:03.685 10:05:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:03.685 10:05:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:03.685 10:05:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:03.685 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:03.685 10:05:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:03.685 10:05:09 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:03.685 10:05:09 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:03.685 10:05:09 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:03.685 10:05:09 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:03.685 10:05:09 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:03.685 10:05:09 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:03.685 10:05:09 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:03.685 10:05:09 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:03.685 10:05:09 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:03.685 10:05:09 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:03.685 10:05:09 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:03.685 10:05:09 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:03.685 10:05:09 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:03.685 10:05:09 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:03.685 10:05:09 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:03.685 10:05:09 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:03.685 10:05:09 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:03.685 10:05:09 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:03.685 10:05:09 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:03.685 10:05:09 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:03.685 10:05:09 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:03.685 10:05:09 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:03.685 10:05:09 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:03.943 10:05:09 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:03.943 10:05:09 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:03.943 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:03.943 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.175 ms 00:19:03.943 00:19:03.943 --- 10.0.0.2 ping statistics --- 00:19:03.943 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:03.943 rtt min/avg/max/mdev = 0.175/0.175/0.175/0.000 ms 00:19:03.943 10:05:09 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:03.943 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:03.943 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.174 ms 00:19:03.943 00:19:03.943 --- 10.0.0.1 ping statistics --- 00:19:03.943 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:03.943 rtt min/avg/max/mdev = 0.174/0.174/0.174/0.000 ms 00:19:03.943 10:05:09 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:03.943 10:05:09 -- nvmf/common.sh@410 -- # return 0 00:19:03.943 10:05:09 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:03.943 10:05:09 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:03.943 10:05:09 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:03.943 10:05:09 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:03.943 10:05:09 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:03.943 10:05:09 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:03.943 10:05:09 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:03.943 10:05:09 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:19:03.943 10:05:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:03.943 10:05:09 -- common/autotest_common.sh@712 -- # xtrace_disable 00:19:03.943 10:05:09 -- common/autotest_common.sh@10 -- # set +x 00:19:03.943 10:05:09 -- nvmf/common.sh@469 -- # nvmfpid=2826249 00:19:03.943 10:05:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:03.943 10:05:09 -- nvmf/common.sh@470 -- # waitforlisten 2826249 00:19:03.943 10:05:09 -- common/autotest_common.sh@819 -- # '[' -z 2826249 ']' 00:19:03.943 10:05:09 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:03.943 10:05:09 -- common/autotest_common.sh@824 -- # local max_retries=100 00:19:03.943 10:05:09 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:03.944 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:03.944 10:05:09 -- common/autotest_common.sh@828 -- # xtrace_disable 00:19:03.944 10:05:09 -- common/autotest_common.sh@10 -- # set +x 00:19:03.944 [2024-07-13 10:05:09.589797] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:19:03.944 [2024-07-13 10:05:09.589890] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:03.944 EAL: No free 2048 kB hugepages reported on node 1 00:19:03.944 [2024-07-13 10:05:09.653827] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:03.944 [2024-07-13 10:05:09.737412] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:03.944 [2024-07-13 10:05:09.737578] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:03.944 [2024-07-13 10:05:09.737611] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:03.944 [2024-07-13 10:05:09.737625] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:03.944 [2024-07-13 10:05:09.737679] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:03.944 [2024-07-13 10:05:09.737741] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:03.944 [2024-07-13 10:05:09.737791] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:03.944 [2024-07-13 10:05:09.737793] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:04.906 10:05:10 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:19:04.906 10:05:10 -- common/autotest_common.sh@852 -- # return 0 00:19:04.906 10:05:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:04.906 10:05:10 -- common/autotest_common.sh@718 -- # xtrace_disable 00:19:04.906 10:05:10 -- common/autotest_common.sh@10 -- # set +x 00:19:04.906 10:05:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:04.906 10:05:10 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:19:05.162 [2024-07-13 10:05:10.835414] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:05.163 10:05:10 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:05.419 10:05:11 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:19:05.419 10:05:11 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:05.677 10:05:11 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:19:05.677 10:05:11 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:05.935 10:05:11 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:19:05.935 10:05:11 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:06.196 10:05:11 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:19:06.196 10:05:11 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:19:06.454 10:05:12 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:06.711 10:05:12 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:19:06.711 10:05:12 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:06.969 10:05:12 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:19:06.969 10:05:12 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:07.226 10:05:12 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:19:07.226 10:05:12 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:19:07.482 10:05:13 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:19:07.738 10:05:13 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:19:07.738 10:05:13 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:07.995 10:05:13 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:19:07.995 10:05:13 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:19:08.253 10:05:13 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:08.510 [2024-07-13 10:05:14.082736] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:08.510 10:05:14 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:19:08.767 10:05:14 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:19:08.767 10:05:14 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:09.700 10:05:15 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:19:09.700 10:05:15 -- common/autotest_common.sh@1177 -- # local i=0 00:19:09.700 10:05:15 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:19:09.700 10:05:15 -- common/autotest_common.sh@1179 -- # [[ -n 4 ]] 00:19:09.700 10:05:15 -- common/autotest_common.sh@1180 -- # nvme_device_counter=4 00:19:09.700 10:05:15 -- common/autotest_common.sh@1184 -- # sleep 2 00:19:11.593 10:05:17 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:19:11.593 10:05:17 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:19:11.593 10:05:17 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:19:11.593 10:05:17 -- common/autotest_common.sh@1186 -- # nvme_devices=4 00:19:11.593 10:05:17 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:19:11.593 10:05:17 -- common/autotest_common.sh@1187 -- # return 0 00:19:11.593 10:05:17 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:19:11.593 [global] 00:19:11.593 thread=1 00:19:11.593 invalidate=1 00:19:11.593 rw=write 00:19:11.593 time_based=1 00:19:11.593 runtime=1 00:19:11.593 ioengine=libaio 00:19:11.593 direct=1 00:19:11.593 bs=4096 00:19:11.593 iodepth=1 00:19:11.593 norandommap=0 00:19:11.593 numjobs=1 00:19:11.593 00:19:11.593 verify_dump=1 00:19:11.593 verify_backlog=512 00:19:11.593 verify_state_save=0 00:19:11.593 do_verify=1 00:19:11.593 verify=crc32c-intel 00:19:11.593 [job0] 00:19:11.593 filename=/dev/nvme0n1 00:19:11.593 [job1] 00:19:11.593 filename=/dev/nvme0n2 00:19:11.593 [job2] 00:19:11.593 filename=/dev/nvme0n3 00:19:11.593 [job3] 00:19:11.593 filename=/dev/nvme0n4 00:19:11.593 Could not set queue depth (nvme0n1) 00:19:11.593 Could not set queue depth (nvme0n2) 00:19:11.593 Could not set queue depth (nvme0n3) 00:19:11.593 Could not set queue depth (nvme0n4) 00:19:11.851 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:11.851 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:11.851 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:11.851 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:11.851 fio-3.35 00:19:11.851 Starting 4 threads 00:19:13.224 00:19:13.224 job0: (groupid=0, jobs=1): err= 0: pid=2827359: Sat Jul 13 10:05:18 2024 00:19:13.224 read: IOPS=1534, BW=6138KiB/s (6285kB/s)(6144KiB/1001msec) 00:19:13.224 slat (nsec): min=5511, max=67108, avg=24846.97, stdev=11147.32 00:19:13.224 clat (usec): min=292, max=652, avg=389.62, stdev=50.98 00:19:13.224 lat (usec): min=305, max=684, avg=414.47, stdev=56.49 00:19:13.224 clat percentiles (usec): 00:19:13.224 | 1.00th=[ 310], 5.00th=[ 322], 10.00th=[ 326], 20.00th=[ 338], 00:19:13.224 | 30.00th=[ 363], 40.00th=[ 375], 50.00th=[ 383], 60.00th=[ 396], 00:19:13.224 | 70.00th=[ 408], 80.00th=[ 437], 90.00th=[ 469], 95.00th=[ 478], 00:19:13.224 | 99.00th=[ 506], 99.50th=[ 515], 99.90th=[ 652], 99.95th=[ 652], 00:19:13.224 | 99.99th=[ 652] 00:19:13.224 write: IOPS=1602, BW=6410KiB/s (6563kB/s)(6416KiB/1001msec); 0 zone resets 00:19:13.224 slat (usec): min=6, max=1319, avg=15.65, stdev=33.10 00:19:13.224 clat (usec): min=161, max=463, avg=199.93, stdev=30.56 00:19:13.224 lat (usec): min=169, max=1571, avg=215.58, stdev=47.26 00:19:13.224 clat percentiles (usec): 00:19:13.224 | 1.00th=[ 167], 5.00th=[ 172], 10.00th=[ 174], 20.00th=[ 180], 00:19:13.224 | 30.00th=[ 184], 40.00th=[ 188], 50.00th=[ 192], 60.00th=[ 198], 00:19:13.224 | 70.00th=[ 206], 80.00th=[ 217], 90.00th=[ 233], 95.00th=[ 249], 00:19:13.224 | 99.00th=[ 322], 99.50th=[ 383], 99.90th=[ 416], 99.95th=[ 465], 00:19:13.224 | 99.99th=[ 465] 00:19:13.224 bw ( KiB/s): min= 8192, max= 8192, per=49.28%, avg=8192.00, stdev= 0.00, samples=1 00:19:13.224 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:19:13.224 lat (usec) : 250=48.60%, 500=50.70%, 750=0.70% 00:19:13.224 cpu : usr=3.10%, sys=6.80%, ctx=3141, majf=0, minf=1 00:19:13.224 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:13.224 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:13.224 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:13.224 issued rwts: total=1536,1604,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:13.224 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:13.224 job1: (groupid=0, jobs=1): err= 0: pid=2827360: Sat Jul 13 10:05:18 2024 00:19:13.224 read: IOPS=39, BW=160KiB/s (164kB/s)(160KiB/1001msec) 00:19:13.224 slat (nsec): min=14664, max=35961, avg=22483.15, stdev=7695.88 00:19:13.224 clat (usec): min=365, max=42101, avg=21668.65, stdev=20474.27 00:19:13.224 lat (usec): min=401, max=42133, avg=21691.13, stdev=20478.05 00:19:13.224 clat percentiles (usec): 00:19:13.224 | 1.00th=[ 367], 5.00th=[ 412], 10.00th=[ 424], 20.00th=[ 429], 00:19:13.224 | 30.00th=[ 441], 40.00th=[ 453], 50.00th=[35390], 60.00th=[41157], 00:19:13.224 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[42206], 00:19:13.224 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:13.224 | 99.99th=[42206] 00:19:13.224 write: IOPS=511, BW=2046KiB/s (2095kB/s)(2048KiB/1001msec); 0 zone resets 00:19:13.224 slat (nsec): min=7071, max=62615, avg=19358.54, stdev=7384.75 00:19:13.224 clat (usec): min=185, max=477, avg=235.13, stdev=38.99 00:19:13.224 lat (usec): min=198, max=492, avg=254.49, stdev=40.48 00:19:13.224 clat percentiles (usec): 00:19:13.224 | 1.00th=[ 186], 5.00th=[ 194], 10.00th=[ 198], 20.00th=[ 204], 00:19:13.224 | 30.00th=[ 208], 40.00th=[ 215], 50.00th=[ 225], 60.00th=[ 239], 00:19:13.224 | 70.00th=[ 249], 80.00th=[ 265], 90.00th=[ 281], 95.00th=[ 302], 00:19:13.224 | 99.00th=[ 383], 99.50th=[ 404], 99.90th=[ 478], 99.95th=[ 478], 00:19:13.224 | 99.99th=[ 478] 00:19:13.224 bw ( KiB/s): min= 4096, max= 4096, per=24.64%, avg=4096.00, stdev= 0.00, samples=1 00:19:13.224 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:13.224 lat (usec) : 250=65.04%, 500=31.16% 00:19:13.224 lat (msec) : 50=3.80% 00:19:13.224 cpu : usr=0.40%, sys=1.30%, ctx=554, majf=0, minf=2 00:19:13.224 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:13.224 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:13.224 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:13.224 issued rwts: total=40,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:13.224 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:13.224 job2: (groupid=0, jobs=1): err= 0: pid=2827361: Sat Jul 13 10:05:18 2024 00:19:13.224 read: IOPS=235, BW=943KiB/s (966kB/s)(944KiB/1001msec) 00:19:13.224 slat (nsec): min=15413, max=39269, avg=20239.24, stdev=5057.35 00:19:13.224 clat (usec): min=320, max=42014, avg=3437.39, stdev=10659.28 00:19:13.224 lat (usec): min=337, max=42038, avg=3457.63, stdev=10661.21 00:19:13.224 clat percentiles (usec): 00:19:13.224 | 1.00th=[ 322], 5.00th=[ 338], 10.00th=[ 351], 20.00th=[ 355], 00:19:13.224 | 30.00th=[ 363], 40.00th=[ 375], 50.00th=[ 392], 60.00th=[ 400], 00:19:13.224 | 70.00th=[ 412], 80.00th=[ 437], 90.00th=[ 482], 95.00th=[41157], 00:19:13.224 | 99.00th=[41157], 99.50th=[41681], 99.90th=[42206], 99.95th=[42206], 00:19:13.224 | 99.99th=[42206] 00:19:13.224 write: IOPS=511, BW=2046KiB/s (2095kB/s)(2048KiB/1001msec); 0 zone resets 00:19:13.224 slat (usec): min=7, max=1934, avg=33.05, stdev=85.11 00:19:13.224 clat (usec): min=194, max=610, avg=318.24, stdev=99.00 00:19:13.224 lat (usec): min=204, max=2278, avg=351.29, stdev=135.90 00:19:13.224 clat percentiles (usec): 00:19:13.224 | 1.00th=[ 198], 5.00th=[ 206], 10.00th=[ 210], 20.00th=[ 221], 00:19:13.224 | 30.00th=[ 233], 40.00th=[ 258], 50.00th=[ 306], 60.00th=[ 338], 00:19:13.224 | 70.00th=[ 379], 80.00th=[ 404], 90.00th=[ 453], 95.00th=[ 515], 00:19:13.224 | 99.00th=[ 562], 99.50th=[ 586], 99.90th=[ 611], 99.95th=[ 611], 00:19:13.224 | 99.99th=[ 611] 00:19:13.224 bw ( KiB/s): min= 4096, max= 4096, per=24.64%, avg=4096.00, stdev= 0.00, samples=1 00:19:13.224 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:13.224 lat (usec) : 250=25.67%, 500=67.25%, 750=4.68% 00:19:13.224 lat (msec) : 50=2.41% 00:19:13.224 cpu : usr=1.40%, sys=2.10%, ctx=749, majf=0, minf=1 00:19:13.224 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:13.224 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:13.224 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:13.224 issued rwts: total=236,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:13.224 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:13.224 job3: (groupid=0, jobs=1): err= 0: pid=2827362: Sat Jul 13 10:05:18 2024 00:19:13.224 read: IOPS=1394, BW=5577KiB/s (5711kB/s)(5588KiB/1002msec) 00:19:13.224 slat (nsec): min=7507, max=55531, avg=16211.13, stdev=5347.00 00:19:13.224 clat (usec): min=264, max=685, avg=354.10, stdev=59.41 00:19:13.224 lat (usec): min=272, max=696, avg=370.31, stdev=62.10 00:19:13.224 clat percentiles (usec): 00:19:13.224 | 1.00th=[ 273], 5.00th=[ 281], 10.00th=[ 285], 20.00th=[ 302], 00:19:13.224 | 30.00th=[ 322], 40.00th=[ 338], 50.00th=[ 343], 60.00th=[ 351], 00:19:13.224 | 70.00th=[ 379], 80.00th=[ 396], 90.00th=[ 420], 95.00th=[ 482], 00:19:13.224 | 99.00th=[ 537], 99.50th=[ 562], 99.90th=[ 611], 99.95th=[ 685], 00:19:13.224 | 99.99th=[ 685] 00:19:13.224 write: IOPS=1532, BW=6132KiB/s (6279kB/s)(6144KiB/1002msec); 0 zone resets 00:19:13.224 slat (usec): min=8, max=43034, avg=50.97, stdev=1097.51 00:19:13.224 clat (usec): min=185, max=453, avg=253.64, stdev=56.16 00:19:13.224 lat (usec): min=196, max=43366, avg=304.61, stdev=1101.21 00:19:13.224 clat percentiles (usec): 00:19:13.224 | 1.00th=[ 190], 5.00th=[ 196], 10.00th=[ 200], 20.00th=[ 212], 00:19:13.224 | 30.00th=[ 219], 40.00th=[ 225], 50.00th=[ 231], 60.00th=[ 247], 00:19:13.224 | 70.00th=[ 265], 80.00th=[ 293], 90.00th=[ 347], 95.00th=[ 375], 00:19:13.224 | 99.00th=[ 424], 99.50th=[ 437], 99.90th=[ 449], 99.95th=[ 453], 00:19:13.224 | 99.99th=[ 453] 00:19:13.224 bw ( KiB/s): min= 4280, max= 8008, per=36.96%, avg=6144.00, stdev=2636.09, samples=2 00:19:13.224 iops : min= 1070, max= 2002, avg=1536.00, stdev=659.02, samples=2 00:19:13.225 lat (usec) : 250=32.08%, 500=66.96%, 750=0.95% 00:19:13.225 cpu : usr=4.10%, sys=7.09%, ctx=2935, majf=0, minf=1 00:19:13.225 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:13.225 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:13.225 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:13.225 issued rwts: total=1397,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:13.225 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:13.225 00:19:13.225 Run status group 0 (all jobs): 00:19:13.225 READ: bw=12.5MiB/s (13.1MB/s), 160KiB/s-6138KiB/s (164kB/s-6285kB/s), io=12.5MiB (13.1MB), run=1001-1002msec 00:19:13.225 WRITE: bw=16.2MiB/s (17.0MB/s), 2046KiB/s-6410KiB/s (2095kB/s-6563kB/s), io=16.3MiB (17.1MB), run=1001-1002msec 00:19:13.225 00:19:13.225 Disk stats (read/write): 00:19:13.225 nvme0n1: ios=1291/1536, merge=0/0, ticks=523/285, in_queue=808, util=86.57% 00:19:13.225 nvme0n2: ios=39/512, merge=0/0, ticks=1598/121, in_queue=1719, util=89.62% 00:19:13.225 nvme0n3: ios=72/512, merge=0/0, ticks=793/147, in_queue=940, util=94.67% 00:19:13.225 nvme0n4: ios=1104/1536, merge=0/0, ticks=587/366, in_queue=953, util=95.37% 00:19:13.225 10:05:18 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:19:13.225 [global] 00:19:13.225 thread=1 00:19:13.225 invalidate=1 00:19:13.225 rw=randwrite 00:19:13.225 time_based=1 00:19:13.225 runtime=1 00:19:13.225 ioengine=libaio 00:19:13.225 direct=1 00:19:13.225 bs=4096 00:19:13.225 iodepth=1 00:19:13.225 norandommap=0 00:19:13.225 numjobs=1 00:19:13.225 00:19:13.225 verify_dump=1 00:19:13.225 verify_backlog=512 00:19:13.225 verify_state_save=0 00:19:13.225 do_verify=1 00:19:13.225 verify=crc32c-intel 00:19:13.225 [job0] 00:19:13.225 filename=/dev/nvme0n1 00:19:13.225 [job1] 00:19:13.225 filename=/dev/nvme0n2 00:19:13.225 [job2] 00:19:13.225 filename=/dev/nvme0n3 00:19:13.225 [job3] 00:19:13.225 filename=/dev/nvme0n4 00:19:13.225 Could not set queue depth (nvme0n1) 00:19:13.225 Could not set queue depth (nvme0n2) 00:19:13.225 Could not set queue depth (nvme0n3) 00:19:13.225 Could not set queue depth (nvme0n4) 00:19:13.225 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:13.225 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:13.225 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:13.225 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:13.225 fio-3.35 00:19:13.225 Starting 4 threads 00:19:14.597 00:19:14.597 job0: (groupid=0, jobs=1): err= 0: pid=2827598: Sat Jul 13 10:05:20 2024 00:19:14.597 read: IOPS=20, BW=83.2KiB/s (85.2kB/s)(84.0KiB/1009msec) 00:19:14.597 slat (nsec): min=12486, max=32610, avg=28524.10, stdev=6942.04 00:19:14.597 clat (usec): min=40908, max=42010, avg=41647.90, stdev=462.43 00:19:14.597 lat (usec): min=40940, max=42042, avg=41676.43, stdev=465.91 00:19:14.597 clat percentiles (usec): 00:19:14.597 | 1.00th=[41157], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:19:14.597 | 30.00th=[41157], 40.00th=[41681], 50.00th=[42206], 60.00th=[42206], 00:19:14.597 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:19:14.597 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:14.597 | 99.99th=[42206] 00:19:14.597 write: IOPS=507, BW=2030KiB/s (2078kB/s)(2048KiB/1009msec); 0 zone resets 00:19:14.597 slat (nsec): min=6404, max=46396, avg=10513.09, stdev=5117.96 00:19:14.597 clat (usec): min=177, max=2020, avg=240.94, stdev=90.61 00:19:14.597 lat (usec): min=184, max=2038, avg=251.46, stdev=91.65 00:19:14.597 clat percentiles (usec): 00:19:14.597 | 1.00th=[ 190], 5.00th=[ 196], 10.00th=[ 202], 20.00th=[ 208], 00:19:14.597 | 30.00th=[ 215], 40.00th=[ 223], 50.00th=[ 227], 60.00th=[ 233], 00:19:14.597 | 70.00th=[ 241], 80.00th=[ 251], 90.00th=[ 285], 95.00th=[ 338], 00:19:14.597 | 99.00th=[ 408], 99.50th=[ 465], 99.90th=[ 2024], 99.95th=[ 2024], 00:19:14.597 | 99.99th=[ 2024] 00:19:14.597 bw ( KiB/s): min= 4096, max= 4096, per=50.95%, avg=4096.00, stdev= 0.00, samples=1 00:19:14.597 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:14.597 lat (usec) : 250=75.61%, 500=20.08%, 750=0.19% 00:19:14.597 lat (msec) : 4=0.19%, 50=3.94% 00:19:14.597 cpu : usr=0.00%, sys=0.89%, ctx=534, majf=0, minf=1 00:19:14.597 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:14.597 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:14.597 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:14.597 issued rwts: total=21,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:14.597 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:14.597 job1: (groupid=0, jobs=1): err= 0: pid=2827599: Sat Jul 13 10:05:20 2024 00:19:14.597 read: IOPS=60, BW=242KiB/s (248kB/s)(244KiB/1009msec) 00:19:14.597 slat (nsec): min=4674, max=37261, avg=18819.67, stdev=10592.96 00:19:14.597 clat (usec): min=265, max=41225, avg=14324.39, stdev=19464.36 00:19:14.597 lat (usec): min=273, max=41233, avg=14343.21, stdev=19470.46 00:19:14.597 clat percentiles (usec): 00:19:14.597 | 1.00th=[ 265], 5.00th=[ 269], 10.00th=[ 273], 20.00th=[ 285], 00:19:14.597 | 30.00th=[ 297], 40.00th=[ 338], 50.00th=[ 363], 60.00th=[ 494], 00:19:14.597 | 70.00th=[40633], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:19:14.598 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:14.598 | 99.99th=[41157] 00:19:14.598 write: IOPS=507, BW=2030KiB/s (2078kB/s)(2048KiB/1009msec); 0 zone resets 00:19:14.598 slat (nsec): min=6470, max=55320, avg=11064.39, stdev=6689.74 00:19:14.598 clat (usec): min=178, max=523, avg=245.90, stdev=58.13 00:19:14.598 lat (usec): min=185, max=532, avg=256.96, stdev=61.03 00:19:14.598 clat percentiles (usec): 00:19:14.598 | 1.00th=[ 188], 5.00th=[ 196], 10.00th=[ 202], 20.00th=[ 208], 00:19:14.598 | 30.00th=[ 217], 40.00th=[ 221], 50.00th=[ 227], 60.00th=[ 235], 00:19:14.598 | 70.00th=[ 245], 80.00th=[ 265], 90.00th=[ 334], 95.00th=[ 388], 00:19:14.598 | 99.00th=[ 441], 99.50th=[ 478], 99.90th=[ 523], 99.95th=[ 523], 00:19:14.598 | 99.99th=[ 523] 00:19:14.598 bw ( KiB/s): min= 4096, max= 4096, per=50.95%, avg=4096.00, stdev= 0.00, samples=1 00:19:14.598 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:14.598 lat (usec) : 250=67.36%, 500=28.27%, 750=0.70% 00:19:14.598 lat (msec) : 50=3.66% 00:19:14.598 cpu : usr=0.10%, sys=0.89%, ctx=575, majf=0, minf=1 00:19:14.598 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:14.598 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:14.598 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:14.598 issued rwts: total=61,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:14.598 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:14.598 job2: (groupid=0, jobs=1): err= 0: pid=2827600: Sat Jul 13 10:05:20 2024 00:19:14.598 read: IOPS=457, BW=1829KiB/s (1873kB/s)(1864KiB/1019msec) 00:19:14.598 slat (nsec): min=5796, max=45874, avg=15419.88, stdev=8640.67 00:19:14.598 clat (usec): min=264, max=41971, avg=1892.06, stdev=7849.97 00:19:14.598 lat (usec): min=274, max=42006, avg=1907.48, stdev=7853.78 00:19:14.598 clat percentiles (usec): 00:19:14.598 | 1.00th=[ 269], 5.00th=[ 281], 10.00th=[ 293], 20.00th=[ 302], 00:19:14.598 | 30.00th=[ 310], 40.00th=[ 314], 50.00th=[ 318], 60.00th=[ 322], 00:19:14.598 | 70.00th=[ 326], 80.00th=[ 334], 90.00th=[ 363], 95.00th=[ 437], 00:19:14.598 | 99.00th=[41157], 99.50th=[41157], 99.90th=[42206], 99.95th=[42206], 00:19:14.598 | 99.99th=[42206] 00:19:14.598 write: IOPS=502, BW=2010KiB/s (2058kB/s)(2048KiB/1019msec); 0 zone resets 00:19:14.598 slat (nsec): min=8020, max=59161, avg=12676.25, stdev=6495.80 00:19:14.598 clat (usec): min=194, max=657, avg=232.47, stdev=31.74 00:19:14.598 lat (usec): min=202, max=666, avg=245.14, stdev=33.07 00:19:14.598 clat percentiles (usec): 00:19:14.598 | 1.00th=[ 198], 5.00th=[ 206], 10.00th=[ 208], 20.00th=[ 215], 00:19:14.598 | 30.00th=[ 219], 40.00th=[ 223], 50.00th=[ 227], 60.00th=[ 233], 00:19:14.598 | 70.00th=[ 237], 80.00th=[ 245], 90.00th=[ 255], 95.00th=[ 269], 00:19:14.598 | 99.00th=[ 343], 99.50th=[ 371], 99.90th=[ 660], 99.95th=[ 660], 00:19:14.598 | 99.99th=[ 660] 00:19:14.598 bw ( KiB/s): min= 4096, max= 4096, per=50.95%, avg=4096.00, stdev= 0.00, samples=1 00:19:14.598 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:14.598 lat (usec) : 250=45.30%, 500=52.66%, 750=0.20% 00:19:14.598 lat (msec) : 50=1.84% 00:19:14.598 cpu : usr=0.79%, sys=1.87%, ctx=979, majf=0, minf=1 00:19:14.598 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:14.598 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:14.598 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:14.598 issued rwts: total=466,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:14.598 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:14.598 job3: (groupid=0, jobs=1): err= 0: pid=2827601: Sat Jul 13 10:05:20 2024 00:19:14.598 read: IOPS=144, BW=579KiB/s (593kB/s)(584KiB/1009msec) 00:19:14.598 slat (nsec): min=5945, max=38541, avg=14867.57, stdev=11580.75 00:19:14.598 clat (usec): min=281, max=41480, avg=5928.66, stdev=14051.84 00:19:14.598 lat (usec): min=290, max=41515, avg=5943.53, stdev=14058.09 00:19:14.598 clat percentiles (usec): 00:19:14.598 | 1.00th=[ 285], 5.00th=[ 297], 10.00th=[ 297], 20.00th=[ 306], 00:19:14.598 | 30.00th=[ 310], 40.00th=[ 314], 50.00th=[ 322], 60.00th=[ 334], 00:19:14.598 | 70.00th=[ 351], 80.00th=[ 529], 90.00th=[41157], 95.00th=[41157], 00:19:14.598 | 99.00th=[41681], 99.50th=[41681], 99.90th=[41681], 99.95th=[41681], 00:19:14.598 | 99.99th=[41681] 00:19:14.598 write: IOPS=507, BW=2030KiB/s (2078kB/s)(2048KiB/1009msec); 0 zone resets 00:19:14.598 slat (nsec): min=8055, max=57006, avg=13025.76, stdev=7173.24 00:19:14.598 clat (usec): min=181, max=444, avg=251.07, stdev=36.21 00:19:14.598 lat (usec): min=190, max=454, avg=264.10, stdev=37.91 00:19:14.598 clat percentiles (usec): 00:19:14.598 | 1.00th=[ 194], 5.00th=[ 210], 10.00th=[ 219], 20.00th=[ 227], 00:19:14.598 | 30.00th=[ 235], 40.00th=[ 239], 50.00th=[ 243], 60.00th=[ 251], 00:19:14.598 | 70.00th=[ 258], 80.00th=[ 269], 90.00th=[ 289], 95.00th=[ 338], 00:19:14.598 | 99.00th=[ 392], 99.50th=[ 400], 99.90th=[ 445], 99.95th=[ 445], 00:19:14.598 | 99.99th=[ 445] 00:19:14.598 bw ( KiB/s): min= 4096, max= 4096, per=50.95%, avg=4096.00, stdev= 0.00, samples=1 00:19:14.598 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:14.598 lat (usec) : 250=46.50%, 500=48.33%, 750=2.13% 00:19:14.598 lat (msec) : 50=3.04% 00:19:14.598 cpu : usr=0.60%, sys=1.09%, ctx=660, majf=0, minf=2 00:19:14.598 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:14.598 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:14.598 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:14.598 issued rwts: total=146,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:14.598 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:14.598 00:19:14.598 Run status group 0 (all jobs): 00:19:14.598 READ: bw=2724KiB/s (2790kB/s), 83.2KiB/s-1829KiB/s (85.2kB/s-1873kB/s), io=2776KiB (2843kB), run=1009-1019msec 00:19:14.598 WRITE: bw=8039KiB/s (8232kB/s), 2010KiB/s-2030KiB/s (2058kB/s-2078kB/s), io=8192KiB (8389kB), run=1009-1019msec 00:19:14.598 00:19:14.598 Disk stats (read/write): 00:19:14.598 nvme0n1: ios=60/512, merge=0/0, ticks=1410/125, in_queue=1535, util=97.70% 00:19:14.598 nvme0n2: ios=81/512, merge=0/0, ticks=1696/124, in_queue=1820, util=98.37% 00:19:14.598 nvme0n3: ios=519/512, merge=0/0, ticks=1786/118, in_queue=1904, util=98.12% 00:19:14.598 nvme0n4: ios=161/512, merge=0/0, ticks=1642/126, in_queue=1768, util=96.11% 00:19:14.598 10:05:20 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:19:14.598 [global] 00:19:14.598 thread=1 00:19:14.598 invalidate=1 00:19:14.598 rw=write 00:19:14.598 time_based=1 00:19:14.598 runtime=1 00:19:14.598 ioengine=libaio 00:19:14.598 direct=1 00:19:14.598 bs=4096 00:19:14.598 iodepth=128 00:19:14.598 norandommap=0 00:19:14.598 numjobs=1 00:19:14.598 00:19:14.598 verify_dump=1 00:19:14.598 verify_backlog=512 00:19:14.598 verify_state_save=0 00:19:14.598 do_verify=1 00:19:14.598 verify=crc32c-intel 00:19:14.598 [job0] 00:19:14.598 filename=/dev/nvme0n1 00:19:14.598 [job1] 00:19:14.598 filename=/dev/nvme0n2 00:19:14.598 [job2] 00:19:14.598 filename=/dev/nvme0n3 00:19:14.598 [job3] 00:19:14.598 filename=/dev/nvme0n4 00:19:14.598 Could not set queue depth (nvme0n1) 00:19:14.598 Could not set queue depth (nvme0n2) 00:19:14.598 Could not set queue depth (nvme0n3) 00:19:14.598 Could not set queue depth (nvme0n4) 00:19:14.598 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:14.598 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:14.598 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:14.598 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:14.598 fio-3.35 00:19:14.598 Starting 4 threads 00:19:15.972 00:19:15.972 job0: (groupid=0, jobs=1): err= 0: pid=2827956: Sat Jul 13 10:05:21 2024 00:19:15.972 read: IOPS=3062, BW=12.0MiB/s (12.5MB/s)(12.0MiB/1003msec) 00:19:15.972 slat (usec): min=2, max=16948, avg=170.64, stdev=1039.63 00:19:15.972 clat (usec): min=2754, max=58959, avg=21238.36, stdev=11596.96 00:19:15.972 lat (usec): min=2775, max=58997, avg=21409.00, stdev=11698.89 00:19:15.972 clat percentiles (usec): 00:19:15.972 | 1.00th=[ 3228], 5.00th=[ 8455], 10.00th=[ 8848], 20.00th=[ 9896], 00:19:15.972 | 30.00th=[11469], 40.00th=[14484], 50.00th=[20317], 60.00th=[23462], 00:19:15.972 | 70.00th=[25560], 80.00th=[31327], 90.00th=[37487], 95.00th=[41681], 00:19:15.972 | 99.00th=[53216], 99.50th=[53216], 99.90th=[55837], 99.95th=[58983], 00:19:15.972 | 99.99th=[58983] 00:19:15.972 write: IOPS=3076, BW=12.0MiB/s (12.6MB/s)(12.1MiB/1003msec); 0 zone resets 00:19:15.972 slat (usec): min=3, max=39263, avg=145.99, stdev=1168.32 00:19:15.972 clat (usec): min=1782, max=52496, avg=17276.21, stdev=7359.80 00:19:15.972 lat (usec): min=4188, max=76403, avg=17422.20, stdev=7496.07 00:19:15.972 clat percentiles (usec): 00:19:15.972 | 1.00th=[ 5735], 5.00th=[ 6456], 10.00th=[ 8160], 20.00th=[10683], 00:19:15.972 | 30.00th=[12125], 40.00th=[14746], 50.00th=[16450], 60.00th=[18744], 00:19:15.972 | 70.00th=[20317], 80.00th=[22938], 90.00th=[27919], 95.00th=[30278], 00:19:15.972 | 99.00th=[38536], 99.50th=[38536], 99.90th=[39584], 99.95th=[44827], 00:19:15.972 | 99.99th=[52691] 00:19:15.972 bw ( KiB/s): min=11792, max=12784, per=19.91%, avg=12288.00, stdev=701.45, samples=2 00:19:15.972 iops : min= 2948, max= 3196, avg=3072.00, stdev=175.36, samples=2 00:19:15.972 lat (msec) : 2=0.02%, 4=0.54%, 10=17.39%, 20=39.77%, 50=40.58% 00:19:15.972 lat (msec) : 100=1.71% 00:19:15.972 cpu : usr=2.79%, sys=5.59%, ctx=225, majf=0, minf=1 00:19:15.972 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:19:15.972 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:15.972 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:15.972 issued rwts: total=3072,3086,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:15.972 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:15.972 job1: (groupid=0, jobs=1): err= 0: pid=2827957: Sat Jul 13 10:05:21 2024 00:19:15.972 read: IOPS=4380, BW=17.1MiB/s (17.9MB/s)(17.1MiB/1001msec) 00:19:15.972 slat (usec): min=3, max=19563, avg=110.82, stdev=702.64 00:19:15.972 clat (usec): min=468, max=44935, avg=14478.55, stdev=6148.29 00:19:15.972 lat (usec): min=2039, max=44950, avg=14589.37, stdev=6196.39 00:19:15.972 clat percentiles (usec): 00:19:15.972 | 1.00th=[ 5473], 5.00th=[ 8455], 10.00th=[ 8848], 20.00th=[ 9372], 00:19:15.972 | 30.00th=[ 9896], 40.00th=[10945], 50.00th=[11863], 60.00th=[15533], 00:19:15.972 | 70.00th=[16909], 80.00th=[18744], 90.00th=[21365], 95.00th=[26870], 00:19:15.972 | 99.00th=[35390], 99.50th=[35390], 99.90th=[35390], 99.95th=[35390], 00:19:15.972 | 99.99th=[44827] 00:19:15.972 write: IOPS=4603, BW=18.0MiB/s (18.9MB/s)(18.0MiB/1001msec); 0 zone resets 00:19:15.972 slat (usec): min=4, max=13956, avg=101.42, stdev=622.98 00:19:15.972 clat (usec): min=4965, max=44595, avg=13722.14, stdev=5368.57 00:19:15.972 lat (usec): min=4975, max=44609, avg=13823.56, stdev=5424.50 00:19:15.972 clat percentiles (usec): 00:19:15.972 | 1.00th=[ 7963], 5.00th=[ 8356], 10.00th=[ 8586], 20.00th=[ 9634], 00:19:15.972 | 30.00th=[10683], 40.00th=[11076], 50.00th=[11994], 60.00th=[12911], 00:19:15.972 | 70.00th=[14353], 80.00th=[17695], 90.00th=[21103], 95.00th=[24511], 00:19:15.972 | 99.00th=[31065], 99.50th=[32637], 99.90th=[34341], 99.95th=[35390], 00:19:15.972 | 99.99th=[44827] 00:19:15.972 bw ( KiB/s): min=14760, max=22104, per=29.86%, avg=18432.00, stdev=5192.99, samples=2 00:19:15.972 iops : min= 3690, max= 5526, avg=4608.00, stdev=1298.25, samples=2 00:19:15.972 lat (usec) : 500=0.01% 00:19:15.972 lat (msec) : 4=0.36%, 10=27.01%, 20=60.14%, 50=12.49% 00:19:15.972 cpu : usr=6.70%, sys=8.70%, ctx=404, majf=0, minf=1 00:19:15.972 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:19:15.972 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:15.972 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:15.972 issued rwts: total=4385,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:15.972 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:15.972 job2: (groupid=0, jobs=1): err= 0: pid=2827958: Sat Jul 13 10:05:21 2024 00:19:15.972 read: IOPS=4071, BW=15.9MiB/s (16.7MB/s)(16.0MiB/1006msec) 00:19:15.972 slat (usec): min=3, max=12256, avg=113.86, stdev=719.45 00:19:15.972 clat (usec): min=5653, max=36149, avg=14690.53, stdev=5184.31 00:19:15.972 lat (usec): min=5673, max=37621, avg=14804.39, stdev=5241.86 00:19:15.972 clat percentiles (usec): 00:19:15.972 | 1.00th=[ 6325], 5.00th=[ 9634], 10.00th=[10683], 20.00th=[11076], 00:19:15.972 | 30.00th=[11600], 40.00th=[12125], 50.00th=[12518], 60.00th=[13304], 00:19:15.972 | 70.00th=[15795], 80.00th=[17695], 90.00th=[23462], 95.00th=[25297], 00:19:15.972 | 99.00th=[30802], 99.50th=[30802], 99.90th=[32637], 99.95th=[33424], 00:19:15.972 | 99.99th=[35914] 00:19:15.972 write: IOPS=4221, BW=16.5MiB/s (17.3MB/s)(16.6MiB/1006msec); 0 zone resets 00:19:15.972 slat (usec): min=4, max=32932, avg=117.50, stdev=814.23 00:19:15.972 clat (usec): min=2224, max=43872, avg=15131.34, stdev=8214.96 00:19:15.972 lat (usec): min=2236, max=43886, avg=15248.84, stdev=8257.47 00:19:15.972 clat percentiles (usec): 00:19:15.972 | 1.00th=[ 5014], 5.00th=[ 7177], 10.00th=[ 7504], 20.00th=[ 9372], 00:19:15.972 | 30.00th=[10290], 40.00th=[11731], 50.00th=[12125], 60.00th=[13304], 00:19:15.972 | 70.00th=[15926], 80.00th=[22152], 90.00th=[27132], 95.00th=[33162], 00:19:15.972 | 99.00th=[41157], 99.50th=[42206], 99.90th=[43779], 99.95th=[43779], 00:19:15.972 | 99.99th=[43779] 00:19:15.972 bw ( KiB/s): min=12480, max=20480, per=26.70%, avg=16480.00, stdev=5656.85, samples=2 00:19:15.972 iops : min= 3120, max= 5120, avg=4120.00, stdev=1414.21, samples=2 00:19:15.972 lat (msec) : 4=0.08%, 10=16.95%, 20=63.65%, 50=19.32% 00:19:15.972 cpu : usr=4.08%, sys=7.56%, ctx=337, majf=0, minf=1 00:19:15.972 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:19:15.972 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:15.972 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:15.972 issued rwts: total=4096,4247,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:15.972 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:15.972 job3: (groupid=0, jobs=1): err= 0: pid=2827959: Sat Jul 13 10:05:21 2024 00:19:15.972 read: IOPS=3530, BW=13.8MiB/s (14.5MB/s)(13.9MiB/1006msec) 00:19:15.972 slat (usec): min=3, max=19818, avg=135.14, stdev=837.54 00:19:15.972 clat (usec): min=2533, max=86292, avg=18247.20, stdev=12371.14 00:19:15.972 lat (usec): min=4359, max=86318, avg=18382.34, stdev=12428.01 00:19:15.972 clat percentiles (usec): 00:19:15.972 | 1.00th=[ 8291], 5.00th=[10421], 10.00th=[11731], 20.00th=[12256], 00:19:15.972 | 30.00th=[12518], 40.00th=[12649], 50.00th=[12780], 60.00th=[13304], 00:19:15.972 | 70.00th=[14877], 80.00th=[23462], 90.00th=[34341], 95.00th=[38011], 00:19:15.972 | 99.00th=[76022], 99.50th=[80217], 99.90th=[81265], 99.95th=[86508], 00:19:15.972 | 99.99th=[86508] 00:19:15.972 write: IOPS=3562, BW=13.9MiB/s (14.6MB/s)(14.0MiB/1006msec); 0 zone resets 00:19:15.972 slat (usec): min=4, max=11907, avg=135.44, stdev=678.61 00:19:15.972 clat (usec): min=3696, max=73233, avg=17377.21, stdev=11486.02 00:19:15.972 lat (usec): min=3704, max=73253, avg=17512.65, stdev=11579.74 00:19:15.972 clat percentiles (usec): 00:19:15.972 | 1.00th=[ 4490], 5.00th=[ 8160], 10.00th=[ 9241], 20.00th=[11076], 00:19:15.972 | 30.00th=[11863], 40.00th=[12256], 50.00th=[12780], 60.00th=[13698], 00:19:15.972 | 70.00th=[16450], 80.00th=[23462], 90.00th=[29230], 95.00th=[42206], 00:19:15.972 | 99.00th=[64226], 99.50th=[65274], 99.90th=[71828], 99.95th=[72877], 00:19:15.972 | 99.99th=[72877] 00:19:15.972 bw ( KiB/s): min= 9344, max=19328, per=23.22%, avg=14336.00, stdev=7059.75, samples=2 00:19:15.972 iops : min= 2336, max= 4832, avg=3584.00, stdev=1764.94, samples=2 00:19:15.972 lat (msec) : 4=0.25%, 10=8.18%, 20=68.68%, 50=19.32%, 100=3.56% 00:19:15.972 cpu : usr=4.68%, sys=7.66%, ctx=362, majf=0, minf=1 00:19:15.972 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:19:15.972 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:15.972 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:15.972 issued rwts: total=3552,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:15.972 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:15.972 00:19:15.972 Run status group 0 (all jobs): 00:19:15.972 READ: bw=58.7MiB/s (61.5MB/s), 12.0MiB/s-17.1MiB/s (12.5MB/s-17.9MB/s), io=59.0MiB (61.9MB), run=1001-1006msec 00:19:15.972 WRITE: bw=60.3MiB/s (63.2MB/s), 12.0MiB/s-18.0MiB/s (12.6MB/s-18.9MB/s), io=60.6MiB (63.6MB), run=1001-1006msec 00:19:15.972 00:19:15.972 Disk stats (read/write): 00:19:15.972 nvme0n1: ios=2100/2126, merge=0/0, ticks=21066/16584, in_queue=37650, util=86.87% 00:19:15.973 nvme0n2: ios=3635/3640, merge=0/0, ticks=24374/21465, in_queue=45839, util=89.43% 00:19:15.973 nvme0n3: ios=3639/3759, merge=0/0, ticks=30040/27295, in_queue=57335, util=93.00% 00:19:15.973 nvme0n4: ios=3094/3399, merge=0/0, ticks=14688/17349, in_queue=32037, util=93.47% 00:19:15.973 10:05:21 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:19:15.973 [global] 00:19:15.973 thread=1 00:19:15.973 invalidate=1 00:19:15.973 rw=randwrite 00:19:15.973 time_based=1 00:19:15.973 runtime=1 00:19:15.973 ioengine=libaio 00:19:15.973 direct=1 00:19:15.973 bs=4096 00:19:15.973 iodepth=128 00:19:15.973 norandommap=0 00:19:15.973 numjobs=1 00:19:15.973 00:19:15.973 verify_dump=1 00:19:15.973 verify_backlog=512 00:19:15.973 verify_state_save=0 00:19:15.973 do_verify=1 00:19:15.973 verify=crc32c-intel 00:19:15.973 [job0] 00:19:15.973 filename=/dev/nvme0n1 00:19:15.973 [job1] 00:19:15.973 filename=/dev/nvme0n2 00:19:15.973 [job2] 00:19:15.973 filename=/dev/nvme0n3 00:19:15.973 [job3] 00:19:15.973 filename=/dev/nvme0n4 00:19:15.973 Could not set queue depth (nvme0n1) 00:19:15.973 Could not set queue depth (nvme0n2) 00:19:15.973 Could not set queue depth (nvme0n3) 00:19:15.973 Could not set queue depth (nvme0n4) 00:19:16.232 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:16.232 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:16.232 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:16.232 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:16.232 fio-3.35 00:19:16.232 Starting 4 threads 00:19:17.606 00:19:17.606 job0: (groupid=0, jobs=1): err= 0: pid=2828185: Sat Jul 13 10:05:23 2024 00:19:17.606 read: IOPS=5620, BW=22.0MiB/s (23.0MB/s)(22.0MiB/1002msec) 00:19:17.606 slat (usec): min=2, max=3185, avg=79.03, stdev=370.41 00:19:17.606 clat (usec): min=7409, max=51330, avg=10673.37, stdev=1700.62 00:19:17.606 lat (usec): min=7440, max=51337, avg=10752.39, stdev=1675.61 00:19:17.606 clat percentiles (usec): 00:19:17.606 | 1.00th=[ 7898], 5.00th=[ 8586], 10.00th=[ 9110], 20.00th=[ 9503], 00:19:17.606 | 30.00th=[ 9896], 40.00th=[10421], 50.00th=[10945], 60.00th=[11207], 00:19:17.606 | 70.00th=[11338], 80.00th=[11600], 90.00th=[11994], 95.00th=[12256], 00:19:17.606 | 99.00th=[13566], 99.50th=[14484], 99.90th=[15926], 99.95th=[51119], 00:19:17.606 | 99.99th=[51119] 00:19:17.606 write: IOPS=6047, BW=23.6MiB/s (24.8MB/s)(23.7MiB/1002msec); 0 zone resets 00:19:17.606 slat (usec): min=4, max=3905, avg=83.02, stdev=395.26 00:19:17.606 clat (usec): min=1433, max=16365, avg=10965.10, stdev=2273.96 00:19:17.606 lat (usec): min=1477, max=16376, avg=11048.13, stdev=2263.83 00:19:17.606 clat percentiles (usec): 00:19:17.606 | 1.00th=[ 5014], 5.00th=[ 7963], 10.00th=[ 8291], 20.00th=[ 8979], 00:19:17.606 | 30.00th=[ 9634], 40.00th=[10290], 50.00th=[10945], 60.00th=[11338], 00:19:17.606 | 70.00th=[11731], 80.00th=[12649], 90.00th=[14877], 95.00th=[15270], 00:19:17.606 | 99.00th=[15664], 99.50th=[15795], 99.90th=[16319], 99.95th=[16319], 00:19:17.606 | 99.99th=[16319] 00:19:17.606 bw ( KiB/s): min=23152, max=24304, per=38.98%, avg=23728.00, stdev=814.59, samples=2 00:19:17.606 iops : min= 5788, max= 6078, avg=5933.00, stdev=205.06, samples=2 00:19:17.606 lat (msec) : 2=0.02%, 4=0.29%, 10=33.19%, 20=66.46%, 100=0.04% 00:19:17.607 cpu : usr=8.39%, sys=8.29%, ctx=577, majf=0, minf=1 00:19:17.607 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:19:17.607 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:17.607 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:17.607 issued rwts: total=5632,6060,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:17.607 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:17.607 job1: (groupid=0, jobs=1): err= 0: pid=2828186: Sat Jul 13 10:05:23 2024 00:19:17.607 read: IOPS=2037, BW=8151KiB/s (8347kB/s)(8192KiB/1005msec) 00:19:17.607 slat (usec): min=3, max=16922, avg=147.46, stdev=837.58 00:19:17.607 clat (usec): min=10272, max=44704, avg=17931.17, stdev=5343.80 00:19:17.607 lat (usec): min=10279, max=44744, avg=18078.63, stdev=5418.29 00:19:17.607 clat percentiles (usec): 00:19:17.607 | 1.00th=[11731], 5.00th=[14222], 10.00th=[14484], 20.00th=[14746], 00:19:17.607 | 30.00th=[14877], 40.00th=[15139], 50.00th=[15533], 60.00th=[16057], 00:19:17.607 | 70.00th=[17957], 80.00th=[20055], 90.00th=[27657], 95.00th=[31851], 00:19:17.607 | 99.00th=[34341], 99.50th=[34341], 99.90th=[34866], 99.95th=[41157], 00:19:17.607 | 99.99th=[44827] 00:19:17.607 write: IOPS=2463, BW=9855KiB/s (10.1MB/s)(9904KiB/1005msec); 0 zone resets 00:19:17.607 slat (usec): min=4, max=23723, avg=273.99, stdev=1395.89 00:19:17.607 clat (usec): min=1713, max=102423, avg=36292.92, stdev=20013.09 00:19:17.607 lat (msec): min=12, max=102, avg=36.57, stdev=20.14 00:19:17.607 clat percentiles (msec): 00:19:17.607 | 1.00th=[ 13], 5.00th=[ 15], 10.00th=[ 15], 20.00th=[ 22], 00:19:17.607 | 30.00th=[ 24], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 34], 00:19:17.607 | 70.00th=[ 44], 80.00th=[ 54], 90.00th=[ 63], 95.00th=[ 84], 00:19:17.607 | 99.00th=[ 96], 99.50th=[ 97], 99.90th=[ 103], 99.95th=[ 103], 00:19:17.607 | 99.99th=[ 103] 00:19:17.607 bw ( KiB/s): min= 8808, max= 9976, per=15.43%, avg=9392.00, stdev=825.90, samples=2 00:19:17.607 iops : min= 2202, max= 2494, avg=2348.00, stdev=206.48, samples=2 00:19:17.607 lat (msec) : 2=0.02%, 20=46.44%, 50=41.27%, 100=12.11%, 250=0.15% 00:19:17.607 cpu : usr=2.19%, sys=5.18%, ctx=301, majf=0, minf=1 00:19:17.607 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:19:17.607 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:17.607 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:17.607 issued rwts: total=2048,2476,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:17.607 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:17.607 job2: (groupid=0, jobs=1): err= 0: pid=2828187: Sat Jul 13 10:05:23 2024 00:19:17.607 read: IOPS=2527, BW=9.87MiB/s (10.4MB/s)(10.0MiB/1013msec) 00:19:17.607 slat (usec): min=2, max=16586, avg=145.79, stdev=919.69 00:19:17.607 clat (usec): min=5781, max=51757, avg=16571.87, stdev=7274.81 00:19:17.607 lat (usec): min=5788, max=51774, avg=16717.66, stdev=7348.84 00:19:17.607 clat percentiles (usec): 00:19:17.607 | 1.00th=[ 8094], 5.00th=[10028], 10.00th=[10683], 20.00th=[11469], 00:19:17.607 | 30.00th=[12387], 40.00th=[12911], 50.00th=[13698], 60.00th=[16319], 00:19:17.607 | 70.00th=[16712], 80.00th=[19268], 90.00th=[27132], 95.00th=[32113], 00:19:17.607 | 99.00th=[44827], 99.50th=[47973], 99.90th=[51643], 99.95th=[51643], 00:19:17.607 | 99.99th=[51643] 00:19:17.607 write: IOPS=2746, BW=10.7MiB/s (11.2MB/s)(10.9MiB/1013msec); 0 zone resets 00:19:17.607 slat (usec): min=4, max=15131, avg=216.76, stdev=969.75 00:19:17.607 clat (msec): min=2, max=102, avg=30.90, stdev=17.39 00:19:17.607 lat (msec): min=2, max=102, avg=31.12, stdev=17.49 00:19:17.607 clat percentiles (msec): 00:19:17.607 | 1.00th=[ 6], 5.00th=[ 9], 10.00th=[ 12], 20.00th=[ 17], 00:19:17.607 | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 28], 60.00th=[ 33], 00:19:17.607 | 70.00th=[ 37], 80.00th=[ 42], 90.00th=[ 53], 95.00th=[ 59], 00:19:17.607 | 99.00th=[ 96], 99.50th=[ 97], 99.90th=[ 103], 99.95th=[ 103], 00:19:17.607 | 99.99th=[ 103] 00:19:17.607 bw ( KiB/s): min= 8640, max=12592, per=17.44%, avg=10616.00, stdev=2794.49, samples=2 00:19:17.607 iops : min= 2160, max= 3148, avg=2654.00, stdev=698.62, samples=2 00:19:17.607 lat (msec) : 4=0.11%, 10=5.04%, 20=47.85%, 50=41.26%, 100=5.62% 00:19:17.607 lat (msec) : 250=0.13% 00:19:17.607 cpu : usr=3.16%, sys=5.34%, ctx=334, majf=0, minf=1 00:19:17.607 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:19:17.607 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:17.607 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:17.607 issued rwts: total=2560,2782,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:17.607 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:17.607 job3: (groupid=0, jobs=1): err= 0: pid=2828188: Sat Jul 13 10:05:23 2024 00:19:17.607 read: IOPS=3687, BW=14.4MiB/s (15.1MB/s)(14.5MiB/1006msec) 00:19:17.607 slat (usec): min=2, max=18602, avg=120.43, stdev=802.54 00:19:17.607 clat (usec): min=3207, max=80107, avg=13928.73, stdev=7800.25 00:19:17.607 lat (usec): min=5465, max=80116, avg=14049.16, stdev=7893.66 00:19:17.607 clat percentiles (usec): 00:19:17.607 | 1.00th=[ 6259], 5.00th=[ 8094], 10.00th=[ 9241], 20.00th=[10290], 00:19:17.607 | 30.00th=[11469], 40.00th=[11863], 50.00th=[12125], 60.00th=[12780], 00:19:17.607 | 70.00th=[13304], 80.00th=[14746], 90.00th=[18744], 95.00th=[25560], 00:19:17.607 | 99.00th=[51643], 99.50th=[66847], 99.90th=[80217], 99.95th=[80217], 00:19:17.607 | 99.99th=[80217] 00:19:17.607 write: IOPS=4071, BW=15.9MiB/s (16.7MB/s)(16.0MiB/1006msec); 0 zone resets 00:19:17.607 slat (usec): min=3, max=12666, avg=129.44, stdev=724.48 00:19:17.607 clat (usec): min=2819, max=81601, avg=18483.43, stdev=14977.07 00:19:17.607 lat (usec): min=2823, max=81609, avg=18612.87, stdev=15066.68 00:19:17.607 clat percentiles (usec): 00:19:17.607 | 1.00th=[ 5080], 5.00th=[ 7177], 10.00th=[ 8160], 20.00th=[11469], 00:19:17.607 | 30.00th=[11863], 40.00th=[12387], 50.00th=[12649], 60.00th=[12911], 00:19:17.607 | 70.00th=[13829], 80.00th=[20841], 90.00th=[42206], 95.00th=[55837], 00:19:17.607 | 99.00th=[76022], 99.50th=[77071], 99.90th=[81265], 99.95th=[81265], 00:19:17.607 | 99.99th=[81265] 00:19:17.607 bw ( KiB/s): min=12272, max=20521, per=26.94%, avg=16396.50, stdev=5832.92, samples=2 00:19:17.607 iops : min= 3068, max= 5130, avg=4099.00, stdev=1458.05, samples=2 00:19:17.607 lat (msec) : 4=0.17%, 10=14.36%, 20=70.51%, 50=11.13%, 100=3.83% 00:19:17.607 cpu : usr=1.79%, sys=4.98%, ctx=353, majf=0, minf=1 00:19:17.607 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:19:17.607 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:17.607 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:17.607 issued rwts: total=3710,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:17.607 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:17.607 00:19:17.607 Run status group 0 (all jobs): 00:19:17.607 READ: bw=53.8MiB/s (56.4MB/s), 8151KiB/s-22.0MiB/s (8347kB/s-23.0MB/s), io=54.5MiB (57.1MB), run=1002-1013msec 00:19:17.607 WRITE: bw=59.4MiB/s (62.3MB/s), 9855KiB/s-23.6MiB/s (10.1MB/s-24.8MB/s), io=60.2MiB (63.1MB), run=1002-1013msec 00:19:17.607 00:19:17.607 Disk stats (read/write): 00:19:17.607 nvme0n1: ios=4653/5113, merge=0/0, ticks=12990/13508, in_queue=26498, util=98.70% 00:19:17.607 nvme0n2: ios=1558/2023, merge=0/0, ticks=12379/40275, in_queue=52654, util=87.09% 00:19:17.607 nvme0n3: ios=2073/2415, merge=0/0, ticks=32667/72445, in_queue=105112, util=97.91% 00:19:17.607 nvme0n4: ios=3584/3791, merge=0/0, ticks=31502/43228, in_queue=74730, util=89.68% 00:19:17.607 10:05:23 -- target/fio.sh@55 -- # sync 00:19:17.607 10:05:23 -- target/fio.sh@59 -- # fio_pid=2828334 00:19:17.607 10:05:23 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:19:17.607 10:05:23 -- target/fio.sh@61 -- # sleep 3 00:19:17.607 [global] 00:19:17.607 thread=1 00:19:17.607 invalidate=1 00:19:17.607 rw=read 00:19:17.607 time_based=1 00:19:17.607 runtime=10 00:19:17.607 ioengine=libaio 00:19:17.607 direct=1 00:19:17.607 bs=4096 00:19:17.607 iodepth=1 00:19:17.607 norandommap=1 00:19:17.607 numjobs=1 00:19:17.607 00:19:17.607 [job0] 00:19:17.607 filename=/dev/nvme0n1 00:19:17.607 [job1] 00:19:17.607 filename=/dev/nvme0n2 00:19:17.607 [job2] 00:19:17.607 filename=/dev/nvme0n3 00:19:17.607 [job3] 00:19:17.607 filename=/dev/nvme0n4 00:19:17.607 Could not set queue depth (nvme0n1) 00:19:17.607 Could not set queue depth (nvme0n2) 00:19:17.607 Could not set queue depth (nvme0n3) 00:19:17.607 Could not set queue depth (nvme0n4) 00:19:17.607 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:17.607 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:17.607 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:17.607 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:17.607 fio-3.35 00:19:17.607 Starting 4 threads 00:19:20.887 10:05:26 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:19:20.887 10:05:26 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:19:20.887 fio: io_u error on file /dev/nvme0n4: Remote I/O error: read offset=26984448, buflen=4096 00:19:20.887 fio: pid=2828425, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:19:20.887 10:05:26 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:20.887 10:05:26 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:19:20.887 fio: io_u error on file /dev/nvme0n3: Remote I/O error: read offset=1683456, buflen=4096 00:19:20.887 fio: pid=2828424, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:19:21.144 10:05:26 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:21.144 10:05:26 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:19:21.144 fio: io_u error on file /dev/nvme0n1: Remote I/O error: read offset=20881408, buflen=4096 00:19:21.144 fio: pid=2828422, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:19:21.402 fio: io_u error on file /dev/nvme0n2: Remote I/O error: read offset=27648000, buflen=4096 00:19:21.402 fio: pid=2828423, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:19:21.402 10:05:27 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:21.402 10:05:27 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:19:21.402 00:19:21.402 job0: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=2828422: Sat Jul 13 10:05:27 2024 00:19:21.402 read: IOPS=1500, BW=6001KiB/s (6145kB/s)(19.9MiB/3398msec) 00:19:21.402 slat (usec): min=4, max=17812, avg=18.43, stdev=308.28 00:19:21.402 clat (usec): min=249, max=45907, avg=639.29, stdev=3298.42 00:19:21.402 lat (usec): min=254, max=58954, avg=657.73, stdev=3386.35 00:19:21.402 clat percentiles (usec): 00:19:21.402 | 1.00th=[ 265], 5.00th=[ 281], 10.00th=[ 293], 20.00th=[ 306], 00:19:21.402 | 30.00th=[ 318], 40.00th=[ 330], 50.00th=[ 363], 60.00th=[ 375], 00:19:21.402 | 70.00th=[ 388], 80.00th=[ 420], 90.00th=[ 482], 95.00th=[ 519], 00:19:21.402 | 99.00th=[ 676], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:21.402 | 99.99th=[45876] 00:19:21.402 bw ( KiB/s): min= 96, max=10736, per=32.65%, avg=6785.33, stdev=4216.66, samples=6 00:19:21.402 iops : min= 24, max= 2684, avg=1696.33, stdev=1054.16, samples=6 00:19:21.402 lat (usec) : 250=0.02%, 500=92.76%, 750=6.31%, 1000=0.12% 00:19:21.402 lat (msec) : 2=0.10%, 50=0.67% 00:19:21.402 cpu : usr=0.56%, sys=2.97%, ctx=5103, majf=0, minf=1 00:19:21.402 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:21.402 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:21.402 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:21.402 issued rwts: total=5099,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:21.402 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:21.402 job1: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=2828423: Sat Jul 13 10:05:27 2024 00:19:21.402 read: IOPS=1860, BW=7442KiB/s (7621kB/s)(26.4MiB/3628msec) 00:19:21.402 slat (usec): min=4, max=11600, avg=23.73, stdev=281.39 00:19:21.402 clat (usec): min=242, max=41236, avg=506.72, stdev=2420.19 00:19:21.402 lat (usec): min=247, max=41249, avg=529.33, stdev=2434.43 00:19:21.402 clat percentiles (usec): 00:19:21.402 | 1.00th=[ 262], 5.00th=[ 277], 10.00th=[ 285], 20.00th=[ 306], 00:19:21.402 | 30.00th=[ 322], 40.00th=[ 338], 50.00th=[ 359], 60.00th=[ 379], 00:19:21.402 | 70.00th=[ 388], 80.00th=[ 404], 90.00th=[ 441], 95.00th=[ 486], 00:19:21.402 | 99.00th=[ 578], 99.50th=[ 938], 99.90th=[41157], 99.95th=[41157], 00:19:21.402 | 99.99th=[41157] 00:19:21.402 bw ( KiB/s): min= 976, max=10840, per=35.98%, avg=7477.00, stdev=3515.70, samples=7 00:19:21.402 iops : min= 244, max= 2710, avg=1869.14, stdev=878.90, samples=7 00:19:21.402 lat (usec) : 250=0.19%, 500=95.94%, 750=3.33%, 1000=0.03% 00:19:21.402 lat (msec) : 2=0.13%, 50=0.36% 00:19:21.402 cpu : usr=1.24%, sys=3.34%, ctx=6757, majf=0, minf=1 00:19:21.402 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:21.402 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:21.402 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:21.402 issued rwts: total=6751,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:21.402 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:21.402 job2: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=2828424: Sat Jul 13 10:05:27 2024 00:19:21.402 read: IOPS=132, BW=529KiB/s (541kB/s)(1644KiB/3110msec) 00:19:21.402 slat (usec): min=5, max=108, avg=11.58, stdev= 9.08 00:19:21.402 clat (usec): min=268, max=43846, avg=7496.36, stdev=15545.01 00:19:21.402 lat (usec): min=274, max=43860, avg=7507.87, stdev=15548.51 00:19:21.402 clat percentiles (usec): 00:19:21.402 | 1.00th=[ 281], 5.00th=[ 293], 10.00th=[ 306], 20.00th=[ 314], 00:19:21.402 | 30.00th=[ 322], 40.00th=[ 330], 50.00th=[ 334], 60.00th=[ 347], 00:19:21.402 | 70.00th=[ 371], 80.00th=[ 469], 90.00th=[41157], 95.00th=[41157], 00:19:21.402 | 99.00th=[42206], 99.50th=[42206], 99.90th=[43779], 99.95th=[43779], 00:19:21.402 | 99.99th=[43779] 00:19:21.402 bw ( KiB/s): min= 96, max= 2488, per=2.62%, avg=544.00, stdev=958.75, samples=6 00:19:21.402 iops : min= 24, max= 622, avg=136.00, stdev=239.69, samples=6 00:19:21.402 lat (usec) : 500=80.10%, 750=1.94%, 1000=0.24% 00:19:21.402 lat (msec) : 50=17.48% 00:19:21.402 cpu : usr=0.06%, sys=0.23%, ctx=413, majf=0, minf=1 00:19:21.402 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:21.402 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:21.402 complete : 0=0.2%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:21.402 issued rwts: total=412,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:21.402 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:21.402 job3: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=2828425: Sat Jul 13 10:05:27 2024 00:19:21.402 read: IOPS=2299, BW=9198KiB/s (9419kB/s)(25.7MiB/2865msec) 00:19:21.402 slat (nsec): min=4556, max=72836, avg=13411.19, stdev=8249.92 00:19:21.402 clat (usec): min=265, max=41101, avg=414.80, stdev=1241.79 00:19:21.402 lat (usec): min=272, max=41109, avg=428.21, stdev=1241.89 00:19:21.402 clat percentiles (usec): 00:19:21.402 | 1.00th=[ 293], 5.00th=[ 306], 10.00th=[ 314], 20.00th=[ 326], 00:19:21.402 | 30.00th=[ 338], 40.00th=[ 351], 50.00th=[ 363], 60.00th=[ 375], 00:19:21.402 | 70.00th=[ 388], 80.00th=[ 408], 90.00th=[ 469], 95.00th=[ 506], 00:19:21.402 | 99.00th=[ 578], 99.50th=[ 619], 99.90th=[16581], 99.95th=[41157], 00:19:21.402 | 99.99th=[41157] 00:19:21.402 bw ( KiB/s): min= 5936, max=11104, per=43.40%, avg=9019.20, stdev=2061.03, samples=5 00:19:21.402 iops : min= 1484, max= 2776, avg=2254.80, stdev=515.26, samples=5 00:19:21.402 lat (usec) : 500=94.34%, 750=5.40%, 1000=0.08% 00:19:21.402 lat (msec) : 2=0.06%, 20=0.02%, 50=0.09% 00:19:21.402 cpu : usr=1.71%, sys=4.16%, ctx=6590, majf=0, minf=1 00:19:21.402 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:21.402 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:21.402 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:21.402 issued rwts: total=6589,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:21.402 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:21.402 00:19:21.402 Run status group 0 (all jobs): 00:19:21.402 READ: bw=20.3MiB/s (21.3MB/s), 529KiB/s-9198KiB/s (541kB/s-9419kB/s), io=73.6MiB (77.2MB), run=2865-3628msec 00:19:21.402 00:19:21.402 Disk stats (read/write): 00:19:21.402 nvme0n1: ios=5137/0, merge=0/0, ticks=3949/0, in_queue=3949, util=98.37% 00:19:21.402 nvme0n2: ios=6750/0, merge=0/0, ticks=3349/0, in_queue=3349, util=95.20% 00:19:21.402 nvme0n3: ios=412/0, merge=0/0, ticks=3091/0, in_queue=3091, util=96.57% 00:19:21.402 nvme0n4: ios=6636/0, merge=0/0, ticks=4032/0, in_queue=4032, util=99.05% 00:19:21.678 10:05:27 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:21.678 10:05:27 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:19:21.938 10:05:27 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:21.938 10:05:27 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:19:22.240 10:05:27 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:22.240 10:05:27 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:19:22.240 10:05:28 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:22.240 10:05:28 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:19:22.498 10:05:28 -- target/fio.sh@69 -- # fio_status=0 00:19:22.498 10:05:28 -- target/fio.sh@70 -- # wait 2828334 00:19:22.498 10:05:28 -- target/fio.sh@70 -- # fio_status=4 00:19:22.498 10:05:28 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:22.754 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:19:22.754 10:05:28 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:19:22.754 10:05:28 -- common/autotest_common.sh@1198 -- # local i=0 00:19:22.754 10:05:28 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:19:22.754 10:05:28 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:22.754 10:05:28 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:19:22.754 10:05:28 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:22.754 10:05:28 -- common/autotest_common.sh@1210 -- # return 0 00:19:22.754 10:05:28 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:19:22.754 10:05:28 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:19:22.754 nvmf hotplug test: fio failed as expected 00:19:22.754 10:05:28 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:23.011 10:05:28 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:19:23.011 10:05:28 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:19:23.011 10:05:28 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:19:23.011 10:05:28 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:19:23.011 10:05:28 -- target/fio.sh@91 -- # nvmftestfini 00:19:23.011 10:05:28 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:23.011 10:05:28 -- nvmf/common.sh@116 -- # sync 00:19:23.011 10:05:28 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:23.011 10:05:28 -- nvmf/common.sh@119 -- # set +e 00:19:23.011 10:05:28 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:23.011 10:05:28 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:23.011 rmmod nvme_tcp 00:19:23.011 rmmod nvme_fabrics 00:19:23.011 rmmod nvme_keyring 00:19:23.011 10:05:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:23.011 10:05:28 -- nvmf/common.sh@123 -- # set -e 00:19:23.011 10:05:28 -- nvmf/common.sh@124 -- # return 0 00:19:23.011 10:05:28 -- nvmf/common.sh@477 -- # '[' -n 2826249 ']' 00:19:23.011 10:05:28 -- nvmf/common.sh@478 -- # killprocess 2826249 00:19:23.011 10:05:28 -- common/autotest_common.sh@926 -- # '[' -z 2826249 ']' 00:19:23.011 10:05:28 -- common/autotest_common.sh@930 -- # kill -0 2826249 00:19:23.011 10:05:28 -- common/autotest_common.sh@931 -- # uname 00:19:23.011 10:05:28 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:19:23.011 10:05:28 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2826249 00:19:23.011 10:05:28 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:19:23.011 10:05:28 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:19:23.011 10:05:28 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2826249' 00:19:23.011 killing process with pid 2826249 00:19:23.011 10:05:28 -- common/autotest_common.sh@945 -- # kill 2826249 00:19:23.011 10:05:28 -- common/autotest_common.sh@950 -- # wait 2826249 00:19:23.269 10:05:28 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:23.269 10:05:28 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:23.269 10:05:28 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:23.269 10:05:28 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:23.269 10:05:28 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:23.269 10:05:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:23.269 10:05:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:23.269 10:05:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:25.797 10:05:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:25.797 00:19:25.797 real 0m23.701s 00:19:25.797 user 1m22.663s 00:19:25.797 sys 0m6.790s 00:19:25.797 10:05:31 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:19:25.797 10:05:31 -- common/autotest_common.sh@10 -- # set +x 00:19:25.797 ************************************ 00:19:25.797 END TEST nvmf_fio_target 00:19:25.797 ************************************ 00:19:25.797 10:05:31 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:19:25.797 10:05:31 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:19:25.797 10:05:31 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:19:25.797 10:05:31 -- common/autotest_common.sh@10 -- # set +x 00:19:25.797 ************************************ 00:19:25.797 START TEST nvmf_bdevio 00:19:25.797 ************************************ 00:19:25.797 10:05:31 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:19:25.797 * Looking for test storage... 00:19:25.797 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:25.797 10:05:31 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:25.797 10:05:31 -- nvmf/common.sh@7 -- # uname -s 00:19:25.798 10:05:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:25.798 10:05:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:25.798 10:05:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:25.798 10:05:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:25.798 10:05:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:25.798 10:05:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:25.798 10:05:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:25.798 10:05:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:25.798 10:05:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:25.798 10:05:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:25.798 10:05:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:25.798 10:05:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:25.798 10:05:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:25.798 10:05:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:25.798 10:05:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:25.798 10:05:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:25.798 10:05:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:25.798 10:05:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:25.798 10:05:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:25.798 10:05:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:25.798 10:05:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:25.798 10:05:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:25.798 10:05:31 -- paths/export.sh@5 -- # export PATH 00:19:25.798 10:05:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:25.798 10:05:31 -- nvmf/common.sh@46 -- # : 0 00:19:25.798 10:05:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:25.798 10:05:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:25.798 10:05:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:25.798 10:05:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:25.798 10:05:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:25.798 10:05:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:25.798 10:05:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:25.798 10:05:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:25.798 10:05:31 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:25.798 10:05:31 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:25.798 10:05:31 -- target/bdevio.sh@14 -- # nvmftestinit 00:19:25.798 10:05:31 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:25.798 10:05:31 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:25.798 10:05:31 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:25.798 10:05:31 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:25.798 10:05:31 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:25.798 10:05:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:25.798 10:05:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:25.798 10:05:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:25.798 10:05:31 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:25.798 10:05:31 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:25.798 10:05:31 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:25.798 10:05:31 -- common/autotest_common.sh@10 -- # set +x 00:19:27.182 10:05:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:27.182 10:05:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:27.182 10:05:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:27.182 10:05:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:27.182 10:05:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:27.182 10:05:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:27.182 10:05:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:27.182 10:05:32 -- nvmf/common.sh@294 -- # net_devs=() 00:19:27.182 10:05:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:27.182 10:05:32 -- nvmf/common.sh@295 -- # e810=() 00:19:27.182 10:05:32 -- nvmf/common.sh@295 -- # local -ga e810 00:19:27.182 10:05:32 -- nvmf/common.sh@296 -- # x722=() 00:19:27.182 10:05:32 -- nvmf/common.sh@296 -- # local -ga x722 00:19:27.182 10:05:32 -- nvmf/common.sh@297 -- # mlx=() 00:19:27.182 10:05:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:27.182 10:05:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:27.182 10:05:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:27.182 10:05:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:27.182 10:05:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:27.182 10:05:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:27.182 10:05:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:27.182 10:05:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:27.182 10:05:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:27.182 10:05:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:27.182 10:05:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:27.182 10:05:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:27.182 10:05:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:27.182 10:05:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:27.182 10:05:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:27.182 10:05:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:27.182 10:05:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:27.182 10:05:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:27.182 10:05:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:27.182 10:05:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:27.182 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:27.182 10:05:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:27.182 10:05:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:27.182 10:05:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:27.182 10:05:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:27.182 10:05:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:27.445 10:05:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:27.445 10:05:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:27.445 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:27.445 10:05:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:27.445 10:05:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:27.445 10:05:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:27.445 10:05:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:27.445 10:05:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:27.445 10:05:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:27.445 10:05:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:27.445 10:05:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:27.445 10:05:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:27.445 10:05:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:27.445 10:05:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:27.445 10:05:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:27.445 10:05:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:27.445 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:27.445 10:05:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:27.445 10:05:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:27.445 10:05:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:27.445 10:05:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:27.445 10:05:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:27.445 10:05:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:27.445 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:27.445 10:05:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:27.445 10:05:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:27.445 10:05:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:27.445 10:05:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:27.445 10:05:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:27.445 10:05:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:27.445 10:05:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:27.445 10:05:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:27.445 10:05:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:27.445 10:05:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:27.445 10:05:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:27.445 10:05:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:27.445 10:05:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:27.445 10:05:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:27.445 10:05:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:27.445 10:05:33 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:27.445 10:05:33 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:27.445 10:05:33 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:27.445 10:05:33 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:27.445 10:05:33 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:27.445 10:05:33 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:27.446 10:05:33 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:27.446 10:05:33 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:27.446 10:05:33 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:27.446 10:05:33 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:27.446 10:05:33 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:27.446 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:27.446 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.139 ms 00:19:27.446 00:19:27.446 --- 10.0.0.2 ping statistics --- 00:19:27.446 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:27.446 rtt min/avg/max/mdev = 0.139/0.139/0.139/0.000 ms 00:19:27.446 10:05:33 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:27.446 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:27.446 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.125 ms 00:19:27.446 00:19:27.446 --- 10.0.0.1 ping statistics --- 00:19:27.446 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:27.446 rtt min/avg/max/mdev = 0.125/0.125/0.125/0.000 ms 00:19:27.446 10:05:33 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:27.446 10:05:33 -- nvmf/common.sh@410 -- # return 0 00:19:27.446 10:05:33 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:27.446 10:05:33 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:27.446 10:05:33 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:27.446 10:05:33 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:27.446 10:05:33 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:27.446 10:05:33 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:27.446 10:05:33 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:27.446 10:05:33 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:19:27.446 10:05:33 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:27.446 10:05:33 -- common/autotest_common.sh@712 -- # xtrace_disable 00:19:27.446 10:05:33 -- common/autotest_common.sh@10 -- # set +x 00:19:27.446 10:05:33 -- nvmf/common.sh@469 -- # nvmfpid=2831081 00:19:27.446 10:05:33 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:19:27.446 10:05:33 -- nvmf/common.sh@470 -- # waitforlisten 2831081 00:19:27.446 10:05:33 -- common/autotest_common.sh@819 -- # '[' -z 2831081 ']' 00:19:27.446 10:05:33 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:27.446 10:05:33 -- common/autotest_common.sh@824 -- # local max_retries=100 00:19:27.446 10:05:33 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:27.446 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:27.446 10:05:33 -- common/autotest_common.sh@828 -- # xtrace_disable 00:19:27.446 10:05:33 -- common/autotest_common.sh@10 -- # set +x 00:19:27.446 [2024-07-13 10:05:33.201837] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:19:27.446 [2024-07-13 10:05:33.201936] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:27.446 EAL: No free 2048 kB hugepages reported on node 1 00:19:27.704 [2024-07-13 10:05:33.276608] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:27.704 [2024-07-13 10:05:33.371373] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:27.704 [2024-07-13 10:05:33.371529] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:27.704 [2024-07-13 10:05:33.371549] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:27.704 [2024-07-13 10:05:33.371564] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:27.704 [2024-07-13 10:05:33.371806] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:19:27.704 [2024-07-13 10:05:33.371872] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:19:27.704 [2024-07-13 10:05:33.371890] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:19:27.704 [2024-07-13 10:05:33.371893] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:28.637 10:05:34 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:19:28.637 10:05:34 -- common/autotest_common.sh@852 -- # return 0 00:19:28.637 10:05:34 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:28.637 10:05:34 -- common/autotest_common.sh@718 -- # xtrace_disable 00:19:28.637 10:05:34 -- common/autotest_common.sh@10 -- # set +x 00:19:28.637 10:05:34 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:28.637 10:05:34 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:28.637 10:05:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:28.637 10:05:34 -- common/autotest_common.sh@10 -- # set +x 00:19:28.637 [2024-07-13 10:05:34.216504] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:28.637 10:05:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:28.637 10:05:34 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:28.637 10:05:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:28.637 10:05:34 -- common/autotest_common.sh@10 -- # set +x 00:19:28.637 Malloc0 00:19:28.637 10:05:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:28.637 10:05:34 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:28.637 10:05:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:28.638 10:05:34 -- common/autotest_common.sh@10 -- # set +x 00:19:28.638 10:05:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:28.638 10:05:34 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:28.638 10:05:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:28.638 10:05:34 -- common/autotest_common.sh@10 -- # set +x 00:19:28.638 10:05:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:28.638 10:05:34 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:28.638 10:05:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:28.638 10:05:34 -- common/autotest_common.sh@10 -- # set +x 00:19:28.638 [2024-07-13 10:05:34.269887] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:28.638 10:05:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:28.638 10:05:34 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:19:28.638 10:05:34 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:19:28.638 10:05:34 -- nvmf/common.sh@520 -- # config=() 00:19:28.638 10:05:34 -- nvmf/common.sh@520 -- # local subsystem config 00:19:28.638 10:05:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:19:28.638 10:05:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:19:28.638 { 00:19:28.638 "params": { 00:19:28.638 "name": "Nvme$subsystem", 00:19:28.638 "trtype": "$TEST_TRANSPORT", 00:19:28.638 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:28.638 "adrfam": "ipv4", 00:19:28.638 "trsvcid": "$NVMF_PORT", 00:19:28.638 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:28.638 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:28.638 "hdgst": ${hdgst:-false}, 00:19:28.638 "ddgst": ${ddgst:-false} 00:19:28.638 }, 00:19:28.638 "method": "bdev_nvme_attach_controller" 00:19:28.638 } 00:19:28.638 EOF 00:19:28.638 )") 00:19:28.638 10:05:34 -- nvmf/common.sh@542 -- # cat 00:19:28.638 10:05:34 -- nvmf/common.sh@544 -- # jq . 00:19:28.638 10:05:34 -- nvmf/common.sh@545 -- # IFS=, 00:19:28.638 10:05:34 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:19:28.638 "params": { 00:19:28.638 "name": "Nvme1", 00:19:28.638 "trtype": "tcp", 00:19:28.638 "traddr": "10.0.0.2", 00:19:28.638 "adrfam": "ipv4", 00:19:28.638 "trsvcid": "4420", 00:19:28.638 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:28.638 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:28.638 "hdgst": false, 00:19:28.638 "ddgst": false 00:19:28.638 }, 00:19:28.638 "method": "bdev_nvme_attach_controller" 00:19:28.638 }' 00:19:28.638 [2024-07-13 10:05:34.314646] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:19:28.638 [2024-07-13 10:05:34.314713] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2831239 ] 00:19:28.638 EAL: No free 2048 kB hugepages reported on node 1 00:19:28.638 [2024-07-13 10:05:34.374791] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:19:28.895 [2024-07-13 10:05:34.468906] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:28.895 [2024-07-13 10:05:34.468948] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:28.895 [2024-07-13 10:05:34.468952] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:28.895 [2024-07-13 10:05:34.641017] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:19:28.895 [2024-07-13 10:05:34.641069] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:19:28.895 I/O targets: 00:19:28.895 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:19:28.895 00:19:28.895 00:19:28.895 CUnit - A unit testing framework for C - Version 2.1-3 00:19:28.895 http://cunit.sourceforge.net/ 00:19:28.895 00:19:28.895 00:19:28.895 Suite: bdevio tests on: Nvme1n1 00:19:28.895 Test: blockdev write read block ...passed 00:19:29.153 Test: blockdev write zeroes read block ...passed 00:19:29.153 Test: blockdev write zeroes read no split ...passed 00:19:29.153 Test: blockdev write zeroes read split ...passed 00:19:29.153 Test: blockdev write zeroes read split partial ...passed 00:19:29.153 Test: blockdev reset ...[2024-07-13 10:05:34.849736] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:19:29.153 [2024-07-13 10:05:34.849850] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19b4860 (9): Bad file descriptor 00:19:29.153 [2024-07-13 10:05:34.901878] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:19:29.153 passed 00:19:29.153 Test: blockdev write read 8 blocks ...passed 00:19:29.153 Test: blockdev write read size > 128k ...passed 00:19:29.153 Test: blockdev write read invalid size ...passed 00:19:29.410 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:19:29.410 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:19:29.410 Test: blockdev write read max offset ...passed 00:19:29.410 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:19:29.410 Test: blockdev writev readv 8 blocks ...passed 00:19:29.410 Test: blockdev writev readv 30 x 1block ...passed 00:19:29.410 Test: blockdev writev readv block ...passed 00:19:29.410 Test: blockdev writev readv size > 128k ...passed 00:19:29.410 Test: blockdev writev readv size > 128k in two iovs ...passed 00:19:29.411 Test: blockdev comparev and writev ...[2024-07-13 10:05:35.116022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:29.411 [2024-07-13 10:05:35.116059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:19:29.411 [2024-07-13 10:05:35.116083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:29.411 [2024-07-13 10:05:35.116099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:19:29.411 [2024-07-13 10:05:35.116451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:29.411 [2024-07-13 10:05:35.116476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:19:29.411 [2024-07-13 10:05:35.116498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:29.411 [2024-07-13 10:05:35.116514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:19:29.411 [2024-07-13 10:05:35.116858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:29.411 [2024-07-13 10:05:35.116889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:19:29.411 [2024-07-13 10:05:35.116912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:29.411 [2024-07-13 10:05:35.116928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:19:29.411 [2024-07-13 10:05:35.117277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:29.411 [2024-07-13 10:05:35.117301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:19:29.411 [2024-07-13 10:05:35.117324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:29.411 [2024-07-13 10:05:35.117344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:19:29.411 passed 00:19:29.411 Test: blockdev nvme passthru rw ...passed 00:19:29.411 Test: blockdev nvme passthru vendor specific ...[2024-07-13 10:05:35.200206] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:29.411 [2024-07-13 10:05:35.200235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:19:29.411 [2024-07-13 10:05:35.200423] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:29.411 [2024-07-13 10:05:35.200453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:19:29.411 [2024-07-13 10:05:35.200638] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:29.411 [2024-07-13 10:05:35.200661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:19:29.411 [2024-07-13 10:05:35.200854] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:29.411 [2024-07-13 10:05:35.200885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:19:29.411 passed 00:19:29.411 Test: blockdev nvme admin passthru ...passed 00:19:29.668 Test: blockdev copy ...passed 00:19:29.668 00:19:29.668 Run Summary: Type Total Ran Passed Failed Inactive 00:19:29.668 suites 1 1 n/a 0 0 00:19:29.668 tests 23 23 23 0 0 00:19:29.668 asserts 152 152 152 0 n/a 00:19:29.668 00:19:29.668 Elapsed time = 1.241 seconds 00:19:29.668 10:05:35 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:29.668 10:05:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:29.668 10:05:35 -- common/autotest_common.sh@10 -- # set +x 00:19:29.668 10:05:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:29.668 10:05:35 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:19:29.668 10:05:35 -- target/bdevio.sh@30 -- # nvmftestfini 00:19:29.668 10:05:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:29.668 10:05:35 -- nvmf/common.sh@116 -- # sync 00:19:29.668 10:05:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:29.668 10:05:35 -- nvmf/common.sh@119 -- # set +e 00:19:29.668 10:05:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:29.668 10:05:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:29.668 rmmod nvme_tcp 00:19:29.925 rmmod nvme_fabrics 00:19:29.925 rmmod nvme_keyring 00:19:29.925 10:05:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:29.925 10:05:35 -- nvmf/common.sh@123 -- # set -e 00:19:29.925 10:05:35 -- nvmf/common.sh@124 -- # return 0 00:19:29.925 10:05:35 -- nvmf/common.sh@477 -- # '[' -n 2831081 ']' 00:19:29.925 10:05:35 -- nvmf/common.sh@478 -- # killprocess 2831081 00:19:29.925 10:05:35 -- common/autotest_common.sh@926 -- # '[' -z 2831081 ']' 00:19:29.925 10:05:35 -- common/autotest_common.sh@930 -- # kill -0 2831081 00:19:29.925 10:05:35 -- common/autotest_common.sh@931 -- # uname 00:19:29.925 10:05:35 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:19:29.925 10:05:35 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2831081 00:19:29.925 10:05:35 -- common/autotest_common.sh@932 -- # process_name=reactor_3 00:19:29.925 10:05:35 -- common/autotest_common.sh@936 -- # '[' reactor_3 = sudo ']' 00:19:29.925 10:05:35 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2831081' 00:19:29.925 killing process with pid 2831081 00:19:29.925 10:05:35 -- common/autotest_common.sh@945 -- # kill 2831081 00:19:29.925 10:05:35 -- common/autotest_common.sh@950 -- # wait 2831081 00:19:30.182 10:05:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:30.182 10:05:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:30.182 10:05:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:30.183 10:05:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:30.183 10:05:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:30.183 10:05:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:30.183 10:05:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:30.183 10:05:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:32.086 10:05:37 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:32.086 00:19:32.086 real 0m6.811s 00:19:32.086 user 0m12.703s 00:19:32.086 sys 0m2.045s 00:19:32.086 10:05:37 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:19:32.086 10:05:37 -- common/autotest_common.sh@10 -- # set +x 00:19:32.086 ************************************ 00:19:32.086 END TEST nvmf_bdevio 00:19:32.086 ************************************ 00:19:32.086 10:05:37 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:19:32.086 10:05:37 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:19:32.086 10:05:37 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:19:32.086 10:05:37 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:19:32.086 10:05:37 -- common/autotest_common.sh@10 -- # set +x 00:19:32.086 ************************************ 00:19:32.086 START TEST nvmf_bdevio_no_huge 00:19:32.086 ************************************ 00:19:32.086 10:05:37 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:19:32.345 * Looking for test storage... 00:19:32.345 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:32.345 10:05:37 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:32.345 10:05:37 -- nvmf/common.sh@7 -- # uname -s 00:19:32.345 10:05:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:32.345 10:05:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:32.345 10:05:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:32.345 10:05:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:32.345 10:05:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:32.345 10:05:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:32.345 10:05:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:32.345 10:05:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:32.345 10:05:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:32.345 10:05:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:32.345 10:05:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:32.345 10:05:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:32.345 10:05:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:32.345 10:05:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:32.345 10:05:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:32.345 10:05:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:32.345 10:05:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:32.345 10:05:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:32.345 10:05:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:32.345 10:05:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:32.345 10:05:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:32.345 10:05:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:32.345 10:05:37 -- paths/export.sh@5 -- # export PATH 00:19:32.345 10:05:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:32.345 10:05:37 -- nvmf/common.sh@46 -- # : 0 00:19:32.345 10:05:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:32.345 10:05:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:32.345 10:05:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:32.345 10:05:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:32.345 10:05:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:32.345 10:05:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:32.345 10:05:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:32.345 10:05:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:32.345 10:05:37 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:32.345 10:05:37 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:32.345 10:05:37 -- target/bdevio.sh@14 -- # nvmftestinit 00:19:32.345 10:05:37 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:32.345 10:05:37 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:32.345 10:05:37 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:32.345 10:05:37 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:32.345 10:05:37 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:32.345 10:05:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:32.345 10:05:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:32.345 10:05:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:32.345 10:05:37 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:32.345 10:05:37 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:32.345 10:05:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:32.345 10:05:37 -- common/autotest_common.sh@10 -- # set +x 00:19:34.247 10:05:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:34.247 10:05:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:34.247 10:05:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:34.247 10:05:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:34.247 10:05:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:34.247 10:05:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:34.247 10:05:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:34.247 10:05:39 -- nvmf/common.sh@294 -- # net_devs=() 00:19:34.247 10:05:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:34.247 10:05:39 -- nvmf/common.sh@295 -- # e810=() 00:19:34.247 10:05:39 -- nvmf/common.sh@295 -- # local -ga e810 00:19:34.247 10:05:39 -- nvmf/common.sh@296 -- # x722=() 00:19:34.247 10:05:39 -- nvmf/common.sh@296 -- # local -ga x722 00:19:34.247 10:05:39 -- nvmf/common.sh@297 -- # mlx=() 00:19:34.247 10:05:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:34.247 10:05:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:34.247 10:05:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:34.247 10:05:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:34.247 10:05:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:34.247 10:05:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:34.247 10:05:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:34.247 10:05:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:34.247 10:05:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:34.247 10:05:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:34.247 10:05:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:34.247 10:05:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:34.247 10:05:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:34.247 10:05:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:34.247 10:05:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:34.247 10:05:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:34.247 10:05:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:34.247 10:05:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:34.247 10:05:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:34.247 10:05:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:34.247 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:34.247 10:05:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:34.247 10:05:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:34.247 10:05:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:34.247 10:05:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:34.247 10:05:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:34.247 10:05:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:34.247 10:05:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:34.247 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:34.247 10:05:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:34.247 10:05:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:34.247 10:05:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:34.247 10:05:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:34.247 10:05:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:34.247 10:05:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:34.247 10:05:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:34.247 10:05:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:34.247 10:05:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:34.247 10:05:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:34.247 10:05:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:34.247 10:05:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:34.247 10:05:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:34.247 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:34.247 10:05:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:34.247 10:05:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:34.247 10:05:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:34.247 10:05:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:34.247 10:05:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:34.247 10:05:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:34.247 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:34.247 10:05:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:34.247 10:05:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:34.247 10:05:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:34.247 10:05:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:34.247 10:05:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:34.247 10:05:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:34.247 10:05:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:34.247 10:05:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:34.247 10:05:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:34.247 10:05:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:34.247 10:05:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:34.247 10:05:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:34.247 10:05:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:34.247 10:05:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:34.247 10:05:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:34.247 10:05:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:34.247 10:05:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:34.247 10:05:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:34.247 10:05:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:34.247 10:05:39 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:34.247 10:05:39 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:34.247 10:05:39 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:34.247 10:05:39 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:34.247 10:05:39 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:34.247 10:05:39 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:34.247 10:05:39 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:34.247 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:34.247 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.191 ms 00:19:34.247 00:19:34.247 --- 10.0.0.2 ping statistics --- 00:19:34.247 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:34.247 rtt min/avg/max/mdev = 0.191/0.191/0.191/0.000 ms 00:19:34.247 10:05:39 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:34.247 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:34.247 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.135 ms 00:19:34.247 00:19:34.247 --- 10.0.0.1 ping statistics --- 00:19:34.247 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:34.247 rtt min/avg/max/mdev = 0.135/0.135/0.135/0.000 ms 00:19:34.247 10:05:39 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:34.247 10:05:39 -- nvmf/common.sh@410 -- # return 0 00:19:34.247 10:05:39 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:34.247 10:05:39 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:34.247 10:05:39 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:34.247 10:05:39 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:34.247 10:05:39 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:34.247 10:05:39 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:34.247 10:05:39 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:34.247 10:05:39 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:19:34.247 10:05:39 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:34.247 10:05:39 -- common/autotest_common.sh@712 -- # xtrace_disable 00:19:34.247 10:05:39 -- common/autotest_common.sh@10 -- # set +x 00:19:34.247 10:05:39 -- nvmf/common.sh@469 -- # nvmfpid=2833319 00:19:34.247 10:05:39 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:19:34.247 10:05:39 -- nvmf/common.sh@470 -- # waitforlisten 2833319 00:19:34.247 10:05:39 -- common/autotest_common.sh@819 -- # '[' -z 2833319 ']' 00:19:34.247 10:05:39 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:34.247 10:05:39 -- common/autotest_common.sh@824 -- # local max_retries=100 00:19:34.247 10:05:39 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:34.247 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:34.247 10:05:39 -- common/autotest_common.sh@828 -- # xtrace_disable 00:19:34.247 10:05:39 -- common/autotest_common.sh@10 -- # set +x 00:19:34.247 [2024-07-13 10:05:39.953959] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:19:34.247 [2024-07-13 10:05:39.954038] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:19:34.247 [2024-07-13 10:05:40.026463] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:34.505 [2024-07-13 10:05:40.116706] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:34.505 [2024-07-13 10:05:40.116885] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:34.505 [2024-07-13 10:05:40.116904] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:34.505 [2024-07-13 10:05:40.116928] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:34.505 [2024-07-13 10:05:40.117013] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:19:34.505 [2024-07-13 10:05:40.117074] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:19:34.505 [2024-07-13 10:05:40.117204] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:19:34.505 [2024-07-13 10:05:40.117207] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:35.438 10:05:40 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:19:35.438 10:05:40 -- common/autotest_common.sh@852 -- # return 0 00:19:35.438 10:05:40 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:35.438 10:05:40 -- common/autotest_common.sh@718 -- # xtrace_disable 00:19:35.438 10:05:40 -- common/autotest_common.sh@10 -- # set +x 00:19:35.438 10:05:40 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:35.438 10:05:40 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:35.438 10:05:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:35.438 10:05:40 -- common/autotest_common.sh@10 -- # set +x 00:19:35.438 [2024-07-13 10:05:40.942910] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:35.438 10:05:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:35.438 10:05:40 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:35.438 10:05:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:35.438 10:05:40 -- common/autotest_common.sh@10 -- # set +x 00:19:35.438 Malloc0 00:19:35.438 10:05:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:35.438 10:05:40 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:35.438 10:05:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:35.438 10:05:40 -- common/autotest_common.sh@10 -- # set +x 00:19:35.438 10:05:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:35.438 10:05:40 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:35.438 10:05:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:35.438 10:05:40 -- common/autotest_common.sh@10 -- # set +x 00:19:35.438 10:05:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:35.438 10:05:40 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:35.438 10:05:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:35.438 10:05:40 -- common/autotest_common.sh@10 -- # set +x 00:19:35.438 [2024-07-13 10:05:40.980648] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:35.438 10:05:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:35.438 10:05:40 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:19:35.439 10:05:40 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:19:35.439 10:05:40 -- nvmf/common.sh@520 -- # config=() 00:19:35.439 10:05:40 -- nvmf/common.sh@520 -- # local subsystem config 00:19:35.439 10:05:40 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:19:35.439 10:05:40 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:19:35.439 { 00:19:35.439 "params": { 00:19:35.439 "name": "Nvme$subsystem", 00:19:35.439 "trtype": "$TEST_TRANSPORT", 00:19:35.439 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:35.439 "adrfam": "ipv4", 00:19:35.439 "trsvcid": "$NVMF_PORT", 00:19:35.439 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:35.439 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:35.439 "hdgst": ${hdgst:-false}, 00:19:35.439 "ddgst": ${ddgst:-false} 00:19:35.439 }, 00:19:35.439 "method": "bdev_nvme_attach_controller" 00:19:35.439 } 00:19:35.439 EOF 00:19:35.439 )") 00:19:35.439 10:05:40 -- nvmf/common.sh@542 -- # cat 00:19:35.439 10:05:40 -- nvmf/common.sh@544 -- # jq . 00:19:35.439 10:05:40 -- nvmf/common.sh@545 -- # IFS=, 00:19:35.439 10:05:40 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:19:35.439 "params": { 00:19:35.439 "name": "Nvme1", 00:19:35.439 "trtype": "tcp", 00:19:35.439 "traddr": "10.0.0.2", 00:19:35.439 "adrfam": "ipv4", 00:19:35.439 "trsvcid": "4420", 00:19:35.439 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:35.439 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:35.439 "hdgst": false, 00:19:35.439 "ddgst": false 00:19:35.439 }, 00:19:35.439 "method": "bdev_nvme_attach_controller" 00:19:35.439 }' 00:19:35.439 [2024-07-13 10:05:41.020929] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:19:35.439 [2024-07-13 10:05:41.021010] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid2833477 ] 00:19:35.439 [2024-07-13 10:05:41.081423] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:19:35.439 [2024-07-13 10:05:41.163095] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:35.439 [2024-07-13 10:05:41.163145] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:35.439 [2024-07-13 10:05:41.163148] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:35.697 [2024-07-13 10:05:41.355383] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:19:35.697 [2024-07-13 10:05:41.355438] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:19:35.697 I/O targets: 00:19:35.697 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:19:35.697 00:19:35.697 00:19:35.697 CUnit - A unit testing framework for C - Version 2.1-3 00:19:35.697 http://cunit.sourceforge.net/ 00:19:35.697 00:19:35.697 00:19:35.697 Suite: bdevio tests on: Nvme1n1 00:19:35.697 Test: blockdev write read block ...passed 00:19:35.697 Test: blockdev write zeroes read block ...passed 00:19:35.697 Test: blockdev write zeroes read no split ...passed 00:19:35.955 Test: blockdev write zeroes read split ...passed 00:19:35.955 Test: blockdev write zeroes read split partial ...passed 00:19:35.955 Test: blockdev reset ...[2024-07-13 10:05:41.573329] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:19:35.955 [2024-07-13 10:05:41.573441] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10a3ef0 (9): Bad file descriptor 00:19:35.955 [2024-07-13 10:05:41.625492] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:19:35.955 passed 00:19:35.955 Test: blockdev write read 8 blocks ...passed 00:19:35.955 Test: blockdev write read size > 128k ...passed 00:19:35.955 Test: blockdev write read invalid size ...passed 00:19:35.955 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:19:35.955 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:19:35.955 Test: blockdev write read max offset ...passed 00:19:35.955 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:19:36.213 Test: blockdev writev readv 8 blocks ...passed 00:19:36.213 Test: blockdev writev readv 30 x 1block ...passed 00:19:36.213 Test: blockdev writev readv block ...passed 00:19:36.213 Test: blockdev writev readv size > 128k ...passed 00:19:36.213 Test: blockdev writev readv size > 128k in two iovs ...passed 00:19:36.213 Test: blockdev comparev and writev ...[2024-07-13 10:05:41.842939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:36.213 [2024-07-13 10:05:41.842975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:19:36.213 [2024-07-13 10:05:41.843000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:36.213 [2024-07-13 10:05:41.843016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:19:36.213 [2024-07-13 10:05:41.843351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:36.213 [2024-07-13 10:05:41.843376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:19:36.214 [2024-07-13 10:05:41.843399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:36.214 [2024-07-13 10:05:41.843415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:19:36.214 [2024-07-13 10:05:41.843752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:36.214 [2024-07-13 10:05:41.843776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:19:36.214 [2024-07-13 10:05:41.843797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:36.214 [2024-07-13 10:05:41.843813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:19:36.214 [2024-07-13 10:05:41.844156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:36.214 [2024-07-13 10:05:41.844181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:19:36.214 [2024-07-13 10:05:41.844203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:36.214 [2024-07-13 10:05:41.844219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:19:36.214 passed 00:19:36.214 Test: blockdev nvme passthru rw ...passed 00:19:36.214 Test: blockdev nvme passthru vendor specific ...[2024-07-13 10:05:41.927173] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:36.214 [2024-07-13 10:05:41.927200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:19:36.214 [2024-07-13 10:05:41.927379] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:36.214 [2024-07-13 10:05:41.927403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:19:36.214 [2024-07-13 10:05:41.927587] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:36.214 [2024-07-13 10:05:41.927621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:19:36.214 [2024-07-13 10:05:41.927799] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:36.214 [2024-07-13 10:05:41.927822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:19:36.214 passed 00:19:36.214 Test: blockdev nvme admin passthru ...passed 00:19:36.214 Test: blockdev copy ...passed 00:19:36.214 00:19:36.214 Run Summary: Type Total Ran Passed Failed Inactive 00:19:36.214 suites 1 1 n/a 0 0 00:19:36.214 tests 23 23 23 0 0 00:19:36.214 asserts 152 152 152 0 n/a 00:19:36.214 00:19:36.214 Elapsed time = 1.259 seconds 00:19:36.782 10:05:42 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:36.782 10:05:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:36.782 10:05:42 -- common/autotest_common.sh@10 -- # set +x 00:19:36.782 10:05:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:36.782 10:05:42 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:19:36.782 10:05:42 -- target/bdevio.sh@30 -- # nvmftestfini 00:19:36.782 10:05:42 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:36.782 10:05:42 -- nvmf/common.sh@116 -- # sync 00:19:36.782 10:05:42 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:36.782 10:05:42 -- nvmf/common.sh@119 -- # set +e 00:19:36.782 10:05:42 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:36.782 10:05:42 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:36.782 rmmod nvme_tcp 00:19:36.782 rmmod nvme_fabrics 00:19:36.782 rmmod nvme_keyring 00:19:36.782 10:05:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:36.782 10:05:42 -- nvmf/common.sh@123 -- # set -e 00:19:36.782 10:05:42 -- nvmf/common.sh@124 -- # return 0 00:19:36.782 10:05:42 -- nvmf/common.sh@477 -- # '[' -n 2833319 ']' 00:19:36.782 10:05:42 -- nvmf/common.sh@478 -- # killprocess 2833319 00:19:36.782 10:05:42 -- common/autotest_common.sh@926 -- # '[' -z 2833319 ']' 00:19:36.782 10:05:42 -- common/autotest_common.sh@930 -- # kill -0 2833319 00:19:36.782 10:05:42 -- common/autotest_common.sh@931 -- # uname 00:19:36.782 10:05:42 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:19:36.782 10:05:42 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2833319 00:19:36.782 10:05:42 -- common/autotest_common.sh@932 -- # process_name=reactor_3 00:19:36.782 10:05:42 -- common/autotest_common.sh@936 -- # '[' reactor_3 = sudo ']' 00:19:36.782 10:05:42 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2833319' 00:19:36.782 killing process with pid 2833319 00:19:36.782 10:05:42 -- common/autotest_common.sh@945 -- # kill 2833319 00:19:36.782 10:05:42 -- common/autotest_common.sh@950 -- # wait 2833319 00:19:37.041 10:05:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:37.041 10:05:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:37.041 10:05:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:37.041 10:05:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:37.041 10:05:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:37.041 10:05:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:37.041 10:05:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:37.041 10:05:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:39.612 10:05:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:39.612 00:19:39.612 real 0m6.891s 00:19:39.612 user 0m13.249s 00:19:39.612 sys 0m2.333s 00:19:39.612 10:05:44 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:19:39.612 10:05:44 -- common/autotest_common.sh@10 -- # set +x 00:19:39.612 ************************************ 00:19:39.612 END TEST nvmf_bdevio_no_huge 00:19:39.612 ************************************ 00:19:39.612 10:05:44 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:19:39.612 10:05:44 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:19:39.612 10:05:44 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:19:39.612 10:05:44 -- common/autotest_common.sh@10 -- # set +x 00:19:39.612 ************************************ 00:19:39.612 START TEST nvmf_tls 00:19:39.612 ************************************ 00:19:39.612 10:05:44 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:19:39.612 * Looking for test storage... 00:19:39.612 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:39.612 10:05:44 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:39.612 10:05:44 -- nvmf/common.sh@7 -- # uname -s 00:19:39.612 10:05:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:39.612 10:05:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:39.612 10:05:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:39.612 10:05:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:39.612 10:05:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:39.612 10:05:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:39.612 10:05:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:39.612 10:05:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:39.612 10:05:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:39.612 10:05:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:39.612 10:05:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:39.612 10:05:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:39.612 10:05:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:39.612 10:05:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:39.612 10:05:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:39.612 10:05:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:39.612 10:05:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:39.612 10:05:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:39.612 10:05:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:39.612 10:05:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:39.612 10:05:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:39.612 10:05:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:39.612 10:05:44 -- paths/export.sh@5 -- # export PATH 00:19:39.612 10:05:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:39.612 10:05:44 -- nvmf/common.sh@46 -- # : 0 00:19:39.612 10:05:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:39.612 10:05:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:39.612 10:05:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:39.612 10:05:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:39.612 10:05:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:39.612 10:05:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:39.612 10:05:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:39.612 10:05:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:39.612 10:05:44 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:19:39.612 10:05:44 -- target/tls.sh@71 -- # nvmftestinit 00:19:39.612 10:05:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:39.612 10:05:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:39.612 10:05:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:39.612 10:05:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:39.612 10:05:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:39.612 10:05:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:39.612 10:05:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:39.612 10:05:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:39.612 10:05:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:39.612 10:05:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:39.612 10:05:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:39.612 10:05:44 -- common/autotest_common.sh@10 -- # set +x 00:19:41.514 10:05:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:41.514 10:05:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:41.514 10:05:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:41.514 10:05:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:41.514 10:05:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:41.514 10:05:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:41.514 10:05:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:41.514 10:05:46 -- nvmf/common.sh@294 -- # net_devs=() 00:19:41.514 10:05:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:41.514 10:05:46 -- nvmf/common.sh@295 -- # e810=() 00:19:41.514 10:05:46 -- nvmf/common.sh@295 -- # local -ga e810 00:19:41.515 10:05:46 -- nvmf/common.sh@296 -- # x722=() 00:19:41.515 10:05:46 -- nvmf/common.sh@296 -- # local -ga x722 00:19:41.515 10:05:46 -- nvmf/common.sh@297 -- # mlx=() 00:19:41.515 10:05:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:41.515 10:05:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:41.515 10:05:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:41.515 10:05:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:41.515 10:05:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:41.515 10:05:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:41.515 10:05:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:41.515 10:05:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:41.515 10:05:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:41.515 10:05:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:41.515 10:05:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:41.515 10:05:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:41.515 10:05:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:41.515 10:05:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:41.515 10:05:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:41.515 10:05:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:41.515 10:05:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:41.515 10:05:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:41.515 10:05:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:41.515 10:05:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:41.515 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:41.515 10:05:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:41.515 10:05:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:41.515 10:05:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:41.515 10:05:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:41.515 10:05:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:41.515 10:05:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:41.515 10:05:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:41.515 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:41.515 10:05:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:41.515 10:05:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:41.515 10:05:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:41.515 10:05:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:41.515 10:05:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:41.515 10:05:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:41.515 10:05:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:41.515 10:05:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:41.515 10:05:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:41.515 10:05:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:41.515 10:05:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:41.515 10:05:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:41.515 10:05:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:41.515 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:41.515 10:05:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:41.515 10:05:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:41.515 10:05:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:41.515 10:05:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:41.515 10:05:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:41.515 10:05:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:41.515 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:41.515 10:05:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:41.515 10:05:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:41.515 10:05:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:41.515 10:05:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:41.515 10:05:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:41.515 10:05:46 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:41.515 10:05:46 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:41.515 10:05:46 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:41.515 10:05:46 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:41.515 10:05:46 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:41.515 10:05:46 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:41.515 10:05:46 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:41.515 10:05:46 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:41.515 10:05:46 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:41.515 10:05:46 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:41.515 10:05:46 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:41.515 10:05:46 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:41.515 10:05:46 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:41.515 10:05:46 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:41.515 10:05:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:41.515 10:05:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:41.515 10:05:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:41.515 10:05:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:41.515 10:05:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:41.515 10:05:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:41.515 10:05:47 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:41.515 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:41.515 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.195 ms 00:19:41.515 00:19:41.515 --- 10.0.0.2 ping statistics --- 00:19:41.515 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:41.515 rtt min/avg/max/mdev = 0.195/0.195/0.195/0.000 ms 00:19:41.515 10:05:47 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:41.515 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:41.515 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.140 ms 00:19:41.515 00:19:41.515 --- 10.0.0.1 ping statistics --- 00:19:41.515 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:41.515 rtt min/avg/max/mdev = 0.140/0.140/0.140/0.000 ms 00:19:41.515 10:05:47 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:41.515 10:05:47 -- nvmf/common.sh@410 -- # return 0 00:19:41.515 10:05:47 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:41.515 10:05:47 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:41.515 10:05:47 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:41.515 10:05:47 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:41.515 10:05:47 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:41.515 10:05:47 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:41.515 10:05:47 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:41.515 10:05:47 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:19:41.515 10:05:47 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:41.515 10:05:47 -- common/autotest_common.sh@712 -- # xtrace_disable 00:19:41.515 10:05:47 -- common/autotest_common.sh@10 -- # set +x 00:19:41.515 10:05:47 -- nvmf/common.sh@469 -- # nvmfpid=2835561 00:19:41.515 10:05:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:19:41.515 10:05:47 -- nvmf/common.sh@470 -- # waitforlisten 2835561 00:19:41.515 10:05:47 -- common/autotest_common.sh@819 -- # '[' -z 2835561 ']' 00:19:41.515 10:05:47 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:41.515 10:05:47 -- common/autotest_common.sh@824 -- # local max_retries=100 00:19:41.515 10:05:47 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:41.515 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:41.515 10:05:47 -- common/autotest_common.sh@828 -- # xtrace_disable 00:19:41.515 10:05:47 -- common/autotest_common.sh@10 -- # set +x 00:19:41.515 [2024-07-13 10:05:47.084387] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:19:41.515 [2024-07-13 10:05:47.084465] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:41.515 EAL: No free 2048 kB hugepages reported on node 1 00:19:41.515 [2024-07-13 10:05:47.159803] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:41.515 [2024-07-13 10:05:47.248933] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:41.515 [2024-07-13 10:05:47.249108] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:41.515 [2024-07-13 10:05:47.249127] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:41.515 [2024-07-13 10:05:47.249141] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:41.515 [2024-07-13 10:05:47.249179] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:41.515 10:05:47 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:19:41.515 10:05:47 -- common/autotest_common.sh@852 -- # return 0 00:19:41.515 10:05:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:41.515 10:05:47 -- common/autotest_common.sh@718 -- # xtrace_disable 00:19:41.515 10:05:47 -- common/autotest_common.sh@10 -- # set +x 00:19:41.515 10:05:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:41.515 10:05:47 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:19:41.515 10:05:47 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:19:41.773 true 00:19:41.773 10:05:47 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:41.773 10:05:47 -- target/tls.sh@82 -- # jq -r .tls_version 00:19:42.031 10:05:47 -- target/tls.sh@82 -- # version=0 00:19:42.031 10:05:47 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:19:42.031 10:05:47 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:19:42.288 10:05:48 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:42.288 10:05:48 -- target/tls.sh@90 -- # jq -r .tls_version 00:19:42.546 10:05:48 -- target/tls.sh@90 -- # version=13 00:19:42.546 10:05:48 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:19:42.546 10:05:48 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:19:42.803 10:05:48 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:42.803 10:05:48 -- target/tls.sh@98 -- # jq -r .tls_version 00:19:43.060 10:05:48 -- target/tls.sh@98 -- # version=7 00:19:43.060 10:05:48 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:19:43.060 10:05:48 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:43.060 10:05:48 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:19:43.318 10:05:49 -- target/tls.sh@105 -- # ktls=false 00:19:43.318 10:05:49 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:19:43.318 10:05:49 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:19:43.576 10:05:49 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:43.576 10:05:49 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:19:43.834 10:05:49 -- target/tls.sh@113 -- # ktls=true 00:19:43.834 10:05:49 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:19:43.834 10:05:49 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:19:44.090 10:05:49 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:44.090 10:05:49 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:19:44.361 10:05:49 -- target/tls.sh@121 -- # ktls=false 00:19:44.361 10:05:49 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:19:44.361 10:05:49 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:19:44.361 10:05:49 -- target/tls.sh@49 -- # local key hash crc 00:19:44.361 10:05:49 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:19:44.361 10:05:49 -- target/tls.sh@51 -- # hash=01 00:19:44.361 10:05:49 -- target/tls.sh@52 -- # gzip -1 -c 00:19:44.361 10:05:49 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:19:44.361 10:05:49 -- target/tls.sh@52 -- # tail -c8 00:19:44.361 10:05:49 -- target/tls.sh@52 -- # head -c 4 00:19:44.361 10:05:49 -- target/tls.sh@52 -- # crc='p$H�' 00:19:44.361 10:05:49 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:19:44.361 10:05:49 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:19:44.361 10:05:49 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:19:44.361 10:05:49 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:19:44.361 10:05:49 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:19:44.361 10:05:49 -- target/tls.sh@49 -- # local key hash crc 00:19:44.361 10:05:49 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:19:44.361 10:05:49 -- target/tls.sh@51 -- # hash=01 00:19:44.361 10:05:49 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:19:44.361 10:05:49 -- target/tls.sh@52 -- # gzip -1 -c 00:19:44.361 10:05:49 -- target/tls.sh@52 -- # tail -c8 00:19:44.361 10:05:49 -- target/tls.sh@52 -- # head -c 4 00:19:44.361 10:05:49 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:19:44.361 10:05:49 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:19:44.361 10:05:49 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:19:44.361 10:05:50 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:19:44.361 10:05:50 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:19:44.361 10:05:50 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:44.361 10:05:50 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:19:44.361 10:05:50 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:19:44.361 10:05:50 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:19:44.361 10:05:50 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:44.361 10:05:50 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:19:44.361 10:05:50 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:19:44.618 10:05:50 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:19:44.875 10:05:50 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:44.875 10:05:50 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:44.875 10:05:50 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:19:45.132 [2024-07-13 10:05:50.784068] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:45.132 10:05:50 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:19:45.390 10:05:51 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:19:45.647 [2024-07-13 10:05:51.273372] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:19:45.647 [2024-07-13 10:05:51.273604] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:45.647 10:05:51 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:19:45.904 malloc0 00:19:45.904 10:05:51 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:19:46.162 10:05:51 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:46.420 10:05:51 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:46.420 EAL: No free 2048 kB hugepages reported on node 1 00:19:56.388 Initializing NVMe Controllers 00:19:56.388 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:19:56.388 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:19:56.388 Initialization complete. Launching workers. 00:19:56.388 ======================================================== 00:19:56.388 Latency(us) 00:19:56.388 Device Information : IOPS MiB/s Average min max 00:19:56.388 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7725.06 30.18 8287.39 1307.17 9160.69 00:19:56.388 ======================================================== 00:19:56.388 Total : 7725.06 30.18 8287.39 1307.17 9160.69 00:19:56.388 00:19:56.388 10:06:02 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:56.388 10:06:02 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:19:56.388 10:06:02 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:19:56.388 10:06:02 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:19:56.388 10:06:02 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:19:56.388 10:06:02 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:19:56.388 10:06:02 -- target/tls.sh@28 -- # bdevperf_pid=2837511 00:19:56.388 10:06:02 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:19:56.388 10:06:02 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:19:56.388 10:06:02 -- target/tls.sh@31 -- # waitforlisten 2837511 /var/tmp/bdevperf.sock 00:19:56.388 10:06:02 -- common/autotest_common.sh@819 -- # '[' -z 2837511 ']' 00:19:56.388 10:06:02 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:19:56.388 10:06:02 -- common/autotest_common.sh@824 -- # local max_retries=100 00:19:56.388 10:06:02 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:19:56.388 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:19:56.388 10:06:02 -- common/autotest_common.sh@828 -- # xtrace_disable 00:19:56.388 10:06:02 -- common/autotest_common.sh@10 -- # set +x 00:19:56.388 [2024-07-13 10:06:02.138728] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:19:56.388 [2024-07-13 10:06:02.138808] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2837511 ] 00:19:56.388 EAL: No free 2048 kB hugepages reported on node 1 00:19:56.388 [2024-07-13 10:06:02.196123] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:56.645 [2024-07-13 10:06:02.282621] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:57.586 10:06:03 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:19:57.586 10:06:03 -- common/autotest_common.sh@852 -- # return 0 00:19:57.586 10:06:03 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:57.586 [2024-07-13 10:06:03.367399] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:19:57.845 TLSTESTn1 00:19:57.845 10:06:03 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:19:57.845 Running I/O for 10 seconds... 00:20:07.830 00:20:07.830 Latency(us) 00:20:07.830 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:07.830 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:07.830 Verification LBA range: start 0x0 length 0x2000 00:20:07.830 TLSTESTn1 : 10.03 2983.59 11.65 0.00 0.00 42844.24 5170.06 48933.55 00:20:07.830 =================================================================================================================== 00:20:07.830 Total : 2983.59 11.65 0.00 0.00 42844.24 5170.06 48933.55 00:20:07.830 0 00:20:08.098 10:06:13 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:08.098 10:06:13 -- target/tls.sh@45 -- # killprocess 2837511 00:20:08.098 10:06:13 -- common/autotest_common.sh@926 -- # '[' -z 2837511 ']' 00:20:08.098 10:06:13 -- common/autotest_common.sh@930 -- # kill -0 2837511 00:20:08.098 10:06:13 -- common/autotest_common.sh@931 -- # uname 00:20:08.098 10:06:13 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:08.098 10:06:13 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2837511 00:20:08.098 10:06:13 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:20:08.098 10:06:13 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:20:08.098 10:06:13 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2837511' 00:20:08.098 killing process with pid 2837511 00:20:08.098 10:06:13 -- common/autotest_common.sh@945 -- # kill 2837511 00:20:08.098 Received shutdown signal, test time was about 10.000000 seconds 00:20:08.098 00:20:08.098 Latency(us) 00:20:08.098 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:08.098 =================================================================================================================== 00:20:08.098 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:08.098 10:06:13 -- common/autotest_common.sh@950 -- # wait 2837511 00:20:08.098 10:06:13 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:08.098 10:06:13 -- common/autotest_common.sh@640 -- # local es=0 00:20:08.098 10:06:13 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:08.098 10:06:13 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:20:08.098 10:06:13 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:08.098 10:06:13 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:20:08.098 10:06:13 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:08.098 10:06:13 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:08.098 10:06:13 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:08.098 10:06:13 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:08.098 10:06:13 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:08.098 10:06:13 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:20:08.098 10:06:13 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:08.098 10:06:13 -- target/tls.sh@28 -- # bdevperf_pid=2839504 00:20:08.098 10:06:13 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:08.098 10:06:13 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:08.098 10:06:13 -- target/tls.sh@31 -- # waitforlisten 2839504 /var/tmp/bdevperf.sock 00:20:08.099 10:06:13 -- common/autotest_common.sh@819 -- # '[' -z 2839504 ']' 00:20:08.099 10:06:13 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:08.099 10:06:13 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:08.099 10:06:13 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:08.099 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:08.099 10:06:13 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:08.099 10:06:13 -- common/autotest_common.sh@10 -- # set +x 00:20:08.356 [2024-07-13 10:06:13.931274] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:20:08.356 [2024-07-13 10:06:13.931357] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2839504 ] 00:20:08.356 EAL: No free 2048 kB hugepages reported on node 1 00:20:08.356 [2024-07-13 10:06:13.988172] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:08.356 [2024-07-13 10:06:14.069646] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:09.289 10:06:14 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:09.289 10:06:14 -- common/autotest_common.sh@852 -- # return 0 00:20:09.289 10:06:14 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:09.546 [2024-07-13 10:06:15.112747] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:09.546 [2024-07-13 10:06:15.118280] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:09.546 [2024-07-13 10:06:15.118668] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1749130 (107): Transport endpoint is not connected 00:20:09.546 [2024-07-13 10:06:15.119657] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1749130 (9): Bad file descriptor 00:20:09.546 [2024-07-13 10:06:15.120658] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:09.546 [2024-07-13 10:06:15.120678] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:09.546 [2024-07-13 10:06:15.120708] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:09.546 request: 00:20:09.546 { 00:20:09.546 "name": "TLSTEST", 00:20:09.546 "trtype": "tcp", 00:20:09.546 "traddr": "10.0.0.2", 00:20:09.546 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:09.546 "adrfam": "ipv4", 00:20:09.546 "trsvcid": "4420", 00:20:09.546 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:09.546 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:20:09.546 "method": "bdev_nvme_attach_controller", 00:20:09.546 "req_id": 1 00:20:09.546 } 00:20:09.546 Got JSON-RPC error response 00:20:09.546 response: 00:20:09.546 { 00:20:09.546 "code": -32602, 00:20:09.546 "message": "Invalid parameters" 00:20:09.546 } 00:20:09.546 10:06:15 -- target/tls.sh@36 -- # killprocess 2839504 00:20:09.546 10:06:15 -- common/autotest_common.sh@926 -- # '[' -z 2839504 ']' 00:20:09.546 10:06:15 -- common/autotest_common.sh@930 -- # kill -0 2839504 00:20:09.546 10:06:15 -- common/autotest_common.sh@931 -- # uname 00:20:09.546 10:06:15 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:09.546 10:06:15 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2839504 00:20:09.546 10:06:15 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:20:09.546 10:06:15 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:20:09.546 10:06:15 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2839504' 00:20:09.546 killing process with pid 2839504 00:20:09.546 10:06:15 -- common/autotest_common.sh@945 -- # kill 2839504 00:20:09.546 Received shutdown signal, test time was about 10.000000 seconds 00:20:09.546 00:20:09.546 Latency(us) 00:20:09.546 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:09.546 =================================================================================================================== 00:20:09.546 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:09.546 10:06:15 -- common/autotest_common.sh@950 -- # wait 2839504 00:20:09.804 10:06:15 -- target/tls.sh@37 -- # return 1 00:20:09.804 10:06:15 -- common/autotest_common.sh@643 -- # es=1 00:20:09.804 10:06:15 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:20:09.804 10:06:15 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:20:09.804 10:06:15 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:20:09.804 10:06:15 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:09.804 10:06:15 -- common/autotest_common.sh@640 -- # local es=0 00:20:09.804 10:06:15 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:09.804 10:06:15 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:20:09.804 10:06:15 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:09.804 10:06:15 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:20:09.804 10:06:15 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:09.804 10:06:15 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:09.804 10:06:15 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:09.804 10:06:15 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:09.804 10:06:15 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:20:09.804 10:06:15 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:09.804 10:06:15 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:09.804 10:06:15 -- target/tls.sh@28 -- # bdevperf_pid=2839651 00:20:09.804 10:06:15 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:09.804 10:06:15 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:09.804 10:06:15 -- target/tls.sh@31 -- # waitforlisten 2839651 /var/tmp/bdevperf.sock 00:20:09.804 10:06:15 -- common/autotest_common.sh@819 -- # '[' -z 2839651 ']' 00:20:09.804 10:06:15 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:09.804 10:06:15 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:09.804 10:06:15 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:09.804 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:09.804 10:06:15 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:09.804 10:06:15 -- common/autotest_common.sh@10 -- # set +x 00:20:09.804 [2024-07-13 10:06:15.437059] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:20:09.804 [2024-07-13 10:06:15.437157] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2839651 ] 00:20:09.804 EAL: No free 2048 kB hugepages reported on node 1 00:20:09.804 [2024-07-13 10:06:15.505034] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:09.804 [2024-07-13 10:06:15.593323] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:10.737 10:06:16 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:10.737 10:06:16 -- common/autotest_common.sh@852 -- # return 0 00:20:10.737 10:06:16 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:10.996 [2024-07-13 10:06:16.598986] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:10.996 [2024-07-13 10:06:16.604359] tcp.c: 866:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:20:10.996 [2024-07-13 10:06:16.604392] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:20:10.996 [2024-07-13 10:06:16.604449] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:10.996 [2024-07-13 10:06:16.604991] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20ea130 (107): Transport endpoint is not connected 00:20:10.996 [2024-07-13 10:06:16.605977] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20ea130 (9): Bad file descriptor 00:20:10.997 [2024-07-13 10:06:16.606976] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:10.997 [2024-07-13 10:06:16.607000] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:10.997 [2024-07-13 10:06:16.607015] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:10.997 request: 00:20:10.997 { 00:20:10.997 "name": "TLSTEST", 00:20:10.997 "trtype": "tcp", 00:20:10.997 "traddr": "10.0.0.2", 00:20:10.997 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:20:10.997 "adrfam": "ipv4", 00:20:10.997 "trsvcid": "4420", 00:20:10.997 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:10.997 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:20:10.997 "method": "bdev_nvme_attach_controller", 00:20:10.997 "req_id": 1 00:20:10.997 } 00:20:10.997 Got JSON-RPC error response 00:20:10.997 response: 00:20:10.997 { 00:20:10.997 "code": -32602, 00:20:10.997 "message": "Invalid parameters" 00:20:10.997 } 00:20:10.997 10:06:16 -- target/tls.sh@36 -- # killprocess 2839651 00:20:10.997 10:06:16 -- common/autotest_common.sh@926 -- # '[' -z 2839651 ']' 00:20:10.997 10:06:16 -- common/autotest_common.sh@930 -- # kill -0 2839651 00:20:10.997 10:06:16 -- common/autotest_common.sh@931 -- # uname 00:20:10.997 10:06:16 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:10.997 10:06:16 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2839651 00:20:10.997 10:06:16 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:20:10.997 10:06:16 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:20:10.997 10:06:16 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2839651' 00:20:10.997 killing process with pid 2839651 00:20:10.997 10:06:16 -- common/autotest_common.sh@945 -- # kill 2839651 00:20:10.997 Received shutdown signal, test time was about 10.000000 seconds 00:20:10.997 00:20:10.997 Latency(us) 00:20:10.997 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:10.997 =================================================================================================================== 00:20:10.997 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:10.997 10:06:16 -- common/autotest_common.sh@950 -- # wait 2839651 00:20:11.256 10:06:16 -- target/tls.sh@37 -- # return 1 00:20:11.256 10:06:16 -- common/autotest_common.sh@643 -- # es=1 00:20:11.256 10:06:16 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:20:11.256 10:06:16 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:20:11.256 10:06:16 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:20:11.256 10:06:16 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:11.256 10:06:16 -- common/autotest_common.sh@640 -- # local es=0 00:20:11.256 10:06:16 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:11.256 10:06:16 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:20:11.256 10:06:16 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:11.256 10:06:16 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:20:11.256 10:06:16 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:11.256 10:06:16 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:11.256 10:06:16 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:11.256 10:06:16 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:20:11.256 10:06:16 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:11.256 10:06:16 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:11.256 10:06:16 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:11.256 10:06:16 -- target/tls.sh@28 -- # bdevperf_pid=2839807 00:20:11.256 10:06:16 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:11.256 10:06:16 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:11.256 10:06:16 -- target/tls.sh@31 -- # waitforlisten 2839807 /var/tmp/bdevperf.sock 00:20:11.256 10:06:16 -- common/autotest_common.sh@819 -- # '[' -z 2839807 ']' 00:20:11.256 10:06:16 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:11.256 10:06:16 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:11.256 10:06:16 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:11.256 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:11.256 10:06:16 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:11.256 10:06:16 -- common/autotest_common.sh@10 -- # set +x 00:20:11.256 [2024-07-13 10:06:16.913816] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:20:11.256 [2024-07-13 10:06:16.913919] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2839807 ] 00:20:11.256 EAL: No free 2048 kB hugepages reported on node 1 00:20:11.256 [2024-07-13 10:06:16.974381] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:11.256 [2024-07-13 10:06:17.060053] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:12.190 10:06:17 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:12.190 10:06:17 -- common/autotest_common.sh@852 -- # return 0 00:20:12.190 10:06:17 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:12.449 [2024-07-13 10:06:18.088818] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:12.449 [2024-07-13 10:06:18.095841] tcp.c: 866:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:20:12.449 [2024-07-13 10:06:18.095902] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:20:12.449 [2024-07-13 10:06:18.095959] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:12.449 [2024-07-13 10:06:18.096893] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa06130 (107): Transport endpoint is not connected 00:20:12.449 [2024-07-13 10:06:18.097883] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa06130 (9): Bad file descriptor 00:20:12.449 [2024-07-13 10:06:18.098882] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:20:12.449 [2024-07-13 10:06:18.098904] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:12.449 [2024-07-13 10:06:18.098934] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:20:12.449 request: 00:20:12.449 { 00:20:12.449 "name": "TLSTEST", 00:20:12.449 "trtype": "tcp", 00:20:12.449 "traddr": "10.0.0.2", 00:20:12.449 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:12.449 "adrfam": "ipv4", 00:20:12.449 "trsvcid": "4420", 00:20:12.449 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:20:12.449 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:20:12.449 "method": "bdev_nvme_attach_controller", 00:20:12.449 "req_id": 1 00:20:12.449 } 00:20:12.449 Got JSON-RPC error response 00:20:12.449 response: 00:20:12.449 { 00:20:12.449 "code": -32602, 00:20:12.449 "message": "Invalid parameters" 00:20:12.449 } 00:20:12.449 10:06:18 -- target/tls.sh@36 -- # killprocess 2839807 00:20:12.449 10:06:18 -- common/autotest_common.sh@926 -- # '[' -z 2839807 ']' 00:20:12.449 10:06:18 -- common/autotest_common.sh@930 -- # kill -0 2839807 00:20:12.449 10:06:18 -- common/autotest_common.sh@931 -- # uname 00:20:12.449 10:06:18 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:12.449 10:06:18 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2839807 00:20:12.449 10:06:18 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:20:12.449 10:06:18 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:20:12.449 10:06:18 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2839807' 00:20:12.449 killing process with pid 2839807 00:20:12.449 10:06:18 -- common/autotest_common.sh@945 -- # kill 2839807 00:20:12.449 Received shutdown signal, test time was about 10.000000 seconds 00:20:12.449 00:20:12.449 Latency(us) 00:20:12.449 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:12.449 =================================================================================================================== 00:20:12.449 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:12.449 10:06:18 -- common/autotest_common.sh@950 -- # wait 2839807 00:20:12.709 10:06:18 -- target/tls.sh@37 -- # return 1 00:20:12.709 10:06:18 -- common/autotest_common.sh@643 -- # es=1 00:20:12.709 10:06:18 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:20:12.709 10:06:18 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:20:12.709 10:06:18 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:20:12.709 10:06:18 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:12.709 10:06:18 -- common/autotest_common.sh@640 -- # local es=0 00:20:12.709 10:06:18 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:12.709 10:06:18 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:20:12.709 10:06:18 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:12.709 10:06:18 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:20:12.709 10:06:18 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:12.709 10:06:18 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:12.709 10:06:18 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:12.709 10:06:18 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:12.709 10:06:18 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:12.709 10:06:18 -- target/tls.sh@23 -- # psk= 00:20:12.709 10:06:18 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:12.709 10:06:18 -- target/tls.sh@28 -- # bdevperf_pid=2840075 00:20:12.709 10:06:18 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:12.709 10:06:18 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:12.709 10:06:18 -- target/tls.sh@31 -- # waitforlisten 2840075 /var/tmp/bdevperf.sock 00:20:12.709 10:06:18 -- common/autotest_common.sh@819 -- # '[' -z 2840075 ']' 00:20:12.709 10:06:18 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:12.709 10:06:18 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:12.709 10:06:18 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:12.709 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:12.709 10:06:18 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:12.709 10:06:18 -- common/autotest_common.sh@10 -- # set +x 00:20:12.709 [2024-07-13 10:06:18.399455] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:20:12.709 [2024-07-13 10:06:18.399533] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2840075 ] 00:20:12.709 EAL: No free 2048 kB hugepages reported on node 1 00:20:12.709 [2024-07-13 10:06:18.456219] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:12.968 [2024-07-13 10:06:18.537804] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:13.534 10:06:19 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:13.534 10:06:19 -- common/autotest_common.sh@852 -- # return 0 00:20:13.534 10:06:19 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:20:13.792 [2024-07-13 10:06:19.559713] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:13.792 [2024-07-13 10:06:19.561235] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1eaa810 (9): Bad file descriptor 00:20:13.792 [2024-07-13 10:06:19.562220] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:13.792 [2024-07-13 10:06:19.562241] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:13.792 [2024-07-13 10:06:19.562255] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:13.792 request: 00:20:13.792 { 00:20:13.792 "name": "TLSTEST", 00:20:13.792 "trtype": "tcp", 00:20:13.792 "traddr": "10.0.0.2", 00:20:13.792 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:13.792 "adrfam": "ipv4", 00:20:13.792 "trsvcid": "4420", 00:20:13.792 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:13.792 "method": "bdev_nvme_attach_controller", 00:20:13.792 "req_id": 1 00:20:13.792 } 00:20:13.792 Got JSON-RPC error response 00:20:13.792 response: 00:20:13.792 { 00:20:13.792 "code": -32602, 00:20:13.792 "message": "Invalid parameters" 00:20:13.792 } 00:20:13.792 10:06:19 -- target/tls.sh@36 -- # killprocess 2840075 00:20:13.792 10:06:19 -- common/autotest_common.sh@926 -- # '[' -z 2840075 ']' 00:20:13.792 10:06:19 -- common/autotest_common.sh@930 -- # kill -0 2840075 00:20:13.792 10:06:19 -- common/autotest_common.sh@931 -- # uname 00:20:13.792 10:06:19 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:13.792 10:06:19 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2840075 00:20:14.051 10:06:19 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:20:14.051 10:06:19 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:20:14.051 10:06:19 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2840075' 00:20:14.051 killing process with pid 2840075 00:20:14.051 10:06:19 -- common/autotest_common.sh@945 -- # kill 2840075 00:20:14.051 Received shutdown signal, test time was about 10.000000 seconds 00:20:14.051 00:20:14.051 Latency(us) 00:20:14.051 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:14.051 =================================================================================================================== 00:20:14.051 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:14.051 10:06:19 -- common/autotest_common.sh@950 -- # wait 2840075 00:20:14.051 10:06:19 -- target/tls.sh@37 -- # return 1 00:20:14.051 10:06:19 -- common/autotest_common.sh@643 -- # es=1 00:20:14.051 10:06:19 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:20:14.051 10:06:19 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:20:14.051 10:06:19 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:20:14.051 10:06:19 -- target/tls.sh@167 -- # killprocess 2835561 00:20:14.051 10:06:19 -- common/autotest_common.sh@926 -- # '[' -z 2835561 ']' 00:20:14.051 10:06:19 -- common/autotest_common.sh@930 -- # kill -0 2835561 00:20:14.051 10:06:19 -- common/autotest_common.sh@931 -- # uname 00:20:14.051 10:06:19 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:14.051 10:06:19 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2835561 00:20:14.051 10:06:19 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:20:14.051 10:06:19 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:20:14.051 10:06:19 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2835561' 00:20:14.051 killing process with pid 2835561 00:20:14.051 10:06:19 -- common/autotest_common.sh@945 -- # kill 2835561 00:20:14.051 10:06:19 -- common/autotest_common.sh@950 -- # wait 2835561 00:20:14.310 10:06:20 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:20:14.310 10:06:20 -- target/tls.sh@49 -- # local key hash crc 00:20:14.310 10:06:20 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:20:14.310 10:06:20 -- target/tls.sh@51 -- # hash=02 00:20:14.310 10:06:20 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:20:14.310 10:06:20 -- target/tls.sh@52 -- # gzip -1 -c 00:20:14.310 10:06:20 -- target/tls.sh@52 -- # tail -c8 00:20:14.310 10:06:20 -- target/tls.sh@52 -- # head -c 4 00:20:14.310 10:06:20 -- target/tls.sh@52 -- # crc='�e�'\''' 00:20:14.310 10:06:20 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:14.310 10:06:20 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:20:14.310 10:06:20 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:14.310 10:06:20 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:14.310 10:06:20 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:14.310 10:06:20 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:14.310 10:06:20 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:14.310 10:06:20 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:20:14.310 10:06:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:14.310 10:06:20 -- common/autotest_common.sh@712 -- # xtrace_disable 00:20:14.310 10:06:20 -- common/autotest_common.sh@10 -- # set +x 00:20:14.569 10:06:20 -- nvmf/common.sh@469 -- # nvmfpid=2840245 00:20:14.569 10:06:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:14.569 10:06:20 -- nvmf/common.sh@470 -- # waitforlisten 2840245 00:20:14.569 10:06:20 -- common/autotest_common.sh@819 -- # '[' -z 2840245 ']' 00:20:14.569 10:06:20 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:14.569 10:06:20 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:14.569 10:06:20 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:14.569 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:14.569 10:06:20 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:14.569 10:06:20 -- common/autotest_common.sh@10 -- # set +x 00:20:14.569 [2024-07-13 10:06:20.174700] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:20:14.569 [2024-07-13 10:06:20.174779] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:14.569 EAL: No free 2048 kB hugepages reported on node 1 00:20:14.569 [2024-07-13 10:06:20.238955] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:14.569 [2024-07-13 10:06:20.326224] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:14.569 [2024-07-13 10:06:20.326392] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:14.569 [2024-07-13 10:06:20.326411] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:14.569 [2024-07-13 10:06:20.326423] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:14.569 [2024-07-13 10:06:20.326455] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:15.500 10:06:21 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:15.500 10:06:21 -- common/autotest_common.sh@852 -- # return 0 00:20:15.500 10:06:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:15.500 10:06:21 -- common/autotest_common.sh@718 -- # xtrace_disable 00:20:15.500 10:06:21 -- common/autotest_common.sh@10 -- # set +x 00:20:15.500 10:06:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:15.500 10:06:21 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:15.500 10:06:21 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:15.500 10:06:21 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:15.757 [2024-07-13 10:06:21.346139] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:15.757 10:06:21 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:16.015 10:06:21 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:16.273 [2024-07-13 10:06:21.839460] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:16.273 [2024-07-13 10:06:21.839677] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:16.273 10:06:21 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:16.273 malloc0 00:20:16.531 10:06:22 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:16.531 10:06:22 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:17.097 10:06:22 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:17.097 10:06:22 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:17.097 10:06:22 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:17.097 10:06:22 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:17.097 10:06:22 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:20:17.097 10:06:22 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:17.097 10:06:22 -- target/tls.sh@28 -- # bdevperf_pid=2840567 00:20:17.097 10:06:22 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:17.097 10:06:22 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:17.097 10:06:22 -- target/tls.sh@31 -- # waitforlisten 2840567 /var/tmp/bdevperf.sock 00:20:17.097 10:06:22 -- common/autotest_common.sh@819 -- # '[' -z 2840567 ']' 00:20:17.097 10:06:22 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:17.097 10:06:22 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:17.097 10:06:22 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:17.097 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:17.097 10:06:22 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:17.097 10:06:22 -- common/autotest_common.sh@10 -- # set +x 00:20:17.097 [2024-07-13 10:06:22.659568] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:20:17.097 [2024-07-13 10:06:22.659674] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2840567 ] 00:20:17.097 EAL: No free 2048 kB hugepages reported on node 1 00:20:17.097 [2024-07-13 10:06:22.723660] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:17.097 [2024-07-13 10:06:22.807501] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:18.028 10:06:23 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:18.028 10:06:23 -- common/autotest_common.sh@852 -- # return 0 00:20:18.028 10:06:23 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:18.285 [2024-07-13 10:06:23.888008] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:18.285 TLSTESTn1 00:20:18.285 10:06:23 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:18.285 Running I/O for 10 seconds... 00:20:30.479 00:20:30.479 Latency(us) 00:20:30.479 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:30.479 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:30.479 Verification LBA range: start 0x0 length 0x2000 00:20:30.479 TLSTESTn1 : 10.03 2905.47 11.35 0.00 0.00 43987.37 9806.13 49127.73 00:20:30.479 =================================================================================================================== 00:20:30.479 Total : 2905.47 11.35 0.00 0.00 43987.37 9806.13 49127.73 00:20:30.479 0 00:20:30.479 10:06:34 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:30.479 10:06:34 -- target/tls.sh@45 -- # killprocess 2840567 00:20:30.479 10:06:34 -- common/autotest_common.sh@926 -- # '[' -z 2840567 ']' 00:20:30.479 10:06:34 -- common/autotest_common.sh@930 -- # kill -0 2840567 00:20:30.479 10:06:34 -- common/autotest_common.sh@931 -- # uname 00:20:30.479 10:06:34 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:30.479 10:06:34 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2840567 00:20:30.479 10:06:34 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:20:30.479 10:06:34 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:20:30.479 10:06:34 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2840567' 00:20:30.479 killing process with pid 2840567 00:20:30.479 10:06:34 -- common/autotest_common.sh@945 -- # kill 2840567 00:20:30.479 Received shutdown signal, test time was about 10.000000 seconds 00:20:30.479 00:20:30.479 Latency(us) 00:20:30.479 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:30.479 =================================================================================================================== 00:20:30.479 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:30.479 10:06:34 -- common/autotest_common.sh@950 -- # wait 2840567 00:20:30.479 10:06:34 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:30.479 10:06:34 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:30.479 10:06:34 -- common/autotest_common.sh@640 -- # local es=0 00:20:30.479 10:06:34 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:30.479 10:06:34 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:20:30.479 10:06:34 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:30.479 10:06:34 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:20:30.479 10:06:34 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:30.479 10:06:34 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:30.479 10:06:34 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:30.479 10:06:34 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:30.479 10:06:34 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:30.479 10:06:34 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:20:30.479 10:06:34 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:30.479 10:06:34 -- target/tls.sh@28 -- # bdevperf_pid=2842036 00:20:30.479 10:06:34 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:30.479 10:06:34 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:30.479 10:06:34 -- target/tls.sh@31 -- # waitforlisten 2842036 /var/tmp/bdevperf.sock 00:20:30.479 10:06:34 -- common/autotest_common.sh@819 -- # '[' -z 2842036 ']' 00:20:30.479 10:06:34 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:30.479 10:06:34 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:30.479 10:06:34 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:30.479 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:30.479 10:06:34 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:30.479 10:06:34 -- common/autotest_common.sh@10 -- # set +x 00:20:30.479 [2024-07-13 10:06:34.433319] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:20:30.479 [2024-07-13 10:06:34.433398] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2842036 ] 00:20:30.479 EAL: No free 2048 kB hugepages reported on node 1 00:20:30.479 [2024-07-13 10:06:34.489620] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:30.479 [2024-07-13 10:06:34.568342] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:30.479 10:06:35 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:30.479 10:06:35 -- common/autotest_common.sh@852 -- # return 0 00:20:30.479 10:06:35 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:30.479 [2024-07-13 10:06:35.568294] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:30.479 [2024-07-13 10:06:35.568360] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:20:30.479 request: 00:20:30.479 { 00:20:30.479 "name": "TLSTEST", 00:20:30.479 "trtype": "tcp", 00:20:30.479 "traddr": "10.0.0.2", 00:20:30.479 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:30.479 "adrfam": "ipv4", 00:20:30.479 "trsvcid": "4420", 00:20:30.479 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:30.479 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:30.479 "method": "bdev_nvme_attach_controller", 00:20:30.479 "req_id": 1 00:20:30.479 } 00:20:30.479 Got JSON-RPC error response 00:20:30.479 response: 00:20:30.479 { 00:20:30.479 "code": -22, 00:20:30.479 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:20:30.479 } 00:20:30.479 10:06:35 -- target/tls.sh@36 -- # killprocess 2842036 00:20:30.479 10:06:35 -- common/autotest_common.sh@926 -- # '[' -z 2842036 ']' 00:20:30.479 10:06:35 -- common/autotest_common.sh@930 -- # kill -0 2842036 00:20:30.479 10:06:35 -- common/autotest_common.sh@931 -- # uname 00:20:30.479 10:06:35 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:30.479 10:06:35 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2842036 00:20:30.479 10:06:35 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:20:30.479 10:06:35 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:20:30.479 10:06:35 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2842036' 00:20:30.479 killing process with pid 2842036 00:20:30.479 10:06:35 -- common/autotest_common.sh@945 -- # kill 2842036 00:20:30.479 Received shutdown signal, test time was about 10.000000 seconds 00:20:30.479 00:20:30.479 Latency(us) 00:20:30.479 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:30.479 =================================================================================================================== 00:20:30.479 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:30.479 10:06:35 -- common/autotest_common.sh@950 -- # wait 2842036 00:20:30.479 10:06:35 -- target/tls.sh@37 -- # return 1 00:20:30.479 10:06:35 -- common/autotest_common.sh@643 -- # es=1 00:20:30.479 10:06:35 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:20:30.480 10:06:35 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:20:30.480 10:06:35 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:20:30.480 10:06:35 -- target/tls.sh@183 -- # killprocess 2840245 00:20:30.480 10:06:35 -- common/autotest_common.sh@926 -- # '[' -z 2840245 ']' 00:20:30.480 10:06:35 -- common/autotest_common.sh@930 -- # kill -0 2840245 00:20:30.480 10:06:35 -- common/autotest_common.sh@931 -- # uname 00:20:30.480 10:06:35 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:30.480 10:06:35 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2840245 00:20:30.480 10:06:35 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:20:30.480 10:06:35 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:20:30.480 10:06:35 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2840245' 00:20:30.480 killing process with pid 2840245 00:20:30.480 10:06:35 -- common/autotest_common.sh@945 -- # kill 2840245 00:20:30.480 10:06:35 -- common/autotest_common.sh@950 -- # wait 2840245 00:20:30.480 10:06:36 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:20:30.480 10:06:36 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:30.480 10:06:36 -- common/autotest_common.sh@712 -- # xtrace_disable 00:20:30.480 10:06:36 -- common/autotest_common.sh@10 -- # set +x 00:20:30.480 10:06:36 -- nvmf/common.sh@469 -- # nvmfpid=2842193 00:20:30.480 10:06:36 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:30.480 10:06:36 -- nvmf/common.sh@470 -- # waitforlisten 2842193 00:20:30.480 10:06:36 -- common/autotest_common.sh@819 -- # '[' -z 2842193 ']' 00:20:30.480 10:06:36 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:30.480 10:06:36 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:30.480 10:06:36 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:30.480 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:30.480 10:06:36 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:30.480 10:06:36 -- common/autotest_common.sh@10 -- # set +x 00:20:30.480 [2024-07-13 10:06:36.170759] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:20:30.480 [2024-07-13 10:06:36.170844] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:30.480 EAL: No free 2048 kB hugepages reported on node 1 00:20:30.480 [2024-07-13 10:06:36.242895] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:30.738 [2024-07-13 10:06:36.334443] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:30.738 [2024-07-13 10:06:36.334614] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:30.738 [2024-07-13 10:06:36.334634] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:30.738 [2024-07-13 10:06:36.334649] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:30.738 [2024-07-13 10:06:36.334680] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:31.728 10:06:37 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:31.728 10:06:37 -- common/autotest_common.sh@852 -- # return 0 00:20:31.728 10:06:37 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:31.728 10:06:37 -- common/autotest_common.sh@718 -- # xtrace_disable 00:20:31.728 10:06:37 -- common/autotest_common.sh@10 -- # set +x 00:20:31.728 10:06:37 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:31.728 10:06:37 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:31.728 10:06:37 -- common/autotest_common.sh@640 -- # local es=0 00:20:31.728 10:06:37 -- common/autotest_common.sh@642 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:31.728 10:06:37 -- common/autotest_common.sh@628 -- # local arg=setup_nvmf_tgt 00:20:31.728 10:06:37 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:31.728 10:06:37 -- common/autotest_common.sh@632 -- # type -t setup_nvmf_tgt 00:20:31.728 10:06:37 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:31.728 10:06:37 -- common/autotest_common.sh@643 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:31.728 10:06:37 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:31.728 10:06:37 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:31.728 [2024-07-13 10:06:37.432931] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:31.728 10:06:37 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:31.985 10:06:37 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:32.243 [2024-07-13 10:06:37.958390] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:32.243 [2024-07-13 10:06:37.958649] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:32.243 10:06:37 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:32.500 malloc0 00:20:32.500 10:06:38 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:32.758 10:06:38 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:33.016 [2024-07-13 10:06:38.759516] tcp.c:3549:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:20:33.016 [2024-07-13 10:06:38.759564] tcp.c:3618:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:20:33.016 [2024-07-13 10:06:38.759589] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:20:33.016 request: 00:20:33.016 { 00:20:33.016 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:33.016 "host": "nqn.2016-06.io.spdk:host1", 00:20:33.016 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:33.016 "method": "nvmf_subsystem_add_host", 00:20:33.016 "req_id": 1 00:20:33.016 } 00:20:33.016 Got JSON-RPC error response 00:20:33.016 response: 00:20:33.016 { 00:20:33.016 "code": -32603, 00:20:33.016 "message": "Internal error" 00:20:33.016 } 00:20:33.016 10:06:38 -- common/autotest_common.sh@643 -- # es=1 00:20:33.016 10:06:38 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:20:33.016 10:06:38 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:20:33.016 10:06:38 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:20:33.016 10:06:38 -- target/tls.sh@189 -- # killprocess 2842193 00:20:33.016 10:06:38 -- common/autotest_common.sh@926 -- # '[' -z 2842193 ']' 00:20:33.016 10:06:38 -- common/autotest_common.sh@930 -- # kill -0 2842193 00:20:33.016 10:06:38 -- common/autotest_common.sh@931 -- # uname 00:20:33.016 10:06:38 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:33.016 10:06:38 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2842193 00:20:33.016 10:06:38 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:20:33.016 10:06:38 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:20:33.016 10:06:38 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2842193' 00:20:33.016 killing process with pid 2842193 00:20:33.016 10:06:38 -- common/autotest_common.sh@945 -- # kill 2842193 00:20:33.016 10:06:38 -- common/autotest_common.sh@950 -- # wait 2842193 00:20:33.274 10:06:39 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:33.274 10:06:39 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:20:33.274 10:06:39 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:33.274 10:06:39 -- common/autotest_common.sh@712 -- # xtrace_disable 00:20:33.274 10:06:39 -- common/autotest_common.sh@10 -- # set +x 00:20:33.274 10:06:39 -- nvmf/common.sh@469 -- # nvmfpid=2842633 00:20:33.274 10:06:39 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:33.274 10:06:39 -- nvmf/common.sh@470 -- # waitforlisten 2842633 00:20:33.274 10:06:39 -- common/autotest_common.sh@819 -- # '[' -z 2842633 ']' 00:20:33.274 10:06:39 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:33.274 10:06:39 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:33.274 10:06:39 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:33.274 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:33.274 10:06:39 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:33.274 10:06:39 -- common/autotest_common.sh@10 -- # set +x 00:20:33.533 [2024-07-13 10:06:39.109891] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:20:33.533 [2024-07-13 10:06:39.109989] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:33.533 EAL: No free 2048 kB hugepages reported on node 1 00:20:33.533 [2024-07-13 10:06:39.178399] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:33.533 [2024-07-13 10:06:39.263200] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:33.533 [2024-07-13 10:06:39.263377] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:33.533 [2024-07-13 10:06:39.263399] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:33.533 [2024-07-13 10:06:39.263414] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:33.533 [2024-07-13 10:06:39.263457] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:34.467 10:06:40 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:34.467 10:06:40 -- common/autotest_common.sh@852 -- # return 0 00:20:34.467 10:06:40 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:34.467 10:06:40 -- common/autotest_common.sh@718 -- # xtrace_disable 00:20:34.467 10:06:40 -- common/autotest_common.sh@10 -- # set +x 00:20:34.467 10:06:40 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:34.467 10:06:40 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:34.467 10:06:40 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:34.467 10:06:40 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:34.467 [2024-07-13 10:06:40.255190] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:34.467 10:06:40 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:34.725 10:06:40 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:34.983 [2024-07-13 10:06:40.744517] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:34.983 [2024-07-13 10:06:40.744763] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:34.983 10:06:40 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:35.241 malloc0 00:20:35.241 10:06:41 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:35.499 10:06:41 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:35.757 10:06:41 -- target/tls.sh@197 -- # bdevperf_pid=2842933 00:20:35.757 10:06:41 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:35.757 10:06:41 -- target/tls.sh@200 -- # waitforlisten 2842933 /var/tmp/bdevperf.sock 00:20:35.757 10:06:41 -- common/autotest_common.sh@819 -- # '[' -z 2842933 ']' 00:20:35.757 10:06:41 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:35.757 10:06:41 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:35.757 10:06:41 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:35.757 10:06:41 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:35.757 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:35.757 10:06:41 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:35.757 10:06:41 -- common/autotest_common.sh@10 -- # set +x 00:20:36.015 [2024-07-13 10:06:41.576495] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:20:36.015 [2024-07-13 10:06:41.576584] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2842933 ] 00:20:36.015 EAL: No free 2048 kB hugepages reported on node 1 00:20:36.015 [2024-07-13 10:06:41.635277] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:36.015 [2024-07-13 10:06:41.719396] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:36.944 10:06:42 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:36.944 10:06:42 -- common/autotest_common.sh@852 -- # return 0 00:20:36.944 10:06:42 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:36.944 [2024-07-13 10:06:42.759454] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:37.202 TLSTESTn1 00:20:37.202 10:06:42 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:20:37.459 10:06:43 -- target/tls.sh@205 -- # tgtconf='{ 00:20:37.459 "subsystems": [ 00:20:37.459 { 00:20:37.459 "subsystem": "iobuf", 00:20:37.459 "config": [ 00:20:37.459 { 00:20:37.459 "method": "iobuf_set_options", 00:20:37.459 "params": { 00:20:37.459 "small_pool_count": 8192, 00:20:37.459 "large_pool_count": 1024, 00:20:37.459 "small_bufsize": 8192, 00:20:37.459 "large_bufsize": 135168 00:20:37.459 } 00:20:37.459 } 00:20:37.459 ] 00:20:37.459 }, 00:20:37.459 { 00:20:37.459 "subsystem": "sock", 00:20:37.459 "config": [ 00:20:37.459 { 00:20:37.459 "method": "sock_impl_set_options", 00:20:37.459 "params": { 00:20:37.459 "impl_name": "posix", 00:20:37.459 "recv_buf_size": 2097152, 00:20:37.459 "send_buf_size": 2097152, 00:20:37.459 "enable_recv_pipe": true, 00:20:37.459 "enable_quickack": false, 00:20:37.459 "enable_placement_id": 0, 00:20:37.459 "enable_zerocopy_send_server": true, 00:20:37.459 "enable_zerocopy_send_client": false, 00:20:37.459 "zerocopy_threshold": 0, 00:20:37.459 "tls_version": 0, 00:20:37.459 "enable_ktls": false 00:20:37.459 } 00:20:37.459 }, 00:20:37.459 { 00:20:37.459 "method": "sock_impl_set_options", 00:20:37.459 "params": { 00:20:37.459 "impl_name": "ssl", 00:20:37.459 "recv_buf_size": 4096, 00:20:37.459 "send_buf_size": 4096, 00:20:37.459 "enable_recv_pipe": true, 00:20:37.459 "enable_quickack": false, 00:20:37.459 "enable_placement_id": 0, 00:20:37.459 "enable_zerocopy_send_server": true, 00:20:37.459 "enable_zerocopy_send_client": false, 00:20:37.459 "zerocopy_threshold": 0, 00:20:37.459 "tls_version": 0, 00:20:37.459 "enable_ktls": false 00:20:37.459 } 00:20:37.459 } 00:20:37.459 ] 00:20:37.459 }, 00:20:37.459 { 00:20:37.459 "subsystem": "vmd", 00:20:37.459 "config": [] 00:20:37.459 }, 00:20:37.459 { 00:20:37.459 "subsystem": "accel", 00:20:37.459 "config": [ 00:20:37.459 { 00:20:37.459 "method": "accel_set_options", 00:20:37.459 "params": { 00:20:37.459 "small_cache_size": 128, 00:20:37.459 "large_cache_size": 16, 00:20:37.459 "task_count": 2048, 00:20:37.459 "sequence_count": 2048, 00:20:37.459 "buf_count": 2048 00:20:37.459 } 00:20:37.459 } 00:20:37.459 ] 00:20:37.459 }, 00:20:37.459 { 00:20:37.459 "subsystem": "bdev", 00:20:37.459 "config": [ 00:20:37.459 { 00:20:37.459 "method": "bdev_set_options", 00:20:37.459 "params": { 00:20:37.459 "bdev_io_pool_size": 65535, 00:20:37.459 "bdev_io_cache_size": 256, 00:20:37.459 "bdev_auto_examine": true, 00:20:37.459 "iobuf_small_cache_size": 128, 00:20:37.459 "iobuf_large_cache_size": 16 00:20:37.459 } 00:20:37.459 }, 00:20:37.459 { 00:20:37.459 "method": "bdev_raid_set_options", 00:20:37.459 "params": { 00:20:37.459 "process_window_size_kb": 1024 00:20:37.459 } 00:20:37.459 }, 00:20:37.459 { 00:20:37.460 "method": "bdev_iscsi_set_options", 00:20:37.460 "params": { 00:20:37.460 "timeout_sec": 30 00:20:37.460 } 00:20:37.460 }, 00:20:37.460 { 00:20:37.460 "method": "bdev_nvme_set_options", 00:20:37.460 "params": { 00:20:37.460 "action_on_timeout": "none", 00:20:37.460 "timeout_us": 0, 00:20:37.460 "timeout_admin_us": 0, 00:20:37.460 "keep_alive_timeout_ms": 10000, 00:20:37.460 "transport_retry_count": 4, 00:20:37.460 "arbitration_burst": 0, 00:20:37.460 "low_priority_weight": 0, 00:20:37.460 "medium_priority_weight": 0, 00:20:37.460 "high_priority_weight": 0, 00:20:37.460 "nvme_adminq_poll_period_us": 10000, 00:20:37.460 "nvme_ioq_poll_period_us": 0, 00:20:37.460 "io_queue_requests": 0, 00:20:37.460 "delay_cmd_submit": true, 00:20:37.460 "bdev_retry_count": 3, 00:20:37.460 "transport_ack_timeout": 0, 00:20:37.460 "ctrlr_loss_timeout_sec": 0, 00:20:37.460 "reconnect_delay_sec": 0, 00:20:37.460 "fast_io_fail_timeout_sec": 0, 00:20:37.460 "generate_uuids": false, 00:20:37.460 "transport_tos": 0, 00:20:37.460 "io_path_stat": false, 00:20:37.460 "allow_accel_sequence": false 00:20:37.460 } 00:20:37.460 }, 00:20:37.460 { 00:20:37.460 "method": "bdev_nvme_set_hotplug", 00:20:37.460 "params": { 00:20:37.460 "period_us": 100000, 00:20:37.460 "enable": false 00:20:37.460 } 00:20:37.460 }, 00:20:37.460 { 00:20:37.460 "method": "bdev_malloc_create", 00:20:37.460 "params": { 00:20:37.460 "name": "malloc0", 00:20:37.460 "num_blocks": 8192, 00:20:37.460 "block_size": 4096, 00:20:37.460 "physical_block_size": 4096, 00:20:37.460 "uuid": "163873c5-34de-4d2e-a304-f4f07a8dcb40", 00:20:37.460 "optimal_io_boundary": 0 00:20:37.460 } 00:20:37.460 }, 00:20:37.460 { 00:20:37.460 "method": "bdev_wait_for_examine" 00:20:37.460 } 00:20:37.460 ] 00:20:37.460 }, 00:20:37.460 { 00:20:37.460 "subsystem": "nbd", 00:20:37.460 "config": [] 00:20:37.460 }, 00:20:37.460 { 00:20:37.460 "subsystem": "scheduler", 00:20:37.460 "config": [ 00:20:37.460 { 00:20:37.460 "method": "framework_set_scheduler", 00:20:37.460 "params": { 00:20:37.460 "name": "static" 00:20:37.460 } 00:20:37.460 } 00:20:37.460 ] 00:20:37.460 }, 00:20:37.460 { 00:20:37.460 "subsystem": "nvmf", 00:20:37.460 "config": [ 00:20:37.460 { 00:20:37.460 "method": "nvmf_set_config", 00:20:37.460 "params": { 00:20:37.460 "discovery_filter": "match_any", 00:20:37.460 "admin_cmd_passthru": { 00:20:37.460 "identify_ctrlr": false 00:20:37.460 } 00:20:37.460 } 00:20:37.460 }, 00:20:37.460 { 00:20:37.460 "method": "nvmf_set_max_subsystems", 00:20:37.460 "params": { 00:20:37.460 "max_subsystems": 1024 00:20:37.460 } 00:20:37.460 }, 00:20:37.460 { 00:20:37.460 "method": "nvmf_set_crdt", 00:20:37.460 "params": { 00:20:37.460 "crdt1": 0, 00:20:37.460 "crdt2": 0, 00:20:37.460 "crdt3": 0 00:20:37.460 } 00:20:37.460 }, 00:20:37.460 { 00:20:37.460 "method": "nvmf_create_transport", 00:20:37.460 "params": { 00:20:37.460 "trtype": "TCP", 00:20:37.460 "max_queue_depth": 128, 00:20:37.460 "max_io_qpairs_per_ctrlr": 127, 00:20:37.460 "in_capsule_data_size": 4096, 00:20:37.460 "max_io_size": 131072, 00:20:37.460 "io_unit_size": 131072, 00:20:37.460 "max_aq_depth": 128, 00:20:37.460 "num_shared_buffers": 511, 00:20:37.460 "buf_cache_size": 4294967295, 00:20:37.460 "dif_insert_or_strip": false, 00:20:37.460 "zcopy": false, 00:20:37.460 "c2h_success": false, 00:20:37.460 "sock_priority": 0, 00:20:37.460 "abort_timeout_sec": 1 00:20:37.460 } 00:20:37.460 }, 00:20:37.460 { 00:20:37.460 "method": "nvmf_create_subsystem", 00:20:37.460 "params": { 00:20:37.460 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:37.460 "allow_any_host": false, 00:20:37.460 "serial_number": "SPDK00000000000001", 00:20:37.460 "model_number": "SPDK bdev Controller", 00:20:37.460 "max_namespaces": 10, 00:20:37.460 "min_cntlid": 1, 00:20:37.460 "max_cntlid": 65519, 00:20:37.460 "ana_reporting": false 00:20:37.460 } 00:20:37.460 }, 00:20:37.460 { 00:20:37.460 "method": "nvmf_subsystem_add_host", 00:20:37.460 "params": { 00:20:37.460 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:37.460 "host": "nqn.2016-06.io.spdk:host1", 00:20:37.460 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:20:37.460 } 00:20:37.460 }, 00:20:37.460 { 00:20:37.460 "method": "nvmf_subsystem_add_ns", 00:20:37.460 "params": { 00:20:37.460 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:37.460 "namespace": { 00:20:37.460 "nsid": 1, 00:20:37.460 "bdev_name": "malloc0", 00:20:37.460 "nguid": "163873C534DE4D2EA304F4F07A8DCB40", 00:20:37.460 "uuid": "163873c5-34de-4d2e-a304-f4f07a8dcb40" 00:20:37.460 } 00:20:37.460 } 00:20:37.460 }, 00:20:37.460 { 00:20:37.460 "method": "nvmf_subsystem_add_listener", 00:20:37.460 "params": { 00:20:37.460 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:37.460 "listen_address": { 00:20:37.460 "trtype": "TCP", 00:20:37.460 "adrfam": "IPv4", 00:20:37.460 "traddr": "10.0.0.2", 00:20:37.460 "trsvcid": "4420" 00:20:37.460 }, 00:20:37.460 "secure_channel": true 00:20:37.460 } 00:20:37.460 } 00:20:37.460 ] 00:20:37.460 } 00:20:37.460 ] 00:20:37.460 }' 00:20:37.460 10:06:43 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:20:37.718 10:06:43 -- target/tls.sh@206 -- # bdevperfconf='{ 00:20:37.718 "subsystems": [ 00:20:37.718 { 00:20:37.718 "subsystem": "iobuf", 00:20:37.718 "config": [ 00:20:37.718 { 00:20:37.718 "method": "iobuf_set_options", 00:20:37.718 "params": { 00:20:37.718 "small_pool_count": 8192, 00:20:37.718 "large_pool_count": 1024, 00:20:37.718 "small_bufsize": 8192, 00:20:37.718 "large_bufsize": 135168 00:20:37.718 } 00:20:37.718 } 00:20:37.718 ] 00:20:37.718 }, 00:20:37.718 { 00:20:37.718 "subsystem": "sock", 00:20:37.718 "config": [ 00:20:37.718 { 00:20:37.718 "method": "sock_impl_set_options", 00:20:37.718 "params": { 00:20:37.718 "impl_name": "posix", 00:20:37.718 "recv_buf_size": 2097152, 00:20:37.718 "send_buf_size": 2097152, 00:20:37.718 "enable_recv_pipe": true, 00:20:37.718 "enable_quickack": false, 00:20:37.718 "enable_placement_id": 0, 00:20:37.718 "enable_zerocopy_send_server": true, 00:20:37.718 "enable_zerocopy_send_client": false, 00:20:37.718 "zerocopy_threshold": 0, 00:20:37.718 "tls_version": 0, 00:20:37.718 "enable_ktls": false 00:20:37.718 } 00:20:37.718 }, 00:20:37.718 { 00:20:37.718 "method": "sock_impl_set_options", 00:20:37.718 "params": { 00:20:37.718 "impl_name": "ssl", 00:20:37.718 "recv_buf_size": 4096, 00:20:37.718 "send_buf_size": 4096, 00:20:37.718 "enable_recv_pipe": true, 00:20:37.718 "enable_quickack": false, 00:20:37.718 "enable_placement_id": 0, 00:20:37.718 "enable_zerocopy_send_server": true, 00:20:37.718 "enable_zerocopy_send_client": false, 00:20:37.718 "zerocopy_threshold": 0, 00:20:37.718 "tls_version": 0, 00:20:37.718 "enable_ktls": false 00:20:37.718 } 00:20:37.718 } 00:20:37.718 ] 00:20:37.718 }, 00:20:37.718 { 00:20:37.718 "subsystem": "vmd", 00:20:37.718 "config": [] 00:20:37.718 }, 00:20:37.718 { 00:20:37.718 "subsystem": "accel", 00:20:37.718 "config": [ 00:20:37.718 { 00:20:37.718 "method": "accel_set_options", 00:20:37.718 "params": { 00:20:37.718 "small_cache_size": 128, 00:20:37.718 "large_cache_size": 16, 00:20:37.718 "task_count": 2048, 00:20:37.718 "sequence_count": 2048, 00:20:37.718 "buf_count": 2048 00:20:37.718 } 00:20:37.718 } 00:20:37.718 ] 00:20:37.718 }, 00:20:37.718 { 00:20:37.718 "subsystem": "bdev", 00:20:37.718 "config": [ 00:20:37.718 { 00:20:37.718 "method": "bdev_set_options", 00:20:37.718 "params": { 00:20:37.718 "bdev_io_pool_size": 65535, 00:20:37.718 "bdev_io_cache_size": 256, 00:20:37.718 "bdev_auto_examine": true, 00:20:37.718 "iobuf_small_cache_size": 128, 00:20:37.719 "iobuf_large_cache_size": 16 00:20:37.719 } 00:20:37.719 }, 00:20:37.719 { 00:20:37.719 "method": "bdev_raid_set_options", 00:20:37.719 "params": { 00:20:37.719 "process_window_size_kb": 1024 00:20:37.719 } 00:20:37.719 }, 00:20:37.719 { 00:20:37.719 "method": "bdev_iscsi_set_options", 00:20:37.719 "params": { 00:20:37.719 "timeout_sec": 30 00:20:37.719 } 00:20:37.719 }, 00:20:37.719 { 00:20:37.719 "method": "bdev_nvme_set_options", 00:20:37.719 "params": { 00:20:37.719 "action_on_timeout": "none", 00:20:37.719 "timeout_us": 0, 00:20:37.719 "timeout_admin_us": 0, 00:20:37.719 "keep_alive_timeout_ms": 10000, 00:20:37.719 "transport_retry_count": 4, 00:20:37.719 "arbitration_burst": 0, 00:20:37.719 "low_priority_weight": 0, 00:20:37.719 "medium_priority_weight": 0, 00:20:37.719 "high_priority_weight": 0, 00:20:37.719 "nvme_adminq_poll_period_us": 10000, 00:20:37.719 "nvme_ioq_poll_period_us": 0, 00:20:37.719 "io_queue_requests": 512, 00:20:37.719 "delay_cmd_submit": true, 00:20:37.719 "bdev_retry_count": 3, 00:20:37.719 "transport_ack_timeout": 0, 00:20:37.719 "ctrlr_loss_timeout_sec": 0, 00:20:37.719 "reconnect_delay_sec": 0, 00:20:37.719 "fast_io_fail_timeout_sec": 0, 00:20:37.719 "generate_uuids": false, 00:20:37.719 "transport_tos": 0, 00:20:37.719 "io_path_stat": false, 00:20:37.719 "allow_accel_sequence": false 00:20:37.719 } 00:20:37.719 }, 00:20:37.719 { 00:20:37.719 "method": "bdev_nvme_attach_controller", 00:20:37.719 "params": { 00:20:37.719 "name": "TLSTEST", 00:20:37.719 "trtype": "TCP", 00:20:37.719 "adrfam": "IPv4", 00:20:37.719 "traddr": "10.0.0.2", 00:20:37.719 "trsvcid": "4420", 00:20:37.719 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:37.719 "prchk_reftag": false, 00:20:37.719 "prchk_guard": false, 00:20:37.719 "ctrlr_loss_timeout_sec": 0, 00:20:37.719 "reconnect_delay_sec": 0, 00:20:37.719 "fast_io_fail_timeout_sec": 0, 00:20:37.719 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:37.719 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:37.719 "hdgst": false, 00:20:37.719 "ddgst": false 00:20:37.719 } 00:20:37.719 }, 00:20:37.719 { 00:20:37.719 "method": "bdev_nvme_set_hotplug", 00:20:37.719 "params": { 00:20:37.719 "period_us": 100000, 00:20:37.719 "enable": false 00:20:37.719 } 00:20:37.719 }, 00:20:37.719 { 00:20:37.719 "method": "bdev_wait_for_examine" 00:20:37.719 } 00:20:37.719 ] 00:20:37.719 }, 00:20:37.719 { 00:20:37.719 "subsystem": "nbd", 00:20:37.719 "config": [] 00:20:37.719 } 00:20:37.719 ] 00:20:37.719 }' 00:20:37.719 10:06:43 -- target/tls.sh@208 -- # killprocess 2842933 00:20:37.719 10:06:43 -- common/autotest_common.sh@926 -- # '[' -z 2842933 ']' 00:20:37.719 10:06:43 -- common/autotest_common.sh@930 -- # kill -0 2842933 00:20:37.719 10:06:43 -- common/autotest_common.sh@931 -- # uname 00:20:37.719 10:06:43 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:37.719 10:06:43 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2842933 00:20:37.719 10:06:43 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:20:37.719 10:06:43 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:20:37.719 10:06:43 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2842933' 00:20:37.719 killing process with pid 2842933 00:20:37.719 10:06:43 -- common/autotest_common.sh@945 -- # kill 2842933 00:20:37.719 Received shutdown signal, test time was about 10.000000 seconds 00:20:37.719 00:20:37.719 Latency(us) 00:20:37.719 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:37.719 =================================================================================================================== 00:20:37.719 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:37.719 10:06:43 -- common/autotest_common.sh@950 -- # wait 2842933 00:20:37.977 10:06:43 -- target/tls.sh@209 -- # killprocess 2842633 00:20:37.977 10:06:43 -- common/autotest_common.sh@926 -- # '[' -z 2842633 ']' 00:20:37.977 10:06:43 -- common/autotest_common.sh@930 -- # kill -0 2842633 00:20:37.977 10:06:43 -- common/autotest_common.sh@931 -- # uname 00:20:37.977 10:06:43 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:37.977 10:06:43 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2842633 00:20:37.977 10:06:43 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:20:37.977 10:06:43 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:20:37.977 10:06:43 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2842633' 00:20:37.977 killing process with pid 2842633 00:20:37.977 10:06:43 -- common/autotest_common.sh@945 -- # kill 2842633 00:20:37.977 10:06:43 -- common/autotest_common.sh@950 -- # wait 2842633 00:20:38.236 10:06:43 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:20:38.236 10:06:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:38.236 10:06:43 -- target/tls.sh@212 -- # echo '{ 00:20:38.236 "subsystems": [ 00:20:38.236 { 00:20:38.236 "subsystem": "iobuf", 00:20:38.236 "config": [ 00:20:38.236 { 00:20:38.236 "method": "iobuf_set_options", 00:20:38.236 "params": { 00:20:38.236 "small_pool_count": 8192, 00:20:38.236 "large_pool_count": 1024, 00:20:38.236 "small_bufsize": 8192, 00:20:38.236 "large_bufsize": 135168 00:20:38.236 } 00:20:38.236 } 00:20:38.236 ] 00:20:38.236 }, 00:20:38.236 { 00:20:38.236 "subsystem": "sock", 00:20:38.236 "config": [ 00:20:38.236 { 00:20:38.236 "method": "sock_impl_set_options", 00:20:38.236 "params": { 00:20:38.236 "impl_name": "posix", 00:20:38.236 "recv_buf_size": 2097152, 00:20:38.236 "send_buf_size": 2097152, 00:20:38.236 "enable_recv_pipe": true, 00:20:38.236 "enable_quickack": false, 00:20:38.236 "enable_placement_id": 0, 00:20:38.236 "enable_zerocopy_send_server": true, 00:20:38.236 "enable_zerocopy_send_client": false, 00:20:38.236 "zerocopy_threshold": 0, 00:20:38.236 "tls_version": 0, 00:20:38.236 "enable_ktls": false 00:20:38.236 } 00:20:38.236 }, 00:20:38.236 { 00:20:38.236 "method": "sock_impl_set_options", 00:20:38.236 "params": { 00:20:38.236 "impl_name": "ssl", 00:20:38.236 "recv_buf_size": 4096, 00:20:38.236 "send_buf_size": 4096, 00:20:38.236 "enable_recv_pipe": true, 00:20:38.236 "enable_quickack": false, 00:20:38.236 "enable_placement_id": 0, 00:20:38.236 "enable_zerocopy_send_server": true, 00:20:38.236 "enable_zerocopy_send_client": false, 00:20:38.236 "zerocopy_threshold": 0, 00:20:38.236 "tls_version": 0, 00:20:38.236 "enable_ktls": false 00:20:38.236 } 00:20:38.236 } 00:20:38.236 ] 00:20:38.236 }, 00:20:38.236 { 00:20:38.236 "subsystem": "vmd", 00:20:38.236 "config": [] 00:20:38.236 }, 00:20:38.236 { 00:20:38.236 "subsystem": "accel", 00:20:38.236 "config": [ 00:20:38.236 { 00:20:38.236 "method": "accel_set_options", 00:20:38.236 "params": { 00:20:38.236 "small_cache_size": 128, 00:20:38.236 "large_cache_size": 16, 00:20:38.236 "task_count": 2048, 00:20:38.236 "sequence_count": 2048, 00:20:38.236 "buf_count": 2048 00:20:38.236 } 00:20:38.236 } 00:20:38.236 ] 00:20:38.236 }, 00:20:38.236 { 00:20:38.236 "subsystem": "bdev", 00:20:38.236 "config": [ 00:20:38.236 { 00:20:38.236 "method": "bdev_set_options", 00:20:38.236 "params": { 00:20:38.236 "bdev_io_pool_size": 65535, 00:20:38.236 "bdev_io_cache_size": 256, 00:20:38.236 "bdev_auto_examine": true, 00:20:38.236 "iobuf_small_cache_size": 128, 00:20:38.236 "iobuf_large_cache_size": 16 00:20:38.236 } 00:20:38.236 }, 00:20:38.236 { 00:20:38.236 "method": "bdev_raid_set_options", 00:20:38.236 "params": { 00:20:38.236 "process_window_size_kb": 1024 00:20:38.236 } 00:20:38.236 }, 00:20:38.236 { 00:20:38.236 "method": "bdev_iscsi_set_options", 00:20:38.236 "params": { 00:20:38.236 "timeout_sec": 30 00:20:38.236 } 00:20:38.236 }, 00:20:38.236 { 00:20:38.236 "method": "bdev_nvme_set_options", 00:20:38.236 "params": { 00:20:38.236 "action_on_timeout": "none", 00:20:38.236 "timeout_us": 0, 00:20:38.236 "timeout_admin_us": 0, 00:20:38.236 "keep_alive_timeout_ms": 10000, 00:20:38.236 "transport_retry_count": 4, 00:20:38.236 "arbitration_burst": 0, 00:20:38.236 "low_priority_weight": 0, 00:20:38.236 "medium_priority_weight": 0, 00:20:38.236 "high_priority_weight": 0, 00:20:38.236 "nvme_adminq_poll_period_us": 10000, 00:20:38.236 "nvme_ioq_poll_period_us": 0, 00:20:38.236 "io_queue_requests": 0, 00:20:38.236 "delay_cmd_submit": true, 00:20:38.236 "bdev_retry_count": 3, 00:20:38.236 "transport_ack_timeout": 0, 00:20:38.236 "ctrlr_loss_timeout_sec": 0, 00:20:38.236 "reconnect_delay_sec": 0, 00:20:38.236 "fast_io_fail_timeout_sec": 0, 00:20:38.236 "generate_uuids": false, 00:20:38.236 "transport_tos": 0, 00:20:38.236 "io_path_stat": false, 00:20:38.236 "allow_accel_sequence": false 00:20:38.236 } 00:20:38.236 }, 00:20:38.236 { 00:20:38.236 "method": "bdev_nvme_set_hotplug", 00:20:38.236 "params": { 00:20:38.236 "period_us": 100000, 00:20:38.236 "enable": false 00:20:38.236 } 00:20:38.236 }, 00:20:38.236 { 00:20:38.236 "method": "bdev_malloc_create", 00:20:38.237 "params": { 00:20:38.237 "name": "malloc0", 00:20:38.237 "num_blocks": 8192, 00:20:38.237 "block_size": 4096, 00:20:38.237 "physical_block_size": 4096, 00:20:38.237 "uuid": "163873c5-34de-4d2e-a304-f4f07a8dcb40", 00:20:38.237 "optimal_io_boundary": 0 00:20:38.237 } 00:20:38.237 }, 00:20:38.237 { 00:20:38.237 "method": "bdev_wait_for_examine" 00:20:38.237 } 00:20:38.237 ] 00:20:38.237 }, 00:20:38.237 { 00:20:38.237 "subsystem": "nbd", 00:20:38.237 "config": [] 00:20:38.237 }, 00:20:38.237 { 00:20:38.237 "subsystem": "scheduler", 00:20:38.237 "config": [ 00:20:38.237 { 00:20:38.237 "method": "framework_set_scheduler", 00:20:38.237 "params": { 00:20:38.237 "name": "static" 00:20:38.237 } 00:20:38.237 } 00:20:38.237 ] 00:20:38.237 }, 00:20:38.237 { 00:20:38.237 "subsystem": "nvmf", 00:20:38.237 "config": [ 00:20:38.237 { 00:20:38.237 "method": "nvmf_set_config", 00:20:38.237 "params": { 00:20:38.237 "discovery_filter": "match_any", 00:20:38.237 "admin_cmd_passthru": { 00:20:38.237 "identify_ctrlr": false 00:20:38.237 } 00:20:38.237 } 00:20:38.237 }, 00:20:38.237 { 00:20:38.237 "method": "nvmf_set_max_subsystems", 00:20:38.237 "params": { 00:20:38.237 "max_subsystems": 1024 00:20:38.237 } 00:20:38.237 }, 00:20:38.237 { 00:20:38.237 "method": "nvmf_set_crdt", 00:20:38.237 "params": { 00:20:38.237 "crdt1": 0, 00:20:38.237 "crdt2": 0, 00:20:38.237 "crdt3": 0 00:20:38.237 } 00:20:38.237 }, 00:20:38.237 { 00:20:38.237 "method": "nvmf_create_transport", 00:20:38.237 "params": { 00:20:38.237 "trtype": "TCP", 00:20:38.237 "max_queue_depth": 128, 00:20:38.237 "max_io_qpairs_per_ctrlr": 127, 00:20:38.237 "in_capsule_data_size": 4096, 00:20:38.237 "max_io_size": 131072, 00:20:38.237 "io_unit_size": 131072, 00:20:38.237 "max_aq_depth": 128, 00:20:38.237 "num_shared_buffers": 511, 00:20:38.237 "buf_cache_size": 4294967295, 00:20:38.237 "dif_insert_or_strip": false, 00:20:38.237 "zcopy": false, 00:20:38.237 "c2h_success": false, 00:20:38.237 "sock_priority": 0, 00:20:38.237 "abort_timeout_sec": 1 00:20:38.237 } 00:20:38.237 }, 00:20:38.237 { 00:20:38.237 "method": "nvmf_create_subsystem", 00:20:38.237 "params": { 00:20:38.237 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:38.237 "allow_any_host": false, 00:20:38.237 "serial_number": "SPDK00000000000001", 00:20:38.237 "model_number": "SPDK bdev Controller", 00:20:38.237 "max_namespaces": 10, 00:20:38.237 "min_cntlid": 1, 00:20:38.237 "max_cntlid": 65519, 00:20:38.237 "ana_reporting": false 00:20:38.237 } 00:20:38.237 }, 00:20:38.237 { 00:20:38.237 "method": "nvmf_subsystem_add_host", 00:20:38.237 "params": { 00:20:38.237 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:38.237 "host": "nqn.2016-06.io.spdk:host1", 00:20:38.237 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:20:38.237 } 00:20:38.237 }, 00:20:38.237 { 00:20:38.237 "method": "nvmf_subsystem_add_ns", 00:20:38.237 "params": { 00:20:38.237 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:38.237 "namespace": { 00:20:38.237 "nsid": 1, 00:20:38.237 "bdev_name": "malloc0", 00:20:38.237 "nguid": "163873C534DE4D2EA304F4F07A8DCB40", 00:20:38.237 "uuid": "163873c5-34de-4d2e-a304-f4f07a8dcb40" 00:20:38.237 } 00:20:38.237 } 00:20:38.237 }, 00:20:38.237 { 00:20:38.237 "method": "nvmf_subsystem_add_listener", 00:20:38.237 "params": { 00:20:38.237 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:38.237 "listen_address": { 00:20:38.237 "trtype": "TCP", 00:20:38.237 "adrfam": "IPv4", 00:20:38.237 "traddr": "10.0.0.2", 00:20:38.237 "trsvcid": "4420" 00:20:38.237 }, 00:20:38.237 "secure_channel": true 00:20:38.237 } 00:20:38.237 } 00:20:38.237 ] 00:20:38.237 } 00:20:38.237 ] 00:20:38.237 }' 00:20:38.237 10:06:43 -- common/autotest_common.sh@712 -- # xtrace_disable 00:20:38.237 10:06:43 -- common/autotest_common.sh@10 -- # set +x 00:20:38.237 10:06:43 -- nvmf/common.sh@469 -- # nvmfpid=2843228 00:20:38.237 10:06:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:20:38.237 10:06:43 -- nvmf/common.sh@470 -- # waitforlisten 2843228 00:20:38.237 10:06:43 -- common/autotest_common.sh@819 -- # '[' -z 2843228 ']' 00:20:38.237 10:06:43 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:38.237 10:06:43 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:38.237 10:06:43 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:38.237 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:38.237 10:06:43 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:38.237 10:06:43 -- common/autotest_common.sh@10 -- # set +x 00:20:38.237 [2024-07-13 10:06:44.020778] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:20:38.237 [2024-07-13 10:06:44.020876] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:38.496 EAL: No free 2048 kB hugepages reported on node 1 00:20:38.496 [2024-07-13 10:06:44.088820] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:38.496 [2024-07-13 10:06:44.176061] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:38.496 [2024-07-13 10:06:44.176241] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:38.496 [2024-07-13 10:06:44.176264] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:38.496 [2024-07-13 10:06:44.176278] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:38.496 [2024-07-13 10:06:44.176310] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:38.755 [2024-07-13 10:06:44.405087] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:38.755 [2024-07-13 10:06:44.437105] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:38.755 [2024-07-13 10:06:44.437321] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:39.322 10:06:44 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:39.322 10:06:44 -- common/autotest_common.sh@852 -- # return 0 00:20:39.322 10:06:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:39.322 10:06:44 -- common/autotest_common.sh@718 -- # xtrace_disable 00:20:39.322 10:06:44 -- common/autotest_common.sh@10 -- # set +x 00:20:39.322 10:06:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:39.322 10:06:44 -- target/tls.sh@216 -- # bdevperf_pid=2843384 00:20:39.322 10:06:44 -- target/tls.sh@217 -- # waitforlisten 2843384 /var/tmp/bdevperf.sock 00:20:39.322 10:06:44 -- common/autotest_common.sh@819 -- # '[' -z 2843384 ']' 00:20:39.322 10:06:44 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:39.322 10:06:44 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:20:39.322 10:06:44 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:39.322 10:06:44 -- target/tls.sh@213 -- # echo '{ 00:20:39.322 "subsystems": [ 00:20:39.322 { 00:20:39.322 "subsystem": "iobuf", 00:20:39.322 "config": [ 00:20:39.322 { 00:20:39.322 "method": "iobuf_set_options", 00:20:39.322 "params": { 00:20:39.322 "small_pool_count": 8192, 00:20:39.322 "large_pool_count": 1024, 00:20:39.322 "small_bufsize": 8192, 00:20:39.322 "large_bufsize": 135168 00:20:39.322 } 00:20:39.322 } 00:20:39.322 ] 00:20:39.322 }, 00:20:39.322 { 00:20:39.322 "subsystem": "sock", 00:20:39.322 "config": [ 00:20:39.322 { 00:20:39.322 "method": "sock_impl_set_options", 00:20:39.322 "params": { 00:20:39.322 "impl_name": "posix", 00:20:39.322 "recv_buf_size": 2097152, 00:20:39.322 "send_buf_size": 2097152, 00:20:39.322 "enable_recv_pipe": true, 00:20:39.322 "enable_quickack": false, 00:20:39.322 "enable_placement_id": 0, 00:20:39.322 "enable_zerocopy_send_server": true, 00:20:39.322 "enable_zerocopy_send_client": false, 00:20:39.322 "zerocopy_threshold": 0, 00:20:39.322 "tls_version": 0, 00:20:39.322 "enable_ktls": false 00:20:39.322 } 00:20:39.322 }, 00:20:39.322 { 00:20:39.322 "method": "sock_impl_set_options", 00:20:39.322 "params": { 00:20:39.322 "impl_name": "ssl", 00:20:39.322 "recv_buf_size": 4096, 00:20:39.322 "send_buf_size": 4096, 00:20:39.322 "enable_recv_pipe": true, 00:20:39.322 "enable_quickack": false, 00:20:39.322 "enable_placement_id": 0, 00:20:39.322 "enable_zerocopy_send_server": true, 00:20:39.322 "enable_zerocopy_send_client": false, 00:20:39.322 "zerocopy_threshold": 0, 00:20:39.322 "tls_version": 0, 00:20:39.322 "enable_ktls": false 00:20:39.322 } 00:20:39.322 } 00:20:39.322 ] 00:20:39.322 }, 00:20:39.322 { 00:20:39.322 "subsystem": "vmd", 00:20:39.322 "config": [] 00:20:39.322 }, 00:20:39.322 { 00:20:39.322 "subsystem": "accel", 00:20:39.322 "config": [ 00:20:39.322 { 00:20:39.322 "method": "accel_set_options", 00:20:39.322 "params": { 00:20:39.322 "small_cache_size": 128, 00:20:39.322 "large_cache_size": 16, 00:20:39.322 "task_count": 2048, 00:20:39.322 "sequence_count": 2048, 00:20:39.322 "buf_count": 2048 00:20:39.322 } 00:20:39.322 } 00:20:39.322 ] 00:20:39.322 }, 00:20:39.322 { 00:20:39.322 "subsystem": "bdev", 00:20:39.322 "config": [ 00:20:39.322 { 00:20:39.322 "method": "bdev_set_options", 00:20:39.322 "params": { 00:20:39.322 "bdev_io_pool_size": 65535, 00:20:39.322 "bdev_io_cache_size": 256, 00:20:39.322 "bdev_auto_examine": true, 00:20:39.322 "iobuf_small_cache_size": 128, 00:20:39.322 "iobuf_large_cache_size": 16 00:20:39.322 } 00:20:39.322 }, 00:20:39.322 { 00:20:39.322 "method": "bdev_raid_set_options", 00:20:39.322 "params": { 00:20:39.322 "process_window_size_kb": 1024 00:20:39.322 } 00:20:39.322 }, 00:20:39.322 { 00:20:39.322 "method": "bdev_iscsi_set_options", 00:20:39.322 "params": { 00:20:39.322 "timeout_sec": 30 00:20:39.322 } 00:20:39.322 }, 00:20:39.322 { 00:20:39.322 "method": "bdev_nvme_set_options", 00:20:39.322 "params": { 00:20:39.322 "action_on_timeout": "none", 00:20:39.322 "timeout_us": 0, 00:20:39.322 "timeout_admin_us": 0, 00:20:39.322 "keep_alive_timeout_ms": 10000, 00:20:39.322 "transport_retry_count": 4, 00:20:39.322 "arbitration_burst": 0, 00:20:39.322 "low_priority_weight": 0, 00:20:39.322 "medium_priority_weight": 0, 00:20:39.322 "high_priority_weight": 0, 00:20:39.322 "nvme_adminq_poll_period_us": 10000, 00:20:39.322 "nvme_ioq_poll_period_us": 0, 00:20:39.322 "io_queue_requests": 512, 00:20:39.322 "delay_cmd_submit": true, 00:20:39.322 "bdev_retry_count": 3, 00:20:39.323 "transport_ack_timeout": 0, 00:20:39.323 "ctrlr_loss_timeout_sec": 0, 00:20:39.323 "reconnect_delay_sec": 0, 00:20:39.323 "fast_io_fail_timeout_sec": 0, 00:20:39.323 "generate_uuids": false, 00:20:39.323 "transport_tos": 0, 00:20:39.323 "io_path_stat": false, 00:20:39.323 "allow_accel_sequence": false 00:20:39.323 } 00:20:39.323 }, 00:20:39.323 { 00:20:39.323 "method": "bdev_nvme_attach_controller", 00:20:39.323 "params": { 00:20:39.323 "name": "TLSTEST", 00:20:39.323 "trtype": "TCP", 00:20:39.323 "adrfam": "IPv4", 00:20:39.323 "traddr": "10.0.0.2", 00:20:39.323 "trsvcid": "4420", 00:20:39.323 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:39.323 "prchk_reftag": false, 00:20:39.323 "prchk_guard": false, 00:20:39.323 "ctrlr_loss_timeout_sec": 0, 00:20:39.323 "reconnect_delay_sec": 0, 00:20:39.323 "fast_io_fail_timeout_sec": 0, 00:20:39.323 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:39.323 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:39.323 "hdgst": 10:06:44 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:39.323 false, 00:20:39.323 "ddgst": false 00:20:39.323 } 00:20:39.323 }, 00:20:39.323 { 00:20:39.323 "method": "bdev_nvme_set_hotplug", 00:20:39.323 "params": { 00:20:39.323 "period_us": 100000, 00:20:39.323 "enable": false 00:20:39.323 } 00:20:39.323 }, 00:20:39.323 { 00:20:39.323 "method": "bdev_wait_for_examine" 00:20:39.323 } 00:20:39.323 ] 00:20:39.323 }, 00:20:39.323 { 00:20:39.323 "subsystem": "nbd", 00:20:39.323 "config": [] 00:20:39.323 } 00:20:39.323 ] 00:20:39.323 }' 00:20:39.323 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:39.323 10:06:44 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:39.323 10:06:44 -- common/autotest_common.sh@10 -- # set +x 00:20:39.323 [2024-07-13 10:06:45.013119] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:20:39.323 [2024-07-13 10:06:45.013209] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2843384 ] 00:20:39.323 EAL: No free 2048 kB hugepages reported on node 1 00:20:39.323 [2024-07-13 10:06:45.070196] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:39.581 [2024-07-13 10:06:45.152504] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:39.581 [2024-07-13 10:06:45.306535] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:40.147 10:06:45 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:40.147 10:06:45 -- common/autotest_common.sh@852 -- # return 0 00:20:40.147 10:06:45 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:40.405 Running I/O for 10 seconds... 00:20:50.369 00:20:50.369 Latency(us) 00:20:50.369 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:50.369 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:50.369 Verification LBA range: start 0x0 length 0x2000 00:20:50.369 TLSTESTn1 : 10.02 2874.13 11.23 0.00 0.00 44480.56 5145.79 56312.41 00:20:50.369 =================================================================================================================== 00:20:50.369 Total : 2874.13 11.23 0.00 0.00 44480.56 5145.79 56312.41 00:20:50.369 0 00:20:50.369 10:06:56 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:50.369 10:06:56 -- target/tls.sh@223 -- # killprocess 2843384 00:20:50.369 10:06:56 -- common/autotest_common.sh@926 -- # '[' -z 2843384 ']' 00:20:50.369 10:06:56 -- common/autotest_common.sh@930 -- # kill -0 2843384 00:20:50.369 10:06:56 -- common/autotest_common.sh@931 -- # uname 00:20:50.369 10:06:56 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:50.369 10:06:56 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2843384 00:20:50.369 10:06:56 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:20:50.369 10:06:56 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:20:50.369 10:06:56 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2843384' 00:20:50.369 killing process with pid 2843384 00:20:50.369 10:06:56 -- common/autotest_common.sh@945 -- # kill 2843384 00:20:50.369 Received shutdown signal, test time was about 10.000000 seconds 00:20:50.369 00:20:50.369 Latency(us) 00:20:50.369 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:50.369 =================================================================================================================== 00:20:50.369 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:50.369 10:06:56 -- common/autotest_common.sh@950 -- # wait 2843384 00:20:50.626 10:06:56 -- target/tls.sh@224 -- # killprocess 2843228 00:20:50.626 10:06:56 -- common/autotest_common.sh@926 -- # '[' -z 2843228 ']' 00:20:50.626 10:06:56 -- common/autotest_common.sh@930 -- # kill -0 2843228 00:20:50.626 10:06:56 -- common/autotest_common.sh@931 -- # uname 00:20:50.626 10:06:56 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:50.626 10:06:56 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2843228 00:20:50.626 10:06:56 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:20:50.626 10:06:56 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:20:50.626 10:06:56 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2843228' 00:20:50.626 killing process with pid 2843228 00:20:50.626 10:06:56 -- common/autotest_common.sh@945 -- # kill 2843228 00:20:50.626 10:06:56 -- common/autotest_common.sh@950 -- # wait 2843228 00:20:50.884 10:06:56 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:20:50.884 10:06:56 -- target/tls.sh@227 -- # cleanup 00:20:50.884 10:06:56 -- target/tls.sh@15 -- # process_shm --id 0 00:20:50.884 10:06:56 -- common/autotest_common.sh@796 -- # type=--id 00:20:50.884 10:06:56 -- common/autotest_common.sh@797 -- # id=0 00:20:50.884 10:06:56 -- common/autotest_common.sh@798 -- # '[' --id = --pid ']' 00:20:50.884 10:06:56 -- common/autotest_common.sh@802 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:20:50.884 10:06:56 -- common/autotest_common.sh@802 -- # shm_files=nvmf_trace.0 00:20:50.884 10:06:56 -- common/autotest_common.sh@804 -- # [[ -z nvmf_trace.0 ]] 00:20:50.884 10:06:56 -- common/autotest_common.sh@808 -- # for n in $shm_files 00:20:50.884 10:06:56 -- common/autotest_common.sh@809 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:20:50.884 nvmf_trace.0 00:20:50.884 10:06:56 -- common/autotest_common.sh@811 -- # return 0 00:20:50.884 10:06:56 -- target/tls.sh@16 -- # killprocess 2843384 00:20:50.884 10:06:56 -- common/autotest_common.sh@926 -- # '[' -z 2843384 ']' 00:20:50.884 10:06:56 -- common/autotest_common.sh@930 -- # kill -0 2843384 00:20:50.884 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (2843384) - No such process 00:20:50.884 10:06:56 -- common/autotest_common.sh@953 -- # echo 'Process with pid 2843384 is not found' 00:20:50.884 Process with pid 2843384 is not found 00:20:50.884 10:06:56 -- target/tls.sh@17 -- # nvmftestfini 00:20:50.884 10:06:56 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:50.884 10:06:56 -- nvmf/common.sh@116 -- # sync 00:20:50.884 10:06:56 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:50.884 10:06:56 -- nvmf/common.sh@119 -- # set +e 00:20:50.884 10:06:56 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:50.884 10:06:56 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:50.884 rmmod nvme_tcp 00:20:50.884 rmmod nvme_fabrics 00:20:50.884 rmmod nvme_keyring 00:20:50.884 10:06:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:51.142 10:06:56 -- nvmf/common.sh@123 -- # set -e 00:20:51.142 10:06:56 -- nvmf/common.sh@124 -- # return 0 00:20:51.142 10:06:56 -- nvmf/common.sh@477 -- # '[' -n 2843228 ']' 00:20:51.142 10:06:56 -- nvmf/common.sh@478 -- # killprocess 2843228 00:20:51.142 10:06:56 -- common/autotest_common.sh@926 -- # '[' -z 2843228 ']' 00:20:51.142 10:06:56 -- common/autotest_common.sh@930 -- # kill -0 2843228 00:20:51.142 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (2843228) - No such process 00:20:51.142 10:06:56 -- common/autotest_common.sh@953 -- # echo 'Process with pid 2843228 is not found' 00:20:51.142 Process with pid 2843228 is not found 00:20:51.142 10:06:56 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:51.142 10:06:56 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:51.142 10:06:56 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:51.142 10:06:56 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:51.142 10:06:56 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:51.142 10:06:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:51.142 10:06:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:51.142 10:06:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:53.046 10:06:58 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:53.046 10:06:58 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:53.046 00:20:53.046 real 1m13.926s 00:20:53.046 user 1m56.210s 00:20:53.046 sys 0m26.395s 00:20:53.046 10:06:58 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:20:53.046 10:06:58 -- common/autotest_common.sh@10 -- # set +x 00:20:53.046 ************************************ 00:20:53.046 END TEST nvmf_tls 00:20:53.046 ************************************ 00:20:53.046 10:06:58 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:20:53.046 10:06:58 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:20:53.046 10:06:58 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:20:53.046 10:06:58 -- common/autotest_common.sh@10 -- # set +x 00:20:53.046 ************************************ 00:20:53.046 START TEST nvmf_fips 00:20:53.046 ************************************ 00:20:53.046 10:06:58 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:20:53.046 * Looking for test storage... 00:20:53.046 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:20:53.046 10:06:58 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:53.046 10:06:58 -- nvmf/common.sh@7 -- # uname -s 00:20:53.046 10:06:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:53.046 10:06:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:53.046 10:06:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:53.046 10:06:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:53.046 10:06:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:53.046 10:06:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:53.046 10:06:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:53.046 10:06:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:53.046 10:06:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:53.046 10:06:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:53.046 10:06:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:53.046 10:06:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:53.046 10:06:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:53.046 10:06:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:53.046 10:06:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:53.046 10:06:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:53.046 10:06:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:53.046 10:06:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:53.046 10:06:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:53.046 10:06:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:53.046 10:06:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:53.046 10:06:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:53.046 10:06:58 -- paths/export.sh@5 -- # export PATH 00:20:53.046 10:06:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:53.046 10:06:58 -- nvmf/common.sh@46 -- # : 0 00:20:53.046 10:06:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:53.046 10:06:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:53.046 10:06:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:53.046 10:06:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:53.046 10:06:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:53.046 10:06:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:53.046 10:06:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:53.046 10:06:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:53.046 10:06:58 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:20:53.046 10:06:58 -- fips/fips.sh@89 -- # check_openssl_version 00:20:53.046 10:06:58 -- fips/fips.sh@83 -- # local target=3.0.0 00:20:53.046 10:06:58 -- fips/fips.sh@85 -- # openssl version 00:20:53.046 10:06:58 -- fips/fips.sh@85 -- # awk '{print $2}' 00:20:53.046 10:06:58 -- fips/fips.sh@85 -- # ge 3.0.9 3.0.0 00:20:53.046 10:06:58 -- scripts/common.sh@375 -- # cmp_versions 3.0.9 '>=' 3.0.0 00:20:53.046 10:06:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:53.046 10:06:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:53.046 10:06:58 -- scripts/common.sh@335 -- # IFS=.-: 00:20:53.046 10:06:58 -- scripts/common.sh@335 -- # read -ra ver1 00:20:53.046 10:06:58 -- scripts/common.sh@336 -- # IFS=.-: 00:20:53.046 10:06:58 -- scripts/common.sh@336 -- # read -ra ver2 00:20:53.046 10:06:58 -- scripts/common.sh@337 -- # local 'op=>=' 00:20:53.046 10:06:58 -- scripts/common.sh@339 -- # ver1_l=3 00:20:53.046 10:06:58 -- scripts/common.sh@340 -- # ver2_l=3 00:20:53.046 10:06:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:53.046 10:06:58 -- scripts/common.sh@343 -- # case "$op" in 00:20:53.046 10:06:58 -- scripts/common.sh@347 -- # : 1 00:20:53.046 10:06:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:53.046 10:06:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:53.046 10:06:58 -- scripts/common.sh@364 -- # decimal 3 00:20:53.046 10:06:58 -- scripts/common.sh@352 -- # local d=3 00:20:53.046 10:06:58 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:20:53.046 10:06:58 -- scripts/common.sh@354 -- # echo 3 00:20:53.046 10:06:58 -- scripts/common.sh@364 -- # ver1[v]=3 00:20:53.046 10:06:58 -- scripts/common.sh@365 -- # decimal 3 00:20:53.046 10:06:58 -- scripts/common.sh@352 -- # local d=3 00:20:53.046 10:06:58 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:20:53.046 10:06:58 -- scripts/common.sh@354 -- # echo 3 00:20:53.046 10:06:58 -- scripts/common.sh@365 -- # ver2[v]=3 00:20:53.046 10:06:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:53.046 10:06:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:53.046 10:06:58 -- scripts/common.sh@363 -- # (( v++ )) 00:20:53.046 10:06:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:53.046 10:06:58 -- scripts/common.sh@364 -- # decimal 0 00:20:53.046 10:06:58 -- scripts/common.sh@352 -- # local d=0 00:20:53.046 10:06:58 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:20:53.046 10:06:58 -- scripts/common.sh@354 -- # echo 0 00:20:53.046 10:06:58 -- scripts/common.sh@364 -- # ver1[v]=0 00:20:53.046 10:06:58 -- scripts/common.sh@365 -- # decimal 0 00:20:53.046 10:06:58 -- scripts/common.sh@352 -- # local d=0 00:20:53.046 10:06:58 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:20:53.046 10:06:58 -- scripts/common.sh@354 -- # echo 0 00:20:53.046 10:06:58 -- scripts/common.sh@365 -- # ver2[v]=0 00:20:53.046 10:06:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:53.046 10:06:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:53.046 10:06:58 -- scripts/common.sh@363 -- # (( v++ )) 00:20:53.046 10:06:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:53.046 10:06:58 -- scripts/common.sh@364 -- # decimal 9 00:20:53.046 10:06:58 -- scripts/common.sh@352 -- # local d=9 00:20:53.046 10:06:58 -- scripts/common.sh@353 -- # [[ 9 =~ ^[0-9]+$ ]] 00:20:53.046 10:06:58 -- scripts/common.sh@354 -- # echo 9 00:20:53.046 10:06:58 -- scripts/common.sh@364 -- # ver1[v]=9 00:20:53.046 10:06:58 -- scripts/common.sh@365 -- # decimal 0 00:20:53.046 10:06:58 -- scripts/common.sh@352 -- # local d=0 00:20:53.046 10:06:58 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:20:53.334 10:06:58 -- scripts/common.sh@354 -- # echo 0 00:20:53.334 10:06:58 -- scripts/common.sh@365 -- # ver2[v]=0 00:20:53.334 10:06:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:53.334 10:06:58 -- scripts/common.sh@366 -- # return 0 00:20:53.334 10:06:58 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:20:53.334 10:06:58 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:20:53.334 10:06:58 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:20:53.334 10:06:58 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:20:53.334 10:06:58 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:20:53.334 10:06:58 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:20:53.334 10:06:58 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:20:53.334 10:06:58 -- fips/fips.sh@105 -- # export OPENSSL_FORCE_FIPS_MODE=build_openssl_config 00:20:53.334 10:06:58 -- fips/fips.sh@105 -- # OPENSSL_FORCE_FIPS_MODE=build_openssl_config 00:20:53.334 10:06:58 -- fips/fips.sh@114 -- # build_openssl_config 00:20:53.334 10:06:58 -- fips/fips.sh@37 -- # cat 00:20:53.334 10:06:58 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:20:53.334 10:06:58 -- fips/fips.sh@58 -- # cat - 00:20:53.334 10:06:58 -- fips/fips.sh@115 -- # export OPENSSL_CONF=spdk_fips.conf 00:20:53.334 10:06:58 -- fips/fips.sh@115 -- # OPENSSL_CONF=spdk_fips.conf 00:20:53.334 10:06:58 -- fips/fips.sh@117 -- # mapfile -t providers 00:20:53.334 10:06:58 -- fips/fips.sh@117 -- # OPENSSL_CONF=spdk_fips.conf 00:20:53.334 10:06:58 -- fips/fips.sh@117 -- # openssl list -providers 00:20:53.334 10:06:58 -- fips/fips.sh@117 -- # grep name 00:20:53.334 10:06:58 -- fips/fips.sh@121 -- # (( 2 != 2 )) 00:20:53.334 10:06:58 -- fips/fips.sh@121 -- # [[ name: openssl base provider != *base* ]] 00:20:53.334 10:06:58 -- fips/fips.sh@121 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:20:53.334 10:06:58 -- fips/fips.sh@128 -- # NOT openssl md5 /dev/fd/62 00:20:53.334 10:06:58 -- fips/fips.sh@128 -- # : 00:20:53.334 10:06:58 -- common/autotest_common.sh@640 -- # local es=0 00:20:53.334 10:06:58 -- common/autotest_common.sh@642 -- # valid_exec_arg openssl md5 /dev/fd/62 00:20:53.334 10:06:58 -- common/autotest_common.sh@628 -- # local arg=openssl 00:20:53.334 10:06:58 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:53.334 10:06:58 -- common/autotest_common.sh@632 -- # type -t openssl 00:20:53.334 10:06:58 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:53.334 10:06:58 -- common/autotest_common.sh@634 -- # type -P openssl 00:20:53.334 10:06:58 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:53.334 10:06:58 -- common/autotest_common.sh@634 -- # arg=/usr/bin/openssl 00:20:53.334 10:06:58 -- common/autotest_common.sh@634 -- # [[ -x /usr/bin/openssl ]] 00:20:53.334 10:06:58 -- common/autotest_common.sh@643 -- # openssl md5 /dev/fd/62 00:20:53.334 Error setting digest 00:20:53.334 00729AD6597F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:373:Global default library context, Algorithm (MD5 : 97), Properties () 00:20:53.334 00729AD6597F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:254: 00:20:53.334 10:06:58 -- common/autotest_common.sh@643 -- # es=1 00:20:53.334 10:06:58 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:20:53.334 10:06:58 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:20:53.334 10:06:58 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:20:53.334 10:06:58 -- fips/fips.sh@131 -- # nvmftestinit 00:20:53.334 10:06:58 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:53.334 10:06:58 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:53.334 10:06:58 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:53.334 10:06:58 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:53.334 10:06:58 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:53.334 10:06:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:53.334 10:06:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:53.334 10:06:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:53.334 10:06:58 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:53.334 10:06:58 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:53.334 10:06:58 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:53.334 10:06:58 -- common/autotest_common.sh@10 -- # set +x 00:20:55.236 10:07:00 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:55.236 10:07:00 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:55.236 10:07:00 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:55.236 10:07:00 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:55.236 10:07:00 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:55.236 10:07:00 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:55.236 10:07:00 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:55.236 10:07:00 -- nvmf/common.sh@294 -- # net_devs=() 00:20:55.236 10:07:00 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:55.236 10:07:00 -- nvmf/common.sh@295 -- # e810=() 00:20:55.236 10:07:00 -- nvmf/common.sh@295 -- # local -ga e810 00:20:55.236 10:07:00 -- nvmf/common.sh@296 -- # x722=() 00:20:55.236 10:07:00 -- nvmf/common.sh@296 -- # local -ga x722 00:20:55.236 10:07:00 -- nvmf/common.sh@297 -- # mlx=() 00:20:55.236 10:07:00 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:55.236 10:07:00 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:55.236 10:07:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:55.236 10:07:00 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:55.236 10:07:00 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:55.236 10:07:00 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:55.236 10:07:00 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:55.236 10:07:00 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:55.236 10:07:00 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:55.236 10:07:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:55.236 10:07:00 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:55.236 10:07:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:55.236 10:07:00 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:55.236 10:07:00 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:55.236 10:07:00 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:55.236 10:07:00 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:55.236 10:07:00 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:55.236 10:07:00 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:55.236 10:07:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:55.236 10:07:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:55.236 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:55.236 10:07:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:55.236 10:07:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:55.236 10:07:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:55.236 10:07:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:55.236 10:07:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:55.236 10:07:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:55.236 10:07:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:55.236 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:55.236 10:07:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:55.236 10:07:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:55.236 10:07:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:55.236 10:07:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:55.236 10:07:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:55.236 10:07:00 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:55.236 10:07:00 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:55.236 10:07:00 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:55.236 10:07:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:55.236 10:07:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:55.236 10:07:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:55.236 10:07:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:55.236 10:07:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:55.236 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:55.236 10:07:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:55.236 10:07:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:55.236 10:07:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:55.236 10:07:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:55.236 10:07:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:55.236 10:07:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:55.236 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:55.236 10:07:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:55.236 10:07:00 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:55.236 10:07:00 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:55.236 10:07:00 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:55.236 10:07:00 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:55.236 10:07:00 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:55.236 10:07:00 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:55.236 10:07:00 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:55.236 10:07:00 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:55.236 10:07:00 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:55.236 10:07:00 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:55.236 10:07:00 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:55.236 10:07:00 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:55.236 10:07:00 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:55.236 10:07:00 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:55.236 10:07:00 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:55.236 10:07:00 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:55.236 10:07:00 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:55.236 10:07:00 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:55.236 10:07:00 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:55.236 10:07:00 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:55.236 10:07:00 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:55.236 10:07:00 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:55.236 10:07:00 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:55.236 10:07:00 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:55.236 10:07:00 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:55.236 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:55.236 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.217 ms 00:20:55.236 00:20:55.236 --- 10.0.0.2 ping statistics --- 00:20:55.236 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:55.236 rtt min/avg/max/mdev = 0.217/0.217/0.217/0.000 ms 00:20:55.237 10:07:01 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:55.237 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:55.237 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.180 ms 00:20:55.237 00:20:55.237 --- 10.0.0.1 ping statistics --- 00:20:55.237 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:55.237 rtt min/avg/max/mdev = 0.180/0.180/0.180/0.000 ms 00:20:55.237 10:07:01 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:55.237 10:07:01 -- nvmf/common.sh@410 -- # return 0 00:20:55.237 10:07:01 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:55.237 10:07:01 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:55.237 10:07:01 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:55.237 10:07:01 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:55.237 10:07:01 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:55.237 10:07:01 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:55.237 10:07:01 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:55.237 10:07:01 -- fips/fips.sh@132 -- # nvmfappstart -m 0x2 00:20:55.237 10:07:01 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:55.237 10:07:01 -- common/autotest_common.sh@712 -- # xtrace_disable 00:20:55.237 10:07:01 -- common/autotest_common.sh@10 -- # set +x 00:20:55.237 10:07:01 -- nvmf/common.sh@469 -- # nvmfpid=2846720 00:20:55.237 10:07:01 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:55.237 10:07:01 -- nvmf/common.sh@470 -- # waitforlisten 2846720 00:20:55.237 10:07:01 -- common/autotest_common.sh@819 -- # '[' -z 2846720 ']' 00:20:55.237 10:07:01 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:55.237 10:07:01 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:55.237 10:07:01 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:55.237 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:55.237 10:07:01 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:55.237 10:07:01 -- common/autotest_common.sh@10 -- # set +x 00:20:55.495 [2024-07-13 10:07:01.101542] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:20:55.495 [2024-07-13 10:07:01.101620] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:55.495 EAL: No free 2048 kB hugepages reported on node 1 00:20:55.495 [2024-07-13 10:07:01.166329] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:55.495 [2024-07-13 10:07:01.251016] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:55.495 [2024-07-13 10:07:01.251207] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:55.495 [2024-07-13 10:07:01.251235] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:55.495 [2024-07-13 10:07:01.251248] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:55.495 [2024-07-13 10:07:01.251276] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:56.427 10:07:02 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:56.427 10:07:02 -- common/autotest_common.sh@852 -- # return 0 00:20:56.427 10:07:02 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:56.427 10:07:02 -- common/autotest_common.sh@718 -- # xtrace_disable 00:20:56.427 10:07:02 -- common/autotest_common.sh@10 -- # set +x 00:20:56.427 10:07:02 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:56.427 10:07:02 -- fips/fips.sh@134 -- # trap cleanup EXIT 00:20:56.427 10:07:02 -- fips/fips.sh@137 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:20:56.427 10:07:02 -- fips/fips.sh@138 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:20:56.427 10:07:02 -- fips/fips.sh@139 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:20:56.427 10:07:02 -- fips/fips.sh@140 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:20:56.427 10:07:02 -- fips/fips.sh@142 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:20:56.428 10:07:02 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:20:56.428 10:07:02 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:20:56.686 [2024-07-13 10:07:02.252506] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:56.686 [2024-07-13 10:07:02.268490] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:56.686 [2024-07-13 10:07:02.268709] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:56.686 malloc0 00:20:56.686 10:07:02 -- fips/fips.sh@145 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:56.686 10:07:02 -- fips/fips.sh@148 -- # bdevperf_pid=2846942 00:20:56.686 10:07:02 -- fips/fips.sh@146 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:56.686 10:07:02 -- fips/fips.sh@149 -- # waitforlisten 2846942 /var/tmp/bdevperf.sock 00:20:56.686 10:07:02 -- common/autotest_common.sh@819 -- # '[' -z 2846942 ']' 00:20:56.686 10:07:02 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:56.686 10:07:02 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:56.686 10:07:02 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:56.686 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:56.686 10:07:02 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:56.686 10:07:02 -- common/autotest_common.sh@10 -- # set +x 00:20:56.686 [2024-07-13 10:07:02.399322] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:20:56.686 [2024-07-13 10:07:02.399418] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2846942 ] 00:20:56.686 EAL: No free 2048 kB hugepages reported on node 1 00:20:56.686 [2024-07-13 10:07:02.465482] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:56.942 [2024-07-13 10:07:02.557698] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:57.505 10:07:03 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:57.505 10:07:03 -- common/autotest_common.sh@852 -- # return 0 00:20:57.762 10:07:03 -- fips/fips.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:20:58.020 [2024-07-13 10:07:03.589975] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:58.020 TLSTESTn1 00:20:58.020 10:07:03 -- fips/fips.sh@155 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:20:58.020 Running I/O for 10 seconds... 00:21:10.210 00:21:10.210 Latency(us) 00:21:10.210 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:10.210 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:21:10.210 Verification LBA range: start 0x0 length 0x2000 00:21:10.210 TLSTESTn1 : 10.02 2824.74 11.03 0.00 0.00 45257.93 6990.51 51263.72 00:21:10.210 =================================================================================================================== 00:21:10.210 Total : 2824.74 11.03 0.00 0.00 45257.93 6990.51 51263.72 00:21:10.210 0 00:21:10.210 10:07:13 -- fips/fips.sh@1 -- # cleanup 00:21:10.210 10:07:13 -- fips/fips.sh@15 -- # process_shm --id 0 00:21:10.210 10:07:13 -- common/autotest_common.sh@796 -- # type=--id 00:21:10.210 10:07:13 -- common/autotest_common.sh@797 -- # id=0 00:21:10.210 10:07:13 -- common/autotest_common.sh@798 -- # '[' --id = --pid ']' 00:21:10.210 10:07:13 -- common/autotest_common.sh@802 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:21:10.210 10:07:13 -- common/autotest_common.sh@802 -- # shm_files=nvmf_trace.0 00:21:10.210 10:07:13 -- common/autotest_common.sh@804 -- # [[ -z nvmf_trace.0 ]] 00:21:10.210 10:07:13 -- common/autotest_common.sh@808 -- # for n in $shm_files 00:21:10.210 10:07:13 -- common/autotest_common.sh@809 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:21:10.210 nvmf_trace.0 00:21:10.210 10:07:13 -- common/autotest_common.sh@811 -- # return 0 00:21:10.210 10:07:13 -- fips/fips.sh@16 -- # killprocess 2846942 00:21:10.210 10:07:13 -- common/autotest_common.sh@926 -- # '[' -z 2846942 ']' 00:21:10.210 10:07:13 -- common/autotest_common.sh@930 -- # kill -0 2846942 00:21:10.210 10:07:13 -- common/autotest_common.sh@931 -- # uname 00:21:10.210 10:07:13 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:21:10.210 10:07:13 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2846942 00:21:10.210 10:07:13 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:21:10.210 10:07:13 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:21:10.210 10:07:13 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2846942' 00:21:10.210 killing process with pid 2846942 00:21:10.210 10:07:13 -- common/autotest_common.sh@945 -- # kill 2846942 00:21:10.210 Received shutdown signal, test time was about 10.000000 seconds 00:21:10.210 00:21:10.210 Latency(us) 00:21:10.210 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:10.210 =================================================================================================================== 00:21:10.210 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:10.210 10:07:13 -- common/autotest_common.sh@950 -- # wait 2846942 00:21:10.210 10:07:14 -- fips/fips.sh@17 -- # nvmftestfini 00:21:10.210 10:07:14 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:10.210 10:07:14 -- nvmf/common.sh@116 -- # sync 00:21:10.210 10:07:14 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:10.211 10:07:14 -- nvmf/common.sh@119 -- # set +e 00:21:10.211 10:07:14 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:10.211 10:07:14 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:10.211 rmmod nvme_tcp 00:21:10.211 rmmod nvme_fabrics 00:21:10.211 rmmod nvme_keyring 00:21:10.211 10:07:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:10.211 10:07:14 -- nvmf/common.sh@123 -- # set -e 00:21:10.211 10:07:14 -- nvmf/common.sh@124 -- # return 0 00:21:10.211 10:07:14 -- nvmf/common.sh@477 -- # '[' -n 2846720 ']' 00:21:10.211 10:07:14 -- nvmf/common.sh@478 -- # killprocess 2846720 00:21:10.211 10:07:14 -- common/autotest_common.sh@926 -- # '[' -z 2846720 ']' 00:21:10.211 10:07:14 -- common/autotest_common.sh@930 -- # kill -0 2846720 00:21:10.211 10:07:14 -- common/autotest_common.sh@931 -- # uname 00:21:10.211 10:07:14 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:21:10.211 10:07:14 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2846720 00:21:10.211 10:07:14 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:21:10.211 10:07:14 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:21:10.211 10:07:14 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2846720' 00:21:10.211 killing process with pid 2846720 00:21:10.211 10:07:14 -- common/autotest_common.sh@945 -- # kill 2846720 00:21:10.211 10:07:14 -- common/autotest_common.sh@950 -- # wait 2846720 00:21:10.211 10:07:14 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:10.211 10:07:14 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:10.211 10:07:14 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:10.211 10:07:14 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:10.211 10:07:14 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:10.211 10:07:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:10.211 10:07:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:10.211 10:07:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:10.778 10:07:16 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:10.778 10:07:16 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:10.778 00:21:10.778 real 0m17.765s 00:21:10.778 user 0m22.248s 00:21:10.778 sys 0m6.919s 00:21:10.778 10:07:16 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:21:10.778 10:07:16 -- common/autotest_common.sh@10 -- # set +x 00:21:10.778 ************************************ 00:21:10.778 END TEST nvmf_fips 00:21:10.778 ************************************ 00:21:10.778 10:07:16 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:21:10.778 10:07:16 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:21:10.778 10:07:16 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:21:10.778 10:07:16 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:21:10.778 10:07:16 -- common/autotest_common.sh@10 -- # set +x 00:21:10.778 ************************************ 00:21:10.778 START TEST nvmf_fuzz 00:21:10.778 ************************************ 00:21:10.778 10:07:16 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:21:11.036 * Looking for test storage... 00:21:11.036 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:11.036 10:07:16 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:11.036 10:07:16 -- nvmf/common.sh@7 -- # uname -s 00:21:11.036 10:07:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:11.036 10:07:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:11.036 10:07:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:11.036 10:07:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:11.036 10:07:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:11.036 10:07:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:11.036 10:07:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:11.036 10:07:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:11.036 10:07:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:11.036 10:07:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:11.036 10:07:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:11.036 10:07:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:11.036 10:07:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:11.036 10:07:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:11.037 10:07:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:11.037 10:07:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:11.037 10:07:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:11.037 10:07:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:11.037 10:07:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:11.037 10:07:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:11.037 10:07:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:11.037 10:07:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:11.037 10:07:16 -- paths/export.sh@5 -- # export PATH 00:21:11.037 10:07:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:11.037 10:07:16 -- nvmf/common.sh@46 -- # : 0 00:21:11.037 10:07:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:11.037 10:07:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:11.037 10:07:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:11.037 10:07:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:11.037 10:07:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:11.037 10:07:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:11.037 10:07:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:11.037 10:07:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:11.037 10:07:16 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:21:11.037 10:07:16 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:11.037 10:07:16 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:11.037 10:07:16 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:11.037 10:07:16 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:11.037 10:07:16 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:11.037 10:07:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:11.037 10:07:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:11.037 10:07:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:11.037 10:07:16 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:11.037 10:07:16 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:11.037 10:07:16 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:11.037 10:07:16 -- common/autotest_common.sh@10 -- # set +x 00:21:12.933 10:07:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:12.933 10:07:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:12.933 10:07:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:12.933 10:07:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:12.933 10:07:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:12.933 10:07:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:12.933 10:07:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:12.933 10:07:18 -- nvmf/common.sh@294 -- # net_devs=() 00:21:12.933 10:07:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:12.933 10:07:18 -- nvmf/common.sh@295 -- # e810=() 00:21:12.933 10:07:18 -- nvmf/common.sh@295 -- # local -ga e810 00:21:12.933 10:07:18 -- nvmf/common.sh@296 -- # x722=() 00:21:12.933 10:07:18 -- nvmf/common.sh@296 -- # local -ga x722 00:21:12.933 10:07:18 -- nvmf/common.sh@297 -- # mlx=() 00:21:12.933 10:07:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:12.933 10:07:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:12.933 10:07:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:12.933 10:07:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:12.933 10:07:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:12.933 10:07:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:12.933 10:07:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:12.933 10:07:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:12.933 10:07:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:12.933 10:07:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:12.933 10:07:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:12.933 10:07:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:12.933 10:07:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:12.933 10:07:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:12.933 10:07:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:12.933 10:07:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:12.933 10:07:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:12.933 10:07:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:12.933 10:07:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:12.933 10:07:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:12.933 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:12.933 10:07:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:12.933 10:07:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:12.933 10:07:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:12.933 10:07:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:12.933 10:07:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:12.933 10:07:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:12.933 10:07:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:12.933 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:12.933 10:07:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:12.933 10:07:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:12.933 10:07:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:12.933 10:07:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:12.933 10:07:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:12.933 10:07:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:12.933 10:07:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:12.933 10:07:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:12.933 10:07:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:12.933 10:07:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:12.933 10:07:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:12.933 10:07:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:12.933 10:07:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:12.933 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:12.933 10:07:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:12.933 10:07:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:12.933 10:07:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:12.933 10:07:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:12.933 10:07:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:12.933 10:07:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:12.933 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:12.933 10:07:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:12.933 10:07:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:12.933 10:07:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:12.933 10:07:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:12.933 10:07:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:12.933 10:07:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:12.933 10:07:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:12.933 10:07:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:12.933 10:07:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:12.933 10:07:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:12.933 10:07:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:12.933 10:07:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:12.933 10:07:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:12.933 10:07:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:12.933 10:07:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:12.933 10:07:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:12.933 10:07:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:12.933 10:07:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:12.933 10:07:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:12.933 10:07:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:12.933 10:07:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:12.933 10:07:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:12.933 10:07:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:12.933 10:07:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:12.933 10:07:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:12.933 10:07:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:12.933 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:12.933 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.194 ms 00:21:12.933 00:21:12.933 --- 10.0.0.2 ping statistics --- 00:21:12.933 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:12.933 rtt min/avg/max/mdev = 0.194/0.194/0.194/0.000 ms 00:21:12.933 10:07:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:12.933 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:12.933 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.134 ms 00:21:12.933 00:21:12.933 --- 10.0.0.1 ping statistics --- 00:21:12.933 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:12.933 rtt min/avg/max/mdev = 0.134/0.134/0.134/0.000 ms 00:21:12.933 10:07:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:12.933 10:07:18 -- nvmf/common.sh@410 -- # return 0 00:21:12.933 10:07:18 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:12.933 10:07:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:12.933 10:07:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:12.933 10:07:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:12.933 10:07:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:12.933 10:07:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:12.933 10:07:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:12.933 10:07:18 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=2850300 00:21:12.933 10:07:18 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:21:12.933 10:07:18 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:21:12.933 10:07:18 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 2850300 00:21:12.933 10:07:18 -- common/autotest_common.sh@819 -- # '[' -z 2850300 ']' 00:21:12.933 10:07:18 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:12.933 10:07:18 -- common/autotest_common.sh@824 -- # local max_retries=100 00:21:12.933 10:07:18 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:12.933 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:12.933 10:07:18 -- common/autotest_common.sh@828 -- # xtrace_disable 00:21:12.933 10:07:18 -- common/autotest_common.sh@10 -- # set +x 00:21:14.304 10:07:19 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:21:14.304 10:07:19 -- common/autotest_common.sh@852 -- # return 0 00:21:14.304 10:07:19 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:14.304 10:07:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:14.304 10:07:19 -- common/autotest_common.sh@10 -- # set +x 00:21:14.304 10:07:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:14.304 10:07:19 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:21:14.304 10:07:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:14.304 10:07:19 -- common/autotest_common.sh@10 -- # set +x 00:21:14.304 Malloc0 00:21:14.304 10:07:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:14.304 10:07:19 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:14.304 10:07:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:14.304 10:07:19 -- common/autotest_common.sh@10 -- # set +x 00:21:14.304 10:07:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:14.304 10:07:19 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:21:14.304 10:07:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:14.304 10:07:19 -- common/autotest_common.sh@10 -- # set +x 00:21:14.304 10:07:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:14.304 10:07:19 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:14.304 10:07:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:14.304 10:07:19 -- common/autotest_common.sh@10 -- # set +x 00:21:14.304 10:07:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:14.304 10:07:19 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:21:14.304 10:07:19 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:21:46.391 Fuzzing completed. Shutting down the fuzz application 00:21:46.391 00:21:46.391 Dumping successful admin opcodes: 00:21:46.391 8, 9, 10, 24, 00:21:46.391 Dumping successful io opcodes: 00:21:46.391 0, 9, 00:21:46.391 NS: 0x200003aeff00 I/O qp, Total commands completed: 455860, total successful commands: 2645, random_seed: 3754280768 00:21:46.391 NS: 0x200003aeff00 admin qp, Total commands completed: 57200, total successful commands: 455, random_seed: 3741093888 00:21:46.391 10:07:50 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:21:46.391 Fuzzing completed. Shutting down the fuzz application 00:21:46.391 00:21:46.391 Dumping successful admin opcodes: 00:21:46.391 24, 00:21:46.391 Dumping successful io opcodes: 00:21:46.391 00:21:46.391 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 497794557 00:21:46.391 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 497914590 00:21:46.391 10:07:51 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:46.391 10:07:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:46.391 10:07:51 -- common/autotest_common.sh@10 -- # set +x 00:21:46.391 10:07:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:46.391 10:07:51 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:21:46.391 10:07:51 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:21:46.391 10:07:51 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:46.391 10:07:51 -- nvmf/common.sh@116 -- # sync 00:21:46.391 10:07:51 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:46.391 10:07:51 -- nvmf/common.sh@119 -- # set +e 00:21:46.391 10:07:51 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:46.391 10:07:51 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:46.391 rmmod nvme_tcp 00:21:46.391 rmmod nvme_fabrics 00:21:46.391 rmmod nvme_keyring 00:21:46.391 10:07:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:46.391 10:07:51 -- nvmf/common.sh@123 -- # set -e 00:21:46.391 10:07:51 -- nvmf/common.sh@124 -- # return 0 00:21:46.391 10:07:51 -- nvmf/common.sh@477 -- # '[' -n 2850300 ']' 00:21:46.391 10:07:51 -- nvmf/common.sh@478 -- # killprocess 2850300 00:21:46.391 10:07:51 -- common/autotest_common.sh@926 -- # '[' -z 2850300 ']' 00:21:46.391 10:07:51 -- common/autotest_common.sh@930 -- # kill -0 2850300 00:21:46.391 10:07:51 -- common/autotest_common.sh@931 -- # uname 00:21:46.391 10:07:51 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:21:46.391 10:07:51 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2850300 00:21:46.391 10:07:51 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:21:46.391 10:07:51 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:21:46.391 10:07:51 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2850300' 00:21:46.391 killing process with pid 2850300 00:21:46.391 10:07:51 -- common/autotest_common.sh@945 -- # kill 2850300 00:21:46.392 10:07:51 -- common/autotest_common.sh@950 -- # wait 2850300 00:21:46.392 10:07:52 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:46.392 10:07:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:46.392 10:07:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:46.392 10:07:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:46.392 10:07:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:46.392 10:07:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:46.392 10:07:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:46.392 10:07:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:48.925 10:07:54 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:48.925 10:07:54 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:21:48.925 00:21:48.925 real 0m37.594s 00:21:48.925 user 0m51.454s 00:21:48.925 sys 0m15.616s 00:21:48.925 10:07:54 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:21:48.925 10:07:54 -- common/autotest_common.sh@10 -- # set +x 00:21:48.925 ************************************ 00:21:48.925 END TEST nvmf_fuzz 00:21:48.925 ************************************ 00:21:48.925 10:07:54 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:21:48.925 10:07:54 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:21:48.925 10:07:54 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:21:48.925 10:07:54 -- common/autotest_common.sh@10 -- # set +x 00:21:48.925 ************************************ 00:21:48.925 START TEST nvmf_multiconnection 00:21:48.925 ************************************ 00:21:48.925 10:07:54 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:21:48.925 * Looking for test storage... 00:21:48.925 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:48.925 10:07:54 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:48.925 10:07:54 -- nvmf/common.sh@7 -- # uname -s 00:21:48.925 10:07:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:48.925 10:07:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:48.925 10:07:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:48.925 10:07:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:48.925 10:07:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:48.925 10:07:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:48.925 10:07:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:48.925 10:07:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:48.925 10:07:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:48.925 10:07:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:48.925 10:07:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:48.925 10:07:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:48.925 10:07:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:48.925 10:07:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:48.925 10:07:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:48.925 10:07:54 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:48.925 10:07:54 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:48.925 10:07:54 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:48.925 10:07:54 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:48.925 10:07:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:48.925 10:07:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:48.925 10:07:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:48.925 10:07:54 -- paths/export.sh@5 -- # export PATH 00:21:48.925 10:07:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:48.925 10:07:54 -- nvmf/common.sh@46 -- # : 0 00:21:48.925 10:07:54 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:48.925 10:07:54 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:48.925 10:07:54 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:48.925 10:07:54 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:48.925 10:07:54 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:48.925 10:07:54 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:48.925 10:07:54 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:48.925 10:07:54 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:48.925 10:07:54 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:21:48.925 10:07:54 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:21:48.925 10:07:54 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:21:48.925 10:07:54 -- target/multiconnection.sh@16 -- # nvmftestinit 00:21:48.925 10:07:54 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:48.925 10:07:54 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:48.925 10:07:54 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:48.925 10:07:54 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:48.925 10:07:54 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:48.925 10:07:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:48.925 10:07:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:48.925 10:07:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:48.925 10:07:54 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:48.925 10:07:54 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:48.925 10:07:54 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:48.925 10:07:54 -- common/autotest_common.sh@10 -- # set +x 00:21:50.296 10:07:56 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:50.296 10:07:56 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:50.296 10:07:56 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:50.554 10:07:56 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:50.554 10:07:56 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:50.554 10:07:56 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:50.554 10:07:56 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:50.554 10:07:56 -- nvmf/common.sh@294 -- # net_devs=() 00:21:50.554 10:07:56 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:50.555 10:07:56 -- nvmf/common.sh@295 -- # e810=() 00:21:50.555 10:07:56 -- nvmf/common.sh@295 -- # local -ga e810 00:21:50.555 10:07:56 -- nvmf/common.sh@296 -- # x722=() 00:21:50.555 10:07:56 -- nvmf/common.sh@296 -- # local -ga x722 00:21:50.555 10:07:56 -- nvmf/common.sh@297 -- # mlx=() 00:21:50.555 10:07:56 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:50.555 10:07:56 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:50.555 10:07:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:50.555 10:07:56 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:50.555 10:07:56 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:50.555 10:07:56 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:50.555 10:07:56 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:50.555 10:07:56 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:50.555 10:07:56 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:50.555 10:07:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:50.555 10:07:56 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:50.555 10:07:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:50.555 10:07:56 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:50.555 10:07:56 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:50.555 10:07:56 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:50.555 10:07:56 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:50.555 10:07:56 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:50.555 10:07:56 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:50.555 10:07:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:50.555 10:07:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:50.555 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:50.555 10:07:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:50.555 10:07:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:50.555 10:07:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:50.555 10:07:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:50.555 10:07:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:50.555 10:07:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:50.555 10:07:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:50.555 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:50.555 10:07:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:50.555 10:07:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:50.555 10:07:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:50.555 10:07:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:50.555 10:07:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:50.555 10:07:56 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:50.555 10:07:56 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:50.555 10:07:56 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:50.555 10:07:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:50.555 10:07:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:50.555 10:07:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:50.555 10:07:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:50.555 10:07:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:50.555 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:50.555 10:07:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:50.555 10:07:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:50.555 10:07:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:50.555 10:07:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:50.555 10:07:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:50.555 10:07:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:50.555 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:50.555 10:07:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:50.555 10:07:56 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:50.555 10:07:56 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:50.555 10:07:56 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:50.555 10:07:56 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:50.555 10:07:56 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:50.555 10:07:56 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:50.555 10:07:56 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:50.555 10:07:56 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:50.555 10:07:56 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:50.555 10:07:56 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:50.555 10:07:56 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:50.555 10:07:56 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:50.555 10:07:56 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:50.555 10:07:56 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:50.555 10:07:56 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:50.555 10:07:56 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:50.555 10:07:56 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:50.555 10:07:56 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:50.555 10:07:56 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:50.555 10:07:56 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:50.555 10:07:56 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:50.555 10:07:56 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:50.555 10:07:56 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:50.555 10:07:56 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:50.555 10:07:56 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:50.555 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:50.555 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.207 ms 00:21:50.555 00:21:50.555 --- 10.0.0.2 ping statistics --- 00:21:50.555 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:50.555 rtt min/avg/max/mdev = 0.207/0.207/0.207/0.000 ms 00:21:50.555 10:07:56 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:50.555 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:50.555 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.118 ms 00:21:50.555 00:21:50.555 --- 10.0.0.1 ping statistics --- 00:21:50.555 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:50.555 rtt min/avg/max/mdev = 0.118/0.118/0.118/0.000 ms 00:21:50.555 10:07:56 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:50.555 10:07:56 -- nvmf/common.sh@410 -- # return 0 00:21:50.555 10:07:56 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:50.555 10:07:56 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:50.555 10:07:56 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:50.555 10:07:56 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:50.555 10:07:56 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:50.555 10:07:56 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:50.555 10:07:56 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:50.555 10:07:56 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:21:50.555 10:07:56 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:50.555 10:07:56 -- common/autotest_common.sh@712 -- # xtrace_disable 00:21:50.555 10:07:56 -- common/autotest_common.sh@10 -- # set +x 00:21:50.555 10:07:56 -- nvmf/common.sh@469 -- # nvmfpid=2856172 00:21:50.555 10:07:56 -- nvmf/common.sh@470 -- # waitforlisten 2856172 00:21:50.555 10:07:56 -- common/autotest_common.sh@819 -- # '[' -z 2856172 ']' 00:21:50.555 10:07:56 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:50.555 10:07:56 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:21:50.555 10:07:56 -- common/autotest_common.sh@824 -- # local max_retries=100 00:21:50.555 10:07:56 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:50.555 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:50.555 10:07:56 -- common/autotest_common.sh@828 -- # xtrace_disable 00:21:50.555 10:07:56 -- common/autotest_common.sh@10 -- # set +x 00:21:50.555 [2024-07-13 10:07:56.318873] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:21:50.556 [2024-07-13 10:07:56.318964] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:50.556 EAL: No free 2048 kB hugepages reported on node 1 00:21:50.813 [2024-07-13 10:07:56.387445] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:50.813 [2024-07-13 10:07:56.477444] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:50.813 [2024-07-13 10:07:56.477618] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:50.813 [2024-07-13 10:07:56.477638] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:50.813 [2024-07-13 10:07:56.477652] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:50.813 [2024-07-13 10:07:56.477735] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:50.813 [2024-07-13 10:07:56.477764] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:50.813 [2024-07-13 10:07:56.477828] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:50.813 [2024-07-13 10:07:56.477830] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:51.746 10:07:57 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:21:51.746 10:07:57 -- common/autotest_common.sh@852 -- # return 0 00:21:51.746 10:07:57 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:51.746 10:07:57 -- common/autotest_common.sh@718 -- # xtrace_disable 00:21:51.746 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:51.746 10:07:57 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:51.746 10:07:57 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:51.746 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:51.746 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:51.746 [2024-07-13 10:07:57.284446] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:51.746 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:51.746 10:07:57 -- target/multiconnection.sh@21 -- # seq 1 11 00:21:51.746 10:07:57 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:51.746 10:07:57 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:21:51.746 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:51.746 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:51.746 Malloc1 00:21:51.746 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:51.746 10:07:57 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:21:51.746 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:51.746 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:51.746 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:51.746 10:07:57 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:21:51.746 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:51.746 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:51.746 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:51.746 10:07:57 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:51.746 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:51.746 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:51.746 [2024-07-13 10:07:57.339437] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:51.746 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:51.746 10:07:57 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:51.746 10:07:57 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:21:51.746 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:51.746 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:51.746 Malloc2 00:21:51.746 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:51.746 10:07:57 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:21:51.746 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:51.746 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:51.746 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:51.746 10:07:57 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:21:51.746 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:51.746 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:51.746 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:51.746 10:07:57 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:21:51.746 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:51.746 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:51.746 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:51.746 10:07:57 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:51.746 10:07:57 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:21:51.746 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:51.746 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:51.746 Malloc3 00:21:51.746 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:51.746 10:07:57 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:21:51.746 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:51.746 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:51.746 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:51.746 10:07:57 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:21:51.746 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:51.746 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:51.746 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:51.746 10:07:57 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:21:51.746 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:51.746 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:51.746 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:51.746 10:07:57 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:51.746 10:07:57 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:21:51.746 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:51.746 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:51.746 Malloc4 00:21:51.746 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:51.746 10:07:57 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:21:51.746 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:51.746 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:51.746 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:51.746 10:07:57 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:21:51.746 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:51.746 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:51.746 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:51.746 10:07:57 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:21:51.746 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:51.746 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:51.746 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:51.746 10:07:57 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:51.746 10:07:57 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:21:51.746 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:51.746 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:51.746 Malloc5 00:21:51.746 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:51.746 10:07:57 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:21:51.746 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:51.746 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:51.746 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:51.746 10:07:57 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:21:51.746 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:51.746 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:51.746 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:51.747 10:07:57 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:21:51.747 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:51.747 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:51.747 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:51.747 10:07:57 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:51.747 10:07:57 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:21:51.747 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:51.747 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:51.747 Malloc6 00:21:51.747 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:51.747 10:07:57 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:21:51.747 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:51.747 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:51.747 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:51.747 10:07:57 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:21:51.747 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:51.747 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:52.005 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:52.005 10:07:57 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:21:52.005 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:52.005 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:52.005 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:52.005 10:07:57 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:52.005 10:07:57 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:21:52.005 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:52.005 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:52.005 Malloc7 00:21:52.005 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:52.005 10:07:57 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:21:52.005 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:52.005 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:52.005 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:52.005 10:07:57 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:21:52.005 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:52.005 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:52.005 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:52.005 10:07:57 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:21:52.005 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:52.005 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:52.005 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:52.005 10:07:57 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:52.005 10:07:57 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:21:52.005 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:52.005 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:52.005 Malloc8 00:21:52.005 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:52.005 10:07:57 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:21:52.005 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:52.005 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:52.005 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:52.005 10:07:57 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:21:52.005 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:52.005 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:52.005 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:52.005 10:07:57 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:21:52.005 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:52.005 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:52.005 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:52.005 10:07:57 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:52.005 10:07:57 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:21:52.005 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:52.005 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:52.005 Malloc9 00:21:52.005 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:52.006 10:07:57 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:21:52.006 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:52.006 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:52.006 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:52.006 10:07:57 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:21:52.006 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:52.006 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:52.006 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:52.006 10:07:57 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:21:52.006 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:52.006 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:52.006 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:52.006 10:07:57 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:52.006 10:07:57 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:21:52.006 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:52.006 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:52.006 Malloc10 00:21:52.006 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:52.006 10:07:57 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:21:52.006 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:52.006 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:52.006 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:52.006 10:07:57 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:21:52.006 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:52.006 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:52.006 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:52.006 10:07:57 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:21:52.006 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:52.006 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:52.006 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:52.006 10:07:57 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:52.006 10:07:57 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:21:52.006 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:52.006 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:52.006 Malloc11 00:21:52.006 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:52.006 10:07:57 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:21:52.006 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:52.006 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:52.006 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:52.006 10:07:57 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:21:52.006 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:52.006 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:52.006 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:52.006 10:07:57 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:21:52.006 10:07:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:52.006 10:07:57 -- common/autotest_common.sh@10 -- # set +x 00:21:52.264 10:07:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:52.264 10:07:57 -- target/multiconnection.sh@28 -- # seq 1 11 00:21:52.264 10:07:57 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:52.264 10:07:57 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:21:52.830 10:07:58 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:21:52.830 10:07:58 -- common/autotest_common.sh@1177 -- # local i=0 00:21:52.830 10:07:58 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:21:52.830 10:07:58 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:21:52.830 10:07:58 -- common/autotest_common.sh@1184 -- # sleep 2 00:21:54.727 10:08:00 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:21:54.727 10:08:00 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:21:54.727 10:08:00 -- common/autotest_common.sh@1186 -- # grep -c SPDK1 00:21:54.727 10:08:00 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:21:54.727 10:08:00 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:21:54.727 10:08:00 -- common/autotest_common.sh@1187 -- # return 0 00:21:54.727 10:08:00 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:54.727 10:08:00 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:21:55.292 10:08:01 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:21:55.292 10:08:01 -- common/autotest_common.sh@1177 -- # local i=0 00:21:55.292 10:08:01 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:21:55.292 10:08:01 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:21:55.292 10:08:01 -- common/autotest_common.sh@1184 -- # sleep 2 00:21:57.816 10:08:03 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:21:57.816 10:08:03 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:21:57.816 10:08:03 -- common/autotest_common.sh@1186 -- # grep -c SPDK2 00:21:57.816 10:08:03 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:21:57.816 10:08:03 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:21:57.816 10:08:03 -- common/autotest_common.sh@1187 -- # return 0 00:21:57.816 10:08:03 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:57.816 10:08:03 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:21:58.072 10:08:03 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:21:58.072 10:08:03 -- common/autotest_common.sh@1177 -- # local i=0 00:21:58.072 10:08:03 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:21:58.072 10:08:03 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:21:58.072 10:08:03 -- common/autotest_common.sh@1184 -- # sleep 2 00:21:59.994 10:08:05 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:21:59.994 10:08:05 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:21:59.994 10:08:05 -- common/autotest_common.sh@1186 -- # grep -c SPDK3 00:21:59.994 10:08:05 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:21:59.994 10:08:05 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:21:59.994 10:08:05 -- common/autotest_common.sh@1187 -- # return 0 00:21:59.994 10:08:05 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:59.994 10:08:05 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:22:00.934 10:08:06 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:22:00.934 10:08:06 -- common/autotest_common.sh@1177 -- # local i=0 00:22:00.934 10:08:06 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:22:00.934 10:08:06 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:22:00.934 10:08:06 -- common/autotest_common.sh@1184 -- # sleep 2 00:22:02.830 10:08:08 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:22:02.830 10:08:08 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:22:02.830 10:08:08 -- common/autotest_common.sh@1186 -- # grep -c SPDK4 00:22:02.830 10:08:08 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:22:02.830 10:08:08 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:22:02.830 10:08:08 -- common/autotest_common.sh@1187 -- # return 0 00:22:02.830 10:08:08 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:02.830 10:08:08 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:22:03.762 10:08:09 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:22:03.762 10:08:09 -- common/autotest_common.sh@1177 -- # local i=0 00:22:03.762 10:08:09 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:22:03.762 10:08:09 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:22:03.762 10:08:09 -- common/autotest_common.sh@1184 -- # sleep 2 00:22:05.657 10:08:11 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:22:05.657 10:08:11 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:22:05.657 10:08:11 -- common/autotest_common.sh@1186 -- # grep -c SPDK5 00:22:05.657 10:08:11 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:22:05.657 10:08:11 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:22:05.657 10:08:11 -- common/autotest_common.sh@1187 -- # return 0 00:22:05.657 10:08:11 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:05.657 10:08:11 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:22:06.600 10:08:12 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:22:06.600 10:08:12 -- common/autotest_common.sh@1177 -- # local i=0 00:22:06.600 10:08:12 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:22:06.600 10:08:12 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:22:06.600 10:08:12 -- common/autotest_common.sh@1184 -- # sleep 2 00:22:08.496 10:08:14 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:22:08.496 10:08:14 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:22:08.496 10:08:14 -- common/autotest_common.sh@1186 -- # grep -c SPDK6 00:22:08.496 10:08:14 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:22:08.496 10:08:14 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:22:08.496 10:08:14 -- common/autotest_common.sh@1187 -- # return 0 00:22:08.496 10:08:14 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:08.496 10:08:14 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:22:09.059 10:08:14 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:22:09.059 10:08:14 -- common/autotest_common.sh@1177 -- # local i=0 00:22:09.059 10:08:14 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:22:09.059 10:08:14 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:22:09.059 10:08:14 -- common/autotest_common.sh@1184 -- # sleep 2 00:22:10.951 10:08:16 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:22:10.952 10:08:16 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:22:10.952 10:08:16 -- common/autotest_common.sh@1186 -- # grep -c SPDK7 00:22:10.952 10:08:16 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:22:10.952 10:08:16 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:22:10.952 10:08:16 -- common/autotest_common.sh@1187 -- # return 0 00:22:10.952 10:08:16 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:10.952 10:08:16 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:22:11.884 10:08:17 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:22:11.884 10:08:17 -- common/autotest_common.sh@1177 -- # local i=0 00:22:11.884 10:08:17 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:22:11.884 10:08:17 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:22:11.884 10:08:17 -- common/autotest_common.sh@1184 -- # sleep 2 00:22:14.410 10:08:19 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:22:14.410 10:08:19 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:22:14.410 10:08:19 -- common/autotest_common.sh@1186 -- # grep -c SPDK8 00:22:14.410 10:08:19 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:22:14.410 10:08:19 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:22:14.410 10:08:19 -- common/autotest_common.sh@1187 -- # return 0 00:22:14.410 10:08:19 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:14.410 10:08:19 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:22:14.667 10:08:20 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:22:14.667 10:08:20 -- common/autotest_common.sh@1177 -- # local i=0 00:22:14.667 10:08:20 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:22:14.667 10:08:20 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:22:14.667 10:08:20 -- common/autotest_common.sh@1184 -- # sleep 2 00:22:17.189 10:08:22 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:22:17.189 10:08:22 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:22:17.189 10:08:22 -- common/autotest_common.sh@1186 -- # grep -c SPDK9 00:22:17.189 10:08:22 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:22:17.189 10:08:22 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:22:17.189 10:08:22 -- common/autotest_common.sh@1187 -- # return 0 00:22:17.189 10:08:22 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:17.189 10:08:22 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:22:17.752 10:08:23 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:22:17.752 10:08:23 -- common/autotest_common.sh@1177 -- # local i=0 00:22:17.752 10:08:23 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:22:17.752 10:08:23 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:22:17.752 10:08:23 -- common/autotest_common.sh@1184 -- # sleep 2 00:22:19.678 10:08:25 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:22:19.679 10:08:25 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:22:19.679 10:08:25 -- common/autotest_common.sh@1186 -- # grep -c SPDK10 00:22:19.679 10:08:25 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:22:19.679 10:08:25 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:22:19.679 10:08:25 -- common/autotest_common.sh@1187 -- # return 0 00:22:19.679 10:08:25 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:19.679 10:08:25 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:22:20.634 10:08:26 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:22:20.634 10:08:26 -- common/autotest_common.sh@1177 -- # local i=0 00:22:20.634 10:08:26 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:22:20.634 10:08:26 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:22:20.634 10:08:26 -- common/autotest_common.sh@1184 -- # sleep 2 00:22:22.533 10:08:28 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:22:22.533 10:08:28 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:22:22.533 10:08:28 -- common/autotest_common.sh@1186 -- # grep -c SPDK11 00:22:22.533 10:08:28 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:22:22.533 10:08:28 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:22:22.533 10:08:28 -- common/autotest_common.sh@1187 -- # return 0 00:22:22.533 10:08:28 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:22:22.533 [global] 00:22:22.533 thread=1 00:22:22.533 invalidate=1 00:22:22.533 rw=read 00:22:22.533 time_based=1 00:22:22.533 runtime=10 00:22:22.533 ioengine=libaio 00:22:22.533 direct=1 00:22:22.533 bs=262144 00:22:22.533 iodepth=64 00:22:22.533 norandommap=1 00:22:22.533 numjobs=1 00:22:22.533 00:22:22.533 [job0] 00:22:22.533 filename=/dev/nvme0n1 00:22:22.533 [job1] 00:22:22.533 filename=/dev/nvme10n1 00:22:22.533 [job2] 00:22:22.533 filename=/dev/nvme1n1 00:22:22.533 [job3] 00:22:22.533 filename=/dev/nvme2n1 00:22:22.533 [job4] 00:22:22.533 filename=/dev/nvme3n1 00:22:22.533 [job5] 00:22:22.533 filename=/dev/nvme4n1 00:22:22.533 [job6] 00:22:22.533 filename=/dev/nvme5n1 00:22:22.533 [job7] 00:22:22.533 filename=/dev/nvme6n1 00:22:22.533 [job8] 00:22:22.533 filename=/dev/nvme7n1 00:22:22.533 [job9] 00:22:22.533 filename=/dev/nvme8n1 00:22:22.533 [job10] 00:22:22.533 filename=/dev/nvme9n1 00:22:22.795 Could not set queue depth (nvme0n1) 00:22:22.795 Could not set queue depth (nvme10n1) 00:22:22.795 Could not set queue depth (nvme1n1) 00:22:22.795 Could not set queue depth (nvme2n1) 00:22:22.795 Could not set queue depth (nvme3n1) 00:22:22.795 Could not set queue depth (nvme4n1) 00:22:22.795 Could not set queue depth (nvme5n1) 00:22:22.795 Could not set queue depth (nvme6n1) 00:22:22.795 Could not set queue depth (nvme7n1) 00:22:22.795 Could not set queue depth (nvme8n1) 00:22:22.795 Could not set queue depth (nvme9n1) 00:22:23.052 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:23.052 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:23.052 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:23.052 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:23.052 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:23.052 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:23.052 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:23.052 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:23.052 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:23.052 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:23.052 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:23.052 fio-3.35 00:22:23.052 Starting 11 threads 00:22:35.257 00:22:35.257 job0: (groupid=0, jobs=1): err= 0: pid=2860679: Sat Jul 13 10:08:39 2024 00:22:35.257 read: IOPS=575, BW=144MiB/s (151MB/s)(1452MiB/10095msec) 00:22:35.257 slat (usec): min=9, max=97918, avg=1297.81, stdev=4827.71 00:22:35.257 clat (msec): min=2, max=291, avg=109.89, stdev=43.60 00:22:35.257 lat (msec): min=2, max=291, avg=111.18, stdev=44.23 00:22:35.257 clat percentiles (msec): 00:22:35.257 | 1.00th=[ 16], 5.00th=[ 41], 10.00th=[ 51], 20.00th=[ 73], 00:22:35.257 | 30.00th=[ 85], 40.00th=[ 99], 50.00th=[ 115], 60.00th=[ 125], 00:22:35.257 | 70.00th=[ 132], 80.00th=[ 142], 90.00th=[ 165], 95.00th=[ 190], 00:22:35.257 | 99.00th=[ 211], 99.50th=[ 211], 99.90th=[ 271], 99.95th=[ 275], 00:22:35.257 | 99.99th=[ 292] 00:22:35.257 bw ( KiB/s): min=83456, max=242688, per=7.53%, avg=147046.40, stdev=45546.83, samples=20 00:22:35.257 iops : min= 326, max= 948, avg=574.40, stdev=177.92, samples=20 00:22:35.257 lat (msec) : 4=0.33%, 10=0.22%, 20=1.21%, 50=8.06%, 100=30.93% 00:22:35.258 lat (msec) : 250=59.15%, 500=0.10% 00:22:35.258 cpu : usr=0.41%, sys=1.95%, ctx=1421, majf=0, minf=3721 00:22:35.258 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:22:35.258 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:35.258 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:35.258 issued rwts: total=5807,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:35.258 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:35.258 job1: (groupid=0, jobs=1): err= 0: pid=2860692: Sat Jul 13 10:08:39 2024 00:22:35.258 read: IOPS=739, BW=185MiB/s (194MB/s)(1863MiB/10081msec) 00:22:35.258 slat (usec): min=9, max=45751, avg=1164.77, stdev=3567.33 00:22:35.258 clat (msec): min=6, max=248, avg=85.35, stdev=44.73 00:22:35.258 lat (msec): min=6, max=253, avg=86.52, stdev=45.40 00:22:35.258 clat percentiles (msec): 00:22:35.258 | 1.00th=[ 27], 5.00th=[ 34], 10.00th=[ 38], 20.00th=[ 46], 00:22:35.258 | 30.00th=[ 59], 40.00th=[ 69], 50.00th=[ 77], 60.00th=[ 85], 00:22:35.258 | 70.00th=[ 95], 80.00th=[ 116], 90.00th=[ 155], 95.00th=[ 186], 00:22:35.258 | 99.00th=[ 215], 99.50th=[ 224], 99.90th=[ 230], 99.95th=[ 247], 00:22:35.258 | 99.99th=[ 249] 00:22:35.258 bw ( KiB/s): min=78336, max=349184, per=9.69%, avg=189180.95, stdev=76031.57, samples=20 00:22:35.258 iops : min= 306, max= 1364, avg=738.95, stdev=296.98, samples=20 00:22:35.258 lat (msec) : 10=0.11%, 20=0.15%, 50=22.58%, 100=50.60%, 250=26.56% 00:22:35.258 cpu : usr=0.46%, sys=2.52%, ctx=1561, majf=0, minf=4097 00:22:35.258 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:22:35.258 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:35.258 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:35.258 issued rwts: total=7452,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:35.258 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:35.258 job2: (groupid=0, jobs=1): err= 0: pid=2860693: Sat Jul 13 10:08:39 2024 00:22:35.258 read: IOPS=574, BW=144MiB/s (151MB/s)(1444MiB/10049msec) 00:22:35.258 slat (usec): min=10, max=58014, avg=1491.81, stdev=4431.70 00:22:35.258 clat (msec): min=2, max=223, avg=109.82, stdev=38.90 00:22:35.258 lat (msec): min=2, max=247, avg=111.31, stdev=39.68 00:22:35.258 clat percentiles (msec): 00:22:35.258 | 1.00th=[ 14], 5.00th=[ 42], 10.00th=[ 58], 20.00th=[ 81], 00:22:35.258 | 30.00th=[ 93], 40.00th=[ 106], 50.00th=[ 113], 60.00th=[ 120], 00:22:35.258 | 70.00th=[ 128], 80.00th=[ 138], 90.00th=[ 153], 95.00th=[ 182], 00:22:35.258 | 99.00th=[ 213], 99.50th=[ 218], 99.90th=[ 222], 99.95th=[ 224], 00:22:35.258 | 99.99th=[ 224] 00:22:35.258 bw ( KiB/s): min=102400, max=224768, per=7.49%, avg=146201.60, stdev=35297.12, samples=20 00:22:35.258 iops : min= 400, max= 878, avg=571.10, stdev=137.88, samples=20 00:22:35.258 lat (msec) : 4=0.14%, 10=0.52%, 20=1.11%, 50=5.49%, 100=27.43% 00:22:35.258 lat (msec) : 250=65.31% 00:22:35.258 cpu : usr=0.31%, sys=2.19%, ctx=1363, majf=0, minf=4097 00:22:35.258 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:22:35.258 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:35.258 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:35.258 issued rwts: total=5774,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:35.258 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:35.258 job3: (groupid=0, jobs=1): err= 0: pid=2860694: Sat Jul 13 10:08:39 2024 00:22:35.258 read: IOPS=927, BW=232MiB/s (243MB/s)(2341MiB/10095msec) 00:22:35.258 slat (usec): min=13, max=76530, avg=1003.37, stdev=2964.84 00:22:35.258 clat (msec): min=2, max=213, avg=67.93, stdev=31.22 00:22:35.258 lat (msec): min=2, max=213, avg=68.94, stdev=31.70 00:22:35.258 clat percentiles (msec): 00:22:35.258 | 1.00th=[ 17], 5.00th=[ 37], 10.00th=[ 40], 20.00th=[ 42], 00:22:35.258 | 30.00th=[ 44], 40.00th=[ 52], 50.00th=[ 60], 60.00th=[ 68], 00:22:35.258 | 70.00th=[ 78], 80.00th=[ 99], 90.00th=[ 118], 95.00th=[ 128], 00:22:35.258 | 99.00th=[ 146], 99.50th=[ 153], 99.90th=[ 184], 99.95th=[ 203], 00:22:35.258 | 99.99th=[ 213] 00:22:35.258 bw ( KiB/s): min=119296, max=385024, per=12.20%, avg=238105.60, stdev=86166.08, samples=20 00:22:35.258 iops : min= 466, max= 1504, avg=930.10, stdev=336.59, samples=20 00:22:35.258 lat (msec) : 4=0.11%, 10=0.37%, 20=0.80%, 50=37.64%, 100=42.15% 00:22:35.258 lat (msec) : 250=18.92% 00:22:35.258 cpu : usr=0.60%, sys=3.16%, ctx=1950, majf=0, minf=4097 00:22:35.258 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:22:35.258 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:35.258 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:35.258 issued rwts: total=9364,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:35.258 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:35.258 job4: (groupid=0, jobs=1): err= 0: pid=2860695: Sat Jul 13 10:08:39 2024 00:22:35.258 read: IOPS=692, BW=173MiB/s (182MB/s)(1749MiB/10102msec) 00:22:35.258 slat (usec): min=9, max=102324, avg=1050.34, stdev=4040.72 00:22:35.258 clat (usec): min=1612, max=268530, avg=91297.77, stdev=45255.83 00:22:35.258 lat (usec): min=1632, max=279246, avg=92348.11, stdev=45867.54 00:22:35.258 clat percentiles (msec): 00:22:35.258 | 1.00th=[ 10], 5.00th=[ 23], 10.00th=[ 34], 20.00th=[ 55], 00:22:35.258 | 30.00th=[ 64], 40.00th=[ 75], 50.00th=[ 85], 60.00th=[ 96], 00:22:35.258 | 70.00th=[ 114], 80.00th=[ 133], 90.00th=[ 157], 95.00th=[ 174], 00:22:35.258 | 99.00th=[ 203], 99.50th=[ 209], 99.90th=[ 218], 99.95th=[ 230], 00:22:35.258 | 99.99th=[ 271] 00:22:35.258 bw ( KiB/s): min=104960, max=307200, per=9.09%, avg=177475.85, stdev=56245.37, samples=20 00:22:35.258 iops : min= 410, max= 1200, avg=693.25, stdev=219.71, samples=20 00:22:35.258 lat (msec) : 2=0.04%, 4=0.07%, 10=1.04%, 20=3.17%, 50=12.02% 00:22:35.258 lat (msec) : 100=46.80%, 250=36.81%, 500=0.04% 00:22:35.258 cpu : usr=0.43%, sys=2.26%, ctx=1727, majf=0, minf=4097 00:22:35.258 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:22:35.258 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:35.258 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:35.258 issued rwts: total=6996,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:35.258 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:35.258 job5: (groupid=0, jobs=1): err= 0: pid=2860696: Sat Jul 13 10:08:39 2024 00:22:35.258 read: IOPS=693, BW=173MiB/s (182MB/s)(1748MiB/10076msec) 00:22:35.258 slat (usec): min=13, max=91128, avg=1207.38, stdev=4072.20 00:22:35.258 clat (msec): min=3, max=259, avg=90.95, stdev=40.50 00:22:35.258 lat (msec): min=3, max=259, avg=92.15, stdev=41.07 00:22:35.258 clat percentiles (msec): 00:22:35.258 | 1.00th=[ 9], 5.00th=[ 28], 10.00th=[ 35], 20.00th=[ 52], 00:22:35.258 | 30.00th=[ 68], 40.00th=[ 81], 50.00th=[ 96], 60.00th=[ 108], 00:22:35.258 | 70.00th=[ 115], 80.00th=[ 126], 90.00th=[ 138], 95.00th=[ 150], 00:22:35.258 | 99.00th=[ 188], 99.50th=[ 215], 99.90th=[ 226], 99.95th=[ 228], 00:22:35.258 | 99.99th=[ 259] 00:22:35.258 bw ( KiB/s): min=117248, max=378368, per=9.08%, avg=177356.80, stdev=63840.90, samples=20 00:22:35.258 iops : min= 458, max= 1478, avg=692.80, stdev=249.38, samples=20 00:22:35.258 lat (msec) : 4=0.09%, 10=1.59%, 20=1.52%, 50=16.12%, 100=33.24% 00:22:35.258 lat (msec) : 250=47.43%, 500=0.01% 00:22:35.258 cpu : usr=0.42%, sys=2.60%, ctx=1633, majf=0, minf=4097 00:22:35.258 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:22:35.258 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:35.258 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:35.258 issued rwts: total=6991,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:35.258 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:35.258 job6: (groupid=0, jobs=1): err= 0: pid=2860697: Sat Jul 13 10:08:39 2024 00:22:35.258 read: IOPS=756, BW=189MiB/s (198MB/s)(1909MiB/10092msec) 00:22:35.258 slat (usec): min=12, max=152705, avg=1095.55, stdev=4517.12 00:22:35.258 clat (msec): min=3, max=381, avg=83.45, stdev=46.33 00:22:35.258 lat (msec): min=3, max=381, avg=84.55, stdev=47.06 00:22:35.258 clat percentiles (msec): 00:22:35.258 | 1.00th=[ 9], 5.00th=[ 26], 10.00th=[ 33], 20.00th=[ 40], 00:22:35.258 | 30.00th=[ 53], 40.00th=[ 67], 50.00th=[ 79], 60.00th=[ 91], 00:22:35.258 | 70.00th=[ 102], 80.00th=[ 121], 90.00th=[ 142], 95.00th=[ 167], 00:22:35.258 | 99.00th=[ 230], 99.50th=[ 249], 99.90th=[ 262], 99.95th=[ 271], 00:22:35.258 | 99.99th=[ 384] 00:22:35.258 bw ( KiB/s): min=74240, max=439808, per=9.93%, avg=193817.60, stdev=90866.05, samples=20 00:22:35.258 iops : min= 290, max= 1718, avg=757.10, stdev=354.95, samples=20 00:22:35.258 lat (msec) : 4=0.10%, 10=1.15%, 20=2.36%, 50=24.43%, 100=40.73% 00:22:35.258 lat (msec) : 250=30.77%, 500=0.46% 00:22:35.258 cpu : usr=0.48%, sys=2.60%, ctx=1711, majf=0, minf=4097 00:22:35.258 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:22:35.258 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:35.258 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:35.258 issued rwts: total=7634,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:35.258 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:35.258 job7: (groupid=0, jobs=1): err= 0: pid=2860698: Sat Jul 13 10:08:39 2024 00:22:35.258 read: IOPS=619, BW=155MiB/s (163MB/s)(1552MiB/10015msec) 00:22:35.258 slat (usec): min=9, max=57588, avg=1334.45, stdev=3944.81 00:22:35.258 clat (usec): min=1932, max=251002, avg=101837.57, stdev=38241.12 00:22:35.258 lat (usec): min=1951, max=251033, avg=103172.02, stdev=38745.59 00:22:35.258 clat percentiles (msec): 00:22:35.258 | 1.00th=[ 20], 5.00th=[ 35], 10.00th=[ 50], 20.00th=[ 69], 00:22:35.258 | 30.00th=[ 82], 40.00th=[ 93], 50.00th=[ 106], 60.00th=[ 113], 00:22:35.258 | 70.00th=[ 124], 80.00th=[ 136], 90.00th=[ 150], 95.00th=[ 163], 00:22:35.258 | 99.00th=[ 186], 99.50th=[ 197], 99.90th=[ 220], 99.95th=[ 222], 00:22:35.258 | 99.99th=[ 251] 00:22:35.258 bw ( KiB/s): min=105472, max=245760, per=8.06%, avg=157337.60, stdev=43484.35, samples=20 00:22:35.258 iops : min= 412, max= 960, avg=614.60, stdev=169.86, samples=20 00:22:35.258 lat (msec) : 2=0.03%, 4=0.06%, 10=0.29%, 20=0.81%, 50=9.04% 00:22:35.258 lat (msec) : 100=35.24%, 250=54.52%, 500=0.02% 00:22:35.258 cpu : usr=0.31%, sys=2.34%, ctx=1497, majf=0, minf=4097 00:22:35.258 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:22:35.258 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:35.258 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:35.258 issued rwts: total=6209,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:35.258 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:35.258 job8: (groupid=0, jobs=1): err= 0: pid=2860699: Sat Jul 13 10:08:39 2024 00:22:35.258 read: IOPS=745, BW=186MiB/s (195MB/s)(1877MiB/10077msec) 00:22:35.258 slat (usec): min=9, max=112200, avg=1120.84, stdev=4480.66 00:22:35.258 clat (usec): min=1468, max=289467, avg=84716.37, stdev=54099.24 00:22:35.258 lat (usec): min=1520, max=289517, avg=85837.21, stdev=54852.36 00:22:35.258 clat percentiles (msec): 00:22:35.258 | 1.00th=[ 3], 5.00th=[ 9], 10.00th=[ 22], 20.00th=[ 31], 00:22:35.258 | 30.00th=[ 47], 40.00th=[ 62], 50.00th=[ 81], 60.00th=[ 100], 00:22:35.259 | 70.00th=[ 115], 80.00th=[ 132], 90.00th=[ 157], 95.00th=[ 188], 00:22:35.259 | 99.00th=[ 224], 99.50th=[ 226], 99.90th=[ 236], 99.95th=[ 255], 00:22:35.259 | 99.99th=[ 292] 00:22:35.259 bw ( KiB/s): min=73216, max=492032, per=9.76%, avg=190592.00, stdev=103098.37, samples=20 00:22:35.259 iops : min= 286, max= 1922, avg=744.50, stdev=402.73, samples=20 00:22:35.259 lat (msec) : 2=0.13%, 4=1.98%, 10=3.65%, 20=3.66%, 50=22.70% 00:22:35.259 lat (msec) : 100=28.08%, 250=39.74%, 500=0.05% 00:22:35.259 cpu : usr=0.56%, sys=2.32%, ctx=1741, majf=0, minf=4097 00:22:35.259 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:22:35.259 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:35.259 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:35.259 issued rwts: total=7508,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:35.259 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:35.259 job9: (groupid=0, jobs=1): err= 0: pid=2860700: Sat Jul 13 10:08:39 2024 00:22:35.259 read: IOPS=695, BW=174MiB/s (182MB/s)(1757MiB/10097msec) 00:22:35.259 slat (usec): min=9, max=83374, avg=810.98, stdev=3371.44 00:22:35.259 clat (usec): min=1101, max=273269, avg=91089.01, stdev=42801.57 00:22:35.259 lat (usec): min=1138, max=273309, avg=91899.99, stdev=43151.79 00:22:35.259 clat percentiles (msec): 00:22:35.259 | 1.00th=[ 5], 5.00th=[ 18], 10.00th=[ 37], 20.00th=[ 56], 00:22:35.259 | 30.00th=[ 69], 40.00th=[ 81], 50.00th=[ 90], 60.00th=[ 102], 00:22:35.259 | 70.00th=[ 112], 80.00th=[ 127], 90.00th=[ 144], 95.00th=[ 157], 00:22:35.259 | 99.00th=[ 211], 99.50th=[ 249], 99.90th=[ 271], 99.95th=[ 271], 00:22:35.259 | 99.99th=[ 275] 00:22:35.259 bw ( KiB/s): min=106496, max=275968, per=9.13%, avg=178252.80, stdev=41288.54, samples=20 00:22:35.259 iops : min= 416, max= 1078, avg=696.30, stdev=161.28, samples=20 00:22:35.259 lat (msec) : 2=0.09%, 4=0.70%, 10=1.84%, 20=3.15%, 50=10.90% 00:22:35.259 lat (msec) : 100=42.22%, 250=40.63%, 500=0.48% 00:22:35.259 cpu : usr=0.37%, sys=2.09%, ctx=1933, majf=0, minf=4097 00:22:35.259 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:22:35.259 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:35.259 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:35.259 issued rwts: total=7027,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:35.259 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:35.259 job10: (groupid=0, jobs=1): err= 0: pid=2860701: Sat Jul 13 10:08:39 2024 00:22:35.259 read: IOPS=622, BW=156MiB/s (163MB/s)(1569MiB/10078msec) 00:22:35.259 slat (usec): min=9, max=94433, avg=692.74, stdev=3425.69 00:22:35.259 clat (usec): min=1622, max=247514, avg=101977.45, stdev=52199.48 00:22:35.259 lat (usec): min=1647, max=247553, avg=102670.19, stdev=52658.89 00:22:35.259 clat percentiles (msec): 00:22:35.259 | 1.00th=[ 6], 5.00th=[ 23], 10.00th=[ 35], 20.00th=[ 46], 00:22:35.259 | 30.00th=[ 62], 40.00th=[ 89], 50.00th=[ 112], 60.00th=[ 125], 00:22:35.259 | 70.00th=[ 134], 80.00th=[ 146], 90.00th=[ 167], 95.00th=[ 182], 00:22:35.259 | 99.00th=[ 215], 99.50th=[ 228], 99.90th=[ 241], 99.95th=[ 243], 00:22:35.259 | 99.99th=[ 249] 00:22:35.259 bw ( KiB/s): min=92672, max=318976, per=8.15%, avg=159052.80, stdev=63325.52, samples=20 00:22:35.259 iops : min= 362, max= 1246, avg=621.30, stdev=247.37, samples=20 00:22:35.259 lat (msec) : 2=0.11%, 4=0.33%, 10=2.28%, 20=1.59%, 50=19.31% 00:22:35.259 lat (msec) : 100=20.95%, 250=55.42% 00:22:35.259 cpu : usr=0.30%, sys=2.09%, ctx=1960, majf=0, minf=4097 00:22:35.259 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:22:35.259 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:35.259 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:35.259 issued rwts: total=6276,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:35.259 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:35.259 00:22:35.259 Run status group 0 (all jobs): 00:22:35.259 READ: bw=1907MiB/s (1999MB/s), 144MiB/s-232MiB/s (151MB/s-243MB/s), io=18.8GiB (20.2GB), run=10015-10102msec 00:22:35.259 00:22:35.259 Disk stats (read/write): 00:22:35.259 nvme0n1: ios=11420/0, merge=0/0, ticks=1236428/0, in_queue=1236428, util=97.17% 00:22:35.259 nvme10n1: ios=14689/0, merge=0/0, ticks=1234359/0, in_queue=1234359, util=97.38% 00:22:35.259 nvme1n1: ios=11292/0, merge=0/0, ticks=1233507/0, in_queue=1233507, util=97.69% 00:22:35.259 nvme2n1: ios=18517/0, merge=0/0, ticks=1229155/0, in_queue=1229155, util=97.83% 00:22:35.259 nvme3n1: ios=13808/0, merge=0/0, ticks=1235282/0, in_queue=1235282, util=97.90% 00:22:35.259 nvme4n1: ios=13802/0, merge=0/0, ticks=1234597/0, in_queue=1234597, util=98.23% 00:22:35.259 nvme5n1: ios=15095/0, merge=0/0, ticks=1235132/0, in_queue=1235132, util=98.39% 00:22:35.259 nvme6n1: ios=12064/0, merge=0/0, ticks=1235707/0, in_queue=1235707, util=98.50% 00:22:35.259 nvme7n1: ios=14802/0, merge=0/0, ticks=1232827/0, in_queue=1232827, util=98.91% 00:22:35.259 nvme8n1: ios=13880/0, merge=0/0, ticks=1240468/0, in_queue=1240468, util=99.10% 00:22:35.259 nvme9n1: ios=12345/0, merge=0/0, ticks=1245053/0, in_queue=1245053, util=99.24% 00:22:35.259 10:08:39 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:22:35.259 [global] 00:22:35.259 thread=1 00:22:35.259 invalidate=1 00:22:35.259 rw=randwrite 00:22:35.259 time_based=1 00:22:35.259 runtime=10 00:22:35.259 ioengine=libaio 00:22:35.259 direct=1 00:22:35.259 bs=262144 00:22:35.259 iodepth=64 00:22:35.259 norandommap=1 00:22:35.259 numjobs=1 00:22:35.259 00:22:35.259 [job0] 00:22:35.259 filename=/dev/nvme0n1 00:22:35.259 [job1] 00:22:35.259 filename=/dev/nvme10n1 00:22:35.259 [job2] 00:22:35.259 filename=/dev/nvme1n1 00:22:35.259 [job3] 00:22:35.259 filename=/dev/nvme2n1 00:22:35.259 [job4] 00:22:35.259 filename=/dev/nvme3n1 00:22:35.259 [job5] 00:22:35.259 filename=/dev/nvme4n1 00:22:35.259 [job6] 00:22:35.259 filename=/dev/nvme5n1 00:22:35.259 [job7] 00:22:35.259 filename=/dev/nvme6n1 00:22:35.259 [job8] 00:22:35.259 filename=/dev/nvme7n1 00:22:35.259 [job9] 00:22:35.259 filename=/dev/nvme8n1 00:22:35.259 [job10] 00:22:35.259 filename=/dev/nvme9n1 00:22:35.259 Could not set queue depth (nvme0n1) 00:22:35.259 Could not set queue depth (nvme10n1) 00:22:35.259 Could not set queue depth (nvme1n1) 00:22:35.259 Could not set queue depth (nvme2n1) 00:22:35.259 Could not set queue depth (nvme3n1) 00:22:35.259 Could not set queue depth (nvme4n1) 00:22:35.259 Could not set queue depth (nvme5n1) 00:22:35.259 Could not set queue depth (nvme6n1) 00:22:35.259 Could not set queue depth (nvme7n1) 00:22:35.259 Could not set queue depth (nvme8n1) 00:22:35.259 Could not set queue depth (nvme9n1) 00:22:35.259 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:35.259 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:35.259 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:35.259 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:35.259 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:35.259 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:35.259 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:35.259 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:35.259 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:35.259 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:35.259 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:35.259 fio-3.35 00:22:35.259 Starting 11 threads 00:22:45.245 00:22:45.245 job0: (groupid=0, jobs=1): err= 0: pid=2861760: Sat Jul 13 10:08:49 2024 00:22:45.245 write: IOPS=467, BW=117MiB/s (123MB/s)(1185MiB/10134msec); 0 zone resets 00:22:45.245 slat (usec): min=20, max=103470, avg=1685.37, stdev=4366.57 00:22:45.245 clat (msec): min=3, max=391, avg=135.11, stdev=69.94 00:22:45.245 lat (msec): min=3, max=391, avg=136.79, stdev=70.92 00:22:45.245 clat percentiles (msec): 00:22:45.245 | 1.00th=[ 17], 5.00th=[ 32], 10.00th=[ 55], 20.00th=[ 82], 00:22:45.245 | 30.00th=[ 93], 40.00th=[ 113], 50.00th=[ 122], 60.00th=[ 142], 00:22:45.245 | 70.00th=[ 165], 80.00th=[ 188], 90.00th=[ 215], 95.00th=[ 271], 00:22:45.245 | 99.00th=[ 363], 99.50th=[ 376], 99.90th=[ 384], 99.95th=[ 384], 00:22:45.245 | 99.99th=[ 393] 00:22:45.245 bw ( KiB/s): min=49152, max=214016, per=9.34%, avg=119705.60, stdev=45489.54, samples=20 00:22:45.245 iops : min= 192, max= 836, avg=467.60, stdev=177.69, samples=20 00:22:45.245 lat (msec) : 4=0.04%, 10=0.36%, 20=1.16%, 50=7.20%, 100=24.92% 00:22:45.245 lat (msec) : 250=59.57%, 500=6.75% 00:22:45.245 cpu : usr=1.33%, sys=1.48%, ctx=2349, majf=0, minf=1 00:22:45.245 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:22:45.245 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:45.245 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:45.245 issued rwts: total=0,4739,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:45.245 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:45.245 job1: (groupid=0, jobs=1): err= 0: pid=2861772: Sat Jul 13 10:08:49 2024 00:22:45.245 write: IOPS=487, BW=122MiB/s (128MB/s)(1235MiB/10129msec); 0 zone resets 00:22:45.245 slat (usec): min=17, max=1659.5k, avg=1186.58, stdev=23764.95 00:22:45.245 clat (usec): min=1232, max=2527.6k, avg=130001.96, stdev=274112.07 00:22:45.245 lat (usec): min=1263, max=2527.7k, avg=131188.54, stdev=275393.68 00:22:45.245 clat percentiles (msec): 00:22:45.245 | 1.00th=[ 5], 5.00th=[ 9], 10.00th=[ 15], 20.00th=[ 26], 00:22:45.245 | 30.00th=[ 45], 40.00th=[ 63], 50.00th=[ 80], 60.00th=[ 102], 00:22:45.245 | 70.00th=[ 130], 80.00th=[ 167], 90.00th=[ 218], 95.00th=[ 292], 00:22:45.245 | 99.00th=[ 2400], 99.50th=[ 2467], 99.90th=[ 2500], 99.95th=[ 2534], 00:22:45.245 | 99.99th=[ 2534] 00:22:45.245 bw ( KiB/s): min=40960, max=215552, per=11.46%, avg=146853.65, stdev=53543.87, samples=17 00:22:45.245 iops : min= 160, max= 842, avg=573.65, stdev=209.16, samples=17 00:22:45.245 lat (msec) : 2=0.14%, 4=0.75%, 10=4.84%, 20=8.93%, 50=17.59% 00:22:45.245 lat (msec) : 100=27.45%, 250=32.70%, 500=5.99%, 750=0.32%, 2000=0.06% 00:22:45.245 lat (msec) : >=2000=1.21% 00:22:45.245 cpu : usr=1.31%, sys=1.96%, ctx=3285, majf=0, minf=1 00:22:45.245 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.7% 00:22:45.245 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:45.245 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:45.245 issued rwts: total=0,4939,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:45.245 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:45.245 job2: (groupid=0, jobs=1): err= 0: pid=2861773: Sat Jul 13 10:08:49 2024 00:22:45.246 write: IOPS=629, BW=157MiB/s (165MB/s)(1591MiB/10100msec); 0 zone resets 00:22:45.246 slat (usec): min=25, max=85210, avg=1285.03, stdev=3820.65 00:22:45.246 clat (usec): min=1368, max=483000, avg=100270.92, stdev=84606.06 00:22:45.246 lat (usec): min=1436, max=483087, avg=101555.96, stdev=85572.11 00:22:45.246 clat percentiles (msec): 00:22:45.246 | 1.00th=[ 11], 5.00th=[ 33], 10.00th=[ 43], 20.00th=[ 45], 00:22:45.246 | 30.00th=[ 46], 40.00th=[ 48], 50.00th=[ 50], 60.00th=[ 72], 00:22:45.246 | 70.00th=[ 131], 80.00th=[ 171], 90.00th=[ 215], 95.00th=[ 262], 00:22:45.246 | 99.00th=[ 409], 99.50th=[ 430], 99.90th=[ 460], 99.95th=[ 468], 00:22:45.246 | 99.99th=[ 485] 00:22:45.246 bw ( KiB/s): min=44032, max=363008, per=12.58%, avg=161254.40, stdev=114343.84, samples=20 00:22:45.246 iops : min= 172, max= 1418, avg=629.90, stdev=446.66, samples=20 00:22:45.246 lat (msec) : 2=0.06%, 4=0.08%, 10=0.71%, 20=2.00%, 50=50.90% 00:22:45.246 lat (msec) : 100=9.27%, 250=30.97%, 500=6.02% 00:22:45.246 cpu : usr=2.14%, sys=2.24%, ctx=2585, majf=0, minf=1 00:22:45.246 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:22:45.246 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:45.246 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:45.246 issued rwts: total=0,6362,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:45.246 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:45.246 job3: (groupid=0, jobs=1): err= 0: pid=2861774: Sat Jul 13 10:08:49 2024 00:22:45.246 write: IOPS=481, BW=120MiB/s (126MB/s)(1224MiB/10178msec); 0 zone resets 00:22:45.246 slat (usec): min=16, max=901262, avg=1455.21, stdev=13790.04 00:22:45.246 clat (usec): min=1291, max=1315.9k, avg=131493.87, stdev=145125.74 00:22:45.246 lat (usec): min=1334, max=1316.0k, avg=132949.08, stdev=146637.40 00:22:45.246 clat percentiles (msec): 00:22:45.246 | 1.00th=[ 6], 5.00th=[ 19], 10.00th=[ 31], 20.00th=[ 52], 00:22:45.246 | 30.00th=[ 77], 40.00th=[ 90], 50.00th=[ 97], 60.00th=[ 113], 00:22:45.246 | 70.00th=[ 121], 80.00th=[ 161], 90.00th=[ 259], 95.00th=[ 368], 00:22:45.246 | 99.00th=[ 1036], 99.50th=[ 1116], 99.90th=[ 1133], 99.95th=[ 1318], 00:22:45.246 | 99.99th=[ 1318] 00:22:45.246 bw ( KiB/s): min=31232, max=242176, per=10.16%, avg=130253.05, stdev=59465.09, samples=19 00:22:45.246 iops : min= 122, max= 946, avg=508.79, stdev=232.28, samples=19 00:22:45.246 lat (msec) : 2=0.08%, 4=0.51%, 10=1.88%, 20=3.14%, 50=13.52% 00:22:45.246 lat (msec) : 100=33.00%, 250=36.74%, 500=8.78%, 750=1.06%, 2000=1.29% 00:22:45.246 cpu : usr=1.27%, sys=1.86%, ctx=2830, majf=0, minf=1 00:22:45.246 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:22:45.246 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:45.246 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:45.246 issued rwts: total=0,4897,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:45.246 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:45.246 job4: (groupid=0, jobs=1): err= 0: pid=2861775: Sat Jul 13 10:08:49 2024 00:22:45.246 write: IOPS=378, BW=94.6MiB/s (99.2MB/s)(955MiB/10099msec); 0 zone resets 00:22:45.246 slat (usec): min=25, max=123555, avg=2466.05, stdev=6194.52 00:22:45.246 clat (msec): min=5, max=582, avg=166.65, stdev=84.86 00:22:45.246 lat (msec): min=7, max=582, avg=169.11, stdev=85.93 00:22:45.246 clat percentiles (msec): 00:22:45.246 | 1.00th=[ 28], 5.00th=[ 65], 10.00th=[ 77], 20.00th=[ 108], 00:22:45.246 | 30.00th=[ 121], 40.00th=[ 138], 50.00th=[ 157], 60.00th=[ 174], 00:22:45.246 | 70.00th=[ 192], 80.00th=[ 215], 90.00th=[ 264], 95.00th=[ 321], 00:22:45.246 | 99.00th=[ 502], 99.50th=[ 542], 99.90th=[ 575], 99.95th=[ 584], 00:22:45.246 | 99.99th=[ 584] 00:22:45.246 bw ( KiB/s): min=30720, max=204800, per=7.50%, avg=96179.20, stdev=45168.94, samples=20 00:22:45.246 iops : min= 120, max= 800, avg=375.70, stdev=176.44, samples=20 00:22:45.246 lat (msec) : 10=0.08%, 20=0.42%, 50=1.88%, 100=16.73%, 250=69.42% 00:22:45.246 lat (msec) : 500=10.45%, 750=1.02% 00:22:45.246 cpu : usr=1.28%, sys=1.21%, ctx=1257, majf=0, minf=1 00:22:45.246 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.4% 00:22:45.246 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:45.246 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:45.246 issued rwts: total=0,3820,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:45.246 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:45.246 job5: (groupid=0, jobs=1): err= 0: pid=2861776: Sat Jul 13 10:08:49 2024 00:22:45.246 write: IOPS=337, BW=84.3MiB/s (88.4MB/s)(858MiB/10176msec); 0 zone resets 00:22:45.246 slat (usec): min=20, max=868538, avg=1944.82, stdev=19174.26 00:22:45.246 clat (msec): min=2, max=2792, avg=187.20, stdev=340.00 00:22:45.246 lat (msec): min=2, max=2792, avg=189.15, stdev=341.32 00:22:45.246 clat percentiles (msec): 00:22:45.246 | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 24], 20.00th=[ 46], 00:22:45.246 | 30.00th=[ 67], 40.00th=[ 84], 50.00th=[ 108], 60.00th=[ 144], 00:22:45.246 | 70.00th=[ 203], 80.00th=[ 234], 90.00th=[ 317], 95.00th=[ 435], 00:22:45.246 | 99.00th=[ 2635], 99.50th=[ 2702], 99.90th=[ 2769], 99.95th=[ 2802], 00:22:45.246 | 99.99th=[ 2802] 00:22:45.246 bw ( KiB/s): min= 2048, max=217088, per=6.72%, avg=86197.85, stdev=63178.93, samples=20 00:22:45.246 iops : min= 8, max= 848, avg=336.70, stdev=246.80, samples=20 00:22:45.246 lat (msec) : 4=0.09%, 10=2.89%, 20=5.60%, 50=13.44%, 100=25.69% 00:22:45.246 lat (msec) : 250=35.19%, 500=13.79%, 750=1.11%, 1000=0.12%, 2000=0.64% 00:22:45.246 lat (msec) : >=2000=1.46% 00:22:45.246 cpu : usr=1.11%, sys=1.14%, ctx=2410, majf=0, minf=1 00:22:45.246 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.5%, 32=0.9%, >=64=98.2% 00:22:45.246 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:45.246 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:45.246 issued rwts: total=0,3430,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:45.246 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:45.246 job6: (groupid=0, jobs=1): err= 0: pid=2861777: Sat Jul 13 10:08:49 2024 00:22:45.246 write: IOPS=536, BW=134MiB/s (141MB/s)(1360MiB/10136msec); 0 zone resets 00:22:45.246 slat (usec): min=16, max=116719, avg=1271.11, stdev=3751.27 00:22:45.246 clat (usec): min=1356, max=468030, avg=117937.85, stdev=70675.49 00:22:45.246 lat (usec): min=1401, max=468104, avg=119208.96, stdev=71363.43 00:22:45.246 clat percentiles (msec): 00:22:45.246 | 1.00th=[ 4], 5.00th=[ 12], 10.00th=[ 32], 20.00th=[ 65], 00:22:45.246 | 30.00th=[ 79], 40.00th=[ 92], 50.00th=[ 116], 60.00th=[ 127], 00:22:45.246 | 70.00th=[ 148], 80.00th=[ 167], 90.00th=[ 201], 95.00th=[ 230], 00:22:45.246 | 99.00th=[ 359], 99.50th=[ 384], 99.90th=[ 464], 99.95th=[ 468], 00:22:45.246 | 99.99th=[ 468] 00:22:45.246 bw ( KiB/s): min=70656, max=202132, per=10.74%, avg=137645.80, stdev=37748.16, samples=20 00:22:45.246 iops : min= 276, max= 789, avg=537.65, stdev=147.40, samples=20 00:22:45.246 lat (msec) : 2=0.22%, 4=1.05%, 10=3.02%, 20=2.89%, 50=8.92% 00:22:45.246 lat (msec) : 100=27.80%, 250=51.87%, 500=4.25% 00:22:45.246 cpu : usr=1.60%, sys=1.71%, ctx=2940, majf=0, minf=1 00:22:45.246 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:22:45.246 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:45.246 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:45.246 issued rwts: total=0,5439,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:45.246 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:45.246 job7: (groupid=0, jobs=1): err= 0: pid=2861778: Sat Jul 13 10:08:49 2024 00:22:45.246 write: IOPS=421, BW=105MiB/s (110MB/s)(1071MiB/10170msec); 0 zone resets 00:22:45.246 slat (usec): min=21, max=210339, avg=1263.39, stdev=5969.79 00:22:45.246 clat (msec): min=2, max=1346, avg=150.55, stdev=146.69 00:22:45.246 lat (msec): min=2, max=1346, avg=151.81, stdev=147.36 00:22:45.246 clat percentiles (msec): 00:22:45.246 | 1.00th=[ 6], 5.00th=[ 15], 10.00th=[ 28], 20.00th=[ 52], 00:22:45.246 | 30.00th=[ 66], 40.00th=[ 107], 50.00th=[ 133], 60.00th=[ 157], 00:22:45.246 | 70.00th=[ 176], 80.00th=[ 215], 90.00th=[ 279], 95.00th=[ 355], 00:22:45.246 | 99.00th=[ 617], 99.50th=[ 1301], 99.90th=[ 1351], 99.95th=[ 1351], 00:22:45.246 | 99.99th=[ 1351] 00:22:45.246 bw ( KiB/s): min=32191, max=168960, per=8.43%, avg=108079.95, stdev=40488.30, samples=20 00:22:45.246 iops : min= 125, max= 660, avg=422.15, stdev=158.23, samples=20 00:22:45.246 lat (msec) : 4=0.35%, 10=2.43%, 20=4.48%, 50=12.35%, 100=19.60% 00:22:45.246 lat (msec) : 250=49.12%, 500=9.54%, 750=1.28%, 2000=0.84% 00:22:45.246 cpu : usr=1.37%, sys=1.44%, ctx=3014, majf=0, minf=1 00:22:45.246 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.5% 00:22:45.246 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:45.246 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:45.246 issued rwts: total=0,4285,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:45.246 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:45.246 job8: (groupid=0, jobs=1): err= 0: pid=2861779: Sat Jul 13 10:08:49 2024 00:22:45.246 write: IOPS=446, BW=112MiB/s (117MB/s)(1126MiB/10095msec); 0 zone resets 00:22:45.246 slat (usec): min=18, max=717438, avg=1908.79, stdev=18098.43 00:22:45.246 clat (usec): min=1758, max=2727.4k, avg=141430.20, stdev=294752.05 00:22:45.246 lat (usec): min=1802, max=2751.3k, avg=143338.99, stdev=297700.48 00:22:45.246 clat percentiles (msec): 00:22:45.246 | 1.00th=[ 8], 5.00th=[ 16], 10.00th=[ 22], 20.00th=[ 45], 00:22:45.246 | 30.00th=[ 52], 40.00th=[ 63], 50.00th=[ 106], 60.00th=[ 125], 00:22:45.246 | 70.00th=[ 153], 80.00th=[ 167], 90.00th=[ 194], 95.00th=[ 224], 00:22:45.246 | 99.00th=[ 2567], 99.50th=[ 2668], 99.90th=[ 2702], 99.95th=[ 2702], 00:22:45.246 | 99.99th=[ 2735] 00:22:45.246 bw ( KiB/s): min= 2048, max=316928, per=8.87%, avg=113715.20, stdev=92390.70, samples=20 00:22:45.246 iops : min= 8, max= 1238, avg=444.20, stdev=360.90, samples=20 00:22:45.246 lat (msec) : 2=0.02%, 4=0.20%, 10=1.62%, 20=6.81%, 50=17.71% 00:22:45.246 lat (msec) : 100=21.31%, 250=48.99%, 500=1.58%, 1000=0.18%, 2000=0.36% 00:22:45.246 lat (msec) : >=2000=1.22% 00:22:45.246 cpu : usr=1.50%, sys=1.60%, ctx=2252, majf=0, minf=1 00:22:45.246 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:22:45.246 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:45.246 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:45.246 issued rwts: total=0,4505,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:45.246 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:45.246 job9: (groupid=0, jobs=1): err= 0: pid=2861780: Sat Jul 13 10:08:49 2024 00:22:45.246 write: IOPS=473, BW=118MiB/s (124MB/s)(1205MiB/10172msec); 0 zone resets 00:22:45.246 slat (usec): min=24, max=167733, avg=1873.86, stdev=4984.15 00:22:45.246 clat (usec): min=1841, max=486895, avg=133120.63, stdev=73214.75 00:22:45.246 lat (usec): min=1890, max=486944, avg=134994.49, stdev=74000.55 00:22:45.246 clat percentiles (msec): 00:22:45.246 | 1.00th=[ 12], 5.00th=[ 38], 10.00th=[ 44], 20.00th=[ 73], 00:22:45.246 | 30.00th=[ 90], 40.00th=[ 114], 50.00th=[ 124], 60.00th=[ 144], 00:22:45.246 | 70.00th=[ 161], 80.00th=[ 186], 90.00th=[ 224], 95.00th=[ 251], 00:22:45.246 | 99.00th=[ 376], 99.50th=[ 430], 99.90th=[ 464], 99.95th=[ 468], 00:22:45.246 | 99.99th=[ 489] 00:22:45.246 bw ( KiB/s): min=61440, max=284160, per=9.50%, avg=121753.60, stdev=52839.01, samples=20 00:22:45.247 iops : min= 240, max= 1110, avg=475.60, stdev=206.40, samples=20 00:22:45.247 lat (msec) : 2=0.02%, 4=0.12%, 10=0.62%, 20=1.80%, 50=9.63% 00:22:45.247 lat (msec) : 100=20.46%, 250=62.37%, 500=4.98% 00:22:45.247 cpu : usr=1.52%, sys=1.49%, ctx=1743, majf=0, minf=1 00:22:45.247 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:22:45.247 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:45.247 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:45.247 issued rwts: total=0,4820,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:45.247 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:45.247 job10: (groupid=0, jobs=1): err= 0: pid=2861781: Sat Jul 13 10:08:49 2024 00:22:45.247 write: IOPS=368, BW=92.0MiB/s (96.5MB/s)(933MiB/10135msec); 0 zone resets 00:22:45.247 slat (usec): min=19, max=136249, avg=1159.84, stdev=4694.79 00:22:45.247 clat (usec): min=1528, max=2776.8k, avg=172645.29, stdev=330244.17 00:22:45.247 lat (usec): min=1946, max=2776.8k, avg=173805.13, stdev=330495.46 00:22:45.247 clat percentiles (msec): 00:22:45.247 | 1.00th=[ 4], 5.00th=[ 13], 10.00th=[ 24], 20.00th=[ 43], 00:22:45.247 | 30.00th=[ 55], 40.00th=[ 79], 50.00th=[ 92], 60.00th=[ 140], 00:22:45.247 | 70.00th=[ 169], 80.00th=[ 211], 90.00th=[ 296], 95.00th=[ 401], 00:22:45.247 | 99.00th=[ 2635], 99.50th=[ 2702], 99.90th=[ 2769], 99.95th=[ 2769], 00:22:45.247 | 99.99th=[ 2769] 00:22:45.247 bw ( KiB/s): min= 1024, max=198656, per=7.32%, avg=93878.60, stdev=63715.52, samples=20 00:22:45.247 iops : min= 4, max= 776, avg=366.70, stdev=248.90, samples=20 00:22:45.247 lat (msec) : 2=0.05%, 4=0.97%, 10=3.40%, 20=4.40%, 50=19.52% 00:22:45.247 lat (msec) : 100=23.75%, 250=33.38%, 500=10.43%, 750=2.28%, 1000=0.03% 00:22:45.247 lat (msec) : 2000=0.38%, >=2000=1.42% 00:22:45.247 cpu : usr=1.21%, sys=1.32%, ctx=2456, majf=0, minf=1 00:22:45.247 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.9%, >=64=98.3% 00:22:45.247 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:45.247 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:45.247 issued rwts: total=0,3730,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:45.247 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:45.247 00:22:45.247 Run status group 0 (all jobs): 00:22:45.247 WRITE: bw=1252MiB/s (1313MB/s), 84.3MiB/s-157MiB/s (88.4MB/s-165MB/s), io=12.4GiB (13.4GB), run=10095-10178msec 00:22:45.247 00:22:45.247 Disk stats (read/write): 00:22:45.247 nvme0n1: ios=49/9257, merge=0/0, ticks=43/1211162, in_queue=1211205, util=96.97% 00:22:45.247 nvme10n1: ios=43/9654, merge=0/0, ticks=131/1225378, in_queue=1225509, util=97.97% 00:22:45.247 nvme1n1: ios=0/12476, merge=0/0, ticks=0/1207137, in_queue=1207137, util=97.33% 00:22:45.247 nvme2n1: ios=0/9748, merge=0/0, ticks=0/1243768, in_queue=1243768, util=97.57% 00:22:45.247 nvme3n1: ios=0/7393, merge=0/0, ticks=0/1198608, in_queue=1198608, util=97.60% 00:22:45.247 nvme4n1: ios=45/6819, merge=0/0, ticks=844/1238097, in_queue=1238941, util=100.00% 00:22:45.247 nvme5n1: ios=0/10653, merge=0/0, ticks=0/1214935, in_queue=1214935, util=98.15% 00:22:45.247 nvme6n1: ios=0/8528, merge=0/0, ticks=0/1248061, in_queue=1248061, util=98.25% 00:22:45.247 nvme7n1: ios=45/8752, merge=0/0, ticks=1230/1199118, in_queue=1200348, util=100.00% 00:22:45.247 nvme8n1: ios=0/9591, merge=0/0, ticks=0/1231057, in_queue=1231057, util=98.89% 00:22:45.247 nvme9n1: ios=0/7237, merge=0/0, ticks=0/1223663, in_queue=1223663, util=99.09% 00:22:45.247 10:08:49 -- target/multiconnection.sh@36 -- # sync 00:22:45.247 10:08:49 -- target/multiconnection.sh@37 -- # seq 1 11 00:22:45.247 10:08:50 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:45.247 10:08:50 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:22:45.247 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:22:45.247 10:08:50 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:22:45.247 10:08:50 -- common/autotest_common.sh@1198 -- # local i=0 00:22:45.247 10:08:50 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:22:45.247 10:08:50 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK1 00:22:45.247 10:08:50 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:22:45.247 10:08:50 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK1 00:22:45.247 10:08:50 -- common/autotest_common.sh@1210 -- # return 0 00:22:45.247 10:08:50 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:45.247 10:08:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:45.247 10:08:50 -- common/autotest_common.sh@10 -- # set +x 00:22:45.247 10:08:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:45.247 10:08:50 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:45.247 10:08:50 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:22:45.247 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:22:45.247 10:08:50 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:22:45.247 10:08:50 -- common/autotest_common.sh@1198 -- # local i=0 00:22:45.247 10:08:50 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:22:45.247 10:08:50 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK2 00:22:45.247 10:08:50 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:22:45.247 10:08:50 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK2 00:22:45.247 10:08:50 -- common/autotest_common.sh@1210 -- # return 0 00:22:45.247 10:08:50 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:22:45.247 10:08:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:45.247 10:08:50 -- common/autotest_common.sh@10 -- # set +x 00:22:45.247 10:08:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:45.247 10:08:50 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:45.247 10:08:50 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:22:45.506 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:22:45.506 10:08:51 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:22:45.506 10:08:51 -- common/autotest_common.sh@1198 -- # local i=0 00:22:45.506 10:08:51 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:22:45.506 10:08:51 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK3 00:22:45.506 10:08:51 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:22:45.506 10:08:51 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK3 00:22:45.506 10:08:51 -- common/autotest_common.sh@1210 -- # return 0 00:22:45.506 10:08:51 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:22:45.506 10:08:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:45.506 10:08:51 -- common/autotest_common.sh@10 -- # set +x 00:22:45.506 10:08:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:45.506 10:08:51 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:45.506 10:08:51 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:22:45.763 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:22:45.763 10:08:51 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:22:45.763 10:08:51 -- common/autotest_common.sh@1198 -- # local i=0 00:22:45.763 10:08:51 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:22:45.763 10:08:51 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK4 00:22:45.763 10:08:51 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:22:45.763 10:08:51 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK4 00:22:45.763 10:08:51 -- common/autotest_common.sh@1210 -- # return 0 00:22:45.763 10:08:51 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:22:45.763 10:08:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:45.763 10:08:51 -- common/autotest_common.sh@10 -- # set +x 00:22:45.763 10:08:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:45.763 10:08:51 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:45.763 10:08:51 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:22:46.023 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:22:46.023 10:08:51 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:22:46.023 10:08:51 -- common/autotest_common.sh@1198 -- # local i=0 00:22:46.023 10:08:51 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:22:46.023 10:08:51 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK5 00:22:46.023 10:08:51 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:22:46.023 10:08:51 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK5 00:22:46.023 10:08:51 -- common/autotest_common.sh@1210 -- # return 0 00:22:46.023 10:08:51 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:22:46.023 10:08:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:46.023 10:08:51 -- common/autotest_common.sh@10 -- # set +x 00:22:46.023 10:08:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:46.023 10:08:51 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:46.023 10:08:51 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:22:46.283 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:22:46.283 10:08:52 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:22:46.283 10:08:52 -- common/autotest_common.sh@1198 -- # local i=0 00:22:46.283 10:08:52 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:22:46.283 10:08:52 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK6 00:22:46.283 10:08:52 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:22:46.283 10:08:52 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK6 00:22:46.283 10:08:52 -- common/autotest_common.sh@1210 -- # return 0 00:22:46.283 10:08:52 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:22:46.283 10:08:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:46.283 10:08:52 -- common/autotest_common.sh@10 -- # set +x 00:22:46.283 10:08:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:46.283 10:08:52 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:46.283 10:08:52 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:22:46.541 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:22:46.541 10:08:52 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:22:46.541 10:08:52 -- common/autotest_common.sh@1198 -- # local i=0 00:22:46.541 10:08:52 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:22:46.541 10:08:52 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK7 00:22:46.541 10:08:52 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:22:46.541 10:08:52 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK7 00:22:46.541 10:08:52 -- common/autotest_common.sh@1210 -- # return 0 00:22:46.541 10:08:52 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:22:46.541 10:08:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:46.541 10:08:52 -- common/autotest_common.sh@10 -- # set +x 00:22:46.541 10:08:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:46.541 10:08:52 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:46.541 10:08:52 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:22:46.800 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:22:46.800 10:08:52 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:22:46.800 10:08:52 -- common/autotest_common.sh@1198 -- # local i=0 00:22:46.800 10:08:52 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:22:46.800 10:08:52 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK8 00:22:46.800 10:08:52 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:22:46.800 10:08:52 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK8 00:22:46.800 10:08:52 -- common/autotest_common.sh@1210 -- # return 0 00:22:46.800 10:08:52 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:22:46.800 10:08:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:46.800 10:08:52 -- common/autotest_common.sh@10 -- # set +x 00:22:46.800 10:08:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:46.800 10:08:52 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:46.800 10:08:52 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:22:46.800 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:22:46.800 10:08:52 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:22:46.800 10:08:52 -- common/autotest_common.sh@1198 -- # local i=0 00:22:46.800 10:08:52 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:22:46.800 10:08:52 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK9 00:22:47.058 10:08:52 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:22:47.058 10:08:52 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK9 00:22:47.058 10:08:52 -- common/autotest_common.sh@1210 -- # return 0 00:22:47.058 10:08:52 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:22:47.058 10:08:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:47.058 10:08:52 -- common/autotest_common.sh@10 -- # set +x 00:22:47.058 10:08:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:47.058 10:08:52 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:47.058 10:08:52 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:22:47.058 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:22:47.058 10:08:52 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:22:47.058 10:08:52 -- common/autotest_common.sh@1198 -- # local i=0 00:22:47.058 10:08:52 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:22:47.058 10:08:52 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK10 00:22:47.058 10:08:52 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:22:47.058 10:08:52 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK10 00:22:47.058 10:08:52 -- common/autotest_common.sh@1210 -- # return 0 00:22:47.058 10:08:52 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:22:47.058 10:08:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:47.058 10:08:52 -- common/autotest_common.sh@10 -- # set +x 00:22:47.058 10:08:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:47.058 10:08:52 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:47.058 10:08:52 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:22:47.058 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:22:47.058 10:08:52 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:22:47.058 10:08:52 -- common/autotest_common.sh@1198 -- # local i=0 00:22:47.058 10:08:52 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:22:47.058 10:08:52 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK11 00:22:47.058 10:08:52 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:22:47.058 10:08:52 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK11 00:22:47.316 10:08:52 -- common/autotest_common.sh@1210 -- # return 0 00:22:47.316 10:08:52 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:22:47.316 10:08:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:47.316 10:08:52 -- common/autotest_common.sh@10 -- # set +x 00:22:47.316 10:08:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:47.316 10:08:52 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:22:47.316 10:08:52 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:22:47.316 10:08:52 -- target/multiconnection.sh@47 -- # nvmftestfini 00:22:47.316 10:08:52 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:47.316 10:08:52 -- nvmf/common.sh@116 -- # sync 00:22:47.316 10:08:52 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:47.316 10:08:52 -- nvmf/common.sh@119 -- # set +e 00:22:47.316 10:08:52 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:47.316 10:08:52 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:47.316 rmmod nvme_tcp 00:22:47.316 rmmod nvme_fabrics 00:22:47.316 rmmod nvme_keyring 00:22:47.316 10:08:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:47.316 10:08:52 -- nvmf/common.sh@123 -- # set -e 00:22:47.316 10:08:52 -- nvmf/common.sh@124 -- # return 0 00:22:47.316 10:08:52 -- nvmf/common.sh@477 -- # '[' -n 2856172 ']' 00:22:47.316 10:08:52 -- nvmf/common.sh@478 -- # killprocess 2856172 00:22:47.316 10:08:52 -- common/autotest_common.sh@926 -- # '[' -z 2856172 ']' 00:22:47.316 10:08:52 -- common/autotest_common.sh@930 -- # kill -0 2856172 00:22:47.316 10:08:52 -- common/autotest_common.sh@931 -- # uname 00:22:47.316 10:08:52 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:22:47.316 10:08:52 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2856172 00:22:47.316 10:08:52 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:22:47.316 10:08:52 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:22:47.316 10:08:52 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2856172' 00:22:47.316 killing process with pid 2856172 00:22:47.316 10:08:52 -- common/autotest_common.sh@945 -- # kill 2856172 00:22:47.316 10:08:52 -- common/autotest_common.sh@950 -- # wait 2856172 00:22:47.906 10:08:53 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:47.906 10:08:53 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:47.906 10:08:53 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:47.906 10:08:53 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:47.906 10:08:53 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:47.906 10:08:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:47.906 10:08:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:47.906 10:08:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:49.903 10:08:55 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:49.903 00:22:49.903 real 1m1.321s 00:22:49.903 user 3m22.220s 00:22:49.903 sys 0m25.053s 00:22:49.903 10:08:55 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:22:49.903 10:08:55 -- common/autotest_common.sh@10 -- # set +x 00:22:49.903 ************************************ 00:22:49.903 END TEST nvmf_multiconnection 00:22:49.903 ************************************ 00:22:49.903 10:08:55 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:22:49.903 10:08:55 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:22:49.903 10:08:55 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:22:49.903 10:08:55 -- common/autotest_common.sh@10 -- # set +x 00:22:49.903 ************************************ 00:22:49.903 START TEST nvmf_initiator_timeout 00:22:49.903 ************************************ 00:22:49.903 10:08:55 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:22:49.903 * Looking for test storage... 00:22:49.903 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:22:49.903 10:08:55 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:49.903 10:08:55 -- nvmf/common.sh@7 -- # uname -s 00:22:49.903 10:08:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:49.903 10:08:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:49.903 10:08:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:49.903 10:08:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:49.903 10:08:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:49.903 10:08:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:49.903 10:08:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:49.903 10:08:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:49.903 10:08:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:49.903 10:08:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:49.903 10:08:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:49.903 10:08:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:49.903 10:08:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:49.903 10:08:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:49.903 10:08:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:49.903 10:08:55 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:49.903 10:08:55 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:49.903 10:08:55 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:49.903 10:08:55 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:49.903 10:08:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:49.903 10:08:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:49.903 10:08:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:49.903 10:08:55 -- paths/export.sh@5 -- # export PATH 00:22:49.903 10:08:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:49.903 10:08:55 -- nvmf/common.sh@46 -- # : 0 00:22:49.903 10:08:55 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:49.903 10:08:55 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:49.903 10:08:55 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:49.903 10:08:55 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:49.903 10:08:55 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:49.903 10:08:55 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:49.903 10:08:55 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:49.903 10:08:55 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:49.903 10:08:55 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:49.903 10:08:55 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:49.903 10:08:55 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:22:49.903 10:08:55 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:49.903 10:08:55 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:49.903 10:08:55 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:49.903 10:08:55 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:49.903 10:08:55 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:49.903 10:08:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:49.903 10:08:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:49.903 10:08:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:49.903 10:08:55 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:49.903 10:08:55 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:49.903 10:08:55 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:49.903 10:08:55 -- common/autotest_common.sh@10 -- # set +x 00:22:51.809 10:08:57 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:51.809 10:08:57 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:51.809 10:08:57 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:51.809 10:08:57 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:51.809 10:08:57 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:51.809 10:08:57 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:51.809 10:08:57 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:51.809 10:08:57 -- nvmf/common.sh@294 -- # net_devs=() 00:22:51.809 10:08:57 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:51.809 10:08:57 -- nvmf/common.sh@295 -- # e810=() 00:22:51.809 10:08:57 -- nvmf/common.sh@295 -- # local -ga e810 00:22:51.809 10:08:57 -- nvmf/common.sh@296 -- # x722=() 00:22:51.809 10:08:57 -- nvmf/common.sh@296 -- # local -ga x722 00:22:51.809 10:08:57 -- nvmf/common.sh@297 -- # mlx=() 00:22:51.809 10:08:57 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:51.809 10:08:57 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:51.809 10:08:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:51.809 10:08:57 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:51.809 10:08:57 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:51.809 10:08:57 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:51.809 10:08:57 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:51.809 10:08:57 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:51.809 10:08:57 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:51.809 10:08:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:51.809 10:08:57 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:51.809 10:08:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:51.809 10:08:57 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:51.809 10:08:57 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:51.809 10:08:57 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:51.809 10:08:57 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:51.809 10:08:57 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:51.809 10:08:57 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:51.809 10:08:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:51.809 10:08:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:51.809 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:51.809 10:08:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:51.809 10:08:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:51.809 10:08:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:51.809 10:08:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:51.809 10:08:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:51.809 10:08:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:51.809 10:08:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:51.809 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:51.809 10:08:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:51.809 10:08:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:51.809 10:08:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:51.809 10:08:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:51.809 10:08:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:51.809 10:08:57 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:51.810 10:08:57 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:51.810 10:08:57 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:51.810 10:08:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:51.810 10:08:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:51.810 10:08:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:51.810 10:08:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:51.810 10:08:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:51.810 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:51.810 10:08:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:51.810 10:08:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:51.810 10:08:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:51.810 10:08:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:51.810 10:08:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:51.810 10:08:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:51.810 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:51.810 10:08:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:51.810 10:08:57 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:51.810 10:08:57 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:51.810 10:08:57 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:51.810 10:08:57 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:51.810 10:08:57 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:51.810 10:08:57 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:51.810 10:08:57 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:51.810 10:08:57 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:51.810 10:08:57 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:51.810 10:08:57 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:51.810 10:08:57 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:51.810 10:08:57 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:51.810 10:08:57 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:51.810 10:08:57 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:51.810 10:08:57 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:51.810 10:08:57 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:51.810 10:08:57 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:51.810 10:08:57 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:52.069 10:08:57 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:52.069 10:08:57 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:52.069 10:08:57 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:52.069 10:08:57 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:52.069 10:08:57 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:52.069 10:08:57 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:52.069 10:08:57 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:52.069 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:52.069 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.257 ms 00:22:52.069 00:22:52.069 --- 10.0.0.2 ping statistics --- 00:22:52.069 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:52.069 rtt min/avg/max/mdev = 0.257/0.257/0.257/0.000 ms 00:22:52.069 10:08:57 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:52.069 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:52.070 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.170 ms 00:22:52.070 00:22:52.070 --- 10.0.0.1 ping statistics --- 00:22:52.070 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:52.070 rtt min/avg/max/mdev = 0.170/0.170/0.170/0.000 ms 00:22:52.070 10:08:57 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:52.070 10:08:57 -- nvmf/common.sh@410 -- # return 0 00:22:52.070 10:08:57 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:52.070 10:08:57 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:52.070 10:08:57 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:52.070 10:08:57 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:52.070 10:08:57 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:52.070 10:08:57 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:52.070 10:08:57 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:52.070 10:08:57 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:22:52.070 10:08:57 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:52.070 10:08:57 -- common/autotest_common.sh@712 -- # xtrace_disable 00:22:52.070 10:08:57 -- common/autotest_common.sh@10 -- # set +x 00:22:52.070 10:08:57 -- nvmf/common.sh@469 -- # nvmfpid=2865007 00:22:52.070 10:08:57 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:52.070 10:08:57 -- nvmf/common.sh@470 -- # waitforlisten 2865007 00:22:52.070 10:08:57 -- common/autotest_common.sh@819 -- # '[' -z 2865007 ']' 00:22:52.070 10:08:57 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:52.070 10:08:57 -- common/autotest_common.sh@824 -- # local max_retries=100 00:22:52.070 10:08:57 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:52.070 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:52.070 10:08:57 -- common/autotest_common.sh@828 -- # xtrace_disable 00:22:52.070 10:08:57 -- common/autotest_common.sh@10 -- # set +x 00:22:52.070 [2024-07-13 10:08:57.818072] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:22:52.070 [2024-07-13 10:08:57.818146] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:52.070 EAL: No free 2048 kB hugepages reported on node 1 00:22:52.070 [2024-07-13 10:08:57.880743] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:52.329 [2024-07-13 10:08:57.965085] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:52.329 [2024-07-13 10:08:57.965243] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:52.329 [2024-07-13 10:08:57.965260] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:52.329 [2024-07-13 10:08:57.965272] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:52.329 [2024-07-13 10:08:57.965322] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:52.329 [2024-07-13 10:08:57.965381] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:52.329 [2024-07-13 10:08:57.965447] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:52.329 [2024-07-13 10:08:57.965450] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:53.267 10:08:58 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:22:53.267 10:08:58 -- common/autotest_common.sh@852 -- # return 0 00:22:53.267 10:08:58 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:53.267 10:08:58 -- common/autotest_common.sh@718 -- # xtrace_disable 00:22:53.267 10:08:58 -- common/autotest_common.sh@10 -- # set +x 00:22:53.267 10:08:58 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:53.267 10:08:58 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:22:53.267 10:08:58 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:22:53.267 10:08:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:53.267 10:08:58 -- common/autotest_common.sh@10 -- # set +x 00:22:53.267 Malloc0 00:22:53.267 10:08:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:53.267 10:08:58 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:22:53.267 10:08:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:53.267 10:08:58 -- common/autotest_common.sh@10 -- # set +x 00:22:53.267 Delay0 00:22:53.267 10:08:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:53.267 10:08:58 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:53.267 10:08:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:53.267 10:08:58 -- common/autotest_common.sh@10 -- # set +x 00:22:53.267 [2024-07-13 10:08:58.805648] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:53.267 10:08:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:53.267 10:08:58 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:22:53.267 10:08:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:53.267 10:08:58 -- common/autotest_common.sh@10 -- # set +x 00:22:53.267 10:08:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:53.267 10:08:58 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:22:53.267 10:08:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:53.267 10:08:58 -- common/autotest_common.sh@10 -- # set +x 00:22:53.267 10:08:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:53.267 10:08:58 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:53.267 10:08:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:53.267 10:08:58 -- common/autotest_common.sh@10 -- # set +x 00:22:53.267 [2024-07-13 10:08:58.833960] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:53.267 10:08:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:53.268 10:08:58 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:22:53.837 10:08:59 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:22:53.837 10:08:59 -- common/autotest_common.sh@1177 -- # local i=0 00:22:53.837 10:08:59 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:22:53.837 10:08:59 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:22:53.837 10:08:59 -- common/autotest_common.sh@1184 -- # sleep 2 00:22:55.740 10:09:01 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:22:55.740 10:09:01 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:22:55.740 10:09:01 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:22:55.740 10:09:01 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:22:55.740 10:09:01 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:22:55.740 10:09:01 -- common/autotest_common.sh@1187 -- # return 0 00:22:55.740 10:09:01 -- target/initiator_timeout.sh@35 -- # fio_pid=2865543 00:22:55.740 10:09:01 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:22:55.740 10:09:01 -- target/initiator_timeout.sh@37 -- # sleep 3 00:22:55.740 [global] 00:22:55.740 thread=1 00:22:55.740 invalidate=1 00:22:55.740 rw=write 00:22:55.740 time_based=1 00:22:55.740 runtime=60 00:22:55.740 ioengine=libaio 00:22:55.740 direct=1 00:22:55.740 bs=4096 00:22:55.740 iodepth=1 00:22:55.740 norandommap=0 00:22:55.740 numjobs=1 00:22:55.740 00:22:55.740 verify_dump=1 00:22:55.740 verify_backlog=512 00:22:55.740 verify_state_save=0 00:22:55.740 do_verify=1 00:22:55.740 verify=crc32c-intel 00:22:55.740 [job0] 00:22:55.740 filename=/dev/nvme0n1 00:22:55.740 Could not set queue depth (nvme0n1) 00:22:55.998 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:22:55.998 fio-3.35 00:22:55.998 Starting 1 thread 00:22:59.286 10:09:04 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:22:59.286 10:09:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.286 10:09:04 -- common/autotest_common.sh@10 -- # set +x 00:22:59.286 true 00:22:59.286 10:09:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.286 10:09:04 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:22:59.286 10:09:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.286 10:09:04 -- common/autotest_common.sh@10 -- # set +x 00:22:59.286 true 00:22:59.286 10:09:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.286 10:09:04 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:22:59.286 10:09:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.286 10:09:04 -- common/autotest_common.sh@10 -- # set +x 00:22:59.286 true 00:22:59.286 10:09:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.286 10:09:04 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:22:59.286 10:09:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:59.286 10:09:04 -- common/autotest_common.sh@10 -- # set +x 00:22:59.286 true 00:22:59.286 10:09:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:59.286 10:09:04 -- target/initiator_timeout.sh@45 -- # sleep 3 00:23:01.824 10:09:07 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:23:01.824 10:09:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:01.824 10:09:07 -- common/autotest_common.sh@10 -- # set +x 00:23:01.824 true 00:23:01.824 10:09:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:01.824 10:09:07 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:23:01.824 10:09:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:01.824 10:09:07 -- common/autotest_common.sh@10 -- # set +x 00:23:01.824 true 00:23:01.824 10:09:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:01.824 10:09:07 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:23:01.824 10:09:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:01.824 10:09:07 -- common/autotest_common.sh@10 -- # set +x 00:23:01.824 true 00:23:01.824 10:09:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:01.824 10:09:07 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:23:01.824 10:09:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:01.824 10:09:07 -- common/autotest_common.sh@10 -- # set +x 00:23:01.824 true 00:23:01.824 10:09:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:01.824 10:09:07 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:23:01.824 10:09:07 -- target/initiator_timeout.sh@54 -- # wait 2865543 00:23:58.087 00:23:58.087 job0: (groupid=0, jobs=1): err= 0: pid=2865621: Sat Jul 13 10:10:01 2024 00:23:58.087 read: IOPS=51, BW=205KiB/s (210kB/s)(12.0MiB/60001msec) 00:23:58.087 slat (usec): min=6, max=12027, avg=23.00, stdev=296.05 00:23:58.087 clat (usec): min=305, max=40804k, avg=19174.04, stdev=736213.24 00:23:58.087 lat (usec): min=314, max=40804k, avg=19197.03, stdev=736213.36 00:23:58.087 clat percentiles (usec): 00:23:58.087 | 1.00th=[ 318], 5.00th=[ 338], 10.00th=[ 351], 00:23:58.087 | 20.00th=[ 367], 30.00th=[ 379], 40.00th=[ 392], 00:23:58.087 | 50.00th=[ 453], 60.00th=[ 469], 70.00th=[ 482], 00:23:58.087 | 80.00th=[ 510], 90.00th=[ 41157], 95.00th=[ 41157], 00:23:58.087 | 99.00th=[ 42206], 99.50th=[ 42206], 99.90th=[ 42206], 00:23:58.087 | 99.95th=[ 42206], 99.99th=[17112761] 00:23:58.087 write: IOPS=51, BW=207KiB/s (212kB/s)(12.1MiB/60001msec); 0 zone resets 00:23:58.087 slat (nsec): min=6708, max=82645, avg=20268.53, stdev=10328.76 00:23:58.087 clat (usec): min=210, max=497, avg=300.40, stdev=54.32 00:23:58.087 lat (usec): min=218, max=542, avg=320.67, stdev=60.76 00:23:58.087 clat percentiles (usec): 00:23:58.087 | 1.00th=[ 219], 5.00th=[ 229], 10.00th=[ 235], 20.00th=[ 245], 00:23:58.087 | 30.00th=[ 265], 40.00th=[ 285], 50.00th=[ 297], 60.00th=[ 310], 00:23:58.087 | 70.00th=[ 326], 80.00th=[ 355], 90.00th=[ 379], 95.00th=[ 400], 00:23:58.087 | 99.00th=[ 424], 99.50th=[ 445], 99.90th=[ 482], 99.95th=[ 494], 00:23:58.087 | 99.99th=[ 498] 00:23:58.087 bw ( KiB/s): min= 3776, max= 4416, per=100.00%, avg=4096.00, stdev=226.27, samples=5 00:23:58.087 iops : min= 944, max= 1104, avg=1024.00, stdev=56.57, samples=5 00:23:58.087 lat (usec) : 250=12.01%, 500=77.06%, 750=4.23%, 1000=0.02% 00:23:58.087 lat (msec) : 2=0.02%, 50=6.65%, >=2000=0.02% 00:23:58.087 cpu : usr=0.15%, sys=0.23%, ctx=6180, majf=0, minf=2 00:23:58.087 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:23:58.087 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:58.087 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:58.087 issued rwts: total=3072,3105,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:58.087 latency : target=0, window=0, percentile=100.00%, depth=1 00:23:58.087 00:23:58.087 Run status group 0 (all jobs): 00:23:58.087 READ: bw=205KiB/s (210kB/s), 205KiB/s-205KiB/s (210kB/s-210kB/s), io=12.0MiB (12.6MB), run=60001-60001msec 00:23:58.087 WRITE: bw=207KiB/s (212kB/s), 207KiB/s-207KiB/s (212kB/s-212kB/s), io=12.1MiB (12.7MB), run=60001-60001msec 00:23:58.087 00:23:58.087 Disk stats (read/write): 00:23:58.087 nvme0n1: ios=2989/3072, merge=0/0, ticks=18283/864, in_queue=19147, util=99.78% 00:23:58.087 10:10:01 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:23:58.087 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:23:58.087 10:10:01 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:23:58.087 10:10:01 -- common/autotest_common.sh@1198 -- # local i=0 00:23:58.087 10:10:01 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:23:58.087 10:10:01 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:23:58.087 10:10:01 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:23:58.087 10:10:01 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:23:58.087 10:10:01 -- common/autotest_common.sh@1210 -- # return 0 00:23:58.087 10:10:01 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:23:58.087 10:10:01 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:23:58.087 nvmf hotplug test: fio successful as expected 00:23:58.087 10:10:01 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:58.087 10:10:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:58.087 10:10:01 -- common/autotest_common.sh@10 -- # set +x 00:23:58.087 10:10:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:58.087 10:10:01 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:23:58.087 10:10:01 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:23:58.087 10:10:01 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:23:58.087 10:10:01 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:58.087 10:10:01 -- nvmf/common.sh@116 -- # sync 00:23:58.087 10:10:01 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:58.087 10:10:01 -- nvmf/common.sh@119 -- # set +e 00:23:58.087 10:10:01 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:58.087 10:10:01 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:58.087 rmmod nvme_tcp 00:23:58.087 rmmod nvme_fabrics 00:23:58.087 rmmod nvme_keyring 00:23:58.087 10:10:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:58.087 10:10:01 -- nvmf/common.sh@123 -- # set -e 00:23:58.087 10:10:01 -- nvmf/common.sh@124 -- # return 0 00:23:58.087 10:10:01 -- nvmf/common.sh@477 -- # '[' -n 2865007 ']' 00:23:58.087 10:10:01 -- nvmf/common.sh@478 -- # killprocess 2865007 00:23:58.087 10:10:01 -- common/autotest_common.sh@926 -- # '[' -z 2865007 ']' 00:23:58.087 10:10:01 -- common/autotest_common.sh@930 -- # kill -0 2865007 00:23:58.087 10:10:01 -- common/autotest_common.sh@931 -- # uname 00:23:58.087 10:10:01 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:23:58.087 10:10:01 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2865007 00:23:58.087 10:10:01 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:23:58.087 10:10:01 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:23:58.087 10:10:01 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2865007' 00:23:58.087 killing process with pid 2865007 00:23:58.087 10:10:01 -- common/autotest_common.sh@945 -- # kill 2865007 00:23:58.087 10:10:01 -- common/autotest_common.sh@950 -- # wait 2865007 00:23:58.087 10:10:02 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:58.087 10:10:02 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:58.087 10:10:02 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:58.087 10:10:02 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:58.087 10:10:02 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:58.087 10:10:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:58.087 10:10:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:58.087 10:10:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:58.652 10:10:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:58.652 00:23:58.652 real 1m8.735s 00:23:58.652 user 4m13.342s 00:23:58.652 sys 0m6.593s 00:23:58.652 10:10:04 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:23:58.652 10:10:04 -- common/autotest_common.sh@10 -- # set +x 00:23:58.652 ************************************ 00:23:58.652 END TEST nvmf_initiator_timeout 00:23:58.652 ************************************ 00:23:58.652 10:10:04 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:23:58.652 10:10:04 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:23:58.652 10:10:04 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:23:58.652 10:10:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:58.652 10:10:04 -- common/autotest_common.sh@10 -- # set +x 00:24:00.556 10:10:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:00.556 10:10:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:00.556 10:10:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:00.556 10:10:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:00.556 10:10:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:00.556 10:10:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:00.556 10:10:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:00.556 10:10:06 -- nvmf/common.sh@294 -- # net_devs=() 00:24:00.556 10:10:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:00.556 10:10:06 -- nvmf/common.sh@295 -- # e810=() 00:24:00.556 10:10:06 -- nvmf/common.sh@295 -- # local -ga e810 00:24:00.556 10:10:06 -- nvmf/common.sh@296 -- # x722=() 00:24:00.556 10:10:06 -- nvmf/common.sh@296 -- # local -ga x722 00:24:00.556 10:10:06 -- nvmf/common.sh@297 -- # mlx=() 00:24:00.556 10:10:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:00.556 10:10:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:00.556 10:10:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:00.556 10:10:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:00.556 10:10:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:00.556 10:10:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:00.556 10:10:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:00.556 10:10:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:00.556 10:10:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:00.556 10:10:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:00.556 10:10:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:00.556 10:10:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:00.556 10:10:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:00.556 10:10:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:00.556 10:10:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:00.556 10:10:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:00.556 10:10:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:00.556 10:10:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:00.556 10:10:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:00.557 10:10:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:00.557 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:00.557 10:10:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:00.557 10:10:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:00.557 10:10:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:00.557 10:10:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:00.557 10:10:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:00.557 10:10:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:00.557 10:10:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:00.557 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:00.557 10:10:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:00.557 10:10:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:00.557 10:10:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:00.557 10:10:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:00.557 10:10:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:00.557 10:10:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:00.557 10:10:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:00.557 10:10:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:00.557 10:10:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:00.557 10:10:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:00.557 10:10:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:00.557 10:10:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:00.557 10:10:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:00.557 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:00.557 10:10:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:00.557 10:10:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:00.557 10:10:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:00.557 10:10:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:00.557 10:10:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:00.557 10:10:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:00.557 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:00.557 10:10:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:00.557 10:10:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:00.557 10:10:06 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:00.557 10:10:06 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:24:00.557 10:10:06 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:24:00.557 10:10:06 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:24:00.557 10:10:06 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:24:00.557 10:10:06 -- common/autotest_common.sh@10 -- # set +x 00:24:00.557 ************************************ 00:24:00.557 START TEST nvmf_perf_adq 00:24:00.557 ************************************ 00:24:00.557 10:10:06 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:24:00.557 * Looking for test storage... 00:24:00.557 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:24:00.557 10:10:06 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:00.557 10:10:06 -- nvmf/common.sh@7 -- # uname -s 00:24:00.557 10:10:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:00.557 10:10:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:00.557 10:10:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:00.557 10:10:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:00.557 10:10:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:00.557 10:10:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:00.557 10:10:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:00.557 10:10:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:00.557 10:10:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:00.557 10:10:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:00.557 10:10:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:00.557 10:10:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:00.557 10:10:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:00.557 10:10:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:00.557 10:10:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:00.557 10:10:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:00.557 10:10:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:00.557 10:10:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:00.557 10:10:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:00.557 10:10:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:00.557 10:10:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:00.557 10:10:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:00.557 10:10:06 -- paths/export.sh@5 -- # export PATH 00:24:00.557 10:10:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:00.557 10:10:06 -- nvmf/common.sh@46 -- # : 0 00:24:00.557 10:10:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:00.557 10:10:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:00.557 10:10:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:00.557 10:10:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:00.557 10:10:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:00.557 10:10:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:00.557 10:10:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:00.557 10:10:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:00.557 10:10:06 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:24:00.557 10:10:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:00.557 10:10:06 -- common/autotest_common.sh@10 -- # set +x 00:24:02.465 10:10:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:02.465 10:10:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:02.465 10:10:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:02.465 10:10:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:02.465 10:10:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:02.465 10:10:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:02.465 10:10:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:02.465 10:10:08 -- nvmf/common.sh@294 -- # net_devs=() 00:24:02.465 10:10:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:02.465 10:10:08 -- nvmf/common.sh@295 -- # e810=() 00:24:02.465 10:10:08 -- nvmf/common.sh@295 -- # local -ga e810 00:24:02.465 10:10:08 -- nvmf/common.sh@296 -- # x722=() 00:24:02.465 10:10:08 -- nvmf/common.sh@296 -- # local -ga x722 00:24:02.465 10:10:08 -- nvmf/common.sh@297 -- # mlx=() 00:24:02.465 10:10:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:02.465 10:10:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:02.465 10:10:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:02.465 10:10:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:02.465 10:10:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:02.465 10:10:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:02.465 10:10:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:02.465 10:10:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:02.465 10:10:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:02.465 10:10:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:02.465 10:10:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:02.465 10:10:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:02.465 10:10:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:02.465 10:10:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:02.465 10:10:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:02.465 10:10:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:02.465 10:10:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:02.465 10:10:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:02.465 10:10:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:02.465 10:10:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:02.465 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:02.465 10:10:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:02.465 10:10:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:02.465 10:10:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:02.465 10:10:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:02.465 10:10:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:02.465 10:10:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:02.465 10:10:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:02.465 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:02.465 10:10:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:02.465 10:10:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:02.465 10:10:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:02.465 10:10:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:02.465 10:10:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:02.465 10:10:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:02.465 10:10:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:02.465 10:10:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:02.465 10:10:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:02.465 10:10:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:02.465 10:10:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:02.465 10:10:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:02.465 10:10:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:02.465 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:02.465 10:10:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:02.465 10:10:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:02.465 10:10:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:02.465 10:10:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:02.465 10:10:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:02.465 10:10:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:02.465 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:02.465 10:10:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:02.465 10:10:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:02.465 10:10:08 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:02.465 10:10:08 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:24:02.465 10:10:08 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:24:02.465 10:10:08 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:24:02.465 10:10:08 -- target/perf_adq.sh@52 -- # rmmod ice 00:24:03.403 10:10:08 -- target/perf_adq.sh@53 -- # modprobe ice 00:24:05.301 10:10:10 -- target/perf_adq.sh@54 -- # sleep 5 00:24:10.572 10:10:15 -- target/perf_adq.sh@67 -- # nvmftestinit 00:24:10.572 10:10:15 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:10.572 10:10:15 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:10.572 10:10:15 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:10.572 10:10:15 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:10.572 10:10:15 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:10.572 10:10:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:10.572 10:10:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:10.572 10:10:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:10.572 10:10:15 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:10.572 10:10:15 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:10.572 10:10:15 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:10.572 10:10:15 -- common/autotest_common.sh@10 -- # set +x 00:24:10.572 10:10:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:10.572 10:10:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:10.572 10:10:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:10.572 10:10:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:10.572 10:10:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:10.572 10:10:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:10.572 10:10:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:10.572 10:10:15 -- nvmf/common.sh@294 -- # net_devs=() 00:24:10.572 10:10:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:10.572 10:10:15 -- nvmf/common.sh@295 -- # e810=() 00:24:10.572 10:10:15 -- nvmf/common.sh@295 -- # local -ga e810 00:24:10.572 10:10:15 -- nvmf/common.sh@296 -- # x722=() 00:24:10.572 10:10:15 -- nvmf/common.sh@296 -- # local -ga x722 00:24:10.572 10:10:15 -- nvmf/common.sh@297 -- # mlx=() 00:24:10.572 10:10:15 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:10.572 10:10:15 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:10.572 10:10:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:10.572 10:10:15 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:10.572 10:10:15 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:10.572 10:10:15 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:10.572 10:10:15 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:10.572 10:10:15 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:10.572 10:10:15 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:10.572 10:10:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:10.572 10:10:15 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:10.572 10:10:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:10.572 10:10:15 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:10.572 10:10:15 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:10.572 10:10:15 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:10.572 10:10:15 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:10.572 10:10:15 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:10.572 10:10:15 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:10.572 10:10:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:10.572 10:10:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:10.572 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:10.572 10:10:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:10.572 10:10:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:10.572 10:10:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:10.572 10:10:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:10.572 10:10:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:10.572 10:10:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:10.572 10:10:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:10.572 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:10.572 10:10:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:10.572 10:10:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:10.572 10:10:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:10.572 10:10:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:10.572 10:10:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:10.572 10:10:15 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:10.572 10:10:15 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:10.572 10:10:15 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:10.572 10:10:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:10.572 10:10:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:10.572 10:10:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:10.572 10:10:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:10.572 10:10:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:10.572 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:10.572 10:10:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:10.572 10:10:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:10.572 10:10:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:10.572 10:10:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:10.572 10:10:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:10.572 10:10:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:10.572 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:10.572 10:10:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:10.572 10:10:15 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:10.572 10:10:15 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:10.572 10:10:15 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:10.572 10:10:15 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:10.572 10:10:15 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:10.572 10:10:15 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:10.572 10:10:15 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:10.572 10:10:15 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:10.572 10:10:15 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:10.572 10:10:15 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:10.572 10:10:15 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:10.572 10:10:15 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:10.572 10:10:15 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:10.572 10:10:15 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:10.572 10:10:15 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:10.572 10:10:15 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:10.572 10:10:15 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:10.572 10:10:15 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:10.572 10:10:15 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:10.572 10:10:15 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:10.572 10:10:15 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:10.572 10:10:15 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:10.572 10:10:15 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:10.572 10:10:15 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:10.572 10:10:16 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:10.572 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:10.572 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.189 ms 00:24:10.572 00:24:10.572 --- 10.0.0.2 ping statistics --- 00:24:10.572 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:10.572 rtt min/avg/max/mdev = 0.189/0.189/0.189/0.000 ms 00:24:10.573 10:10:16 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:10.573 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:10.573 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.177 ms 00:24:10.573 00:24:10.573 --- 10.0.0.1 ping statistics --- 00:24:10.573 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:10.573 rtt min/avg/max/mdev = 0.177/0.177/0.177/0.000 ms 00:24:10.573 10:10:16 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:10.573 10:10:16 -- nvmf/common.sh@410 -- # return 0 00:24:10.573 10:10:16 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:10.573 10:10:16 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:10.573 10:10:16 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:10.573 10:10:16 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:10.573 10:10:16 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:10.573 10:10:16 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:10.573 10:10:16 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:10.573 10:10:16 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:24:10.573 10:10:16 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:10.573 10:10:16 -- common/autotest_common.sh@712 -- # xtrace_disable 00:24:10.573 10:10:16 -- common/autotest_common.sh@10 -- # set +x 00:24:10.573 10:10:16 -- nvmf/common.sh@469 -- # nvmfpid=2877929 00:24:10.573 10:10:16 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:24:10.573 10:10:16 -- nvmf/common.sh@470 -- # waitforlisten 2877929 00:24:10.573 10:10:16 -- common/autotest_common.sh@819 -- # '[' -z 2877929 ']' 00:24:10.573 10:10:16 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:10.573 10:10:16 -- common/autotest_common.sh@824 -- # local max_retries=100 00:24:10.573 10:10:16 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:10.573 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:10.573 10:10:16 -- common/autotest_common.sh@828 -- # xtrace_disable 00:24:10.573 10:10:16 -- common/autotest_common.sh@10 -- # set +x 00:24:10.573 [2024-07-13 10:10:16.092684] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:24:10.573 [2024-07-13 10:10:16.092777] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:10.573 EAL: No free 2048 kB hugepages reported on node 1 00:24:10.573 [2024-07-13 10:10:16.170057] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:10.573 [2024-07-13 10:10:16.266351] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:10.573 [2024-07-13 10:10:16.266497] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:10.573 [2024-07-13 10:10:16.266517] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:10.573 [2024-07-13 10:10:16.266531] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:10.573 [2024-07-13 10:10:16.266591] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:10.573 [2024-07-13 10:10:16.266654] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:10.573 [2024-07-13 10:10:16.266710] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:10.573 [2024-07-13 10:10:16.266707] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:10.573 10:10:16 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:24:10.573 10:10:16 -- common/autotest_common.sh@852 -- # return 0 00:24:10.573 10:10:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:10.573 10:10:16 -- common/autotest_common.sh@718 -- # xtrace_disable 00:24:10.573 10:10:16 -- common/autotest_common.sh@10 -- # set +x 00:24:10.573 10:10:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:10.573 10:10:16 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:24:10.573 10:10:16 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:24:10.573 10:10:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:10.573 10:10:16 -- common/autotest_common.sh@10 -- # set +x 00:24:10.573 10:10:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:10.573 10:10:16 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:24:10.573 10:10:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:10.573 10:10:16 -- common/autotest_common.sh@10 -- # set +x 00:24:10.831 10:10:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:10.831 10:10:16 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:24:10.831 10:10:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:10.831 10:10:16 -- common/autotest_common.sh@10 -- # set +x 00:24:10.831 [2024-07-13 10:10:16.487778] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:10.831 10:10:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:10.831 10:10:16 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:24:10.831 10:10:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:10.831 10:10:16 -- common/autotest_common.sh@10 -- # set +x 00:24:10.831 Malloc1 00:24:10.831 10:10:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:10.831 10:10:16 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:10.831 10:10:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:10.831 10:10:16 -- common/autotest_common.sh@10 -- # set +x 00:24:10.831 10:10:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:10.831 10:10:16 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:10.831 10:10:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:10.831 10:10:16 -- common/autotest_common.sh@10 -- # set +x 00:24:10.831 10:10:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:10.831 10:10:16 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:10.831 10:10:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:10.831 10:10:16 -- common/autotest_common.sh@10 -- # set +x 00:24:10.831 [2024-07-13 10:10:16.540997] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:10.831 10:10:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:10.831 10:10:16 -- target/perf_adq.sh@73 -- # perfpid=2878077 00:24:10.831 10:10:16 -- target/perf_adq.sh@74 -- # sleep 2 00:24:10.831 10:10:16 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:24:10.831 EAL: No free 2048 kB hugepages reported on node 1 00:24:13.360 10:10:18 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:24:13.360 10:10:18 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:24:13.360 10:10:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:13.360 10:10:18 -- target/perf_adq.sh@76 -- # wc -l 00:24:13.360 10:10:18 -- common/autotest_common.sh@10 -- # set +x 00:24:13.360 10:10:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:13.360 10:10:18 -- target/perf_adq.sh@76 -- # count=4 00:24:13.360 10:10:18 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:24:13.360 10:10:18 -- target/perf_adq.sh@81 -- # wait 2878077 00:24:21.494 Initializing NVMe Controllers 00:24:21.494 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:21.494 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:24:21.494 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:24:21.494 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:24:21.494 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:24:21.494 Initialization complete. Launching workers. 00:24:21.494 ======================================================== 00:24:21.494 Latency(us) 00:24:21.494 Device Information : IOPS MiB/s Average min max 00:24:21.494 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 10999.40 42.97 5819.18 1784.29 9472.69 00:24:21.494 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 11429.40 44.65 5599.81 1494.62 8759.79 00:24:21.494 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 11886.70 46.43 5384.71 1295.73 8930.91 00:24:21.494 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 11191.80 43.72 5719.24 1767.46 9503.74 00:24:21.494 ======================================================== 00:24:21.494 Total : 45507.29 177.76 5626.02 1295.73 9503.74 00:24:21.494 00:24:21.494 10:10:26 -- target/perf_adq.sh@82 -- # nvmftestfini 00:24:21.494 10:10:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:21.494 10:10:26 -- nvmf/common.sh@116 -- # sync 00:24:21.494 10:10:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:21.494 10:10:26 -- nvmf/common.sh@119 -- # set +e 00:24:21.494 10:10:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:21.494 10:10:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:21.494 rmmod nvme_tcp 00:24:21.494 rmmod nvme_fabrics 00:24:21.494 rmmod nvme_keyring 00:24:21.494 10:10:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:21.494 10:10:26 -- nvmf/common.sh@123 -- # set -e 00:24:21.494 10:10:26 -- nvmf/common.sh@124 -- # return 0 00:24:21.494 10:10:26 -- nvmf/common.sh@477 -- # '[' -n 2877929 ']' 00:24:21.494 10:10:26 -- nvmf/common.sh@478 -- # killprocess 2877929 00:24:21.494 10:10:26 -- common/autotest_common.sh@926 -- # '[' -z 2877929 ']' 00:24:21.494 10:10:26 -- common/autotest_common.sh@930 -- # kill -0 2877929 00:24:21.494 10:10:26 -- common/autotest_common.sh@931 -- # uname 00:24:21.494 10:10:26 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:24:21.494 10:10:26 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2877929 00:24:21.494 10:10:26 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:24:21.494 10:10:26 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:24:21.494 10:10:26 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2877929' 00:24:21.494 killing process with pid 2877929 00:24:21.495 10:10:26 -- common/autotest_common.sh@945 -- # kill 2877929 00:24:21.495 10:10:26 -- common/autotest_common.sh@950 -- # wait 2877929 00:24:21.495 10:10:27 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:21.495 10:10:27 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:21.495 10:10:27 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:21.495 10:10:27 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:21.495 10:10:27 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:21.495 10:10:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:21.495 10:10:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:21.495 10:10:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:23.400 10:10:29 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:23.400 10:10:29 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:24:23.400 10:10:29 -- target/perf_adq.sh@52 -- # rmmod ice 00:24:23.968 10:10:29 -- target/perf_adq.sh@53 -- # modprobe ice 00:24:25.870 10:10:31 -- target/perf_adq.sh@54 -- # sleep 5 00:24:31.141 10:10:36 -- target/perf_adq.sh@87 -- # nvmftestinit 00:24:31.141 10:10:36 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:31.141 10:10:36 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:31.141 10:10:36 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:31.141 10:10:36 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:31.141 10:10:36 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:31.141 10:10:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:31.141 10:10:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:31.141 10:10:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:31.141 10:10:36 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:31.141 10:10:36 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:31.141 10:10:36 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:31.141 10:10:36 -- common/autotest_common.sh@10 -- # set +x 00:24:31.141 10:10:36 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:31.141 10:10:36 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:31.141 10:10:36 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:31.141 10:10:36 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:31.141 10:10:36 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:31.141 10:10:36 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:31.141 10:10:36 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:31.141 10:10:36 -- nvmf/common.sh@294 -- # net_devs=() 00:24:31.141 10:10:36 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:31.141 10:10:36 -- nvmf/common.sh@295 -- # e810=() 00:24:31.141 10:10:36 -- nvmf/common.sh@295 -- # local -ga e810 00:24:31.141 10:10:36 -- nvmf/common.sh@296 -- # x722=() 00:24:31.141 10:10:36 -- nvmf/common.sh@296 -- # local -ga x722 00:24:31.141 10:10:36 -- nvmf/common.sh@297 -- # mlx=() 00:24:31.141 10:10:36 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:31.141 10:10:36 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:31.141 10:10:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:31.141 10:10:36 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:31.141 10:10:36 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:31.141 10:10:36 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:31.141 10:10:36 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:31.141 10:10:36 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:31.141 10:10:36 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:31.141 10:10:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:31.141 10:10:36 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:31.141 10:10:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:31.141 10:10:36 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:31.141 10:10:36 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:31.141 10:10:36 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:31.141 10:10:36 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:31.141 10:10:36 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:31.141 10:10:36 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:31.141 10:10:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:31.141 10:10:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:31.141 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:31.141 10:10:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:31.141 10:10:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:31.141 10:10:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:31.141 10:10:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:31.141 10:10:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:31.141 10:10:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:31.141 10:10:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:31.141 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:31.141 10:10:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:31.141 10:10:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:31.142 10:10:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:31.142 10:10:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:31.142 10:10:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:31.142 10:10:36 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:31.142 10:10:36 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:31.142 10:10:36 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:31.142 10:10:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:31.142 10:10:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:31.142 10:10:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:31.142 10:10:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:31.142 10:10:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:31.142 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:31.142 10:10:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:31.142 10:10:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:31.142 10:10:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:31.142 10:10:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:31.142 10:10:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:31.142 10:10:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:31.142 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:31.142 10:10:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:31.142 10:10:36 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:31.142 10:10:36 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:31.142 10:10:36 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:31.142 10:10:36 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:31.142 10:10:36 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:31.142 10:10:36 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:31.142 10:10:36 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:31.142 10:10:36 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:31.142 10:10:36 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:31.142 10:10:36 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:31.142 10:10:36 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:31.142 10:10:36 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:31.142 10:10:36 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:31.142 10:10:36 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:31.142 10:10:36 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:31.142 10:10:36 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:31.142 10:10:36 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:31.142 10:10:36 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:31.142 10:10:36 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:31.142 10:10:36 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:31.142 10:10:36 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:31.142 10:10:36 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:31.142 10:10:36 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:31.142 10:10:36 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:31.142 10:10:36 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:31.142 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:31.142 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.248 ms 00:24:31.142 00:24:31.142 --- 10.0.0.2 ping statistics --- 00:24:31.142 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:31.142 rtt min/avg/max/mdev = 0.248/0.248/0.248/0.000 ms 00:24:31.142 10:10:36 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:31.142 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:31.142 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.184 ms 00:24:31.142 00:24:31.142 --- 10.0.0.1 ping statistics --- 00:24:31.142 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:31.142 rtt min/avg/max/mdev = 0.184/0.184/0.184/0.000 ms 00:24:31.142 10:10:36 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:31.142 10:10:36 -- nvmf/common.sh@410 -- # return 0 00:24:31.142 10:10:36 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:31.142 10:10:36 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:31.142 10:10:36 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:31.142 10:10:36 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:31.142 10:10:36 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:31.142 10:10:36 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:31.142 10:10:36 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:31.142 10:10:36 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:24:31.142 10:10:36 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:24:31.142 10:10:36 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:24:31.142 10:10:36 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:24:31.142 net.core.busy_poll = 1 00:24:31.142 10:10:36 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:24:31.142 net.core.busy_read = 1 00:24:31.142 10:10:36 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:24:31.142 10:10:36 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:24:31.142 10:10:36 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:24:31.142 10:10:36 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:24:31.142 10:10:36 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:24:31.142 10:10:36 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:24:31.142 10:10:36 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:31.142 10:10:36 -- common/autotest_common.sh@712 -- # xtrace_disable 00:24:31.142 10:10:36 -- common/autotest_common.sh@10 -- # set +x 00:24:31.399 10:10:36 -- nvmf/common.sh@469 -- # nvmfpid=2880769 00:24:31.399 10:10:36 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:24:31.399 10:10:36 -- nvmf/common.sh@470 -- # waitforlisten 2880769 00:24:31.399 10:10:36 -- common/autotest_common.sh@819 -- # '[' -z 2880769 ']' 00:24:31.399 10:10:36 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:31.399 10:10:36 -- common/autotest_common.sh@824 -- # local max_retries=100 00:24:31.399 10:10:36 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:31.399 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:31.399 10:10:36 -- common/autotest_common.sh@828 -- # xtrace_disable 00:24:31.399 10:10:36 -- common/autotest_common.sh@10 -- # set +x 00:24:31.399 [2024-07-13 10:10:37.006913] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:24:31.399 [2024-07-13 10:10:37.007001] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:31.399 EAL: No free 2048 kB hugepages reported on node 1 00:24:31.399 [2024-07-13 10:10:37.075888] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:31.399 [2024-07-13 10:10:37.164783] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:31.399 [2024-07-13 10:10:37.164953] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:31.399 [2024-07-13 10:10:37.164982] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:31.399 [2024-07-13 10:10:37.164997] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:31.399 [2024-07-13 10:10:37.165079] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:31.399 [2024-07-13 10:10:37.165137] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:31.399 [2024-07-13 10:10:37.165255] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:31.399 [2024-07-13 10:10:37.165258] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:31.399 10:10:37 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:24:31.399 10:10:37 -- common/autotest_common.sh@852 -- # return 0 00:24:31.399 10:10:37 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:31.399 10:10:37 -- common/autotest_common.sh@718 -- # xtrace_disable 00:24:31.399 10:10:37 -- common/autotest_common.sh@10 -- # set +x 00:24:31.657 10:10:37 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:31.657 10:10:37 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:24:31.657 10:10:37 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:24:31.657 10:10:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:31.657 10:10:37 -- common/autotest_common.sh@10 -- # set +x 00:24:31.657 10:10:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:31.657 10:10:37 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:24:31.657 10:10:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:31.657 10:10:37 -- common/autotest_common.sh@10 -- # set +x 00:24:31.657 10:10:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:31.657 10:10:37 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:24:31.657 10:10:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:31.657 10:10:37 -- common/autotest_common.sh@10 -- # set +x 00:24:31.657 [2024-07-13 10:10:37.344797] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:31.657 10:10:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:31.657 10:10:37 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:24:31.657 10:10:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:31.657 10:10:37 -- common/autotest_common.sh@10 -- # set +x 00:24:31.657 Malloc1 00:24:31.657 10:10:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:31.657 10:10:37 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:31.657 10:10:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:31.657 10:10:37 -- common/autotest_common.sh@10 -- # set +x 00:24:31.657 10:10:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:31.657 10:10:37 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:31.657 10:10:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:31.657 10:10:37 -- common/autotest_common.sh@10 -- # set +x 00:24:31.657 10:10:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:31.657 10:10:37 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:31.657 10:10:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:31.657 10:10:37 -- common/autotest_common.sh@10 -- # set +x 00:24:31.657 [2024-07-13 10:10:37.397966] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:31.657 10:10:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:31.657 10:10:37 -- target/perf_adq.sh@94 -- # perfpid=2880795 00:24:31.657 10:10:37 -- target/perf_adq.sh@95 -- # sleep 2 00:24:31.657 10:10:37 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:24:31.657 EAL: No free 2048 kB hugepages reported on node 1 00:24:34.181 10:10:39 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:24:34.181 10:10:39 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:24:34.181 10:10:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:34.181 10:10:39 -- target/perf_adq.sh@97 -- # wc -l 00:24:34.181 10:10:39 -- common/autotest_common.sh@10 -- # set +x 00:24:34.181 10:10:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:34.181 10:10:39 -- target/perf_adq.sh@97 -- # count=2 00:24:34.181 10:10:39 -- target/perf_adq.sh@98 -- # [[ 2 -lt 2 ]] 00:24:34.181 10:10:39 -- target/perf_adq.sh@103 -- # wait 2880795 00:24:42.285 Initializing NVMe Controllers 00:24:42.285 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:42.285 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:24:42.285 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:24:42.285 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:24:42.285 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:24:42.285 Initialization complete. Launching workers. 00:24:42.285 ======================================================== 00:24:42.285 Latency(us) 00:24:42.285 Device Information : IOPS MiB/s Average min max 00:24:42.285 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 5533.40 21.61 11568.99 1425.61 59912.85 00:24:42.285 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 14287.80 55.81 4491.72 1126.64 45664.59 00:24:42.285 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 4837.30 18.90 13234.22 2688.60 58482.17 00:24:42.285 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 5178.40 20.23 12360.83 1627.01 58903.43 00:24:42.285 ======================================================== 00:24:42.285 Total : 29836.90 116.55 8587.35 1126.64 59912.85 00:24:42.285 00:24:42.285 10:10:47 -- target/perf_adq.sh@104 -- # nvmftestfini 00:24:42.285 10:10:47 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:42.285 10:10:47 -- nvmf/common.sh@116 -- # sync 00:24:42.285 10:10:47 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:42.285 10:10:47 -- nvmf/common.sh@119 -- # set +e 00:24:42.285 10:10:47 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:42.285 10:10:47 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:42.285 rmmod nvme_tcp 00:24:42.285 rmmod nvme_fabrics 00:24:42.285 rmmod nvme_keyring 00:24:42.285 10:10:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:42.285 10:10:47 -- nvmf/common.sh@123 -- # set -e 00:24:42.285 10:10:47 -- nvmf/common.sh@124 -- # return 0 00:24:42.285 10:10:47 -- nvmf/common.sh@477 -- # '[' -n 2880769 ']' 00:24:42.285 10:10:47 -- nvmf/common.sh@478 -- # killprocess 2880769 00:24:42.285 10:10:47 -- common/autotest_common.sh@926 -- # '[' -z 2880769 ']' 00:24:42.285 10:10:47 -- common/autotest_common.sh@930 -- # kill -0 2880769 00:24:42.285 10:10:47 -- common/autotest_common.sh@931 -- # uname 00:24:42.285 10:10:47 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:24:42.285 10:10:47 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2880769 00:24:42.285 10:10:47 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:24:42.285 10:10:47 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:24:42.285 10:10:47 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2880769' 00:24:42.285 killing process with pid 2880769 00:24:42.285 10:10:47 -- common/autotest_common.sh@945 -- # kill 2880769 00:24:42.285 10:10:47 -- common/autotest_common.sh@950 -- # wait 2880769 00:24:42.285 10:10:47 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:42.285 10:10:47 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:42.285 10:10:47 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:42.285 10:10:47 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:42.285 10:10:47 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:42.286 10:10:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:42.286 10:10:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:42.286 10:10:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:44.225 10:10:49 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:44.225 10:10:49 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:24:44.225 00:24:44.225 real 0m43.813s 00:24:44.225 user 2m34.846s 00:24:44.225 sys 0m11.471s 00:24:44.225 10:10:49 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:24:44.225 10:10:49 -- common/autotest_common.sh@10 -- # set +x 00:24:44.225 ************************************ 00:24:44.225 END TEST nvmf_perf_adq 00:24:44.225 ************************************ 00:24:44.225 10:10:49 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:24:44.225 10:10:49 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:24:44.225 10:10:49 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:24:44.225 10:10:49 -- common/autotest_common.sh@10 -- # set +x 00:24:44.225 ************************************ 00:24:44.225 START TEST nvmf_shutdown 00:24:44.225 ************************************ 00:24:44.225 10:10:49 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:24:44.225 * Looking for test storage... 00:24:44.225 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:24:44.225 10:10:50 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:44.225 10:10:50 -- nvmf/common.sh@7 -- # uname -s 00:24:44.225 10:10:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:44.225 10:10:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:44.225 10:10:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:44.225 10:10:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:44.225 10:10:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:44.225 10:10:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:44.225 10:10:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:44.225 10:10:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:44.225 10:10:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:44.225 10:10:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:44.225 10:10:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:44.225 10:10:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:44.225 10:10:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:44.225 10:10:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:44.225 10:10:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:44.225 10:10:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:44.225 10:10:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:44.484 10:10:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:44.484 10:10:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:44.484 10:10:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:44.484 10:10:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:44.484 10:10:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:44.484 10:10:50 -- paths/export.sh@5 -- # export PATH 00:24:44.484 10:10:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:44.484 10:10:50 -- nvmf/common.sh@46 -- # : 0 00:24:44.484 10:10:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:44.484 10:10:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:44.484 10:10:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:44.484 10:10:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:44.484 10:10:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:44.484 10:10:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:44.485 10:10:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:44.485 10:10:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:44.485 10:10:50 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:24:44.485 10:10:50 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:24:44.485 10:10:50 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:24:44.485 10:10:50 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:24:44.485 10:10:50 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:24:44.485 10:10:50 -- common/autotest_common.sh@10 -- # set +x 00:24:44.485 ************************************ 00:24:44.485 START TEST nvmf_shutdown_tc1 00:24:44.485 ************************************ 00:24:44.485 10:10:50 -- common/autotest_common.sh@1104 -- # nvmf_shutdown_tc1 00:24:44.485 10:10:50 -- target/shutdown.sh@74 -- # starttarget 00:24:44.485 10:10:50 -- target/shutdown.sh@15 -- # nvmftestinit 00:24:44.485 10:10:50 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:44.485 10:10:50 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:44.485 10:10:50 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:44.485 10:10:50 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:44.485 10:10:50 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:44.485 10:10:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:44.485 10:10:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:44.485 10:10:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:44.485 10:10:50 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:44.485 10:10:50 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:44.485 10:10:50 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:44.485 10:10:50 -- common/autotest_common.sh@10 -- # set +x 00:24:46.387 10:10:51 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:46.387 10:10:51 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:46.387 10:10:51 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:46.387 10:10:51 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:46.387 10:10:51 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:46.387 10:10:51 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:46.387 10:10:51 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:46.387 10:10:51 -- nvmf/common.sh@294 -- # net_devs=() 00:24:46.387 10:10:51 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:46.387 10:10:51 -- nvmf/common.sh@295 -- # e810=() 00:24:46.387 10:10:51 -- nvmf/common.sh@295 -- # local -ga e810 00:24:46.387 10:10:51 -- nvmf/common.sh@296 -- # x722=() 00:24:46.387 10:10:51 -- nvmf/common.sh@296 -- # local -ga x722 00:24:46.388 10:10:51 -- nvmf/common.sh@297 -- # mlx=() 00:24:46.388 10:10:51 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:46.388 10:10:51 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:46.388 10:10:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:46.388 10:10:51 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:46.388 10:10:51 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:46.388 10:10:51 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:46.388 10:10:51 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:46.388 10:10:51 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:46.388 10:10:51 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:46.388 10:10:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:46.388 10:10:51 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:46.388 10:10:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:46.388 10:10:51 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:46.388 10:10:51 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:46.388 10:10:51 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:46.388 10:10:51 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:46.388 10:10:51 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:46.388 10:10:51 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:46.388 10:10:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:46.388 10:10:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:46.388 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:46.388 10:10:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:46.388 10:10:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:46.388 10:10:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:46.388 10:10:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:46.388 10:10:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:46.388 10:10:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:46.388 10:10:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:46.388 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:46.388 10:10:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:46.388 10:10:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:46.388 10:10:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:46.388 10:10:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:46.388 10:10:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:46.388 10:10:51 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:46.388 10:10:51 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:46.388 10:10:51 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:46.388 10:10:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:46.388 10:10:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:46.388 10:10:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:46.388 10:10:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:46.388 10:10:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:46.388 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:46.388 10:10:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:46.388 10:10:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:46.388 10:10:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:46.388 10:10:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:46.388 10:10:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:46.388 10:10:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:46.388 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:46.388 10:10:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:46.388 10:10:51 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:46.388 10:10:51 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:46.388 10:10:51 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:46.388 10:10:51 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:46.388 10:10:51 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:46.388 10:10:51 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:46.388 10:10:51 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:46.388 10:10:51 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:46.388 10:10:51 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:46.388 10:10:51 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:46.388 10:10:51 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:46.388 10:10:51 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:46.388 10:10:51 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:46.388 10:10:51 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:46.388 10:10:51 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:46.388 10:10:51 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:46.388 10:10:51 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:46.388 10:10:51 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:46.388 10:10:52 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:46.388 10:10:52 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:46.388 10:10:52 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:46.388 10:10:52 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:46.388 10:10:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:46.388 10:10:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:46.388 10:10:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:46.388 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:46.388 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.187 ms 00:24:46.388 00:24:46.388 --- 10.0.0.2 ping statistics --- 00:24:46.388 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:46.388 rtt min/avg/max/mdev = 0.187/0.187/0.187/0.000 ms 00:24:46.388 10:10:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:46.388 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:46.388 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.225 ms 00:24:46.388 00:24:46.388 --- 10.0.0.1 ping statistics --- 00:24:46.388 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:46.388 rtt min/avg/max/mdev = 0.225/0.225/0.225/0.000 ms 00:24:46.388 10:10:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:46.388 10:10:52 -- nvmf/common.sh@410 -- # return 0 00:24:46.388 10:10:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:46.388 10:10:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:46.388 10:10:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:46.388 10:10:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:46.388 10:10:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:46.388 10:10:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:46.388 10:10:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:46.388 10:10:52 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:24:46.388 10:10:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:46.388 10:10:52 -- common/autotest_common.sh@712 -- # xtrace_disable 00:24:46.388 10:10:52 -- common/autotest_common.sh@10 -- # set +x 00:24:46.388 10:10:52 -- nvmf/common.sh@469 -- # nvmfpid=2884003 00:24:46.388 10:10:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:24:46.388 10:10:52 -- nvmf/common.sh@470 -- # waitforlisten 2884003 00:24:46.388 10:10:52 -- common/autotest_common.sh@819 -- # '[' -z 2884003 ']' 00:24:46.388 10:10:52 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:46.388 10:10:52 -- common/autotest_common.sh@824 -- # local max_retries=100 00:24:46.388 10:10:52 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:46.388 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:46.388 10:10:52 -- common/autotest_common.sh@828 -- # xtrace_disable 00:24:46.388 10:10:52 -- common/autotest_common.sh@10 -- # set +x 00:24:46.388 [2024-07-13 10:10:52.152398] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:24:46.388 [2024-07-13 10:10:52.152478] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:46.388 EAL: No free 2048 kB hugepages reported on node 1 00:24:46.647 [2024-07-13 10:10:52.221040] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:46.647 [2024-07-13 10:10:52.311236] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:46.647 [2024-07-13 10:10:52.311395] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:46.647 [2024-07-13 10:10:52.311415] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:46.647 [2024-07-13 10:10:52.311429] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:46.647 [2024-07-13 10:10:52.311516] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:46.647 [2024-07-13 10:10:52.311614] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:46.647 [2024-07-13 10:10:52.311658] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:24:46.647 [2024-07-13 10:10:52.311661] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:47.578 10:10:53 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:24:47.578 10:10:53 -- common/autotest_common.sh@852 -- # return 0 00:24:47.578 10:10:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:47.578 10:10:53 -- common/autotest_common.sh@718 -- # xtrace_disable 00:24:47.578 10:10:53 -- common/autotest_common.sh@10 -- # set +x 00:24:47.578 10:10:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:47.578 10:10:53 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:24:47.578 10:10:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:47.578 10:10:53 -- common/autotest_common.sh@10 -- # set +x 00:24:47.578 [2024-07-13 10:10:53.122478] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:47.578 10:10:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:47.578 10:10:53 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:24:47.578 10:10:53 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:24:47.578 10:10:53 -- common/autotest_common.sh@712 -- # xtrace_disable 00:24:47.578 10:10:53 -- common/autotest_common.sh@10 -- # set +x 00:24:47.578 10:10:53 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:24:47.578 10:10:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:47.578 10:10:53 -- target/shutdown.sh@28 -- # cat 00:24:47.578 10:10:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:47.578 10:10:53 -- target/shutdown.sh@28 -- # cat 00:24:47.578 10:10:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:47.578 10:10:53 -- target/shutdown.sh@28 -- # cat 00:24:47.578 10:10:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:47.578 10:10:53 -- target/shutdown.sh@28 -- # cat 00:24:47.578 10:10:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:47.578 10:10:53 -- target/shutdown.sh@28 -- # cat 00:24:47.578 10:10:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:47.578 10:10:53 -- target/shutdown.sh@28 -- # cat 00:24:47.578 10:10:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:47.578 10:10:53 -- target/shutdown.sh@28 -- # cat 00:24:47.578 10:10:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:47.578 10:10:53 -- target/shutdown.sh@28 -- # cat 00:24:47.578 10:10:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:47.578 10:10:53 -- target/shutdown.sh@28 -- # cat 00:24:47.578 10:10:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:47.578 10:10:53 -- target/shutdown.sh@28 -- # cat 00:24:47.578 10:10:53 -- target/shutdown.sh@35 -- # rpc_cmd 00:24:47.578 10:10:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:47.578 10:10:53 -- common/autotest_common.sh@10 -- # set +x 00:24:47.578 Malloc1 00:24:47.578 [2024-07-13 10:10:53.197589] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:47.578 Malloc2 00:24:47.578 Malloc3 00:24:47.578 Malloc4 00:24:47.578 Malloc5 00:24:47.836 Malloc6 00:24:47.836 Malloc7 00:24:47.836 Malloc8 00:24:47.836 Malloc9 00:24:47.836 Malloc10 00:24:47.836 10:10:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:47.836 10:10:53 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:24:47.836 10:10:53 -- common/autotest_common.sh@718 -- # xtrace_disable 00:24:47.836 10:10:53 -- common/autotest_common.sh@10 -- # set +x 00:24:47.836 10:10:53 -- target/shutdown.sh@78 -- # perfpid=2884195 00:24:47.836 10:10:53 -- target/shutdown.sh@79 -- # waitforlisten 2884195 /var/tmp/bdevperf.sock 00:24:47.836 10:10:53 -- common/autotest_common.sh@819 -- # '[' -z 2884195 ']' 00:24:47.836 10:10:53 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:24:47.836 10:10:53 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:24:47.836 10:10:53 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:24:47.836 10:10:53 -- common/autotest_common.sh@824 -- # local max_retries=100 00:24:47.836 10:10:53 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:24:47.836 10:10:53 -- nvmf/common.sh@520 -- # config=() 00:24:47.836 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:24:47.836 10:10:53 -- common/autotest_common.sh@828 -- # xtrace_disable 00:24:47.836 10:10:53 -- nvmf/common.sh@520 -- # local subsystem config 00:24:47.836 10:10:53 -- common/autotest_common.sh@10 -- # set +x 00:24:47.836 10:10:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:47.836 10:10:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:47.836 { 00:24:47.836 "params": { 00:24:47.836 "name": "Nvme$subsystem", 00:24:47.836 "trtype": "$TEST_TRANSPORT", 00:24:47.836 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:47.836 "adrfam": "ipv4", 00:24:47.836 "trsvcid": "$NVMF_PORT", 00:24:47.836 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:47.836 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:47.836 "hdgst": ${hdgst:-false}, 00:24:47.836 "ddgst": ${ddgst:-false} 00:24:47.836 }, 00:24:47.836 "method": "bdev_nvme_attach_controller" 00:24:47.836 } 00:24:47.836 EOF 00:24:47.836 )") 00:24:47.836 10:10:53 -- nvmf/common.sh@542 -- # cat 00:24:48.094 10:10:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:48.094 10:10:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:48.094 { 00:24:48.094 "params": { 00:24:48.094 "name": "Nvme$subsystem", 00:24:48.094 "trtype": "$TEST_TRANSPORT", 00:24:48.094 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:48.094 "adrfam": "ipv4", 00:24:48.094 "trsvcid": "$NVMF_PORT", 00:24:48.094 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:48.094 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:48.094 "hdgst": ${hdgst:-false}, 00:24:48.094 "ddgst": ${ddgst:-false} 00:24:48.094 }, 00:24:48.094 "method": "bdev_nvme_attach_controller" 00:24:48.094 } 00:24:48.094 EOF 00:24:48.094 )") 00:24:48.094 10:10:53 -- nvmf/common.sh@542 -- # cat 00:24:48.094 10:10:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:48.094 10:10:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:48.094 { 00:24:48.094 "params": { 00:24:48.094 "name": "Nvme$subsystem", 00:24:48.094 "trtype": "$TEST_TRANSPORT", 00:24:48.094 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:48.094 "adrfam": "ipv4", 00:24:48.094 "trsvcid": "$NVMF_PORT", 00:24:48.094 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:48.094 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:48.094 "hdgst": ${hdgst:-false}, 00:24:48.094 "ddgst": ${ddgst:-false} 00:24:48.094 }, 00:24:48.094 "method": "bdev_nvme_attach_controller" 00:24:48.094 } 00:24:48.094 EOF 00:24:48.094 )") 00:24:48.094 10:10:53 -- nvmf/common.sh@542 -- # cat 00:24:48.094 10:10:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:48.094 10:10:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:48.094 { 00:24:48.094 "params": { 00:24:48.094 "name": "Nvme$subsystem", 00:24:48.094 "trtype": "$TEST_TRANSPORT", 00:24:48.094 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:48.094 "adrfam": "ipv4", 00:24:48.094 "trsvcid": "$NVMF_PORT", 00:24:48.094 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:48.094 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:48.094 "hdgst": ${hdgst:-false}, 00:24:48.094 "ddgst": ${ddgst:-false} 00:24:48.094 }, 00:24:48.094 "method": "bdev_nvme_attach_controller" 00:24:48.094 } 00:24:48.094 EOF 00:24:48.094 )") 00:24:48.094 10:10:53 -- nvmf/common.sh@542 -- # cat 00:24:48.094 10:10:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:48.094 10:10:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:48.094 { 00:24:48.094 "params": { 00:24:48.094 "name": "Nvme$subsystem", 00:24:48.094 "trtype": "$TEST_TRANSPORT", 00:24:48.094 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:48.094 "adrfam": "ipv4", 00:24:48.094 "trsvcid": "$NVMF_PORT", 00:24:48.094 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:48.094 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:48.094 "hdgst": ${hdgst:-false}, 00:24:48.094 "ddgst": ${ddgst:-false} 00:24:48.094 }, 00:24:48.094 "method": "bdev_nvme_attach_controller" 00:24:48.094 } 00:24:48.094 EOF 00:24:48.094 )") 00:24:48.094 10:10:53 -- nvmf/common.sh@542 -- # cat 00:24:48.094 10:10:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:48.094 10:10:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:48.094 { 00:24:48.094 "params": { 00:24:48.094 "name": "Nvme$subsystem", 00:24:48.094 "trtype": "$TEST_TRANSPORT", 00:24:48.094 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:48.094 "adrfam": "ipv4", 00:24:48.094 "trsvcid": "$NVMF_PORT", 00:24:48.094 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:48.094 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:48.094 "hdgst": ${hdgst:-false}, 00:24:48.094 "ddgst": ${ddgst:-false} 00:24:48.094 }, 00:24:48.094 "method": "bdev_nvme_attach_controller" 00:24:48.094 } 00:24:48.094 EOF 00:24:48.094 )") 00:24:48.094 10:10:53 -- nvmf/common.sh@542 -- # cat 00:24:48.094 10:10:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:48.094 10:10:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:48.094 { 00:24:48.094 "params": { 00:24:48.094 "name": "Nvme$subsystem", 00:24:48.094 "trtype": "$TEST_TRANSPORT", 00:24:48.094 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:48.094 "adrfam": "ipv4", 00:24:48.094 "trsvcid": "$NVMF_PORT", 00:24:48.094 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:48.094 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:48.094 "hdgst": ${hdgst:-false}, 00:24:48.094 "ddgst": ${ddgst:-false} 00:24:48.094 }, 00:24:48.094 "method": "bdev_nvme_attach_controller" 00:24:48.094 } 00:24:48.094 EOF 00:24:48.094 )") 00:24:48.094 10:10:53 -- nvmf/common.sh@542 -- # cat 00:24:48.094 10:10:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:48.094 10:10:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:48.094 { 00:24:48.094 "params": { 00:24:48.094 "name": "Nvme$subsystem", 00:24:48.094 "trtype": "$TEST_TRANSPORT", 00:24:48.094 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:48.094 "adrfam": "ipv4", 00:24:48.094 "trsvcid": "$NVMF_PORT", 00:24:48.094 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:48.094 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:48.094 "hdgst": ${hdgst:-false}, 00:24:48.094 "ddgst": ${ddgst:-false} 00:24:48.094 }, 00:24:48.094 "method": "bdev_nvme_attach_controller" 00:24:48.094 } 00:24:48.094 EOF 00:24:48.094 )") 00:24:48.094 10:10:53 -- nvmf/common.sh@542 -- # cat 00:24:48.094 10:10:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:48.094 10:10:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:48.094 { 00:24:48.094 "params": { 00:24:48.094 "name": "Nvme$subsystem", 00:24:48.094 "trtype": "$TEST_TRANSPORT", 00:24:48.095 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:48.095 "adrfam": "ipv4", 00:24:48.095 "trsvcid": "$NVMF_PORT", 00:24:48.095 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:48.095 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:48.095 "hdgst": ${hdgst:-false}, 00:24:48.095 "ddgst": ${ddgst:-false} 00:24:48.095 }, 00:24:48.095 "method": "bdev_nvme_attach_controller" 00:24:48.095 } 00:24:48.095 EOF 00:24:48.095 )") 00:24:48.095 10:10:53 -- nvmf/common.sh@542 -- # cat 00:24:48.095 10:10:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:48.095 10:10:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:48.095 { 00:24:48.095 "params": { 00:24:48.095 "name": "Nvme$subsystem", 00:24:48.095 "trtype": "$TEST_TRANSPORT", 00:24:48.095 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:48.095 "adrfam": "ipv4", 00:24:48.095 "trsvcid": "$NVMF_PORT", 00:24:48.095 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:48.095 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:48.095 "hdgst": ${hdgst:-false}, 00:24:48.095 "ddgst": ${ddgst:-false} 00:24:48.095 }, 00:24:48.095 "method": "bdev_nvme_attach_controller" 00:24:48.095 } 00:24:48.095 EOF 00:24:48.095 )") 00:24:48.095 10:10:53 -- nvmf/common.sh@542 -- # cat 00:24:48.095 10:10:53 -- nvmf/common.sh@544 -- # jq . 00:24:48.095 10:10:53 -- nvmf/common.sh@545 -- # IFS=, 00:24:48.095 10:10:53 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:24:48.095 "params": { 00:24:48.095 "name": "Nvme1", 00:24:48.095 "trtype": "tcp", 00:24:48.095 "traddr": "10.0.0.2", 00:24:48.095 "adrfam": "ipv4", 00:24:48.095 "trsvcid": "4420", 00:24:48.095 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:24:48.095 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:24:48.095 "hdgst": false, 00:24:48.095 "ddgst": false 00:24:48.095 }, 00:24:48.095 "method": "bdev_nvme_attach_controller" 00:24:48.095 },{ 00:24:48.095 "params": { 00:24:48.095 "name": "Nvme2", 00:24:48.095 "trtype": "tcp", 00:24:48.095 "traddr": "10.0.0.2", 00:24:48.095 "adrfam": "ipv4", 00:24:48.095 "trsvcid": "4420", 00:24:48.095 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:24:48.095 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:24:48.095 "hdgst": false, 00:24:48.095 "ddgst": false 00:24:48.095 }, 00:24:48.095 "method": "bdev_nvme_attach_controller" 00:24:48.095 },{ 00:24:48.095 "params": { 00:24:48.095 "name": "Nvme3", 00:24:48.095 "trtype": "tcp", 00:24:48.095 "traddr": "10.0.0.2", 00:24:48.095 "adrfam": "ipv4", 00:24:48.095 "trsvcid": "4420", 00:24:48.095 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:24:48.095 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:24:48.095 "hdgst": false, 00:24:48.095 "ddgst": false 00:24:48.095 }, 00:24:48.095 "method": "bdev_nvme_attach_controller" 00:24:48.095 },{ 00:24:48.095 "params": { 00:24:48.095 "name": "Nvme4", 00:24:48.095 "trtype": "tcp", 00:24:48.095 "traddr": "10.0.0.2", 00:24:48.095 "adrfam": "ipv4", 00:24:48.095 "trsvcid": "4420", 00:24:48.095 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:24:48.095 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:24:48.095 "hdgst": false, 00:24:48.095 "ddgst": false 00:24:48.095 }, 00:24:48.095 "method": "bdev_nvme_attach_controller" 00:24:48.095 },{ 00:24:48.095 "params": { 00:24:48.095 "name": "Nvme5", 00:24:48.095 "trtype": "tcp", 00:24:48.095 "traddr": "10.0.0.2", 00:24:48.095 "adrfam": "ipv4", 00:24:48.095 "trsvcid": "4420", 00:24:48.095 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:24:48.095 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:24:48.095 "hdgst": false, 00:24:48.095 "ddgst": false 00:24:48.095 }, 00:24:48.095 "method": "bdev_nvme_attach_controller" 00:24:48.095 },{ 00:24:48.095 "params": { 00:24:48.095 "name": "Nvme6", 00:24:48.095 "trtype": "tcp", 00:24:48.095 "traddr": "10.0.0.2", 00:24:48.095 "adrfam": "ipv4", 00:24:48.095 "trsvcid": "4420", 00:24:48.095 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:24:48.095 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:24:48.095 "hdgst": false, 00:24:48.095 "ddgst": false 00:24:48.095 }, 00:24:48.095 "method": "bdev_nvme_attach_controller" 00:24:48.095 },{ 00:24:48.095 "params": { 00:24:48.095 "name": "Nvme7", 00:24:48.095 "trtype": "tcp", 00:24:48.095 "traddr": "10.0.0.2", 00:24:48.095 "adrfam": "ipv4", 00:24:48.095 "trsvcid": "4420", 00:24:48.095 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:24:48.095 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:24:48.095 "hdgst": false, 00:24:48.095 "ddgst": false 00:24:48.095 }, 00:24:48.095 "method": "bdev_nvme_attach_controller" 00:24:48.095 },{ 00:24:48.095 "params": { 00:24:48.095 "name": "Nvme8", 00:24:48.095 "trtype": "tcp", 00:24:48.095 "traddr": "10.0.0.2", 00:24:48.095 "adrfam": "ipv4", 00:24:48.095 "trsvcid": "4420", 00:24:48.095 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:24:48.095 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:24:48.095 "hdgst": false, 00:24:48.095 "ddgst": false 00:24:48.095 }, 00:24:48.095 "method": "bdev_nvme_attach_controller" 00:24:48.095 },{ 00:24:48.095 "params": { 00:24:48.095 "name": "Nvme9", 00:24:48.095 "trtype": "tcp", 00:24:48.095 "traddr": "10.0.0.2", 00:24:48.095 "adrfam": "ipv4", 00:24:48.095 "trsvcid": "4420", 00:24:48.095 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:24:48.095 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:24:48.095 "hdgst": false, 00:24:48.095 "ddgst": false 00:24:48.095 }, 00:24:48.095 "method": "bdev_nvme_attach_controller" 00:24:48.095 },{ 00:24:48.095 "params": { 00:24:48.095 "name": "Nvme10", 00:24:48.095 "trtype": "tcp", 00:24:48.095 "traddr": "10.0.0.2", 00:24:48.095 "adrfam": "ipv4", 00:24:48.095 "trsvcid": "4420", 00:24:48.095 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:24:48.095 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:24:48.095 "hdgst": false, 00:24:48.095 "ddgst": false 00:24:48.095 }, 00:24:48.095 "method": "bdev_nvme_attach_controller" 00:24:48.095 }' 00:24:48.095 [2024-07-13 10:10:53.688632] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:24:48.095 [2024-07-13 10:10:53.688726] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:24:48.095 EAL: No free 2048 kB hugepages reported on node 1 00:24:48.095 [2024-07-13 10:10:53.754843] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:48.095 [2024-07-13 10:10:53.840933] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:49.992 10:10:55 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:24:49.992 10:10:55 -- common/autotest_common.sh@852 -- # return 0 00:24:49.992 10:10:55 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:24:49.992 10:10:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:49.992 10:10:55 -- common/autotest_common.sh@10 -- # set +x 00:24:49.992 10:10:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:49.992 10:10:55 -- target/shutdown.sh@83 -- # kill -9 2884195 00:24:49.992 10:10:55 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:24:49.992 10:10:55 -- target/shutdown.sh@87 -- # sleep 1 00:24:50.926 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 2884195 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:24:50.926 10:10:56 -- target/shutdown.sh@88 -- # kill -0 2884003 00:24:50.926 10:10:56 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:24:50.926 10:10:56 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:24:50.926 10:10:56 -- nvmf/common.sh@520 -- # config=() 00:24:50.926 10:10:56 -- nvmf/common.sh@520 -- # local subsystem config 00:24:50.926 10:10:56 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:50.926 10:10:56 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:50.926 { 00:24:50.926 "params": { 00:24:50.926 "name": "Nvme$subsystem", 00:24:50.926 "trtype": "$TEST_TRANSPORT", 00:24:50.926 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:50.926 "adrfam": "ipv4", 00:24:50.926 "trsvcid": "$NVMF_PORT", 00:24:50.926 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:50.926 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:50.926 "hdgst": ${hdgst:-false}, 00:24:50.926 "ddgst": ${ddgst:-false} 00:24:50.926 }, 00:24:50.926 "method": "bdev_nvme_attach_controller" 00:24:50.926 } 00:24:50.926 EOF 00:24:50.926 )") 00:24:50.926 10:10:56 -- nvmf/common.sh@542 -- # cat 00:24:50.926 10:10:56 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:50.926 10:10:56 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:50.926 { 00:24:50.926 "params": { 00:24:50.926 "name": "Nvme$subsystem", 00:24:50.926 "trtype": "$TEST_TRANSPORT", 00:24:50.926 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:50.926 "adrfam": "ipv4", 00:24:50.926 "trsvcid": "$NVMF_PORT", 00:24:50.926 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:50.926 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:50.926 "hdgst": ${hdgst:-false}, 00:24:50.926 "ddgst": ${ddgst:-false} 00:24:50.926 }, 00:24:50.926 "method": "bdev_nvme_attach_controller" 00:24:50.926 } 00:24:50.926 EOF 00:24:50.926 )") 00:24:50.926 10:10:56 -- nvmf/common.sh@542 -- # cat 00:24:50.926 10:10:56 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:50.926 10:10:56 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:50.926 { 00:24:50.926 "params": { 00:24:50.926 "name": "Nvme$subsystem", 00:24:50.926 "trtype": "$TEST_TRANSPORT", 00:24:50.926 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:50.926 "adrfam": "ipv4", 00:24:50.926 "trsvcid": "$NVMF_PORT", 00:24:50.926 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:50.926 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:50.926 "hdgst": ${hdgst:-false}, 00:24:50.926 "ddgst": ${ddgst:-false} 00:24:50.926 }, 00:24:50.926 "method": "bdev_nvme_attach_controller" 00:24:50.926 } 00:24:50.926 EOF 00:24:50.926 )") 00:24:50.926 10:10:56 -- nvmf/common.sh@542 -- # cat 00:24:50.926 10:10:56 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:50.926 10:10:56 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:50.926 { 00:24:50.926 "params": { 00:24:50.926 "name": "Nvme$subsystem", 00:24:50.926 "trtype": "$TEST_TRANSPORT", 00:24:50.926 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:50.926 "adrfam": "ipv4", 00:24:50.926 "trsvcid": "$NVMF_PORT", 00:24:50.926 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:50.927 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:50.927 "hdgst": ${hdgst:-false}, 00:24:50.927 "ddgst": ${ddgst:-false} 00:24:50.927 }, 00:24:50.927 "method": "bdev_nvme_attach_controller" 00:24:50.927 } 00:24:50.927 EOF 00:24:50.927 )") 00:24:50.927 10:10:56 -- nvmf/common.sh@542 -- # cat 00:24:50.927 10:10:56 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:50.927 10:10:56 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:50.927 { 00:24:50.927 "params": { 00:24:50.927 "name": "Nvme$subsystem", 00:24:50.927 "trtype": "$TEST_TRANSPORT", 00:24:50.927 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:50.927 "adrfam": "ipv4", 00:24:50.927 "trsvcid": "$NVMF_PORT", 00:24:50.927 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:50.927 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:50.927 "hdgst": ${hdgst:-false}, 00:24:50.927 "ddgst": ${ddgst:-false} 00:24:50.927 }, 00:24:50.927 "method": "bdev_nvme_attach_controller" 00:24:50.927 } 00:24:50.927 EOF 00:24:50.927 )") 00:24:50.927 10:10:56 -- nvmf/common.sh@542 -- # cat 00:24:50.927 10:10:56 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:50.927 10:10:56 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:50.927 { 00:24:50.927 "params": { 00:24:50.927 "name": "Nvme$subsystem", 00:24:50.927 "trtype": "$TEST_TRANSPORT", 00:24:50.927 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:50.927 "adrfam": "ipv4", 00:24:50.927 "trsvcid": "$NVMF_PORT", 00:24:50.927 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:50.927 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:50.927 "hdgst": ${hdgst:-false}, 00:24:50.927 "ddgst": ${ddgst:-false} 00:24:50.927 }, 00:24:50.927 "method": "bdev_nvme_attach_controller" 00:24:50.927 } 00:24:50.927 EOF 00:24:50.927 )") 00:24:50.927 10:10:56 -- nvmf/common.sh@542 -- # cat 00:24:50.927 10:10:56 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:50.927 10:10:56 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:50.927 { 00:24:50.927 "params": { 00:24:50.927 "name": "Nvme$subsystem", 00:24:50.927 "trtype": "$TEST_TRANSPORT", 00:24:50.927 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:50.927 "adrfam": "ipv4", 00:24:50.927 "trsvcid": "$NVMF_PORT", 00:24:50.927 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:50.927 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:50.927 "hdgst": ${hdgst:-false}, 00:24:50.927 "ddgst": ${ddgst:-false} 00:24:50.927 }, 00:24:50.927 "method": "bdev_nvme_attach_controller" 00:24:50.927 } 00:24:50.927 EOF 00:24:50.927 )") 00:24:50.927 10:10:56 -- nvmf/common.sh@542 -- # cat 00:24:50.927 10:10:56 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:50.927 10:10:56 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:50.927 { 00:24:50.927 "params": { 00:24:50.927 "name": "Nvme$subsystem", 00:24:50.927 "trtype": "$TEST_TRANSPORT", 00:24:50.927 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:50.927 "adrfam": "ipv4", 00:24:50.927 "trsvcid": "$NVMF_PORT", 00:24:50.927 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:50.927 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:50.927 "hdgst": ${hdgst:-false}, 00:24:50.927 "ddgst": ${ddgst:-false} 00:24:50.927 }, 00:24:50.927 "method": "bdev_nvme_attach_controller" 00:24:50.927 } 00:24:50.927 EOF 00:24:50.927 )") 00:24:50.927 10:10:56 -- nvmf/common.sh@542 -- # cat 00:24:50.927 10:10:56 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:50.927 10:10:56 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:50.927 { 00:24:50.927 "params": { 00:24:50.927 "name": "Nvme$subsystem", 00:24:50.927 "trtype": "$TEST_TRANSPORT", 00:24:50.927 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:50.927 "adrfam": "ipv4", 00:24:50.927 "trsvcid": "$NVMF_PORT", 00:24:50.927 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:50.927 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:50.927 "hdgst": ${hdgst:-false}, 00:24:50.927 "ddgst": ${ddgst:-false} 00:24:50.927 }, 00:24:50.927 "method": "bdev_nvme_attach_controller" 00:24:50.927 } 00:24:50.927 EOF 00:24:50.927 )") 00:24:50.927 10:10:56 -- nvmf/common.sh@542 -- # cat 00:24:50.927 10:10:56 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:50.927 10:10:56 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:50.927 { 00:24:50.927 "params": { 00:24:50.927 "name": "Nvme$subsystem", 00:24:50.927 "trtype": "$TEST_TRANSPORT", 00:24:50.927 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:50.927 "adrfam": "ipv4", 00:24:50.927 "trsvcid": "$NVMF_PORT", 00:24:50.927 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:50.927 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:50.927 "hdgst": ${hdgst:-false}, 00:24:50.927 "ddgst": ${ddgst:-false} 00:24:50.927 }, 00:24:50.927 "method": "bdev_nvme_attach_controller" 00:24:50.927 } 00:24:50.927 EOF 00:24:50.927 )") 00:24:50.927 10:10:56 -- nvmf/common.sh@542 -- # cat 00:24:50.927 10:10:56 -- nvmf/common.sh@544 -- # jq . 00:24:50.927 10:10:56 -- nvmf/common.sh@545 -- # IFS=, 00:24:50.927 10:10:56 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:24:50.927 "params": { 00:24:50.927 "name": "Nvme1", 00:24:50.927 "trtype": "tcp", 00:24:50.927 "traddr": "10.0.0.2", 00:24:50.927 "adrfam": "ipv4", 00:24:50.927 "trsvcid": "4420", 00:24:50.927 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:24:50.927 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:24:50.927 "hdgst": false, 00:24:50.927 "ddgst": false 00:24:50.927 }, 00:24:50.927 "method": "bdev_nvme_attach_controller" 00:24:50.927 },{ 00:24:50.927 "params": { 00:24:50.927 "name": "Nvme2", 00:24:50.927 "trtype": "tcp", 00:24:50.927 "traddr": "10.0.0.2", 00:24:50.927 "adrfam": "ipv4", 00:24:50.927 "trsvcid": "4420", 00:24:50.927 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:24:50.927 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:24:50.927 "hdgst": false, 00:24:50.927 "ddgst": false 00:24:50.927 }, 00:24:50.927 "method": "bdev_nvme_attach_controller" 00:24:50.927 },{ 00:24:50.927 "params": { 00:24:50.927 "name": "Nvme3", 00:24:50.927 "trtype": "tcp", 00:24:50.927 "traddr": "10.0.0.2", 00:24:50.927 "adrfam": "ipv4", 00:24:50.927 "trsvcid": "4420", 00:24:50.927 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:24:50.927 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:24:50.927 "hdgst": false, 00:24:50.927 "ddgst": false 00:24:50.927 }, 00:24:50.927 "method": "bdev_nvme_attach_controller" 00:24:50.927 },{ 00:24:50.927 "params": { 00:24:50.927 "name": "Nvme4", 00:24:50.927 "trtype": "tcp", 00:24:50.927 "traddr": "10.0.0.2", 00:24:50.927 "adrfam": "ipv4", 00:24:50.927 "trsvcid": "4420", 00:24:50.927 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:24:50.927 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:24:50.927 "hdgst": false, 00:24:50.927 "ddgst": false 00:24:50.927 }, 00:24:50.927 "method": "bdev_nvme_attach_controller" 00:24:50.927 },{ 00:24:50.927 "params": { 00:24:50.927 "name": "Nvme5", 00:24:50.927 "trtype": "tcp", 00:24:50.927 "traddr": "10.0.0.2", 00:24:50.927 "adrfam": "ipv4", 00:24:50.927 "trsvcid": "4420", 00:24:50.927 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:24:50.927 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:24:50.927 "hdgst": false, 00:24:50.927 "ddgst": false 00:24:50.927 }, 00:24:50.927 "method": "bdev_nvme_attach_controller" 00:24:50.927 },{ 00:24:50.927 "params": { 00:24:50.927 "name": "Nvme6", 00:24:50.927 "trtype": "tcp", 00:24:50.927 "traddr": "10.0.0.2", 00:24:50.927 "adrfam": "ipv4", 00:24:50.927 "trsvcid": "4420", 00:24:50.927 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:24:50.927 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:24:50.927 "hdgst": false, 00:24:50.927 "ddgst": false 00:24:50.927 }, 00:24:50.927 "method": "bdev_nvme_attach_controller" 00:24:50.927 },{ 00:24:50.927 "params": { 00:24:50.927 "name": "Nvme7", 00:24:50.927 "trtype": "tcp", 00:24:50.927 "traddr": "10.0.0.2", 00:24:50.927 "adrfam": "ipv4", 00:24:50.927 "trsvcid": "4420", 00:24:50.927 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:24:50.927 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:24:50.927 "hdgst": false, 00:24:50.927 "ddgst": false 00:24:50.927 }, 00:24:50.927 "method": "bdev_nvme_attach_controller" 00:24:50.927 },{ 00:24:50.927 "params": { 00:24:50.927 "name": "Nvme8", 00:24:50.927 "trtype": "tcp", 00:24:50.927 "traddr": "10.0.0.2", 00:24:50.927 "adrfam": "ipv4", 00:24:50.927 "trsvcid": "4420", 00:24:50.927 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:24:50.927 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:24:50.927 "hdgst": false, 00:24:50.927 "ddgst": false 00:24:50.927 }, 00:24:50.927 "method": "bdev_nvme_attach_controller" 00:24:50.927 },{ 00:24:50.927 "params": { 00:24:50.927 "name": "Nvme9", 00:24:50.927 "trtype": "tcp", 00:24:50.927 "traddr": "10.0.0.2", 00:24:50.927 "adrfam": "ipv4", 00:24:50.927 "trsvcid": "4420", 00:24:50.927 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:24:50.927 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:24:50.927 "hdgst": false, 00:24:50.927 "ddgst": false 00:24:50.927 }, 00:24:50.927 "method": "bdev_nvme_attach_controller" 00:24:50.927 },{ 00:24:50.927 "params": { 00:24:50.927 "name": "Nvme10", 00:24:50.927 "trtype": "tcp", 00:24:50.927 "traddr": "10.0.0.2", 00:24:50.927 "adrfam": "ipv4", 00:24:50.927 "trsvcid": "4420", 00:24:50.927 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:24:50.927 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:24:50.927 "hdgst": false, 00:24:50.927 "ddgst": false 00:24:50.927 }, 00:24:50.928 "method": "bdev_nvme_attach_controller" 00:24:50.928 }' 00:24:50.928 [2024-07-13 10:10:56.447973] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:24:50.928 [2024-07-13 10:10:56.448053] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2884627 ] 00:24:50.928 EAL: No free 2048 kB hugepages reported on node 1 00:24:50.928 [2024-07-13 10:10:56.512252] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:50.928 [2024-07-13 10:10:56.596893] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:52.302 Running I/O for 1 seconds... 00:24:53.675 00:24:53.675 Latency(us) 00:24:53.675 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:24:53.675 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:53.675 Verification LBA range: start 0x0 length 0x400 00:24:53.675 Nvme1n1 : 1.10 394.45 24.65 0.00 0.00 159228.54 20194.80 124275.67 00:24:53.675 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:53.675 Verification LBA range: start 0x0 length 0x400 00:24:53.675 Nvme2n1 : 1.10 393.32 24.58 0.00 0.00 158531.68 20583.16 121168.78 00:24:53.675 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:53.675 Verification LBA range: start 0x0 length 0x400 00:24:53.675 Nvme3n1 : 1.11 391.74 24.48 0.00 0.00 158035.72 20194.80 119615.34 00:24:53.675 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:53.675 Verification LBA range: start 0x0 length 0x400 00:24:53.675 Nvme4n1 : 1.11 390.80 24.42 0.00 0.00 157451.83 20097.71 135926.52 00:24:53.675 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:53.675 Verification LBA range: start 0x0 length 0x400 00:24:53.675 Nvme5n1 : 1.11 389.92 24.37 0.00 0.00 156910.68 18252.99 120392.06 00:24:53.675 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:53.675 Verification LBA range: start 0x0 length 0x400 00:24:53.675 Nvme6n1 : 1.12 388.75 24.30 0.00 0.00 155696.91 4903.06 124275.67 00:24:53.675 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:53.675 Verification LBA range: start 0x0 length 0x400 00:24:53.675 Nvme7n1 : 1.09 366.77 22.92 0.00 0.00 163053.28 37476.88 127382.57 00:24:53.675 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:53.675 Verification LBA range: start 0x0 length 0x400 00:24:53.675 Nvme8n1 : 1.12 386.69 24.17 0.00 0.00 156214.77 7330.32 128936.01 00:24:53.675 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:53.675 Verification LBA range: start 0x0 length 0x400 00:24:53.675 Nvme9n1 : 1.17 372.27 23.27 0.00 0.00 155967.51 5776.88 129712.73 00:24:53.675 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:53.675 Verification LBA range: start 0x0 length 0x400 00:24:53.675 Nvme10n1 : 1.10 361.09 22.57 0.00 0.00 162661.50 32428.18 132042.90 00:24:53.675 =================================================================================================================== 00:24:53.675 Total : 3835.81 239.74 0.00 0.00 158299.63 4903.06 135926.52 00:24:53.675 10:10:59 -- target/shutdown.sh@93 -- # stoptarget 00:24:53.675 10:10:59 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:24:53.675 10:10:59 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:24:53.675 10:10:59 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:24:53.675 10:10:59 -- target/shutdown.sh@45 -- # nvmftestfini 00:24:53.675 10:10:59 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:53.675 10:10:59 -- nvmf/common.sh@116 -- # sync 00:24:53.675 10:10:59 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:53.675 10:10:59 -- nvmf/common.sh@119 -- # set +e 00:24:53.675 10:10:59 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:53.675 10:10:59 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:53.675 rmmod nvme_tcp 00:24:53.675 rmmod nvme_fabrics 00:24:53.675 rmmod nvme_keyring 00:24:53.675 10:10:59 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:53.675 10:10:59 -- nvmf/common.sh@123 -- # set -e 00:24:53.675 10:10:59 -- nvmf/common.sh@124 -- # return 0 00:24:53.675 10:10:59 -- nvmf/common.sh@477 -- # '[' -n 2884003 ']' 00:24:53.675 10:10:59 -- nvmf/common.sh@478 -- # killprocess 2884003 00:24:53.675 10:10:59 -- common/autotest_common.sh@926 -- # '[' -z 2884003 ']' 00:24:53.675 10:10:59 -- common/autotest_common.sh@930 -- # kill -0 2884003 00:24:53.931 10:10:59 -- common/autotest_common.sh@931 -- # uname 00:24:53.931 10:10:59 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:24:53.931 10:10:59 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2884003 00:24:53.931 10:10:59 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:24:53.931 10:10:59 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:24:53.931 10:10:59 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2884003' 00:24:53.931 killing process with pid 2884003 00:24:53.931 10:10:59 -- common/autotest_common.sh@945 -- # kill 2884003 00:24:53.931 10:10:59 -- common/autotest_common.sh@950 -- # wait 2884003 00:24:54.496 10:11:00 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:54.496 10:11:00 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:54.496 10:11:00 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:54.496 10:11:00 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:54.496 10:11:00 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:54.496 10:11:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:54.496 10:11:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:54.496 10:11:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:56.395 10:11:02 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:56.395 00:24:56.395 real 0m12.001s 00:24:56.395 user 0m35.376s 00:24:56.395 sys 0m3.160s 00:24:56.395 10:11:02 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:24:56.395 10:11:02 -- common/autotest_common.sh@10 -- # set +x 00:24:56.395 ************************************ 00:24:56.395 END TEST nvmf_shutdown_tc1 00:24:56.395 ************************************ 00:24:56.395 10:11:02 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:24:56.395 10:11:02 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:24:56.395 10:11:02 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:24:56.395 10:11:02 -- common/autotest_common.sh@10 -- # set +x 00:24:56.395 ************************************ 00:24:56.395 START TEST nvmf_shutdown_tc2 00:24:56.395 ************************************ 00:24:56.395 10:11:02 -- common/autotest_common.sh@1104 -- # nvmf_shutdown_tc2 00:24:56.395 10:11:02 -- target/shutdown.sh@98 -- # starttarget 00:24:56.395 10:11:02 -- target/shutdown.sh@15 -- # nvmftestinit 00:24:56.395 10:11:02 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:56.395 10:11:02 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:56.395 10:11:02 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:56.395 10:11:02 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:56.395 10:11:02 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:56.395 10:11:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:56.395 10:11:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:56.395 10:11:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:56.395 10:11:02 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:56.395 10:11:02 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:56.395 10:11:02 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:56.395 10:11:02 -- common/autotest_common.sh@10 -- # set +x 00:24:56.395 10:11:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:56.395 10:11:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:56.395 10:11:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:56.395 10:11:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:56.395 10:11:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:56.395 10:11:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:56.395 10:11:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:56.395 10:11:02 -- nvmf/common.sh@294 -- # net_devs=() 00:24:56.395 10:11:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:56.395 10:11:02 -- nvmf/common.sh@295 -- # e810=() 00:24:56.395 10:11:02 -- nvmf/common.sh@295 -- # local -ga e810 00:24:56.395 10:11:02 -- nvmf/common.sh@296 -- # x722=() 00:24:56.395 10:11:02 -- nvmf/common.sh@296 -- # local -ga x722 00:24:56.395 10:11:02 -- nvmf/common.sh@297 -- # mlx=() 00:24:56.395 10:11:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:56.395 10:11:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:56.395 10:11:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:56.395 10:11:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:56.395 10:11:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:56.395 10:11:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:56.395 10:11:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:56.395 10:11:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:56.395 10:11:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:56.396 10:11:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:56.396 10:11:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:56.396 10:11:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:56.396 10:11:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:56.396 10:11:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:56.396 10:11:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:56.396 10:11:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:56.396 10:11:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:56.396 10:11:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:56.396 10:11:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:56.396 10:11:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:56.396 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:56.396 10:11:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:56.396 10:11:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:56.396 10:11:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:56.396 10:11:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:56.396 10:11:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:56.396 10:11:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:56.396 10:11:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:56.396 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:56.396 10:11:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:56.396 10:11:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:56.396 10:11:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:56.396 10:11:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:56.396 10:11:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:56.396 10:11:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:56.396 10:11:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:56.396 10:11:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:56.396 10:11:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:56.396 10:11:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:56.396 10:11:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:56.396 10:11:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:56.396 10:11:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:56.396 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:56.396 10:11:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:56.396 10:11:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:56.396 10:11:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:56.396 10:11:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:56.396 10:11:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:56.396 10:11:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:56.396 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:56.396 10:11:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:56.396 10:11:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:56.396 10:11:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:56.396 10:11:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:56.396 10:11:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:56.396 10:11:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:56.396 10:11:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:56.396 10:11:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:56.396 10:11:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:56.396 10:11:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:56.396 10:11:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:56.396 10:11:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:56.396 10:11:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:56.396 10:11:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:56.396 10:11:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:56.396 10:11:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:56.396 10:11:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:56.396 10:11:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:56.396 10:11:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:56.396 10:11:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:56.396 10:11:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:56.396 10:11:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:56.396 10:11:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:56.654 10:11:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:56.654 10:11:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:56.654 10:11:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:56.654 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:56.654 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.198 ms 00:24:56.654 00:24:56.654 --- 10.0.0.2 ping statistics --- 00:24:56.654 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:56.654 rtt min/avg/max/mdev = 0.198/0.198/0.198/0.000 ms 00:24:56.654 10:11:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:56.654 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:56.654 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.187 ms 00:24:56.654 00:24:56.654 --- 10.0.0.1 ping statistics --- 00:24:56.654 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:56.654 rtt min/avg/max/mdev = 0.187/0.187/0.187/0.000 ms 00:24:56.654 10:11:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:56.654 10:11:02 -- nvmf/common.sh@410 -- # return 0 00:24:56.654 10:11:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:56.654 10:11:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:56.654 10:11:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:56.654 10:11:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:56.654 10:11:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:56.654 10:11:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:56.654 10:11:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:56.654 10:11:02 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:24:56.654 10:11:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:56.654 10:11:02 -- common/autotest_common.sh@712 -- # xtrace_disable 00:24:56.654 10:11:02 -- common/autotest_common.sh@10 -- # set +x 00:24:56.654 10:11:02 -- nvmf/common.sh@469 -- # nvmfpid=2885411 00:24:56.654 10:11:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:24:56.654 10:11:02 -- nvmf/common.sh@470 -- # waitforlisten 2885411 00:24:56.654 10:11:02 -- common/autotest_common.sh@819 -- # '[' -z 2885411 ']' 00:24:56.654 10:11:02 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:56.654 10:11:02 -- common/autotest_common.sh@824 -- # local max_retries=100 00:24:56.654 10:11:02 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:56.654 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:56.654 10:11:02 -- common/autotest_common.sh@828 -- # xtrace_disable 00:24:56.654 10:11:02 -- common/autotest_common.sh@10 -- # set +x 00:24:56.654 [2024-07-13 10:11:02.308303] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:24:56.654 [2024-07-13 10:11:02.308384] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:56.654 EAL: No free 2048 kB hugepages reported on node 1 00:24:56.654 [2024-07-13 10:11:02.376734] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:56.654 [2024-07-13 10:11:02.465893] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:56.654 [2024-07-13 10:11:02.466055] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:56.654 [2024-07-13 10:11:02.466074] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:56.654 [2024-07-13 10:11:02.466088] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:56.654 [2024-07-13 10:11:02.466193] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:56.654 [2024-07-13 10:11:02.466224] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:56.654 [2024-07-13 10:11:02.466265] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:24:56.654 [2024-07-13 10:11:02.466268] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:57.585 10:11:03 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:24:57.585 10:11:03 -- common/autotest_common.sh@852 -- # return 0 00:24:57.585 10:11:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:57.585 10:11:03 -- common/autotest_common.sh@718 -- # xtrace_disable 00:24:57.585 10:11:03 -- common/autotest_common.sh@10 -- # set +x 00:24:57.585 10:11:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:57.585 10:11:03 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:24:57.585 10:11:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:57.585 10:11:03 -- common/autotest_common.sh@10 -- # set +x 00:24:57.585 [2024-07-13 10:11:03.296473] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:57.585 10:11:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:57.585 10:11:03 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:24:57.585 10:11:03 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:24:57.585 10:11:03 -- common/autotest_common.sh@712 -- # xtrace_disable 00:24:57.585 10:11:03 -- common/autotest_common.sh@10 -- # set +x 00:24:57.585 10:11:03 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:24:57.585 10:11:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:57.585 10:11:03 -- target/shutdown.sh@28 -- # cat 00:24:57.585 10:11:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:57.585 10:11:03 -- target/shutdown.sh@28 -- # cat 00:24:57.585 10:11:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:57.585 10:11:03 -- target/shutdown.sh@28 -- # cat 00:24:57.585 10:11:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:57.585 10:11:03 -- target/shutdown.sh@28 -- # cat 00:24:57.585 10:11:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:57.585 10:11:03 -- target/shutdown.sh@28 -- # cat 00:24:57.585 10:11:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:57.585 10:11:03 -- target/shutdown.sh@28 -- # cat 00:24:57.585 10:11:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:57.585 10:11:03 -- target/shutdown.sh@28 -- # cat 00:24:57.585 10:11:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:57.585 10:11:03 -- target/shutdown.sh@28 -- # cat 00:24:57.585 10:11:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:57.585 10:11:03 -- target/shutdown.sh@28 -- # cat 00:24:57.585 10:11:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:57.585 10:11:03 -- target/shutdown.sh@28 -- # cat 00:24:57.585 10:11:03 -- target/shutdown.sh@35 -- # rpc_cmd 00:24:57.585 10:11:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:57.585 10:11:03 -- common/autotest_common.sh@10 -- # set +x 00:24:57.585 Malloc1 00:24:57.585 [2024-07-13 10:11:03.380044] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:57.842 Malloc2 00:24:57.842 Malloc3 00:24:57.842 Malloc4 00:24:57.842 Malloc5 00:24:57.842 Malloc6 00:24:57.842 Malloc7 00:24:58.100 Malloc8 00:24:58.100 Malloc9 00:24:58.100 Malloc10 00:24:58.100 10:11:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:58.100 10:11:03 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:24:58.100 10:11:03 -- common/autotest_common.sh@718 -- # xtrace_disable 00:24:58.100 10:11:03 -- common/autotest_common.sh@10 -- # set +x 00:24:58.100 10:11:03 -- target/shutdown.sh@102 -- # perfpid=2885605 00:24:58.100 10:11:03 -- target/shutdown.sh@103 -- # waitforlisten 2885605 /var/tmp/bdevperf.sock 00:24:58.100 10:11:03 -- common/autotest_common.sh@819 -- # '[' -z 2885605 ']' 00:24:58.100 10:11:03 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:24:58.100 10:11:03 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:24:58.100 10:11:03 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:24:58.100 10:11:03 -- common/autotest_common.sh@824 -- # local max_retries=100 00:24:58.100 10:11:03 -- nvmf/common.sh@520 -- # config=() 00:24:58.100 10:11:03 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:24:58.100 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:24:58.100 10:11:03 -- nvmf/common.sh@520 -- # local subsystem config 00:24:58.100 10:11:03 -- common/autotest_common.sh@828 -- # xtrace_disable 00:24:58.100 10:11:03 -- common/autotest_common.sh@10 -- # set +x 00:24:58.100 10:11:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:58.100 10:11:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:58.100 { 00:24:58.100 "params": { 00:24:58.100 "name": "Nvme$subsystem", 00:24:58.100 "trtype": "$TEST_TRANSPORT", 00:24:58.100 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:58.100 "adrfam": "ipv4", 00:24:58.100 "trsvcid": "$NVMF_PORT", 00:24:58.100 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:58.100 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:58.100 "hdgst": ${hdgst:-false}, 00:24:58.100 "ddgst": ${ddgst:-false} 00:24:58.100 }, 00:24:58.100 "method": "bdev_nvme_attach_controller" 00:24:58.100 } 00:24:58.100 EOF 00:24:58.100 )") 00:24:58.100 10:11:03 -- nvmf/common.sh@542 -- # cat 00:24:58.100 10:11:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:58.101 10:11:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:58.101 { 00:24:58.101 "params": { 00:24:58.101 "name": "Nvme$subsystem", 00:24:58.101 "trtype": "$TEST_TRANSPORT", 00:24:58.101 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:58.101 "adrfam": "ipv4", 00:24:58.101 "trsvcid": "$NVMF_PORT", 00:24:58.101 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:58.101 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:58.101 "hdgst": ${hdgst:-false}, 00:24:58.101 "ddgst": ${ddgst:-false} 00:24:58.101 }, 00:24:58.101 "method": "bdev_nvme_attach_controller" 00:24:58.101 } 00:24:58.101 EOF 00:24:58.101 )") 00:24:58.101 10:11:03 -- nvmf/common.sh@542 -- # cat 00:24:58.101 10:11:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:58.101 10:11:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:58.101 { 00:24:58.101 "params": { 00:24:58.101 "name": "Nvme$subsystem", 00:24:58.101 "trtype": "$TEST_TRANSPORT", 00:24:58.101 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:58.101 "adrfam": "ipv4", 00:24:58.101 "trsvcid": "$NVMF_PORT", 00:24:58.101 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:58.101 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:58.101 "hdgst": ${hdgst:-false}, 00:24:58.101 "ddgst": ${ddgst:-false} 00:24:58.101 }, 00:24:58.101 "method": "bdev_nvme_attach_controller" 00:24:58.101 } 00:24:58.101 EOF 00:24:58.101 )") 00:24:58.101 10:11:03 -- nvmf/common.sh@542 -- # cat 00:24:58.101 10:11:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:58.101 10:11:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:58.101 { 00:24:58.101 "params": { 00:24:58.101 "name": "Nvme$subsystem", 00:24:58.101 "trtype": "$TEST_TRANSPORT", 00:24:58.101 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:58.101 "adrfam": "ipv4", 00:24:58.101 "trsvcid": "$NVMF_PORT", 00:24:58.101 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:58.101 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:58.101 "hdgst": ${hdgst:-false}, 00:24:58.101 "ddgst": ${ddgst:-false} 00:24:58.101 }, 00:24:58.101 "method": "bdev_nvme_attach_controller" 00:24:58.101 } 00:24:58.101 EOF 00:24:58.101 )") 00:24:58.101 10:11:03 -- nvmf/common.sh@542 -- # cat 00:24:58.101 10:11:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:58.101 10:11:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:58.101 { 00:24:58.101 "params": { 00:24:58.101 "name": "Nvme$subsystem", 00:24:58.101 "trtype": "$TEST_TRANSPORT", 00:24:58.101 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:58.101 "adrfam": "ipv4", 00:24:58.101 "trsvcid": "$NVMF_PORT", 00:24:58.101 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:58.101 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:58.101 "hdgst": ${hdgst:-false}, 00:24:58.101 "ddgst": ${ddgst:-false} 00:24:58.101 }, 00:24:58.101 "method": "bdev_nvme_attach_controller" 00:24:58.101 } 00:24:58.101 EOF 00:24:58.101 )") 00:24:58.101 10:11:03 -- nvmf/common.sh@542 -- # cat 00:24:58.101 10:11:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:58.101 10:11:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:58.101 { 00:24:58.101 "params": { 00:24:58.101 "name": "Nvme$subsystem", 00:24:58.101 "trtype": "$TEST_TRANSPORT", 00:24:58.101 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:58.101 "adrfam": "ipv4", 00:24:58.101 "trsvcid": "$NVMF_PORT", 00:24:58.101 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:58.101 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:58.101 "hdgst": ${hdgst:-false}, 00:24:58.101 "ddgst": ${ddgst:-false} 00:24:58.101 }, 00:24:58.101 "method": "bdev_nvme_attach_controller" 00:24:58.101 } 00:24:58.101 EOF 00:24:58.101 )") 00:24:58.101 10:11:03 -- nvmf/common.sh@542 -- # cat 00:24:58.101 10:11:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:58.101 10:11:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:58.101 { 00:24:58.101 "params": { 00:24:58.101 "name": "Nvme$subsystem", 00:24:58.101 "trtype": "$TEST_TRANSPORT", 00:24:58.101 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:58.101 "adrfam": "ipv4", 00:24:58.101 "trsvcid": "$NVMF_PORT", 00:24:58.101 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:58.101 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:58.101 "hdgst": ${hdgst:-false}, 00:24:58.101 "ddgst": ${ddgst:-false} 00:24:58.101 }, 00:24:58.101 "method": "bdev_nvme_attach_controller" 00:24:58.101 } 00:24:58.101 EOF 00:24:58.101 )") 00:24:58.101 10:11:03 -- nvmf/common.sh@542 -- # cat 00:24:58.101 10:11:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:58.101 10:11:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:58.101 { 00:24:58.101 "params": { 00:24:58.101 "name": "Nvme$subsystem", 00:24:58.101 "trtype": "$TEST_TRANSPORT", 00:24:58.101 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:58.101 "adrfam": "ipv4", 00:24:58.101 "trsvcid": "$NVMF_PORT", 00:24:58.101 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:58.101 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:58.101 "hdgst": ${hdgst:-false}, 00:24:58.101 "ddgst": ${ddgst:-false} 00:24:58.101 }, 00:24:58.101 "method": "bdev_nvme_attach_controller" 00:24:58.101 } 00:24:58.101 EOF 00:24:58.101 )") 00:24:58.101 10:11:03 -- nvmf/common.sh@542 -- # cat 00:24:58.101 10:11:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:58.101 10:11:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:58.101 { 00:24:58.101 "params": { 00:24:58.101 "name": "Nvme$subsystem", 00:24:58.101 "trtype": "$TEST_TRANSPORT", 00:24:58.101 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:58.101 "adrfam": "ipv4", 00:24:58.101 "trsvcid": "$NVMF_PORT", 00:24:58.101 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:58.101 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:58.101 "hdgst": ${hdgst:-false}, 00:24:58.101 "ddgst": ${ddgst:-false} 00:24:58.101 }, 00:24:58.101 "method": "bdev_nvme_attach_controller" 00:24:58.101 } 00:24:58.101 EOF 00:24:58.101 )") 00:24:58.101 10:11:03 -- nvmf/common.sh@542 -- # cat 00:24:58.101 10:11:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:58.101 10:11:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:58.101 { 00:24:58.101 "params": { 00:24:58.101 "name": "Nvme$subsystem", 00:24:58.101 "trtype": "$TEST_TRANSPORT", 00:24:58.101 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:58.101 "adrfam": "ipv4", 00:24:58.101 "trsvcid": "$NVMF_PORT", 00:24:58.101 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:58.101 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:58.101 "hdgst": ${hdgst:-false}, 00:24:58.101 "ddgst": ${ddgst:-false} 00:24:58.101 }, 00:24:58.101 "method": "bdev_nvme_attach_controller" 00:24:58.101 } 00:24:58.101 EOF 00:24:58.101 )") 00:24:58.101 10:11:03 -- nvmf/common.sh@542 -- # cat 00:24:58.101 10:11:03 -- nvmf/common.sh@544 -- # jq . 00:24:58.101 10:11:03 -- nvmf/common.sh@545 -- # IFS=, 00:24:58.101 10:11:03 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:24:58.101 "params": { 00:24:58.101 "name": "Nvme1", 00:24:58.101 "trtype": "tcp", 00:24:58.101 "traddr": "10.0.0.2", 00:24:58.101 "adrfam": "ipv4", 00:24:58.101 "trsvcid": "4420", 00:24:58.101 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:24:58.101 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:24:58.101 "hdgst": false, 00:24:58.101 "ddgst": false 00:24:58.101 }, 00:24:58.102 "method": "bdev_nvme_attach_controller" 00:24:58.102 },{ 00:24:58.102 "params": { 00:24:58.102 "name": "Nvme2", 00:24:58.102 "trtype": "tcp", 00:24:58.102 "traddr": "10.0.0.2", 00:24:58.102 "adrfam": "ipv4", 00:24:58.102 "trsvcid": "4420", 00:24:58.102 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:24:58.102 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:24:58.102 "hdgst": false, 00:24:58.102 "ddgst": false 00:24:58.102 }, 00:24:58.102 "method": "bdev_nvme_attach_controller" 00:24:58.102 },{ 00:24:58.102 "params": { 00:24:58.102 "name": "Nvme3", 00:24:58.102 "trtype": "tcp", 00:24:58.102 "traddr": "10.0.0.2", 00:24:58.102 "adrfam": "ipv4", 00:24:58.102 "trsvcid": "4420", 00:24:58.102 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:24:58.102 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:24:58.102 "hdgst": false, 00:24:58.102 "ddgst": false 00:24:58.102 }, 00:24:58.102 "method": "bdev_nvme_attach_controller" 00:24:58.102 },{ 00:24:58.102 "params": { 00:24:58.102 "name": "Nvme4", 00:24:58.102 "trtype": "tcp", 00:24:58.102 "traddr": "10.0.0.2", 00:24:58.102 "adrfam": "ipv4", 00:24:58.102 "trsvcid": "4420", 00:24:58.102 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:24:58.102 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:24:58.102 "hdgst": false, 00:24:58.102 "ddgst": false 00:24:58.102 }, 00:24:58.102 "method": "bdev_nvme_attach_controller" 00:24:58.102 },{ 00:24:58.102 "params": { 00:24:58.102 "name": "Nvme5", 00:24:58.102 "trtype": "tcp", 00:24:58.102 "traddr": "10.0.0.2", 00:24:58.102 "adrfam": "ipv4", 00:24:58.102 "trsvcid": "4420", 00:24:58.102 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:24:58.102 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:24:58.102 "hdgst": false, 00:24:58.102 "ddgst": false 00:24:58.102 }, 00:24:58.102 "method": "bdev_nvme_attach_controller" 00:24:58.102 },{ 00:24:58.102 "params": { 00:24:58.102 "name": "Nvme6", 00:24:58.102 "trtype": "tcp", 00:24:58.102 "traddr": "10.0.0.2", 00:24:58.102 "adrfam": "ipv4", 00:24:58.102 "trsvcid": "4420", 00:24:58.102 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:24:58.102 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:24:58.102 "hdgst": false, 00:24:58.102 "ddgst": false 00:24:58.102 }, 00:24:58.102 "method": "bdev_nvme_attach_controller" 00:24:58.102 },{ 00:24:58.102 "params": { 00:24:58.102 "name": "Nvme7", 00:24:58.102 "trtype": "tcp", 00:24:58.102 "traddr": "10.0.0.2", 00:24:58.102 "adrfam": "ipv4", 00:24:58.102 "trsvcid": "4420", 00:24:58.102 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:24:58.102 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:24:58.102 "hdgst": false, 00:24:58.102 "ddgst": false 00:24:58.102 }, 00:24:58.102 "method": "bdev_nvme_attach_controller" 00:24:58.102 },{ 00:24:58.102 "params": { 00:24:58.102 "name": "Nvme8", 00:24:58.102 "trtype": "tcp", 00:24:58.102 "traddr": "10.0.0.2", 00:24:58.102 "adrfam": "ipv4", 00:24:58.102 "trsvcid": "4420", 00:24:58.102 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:24:58.102 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:24:58.102 "hdgst": false, 00:24:58.102 "ddgst": false 00:24:58.102 }, 00:24:58.102 "method": "bdev_nvme_attach_controller" 00:24:58.102 },{ 00:24:58.102 "params": { 00:24:58.102 "name": "Nvme9", 00:24:58.102 "trtype": "tcp", 00:24:58.102 "traddr": "10.0.0.2", 00:24:58.102 "adrfam": "ipv4", 00:24:58.102 "trsvcid": "4420", 00:24:58.102 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:24:58.102 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:24:58.102 "hdgst": false, 00:24:58.102 "ddgst": false 00:24:58.102 }, 00:24:58.102 "method": "bdev_nvme_attach_controller" 00:24:58.102 },{ 00:24:58.102 "params": { 00:24:58.102 "name": "Nvme10", 00:24:58.102 "trtype": "tcp", 00:24:58.102 "traddr": "10.0.0.2", 00:24:58.102 "adrfam": "ipv4", 00:24:58.102 "trsvcid": "4420", 00:24:58.102 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:24:58.102 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:24:58.102 "hdgst": false, 00:24:58.102 "ddgst": false 00:24:58.102 }, 00:24:58.102 "method": "bdev_nvme_attach_controller" 00:24:58.102 }' 00:24:58.102 [2024-07-13 10:11:03.876999] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:24:58.102 [2024-07-13 10:11:03.877078] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2885605 ] 00:24:58.102 EAL: No free 2048 kB hugepages reported on node 1 00:24:58.360 [2024-07-13 10:11:03.943933] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:58.360 [2024-07-13 10:11:04.030491] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:00.285 Running I/O for 10 seconds... 00:25:00.852 10:11:06 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:00.852 10:11:06 -- common/autotest_common.sh@852 -- # return 0 00:25:00.852 10:11:06 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:00.852 10:11:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:00.852 10:11:06 -- common/autotest_common.sh@10 -- # set +x 00:25:00.852 10:11:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:00.852 10:11:06 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:25:00.852 10:11:06 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:25:00.852 10:11:06 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:25:00.852 10:11:06 -- target/shutdown.sh@57 -- # local ret=1 00:25:00.852 10:11:06 -- target/shutdown.sh@58 -- # local i 00:25:00.852 10:11:06 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:25:00.852 10:11:06 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:00.852 10:11:06 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:00.852 10:11:06 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:00.852 10:11:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:00.852 10:11:06 -- common/autotest_common.sh@10 -- # set +x 00:25:00.852 10:11:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:00.852 10:11:06 -- target/shutdown.sh@60 -- # read_io_count=211 00:25:00.852 10:11:06 -- target/shutdown.sh@63 -- # '[' 211 -ge 100 ']' 00:25:00.852 10:11:06 -- target/shutdown.sh@64 -- # ret=0 00:25:00.852 10:11:06 -- target/shutdown.sh@65 -- # break 00:25:00.852 10:11:06 -- target/shutdown.sh@69 -- # return 0 00:25:00.852 10:11:06 -- target/shutdown.sh@109 -- # killprocess 2885605 00:25:00.852 10:11:06 -- common/autotest_common.sh@926 -- # '[' -z 2885605 ']' 00:25:00.852 10:11:06 -- common/autotest_common.sh@930 -- # kill -0 2885605 00:25:00.852 10:11:06 -- common/autotest_common.sh@931 -- # uname 00:25:00.852 10:11:06 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:00.852 10:11:06 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2885605 00:25:00.852 10:11:06 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:25:00.852 10:11:06 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:25:00.852 10:11:06 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2885605' 00:25:00.852 killing process with pid 2885605 00:25:00.852 10:11:06 -- common/autotest_common.sh@945 -- # kill 2885605 00:25:00.852 10:11:06 -- common/autotest_common.sh@950 -- # wait 2885605 00:25:00.852 Received shutdown signal, test time was about 0.701666 seconds 00:25:00.852 00:25:00.852 Latency(us) 00:25:00.852 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:00.852 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:00.852 Verification LBA range: start 0x0 length 0x400 00:25:00.852 Nvme1n1 : 0.68 402.25 25.14 0.00 0.00 153581.62 25049.32 121945.51 00:25:00.852 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:00.852 Verification LBA range: start 0x0 length 0x400 00:25:00.852 Nvme2n1 : 0.69 396.07 24.75 0.00 0.00 154307.65 27185.30 155344.59 00:25:00.852 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:00.852 Verification LBA range: start 0x0 length 0x400 00:25:00.852 Nvme3n1 : 0.68 404.41 25.28 0.00 0.00 148267.20 9272.13 116508.44 00:25:00.852 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:00.852 Verification LBA range: start 0x0 length 0x400 00:25:00.852 Nvme4n1 : 0.70 449.46 28.09 0.00 0.00 135728.79 8204.14 114955.00 00:25:00.852 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:00.852 Verification LBA range: start 0x0 length 0x400 00:25:00.852 Nvme5n1 : 0.68 401.36 25.08 0.00 0.00 147401.57 24272.59 115731.72 00:25:00.852 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:00.852 Verification LBA range: start 0x0 length 0x400 00:25:00.852 Nvme6n1 : 0.69 394.23 24.64 0.00 0.00 148250.21 25437.68 133596.35 00:25:00.852 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:00.852 Verification LBA range: start 0x0 length 0x400 00:25:00.852 Nvme7n1 : 0.68 400.52 25.03 0.00 0.00 144215.79 24175.50 111848.11 00:25:00.852 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:00.852 Verification LBA range: start 0x0 length 0x400 00:25:00.852 Nvme8n1 : 0.68 399.34 24.96 0.00 0.00 142958.97 23690.05 110294.66 00:25:00.852 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:00.852 Verification LBA range: start 0x0 length 0x400 00:25:00.852 Nvme9n1 : 0.69 391.84 24.49 0.00 0.00 144236.13 21262.79 121945.51 00:25:00.852 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:00.852 Verification LBA range: start 0x0 length 0x400 00:25:00.852 Nvme10n1 : 0.70 393.80 24.61 0.00 0.00 142202.31 7670.14 123498.95 00:25:00.852 =================================================================================================================== 00:25:00.852 Total : 4033.30 252.08 0.00 0.00 145954.02 7670.14 155344.59 00:25:01.110 10:11:06 -- target/shutdown.sh@112 -- # sleep 1 00:25:02.041 10:11:07 -- target/shutdown.sh@113 -- # kill -0 2885411 00:25:02.041 10:11:07 -- target/shutdown.sh@115 -- # stoptarget 00:25:02.041 10:11:07 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:02.041 10:11:07 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:02.041 10:11:07 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:02.041 10:11:07 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:02.041 10:11:07 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:02.041 10:11:07 -- nvmf/common.sh@116 -- # sync 00:25:02.041 10:11:07 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:02.041 10:11:07 -- nvmf/common.sh@119 -- # set +e 00:25:02.041 10:11:07 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:02.041 10:11:07 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:02.041 rmmod nvme_tcp 00:25:02.041 rmmod nvme_fabrics 00:25:02.298 rmmod nvme_keyring 00:25:02.298 10:11:07 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:02.298 10:11:07 -- nvmf/common.sh@123 -- # set -e 00:25:02.298 10:11:07 -- nvmf/common.sh@124 -- # return 0 00:25:02.298 10:11:07 -- nvmf/common.sh@477 -- # '[' -n 2885411 ']' 00:25:02.298 10:11:07 -- nvmf/common.sh@478 -- # killprocess 2885411 00:25:02.298 10:11:07 -- common/autotest_common.sh@926 -- # '[' -z 2885411 ']' 00:25:02.298 10:11:07 -- common/autotest_common.sh@930 -- # kill -0 2885411 00:25:02.298 10:11:07 -- common/autotest_common.sh@931 -- # uname 00:25:02.298 10:11:07 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:02.298 10:11:07 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2885411 00:25:02.298 10:11:07 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:25:02.298 10:11:07 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:25:02.298 10:11:07 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2885411' 00:25:02.298 killing process with pid 2885411 00:25:02.298 10:11:07 -- common/autotest_common.sh@945 -- # kill 2885411 00:25:02.298 10:11:07 -- common/autotest_common.sh@950 -- # wait 2885411 00:25:02.865 10:11:08 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:02.865 10:11:08 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:02.865 10:11:08 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:02.865 10:11:08 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:02.865 10:11:08 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:02.865 10:11:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:02.865 10:11:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:02.865 10:11:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:04.766 10:11:10 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:04.766 00:25:04.766 real 0m8.391s 00:25:04.766 user 0m26.802s 00:25:04.766 sys 0m1.523s 00:25:04.766 10:11:10 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:25:04.766 10:11:10 -- common/autotest_common.sh@10 -- # set +x 00:25:04.766 ************************************ 00:25:04.766 END TEST nvmf_shutdown_tc2 00:25:04.766 ************************************ 00:25:04.766 10:11:10 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:25:04.766 10:11:10 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:25:04.766 10:11:10 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:25:04.766 10:11:10 -- common/autotest_common.sh@10 -- # set +x 00:25:04.766 ************************************ 00:25:04.766 START TEST nvmf_shutdown_tc3 00:25:04.766 ************************************ 00:25:04.766 10:11:10 -- common/autotest_common.sh@1104 -- # nvmf_shutdown_tc3 00:25:04.766 10:11:10 -- target/shutdown.sh@120 -- # starttarget 00:25:04.766 10:11:10 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:04.766 10:11:10 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:04.766 10:11:10 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:04.766 10:11:10 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:04.766 10:11:10 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:04.766 10:11:10 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:04.766 10:11:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:04.766 10:11:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:04.766 10:11:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:04.766 10:11:10 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:04.766 10:11:10 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:04.766 10:11:10 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:04.766 10:11:10 -- common/autotest_common.sh@10 -- # set +x 00:25:04.766 10:11:10 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:04.766 10:11:10 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:04.767 10:11:10 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:04.767 10:11:10 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:04.767 10:11:10 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:04.767 10:11:10 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:04.767 10:11:10 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:04.767 10:11:10 -- nvmf/common.sh@294 -- # net_devs=() 00:25:04.767 10:11:10 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:04.767 10:11:10 -- nvmf/common.sh@295 -- # e810=() 00:25:04.767 10:11:10 -- nvmf/common.sh@295 -- # local -ga e810 00:25:04.767 10:11:10 -- nvmf/common.sh@296 -- # x722=() 00:25:04.767 10:11:10 -- nvmf/common.sh@296 -- # local -ga x722 00:25:04.767 10:11:10 -- nvmf/common.sh@297 -- # mlx=() 00:25:04.767 10:11:10 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:04.767 10:11:10 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:04.767 10:11:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:04.767 10:11:10 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:04.767 10:11:10 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:04.767 10:11:10 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:04.767 10:11:10 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:04.767 10:11:10 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:04.767 10:11:10 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:04.767 10:11:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:04.767 10:11:10 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:04.767 10:11:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:04.767 10:11:10 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:04.767 10:11:10 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:04.767 10:11:10 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:04.767 10:11:10 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:04.767 10:11:10 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:04.767 10:11:10 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:04.767 10:11:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:04.767 10:11:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:04.767 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:04.767 10:11:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:04.767 10:11:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:04.767 10:11:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:04.767 10:11:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:04.767 10:11:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:04.767 10:11:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:04.767 10:11:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:04.767 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:04.767 10:11:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:04.767 10:11:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:04.767 10:11:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:04.767 10:11:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:04.767 10:11:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:04.767 10:11:10 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:04.767 10:11:10 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:04.767 10:11:10 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:04.767 10:11:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:04.767 10:11:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:04.767 10:11:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:04.767 10:11:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:04.767 10:11:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:04.767 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:04.767 10:11:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:04.767 10:11:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:04.767 10:11:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:04.767 10:11:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:04.767 10:11:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:04.767 10:11:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:04.767 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:04.767 10:11:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:04.767 10:11:10 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:04.767 10:11:10 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:04.767 10:11:10 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:04.767 10:11:10 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:04.767 10:11:10 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:04.767 10:11:10 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:04.767 10:11:10 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:04.767 10:11:10 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:04.767 10:11:10 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:04.767 10:11:10 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:04.767 10:11:10 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:04.767 10:11:10 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:04.767 10:11:10 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:04.767 10:11:10 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:04.767 10:11:10 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:04.767 10:11:10 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:04.767 10:11:10 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:04.767 10:11:10 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:04.767 10:11:10 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:04.767 10:11:10 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:05.025 10:11:10 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:05.025 10:11:10 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:05.025 10:11:10 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:05.025 10:11:10 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:05.025 10:11:10 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:05.025 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:05.025 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.110 ms 00:25:05.025 00:25:05.025 --- 10.0.0.2 ping statistics --- 00:25:05.025 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:05.025 rtt min/avg/max/mdev = 0.110/0.110/0.110/0.000 ms 00:25:05.025 10:11:10 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:05.025 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:05.025 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.131 ms 00:25:05.025 00:25:05.025 --- 10.0.0.1 ping statistics --- 00:25:05.025 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:05.025 rtt min/avg/max/mdev = 0.131/0.131/0.131/0.000 ms 00:25:05.025 10:11:10 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:05.025 10:11:10 -- nvmf/common.sh@410 -- # return 0 00:25:05.025 10:11:10 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:05.026 10:11:10 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:05.026 10:11:10 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:05.026 10:11:10 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:05.026 10:11:10 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:05.026 10:11:10 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:05.026 10:11:10 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:05.026 10:11:10 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:05.026 10:11:10 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:05.026 10:11:10 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:05.026 10:11:10 -- common/autotest_common.sh@10 -- # set +x 00:25:05.026 10:11:10 -- nvmf/common.sh@469 -- # nvmfpid=2886553 00:25:05.026 10:11:10 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:05.026 10:11:10 -- nvmf/common.sh@470 -- # waitforlisten 2886553 00:25:05.026 10:11:10 -- common/autotest_common.sh@819 -- # '[' -z 2886553 ']' 00:25:05.026 10:11:10 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:05.026 10:11:10 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:05.026 10:11:10 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:05.026 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:05.026 10:11:10 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:05.026 10:11:10 -- common/autotest_common.sh@10 -- # set +x 00:25:05.026 [2024-07-13 10:11:10.719477] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:25:05.026 [2024-07-13 10:11:10.719553] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:05.026 EAL: No free 2048 kB hugepages reported on node 1 00:25:05.026 [2024-07-13 10:11:10.791638] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:05.284 [2024-07-13 10:11:10.887046] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:05.284 [2024-07-13 10:11:10.887206] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:05.284 [2024-07-13 10:11:10.887224] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:05.284 [2024-07-13 10:11:10.887236] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:05.284 [2024-07-13 10:11:10.887303] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:05.284 [2024-07-13 10:11:10.887365] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:05.284 [2024-07-13 10:11:10.887444] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:05.284 [2024-07-13 10:11:10.887442] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:06.216 10:11:11 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:06.216 10:11:11 -- common/autotest_common.sh@852 -- # return 0 00:25:06.216 10:11:11 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:06.216 10:11:11 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:06.216 10:11:11 -- common/autotest_common.sh@10 -- # set +x 00:25:06.216 10:11:11 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:06.216 10:11:11 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:06.216 10:11:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:06.216 10:11:11 -- common/autotest_common.sh@10 -- # set +x 00:25:06.216 [2024-07-13 10:11:11.724574] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:06.216 10:11:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:06.216 10:11:11 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:06.216 10:11:11 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:06.216 10:11:11 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:06.216 10:11:11 -- common/autotest_common.sh@10 -- # set +x 00:25:06.216 10:11:11 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:06.216 10:11:11 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:06.216 10:11:11 -- target/shutdown.sh@28 -- # cat 00:25:06.216 10:11:11 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:06.216 10:11:11 -- target/shutdown.sh@28 -- # cat 00:25:06.216 10:11:11 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:06.216 10:11:11 -- target/shutdown.sh@28 -- # cat 00:25:06.216 10:11:11 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:06.216 10:11:11 -- target/shutdown.sh@28 -- # cat 00:25:06.216 10:11:11 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:06.216 10:11:11 -- target/shutdown.sh@28 -- # cat 00:25:06.216 10:11:11 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:06.216 10:11:11 -- target/shutdown.sh@28 -- # cat 00:25:06.216 10:11:11 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:06.216 10:11:11 -- target/shutdown.sh@28 -- # cat 00:25:06.216 10:11:11 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:06.216 10:11:11 -- target/shutdown.sh@28 -- # cat 00:25:06.216 10:11:11 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:06.216 10:11:11 -- target/shutdown.sh@28 -- # cat 00:25:06.216 10:11:11 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:06.216 10:11:11 -- target/shutdown.sh@28 -- # cat 00:25:06.216 10:11:11 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:06.216 10:11:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:06.216 10:11:11 -- common/autotest_common.sh@10 -- # set +x 00:25:06.216 Malloc1 00:25:06.216 [2024-07-13 10:11:11.813945] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:06.216 Malloc2 00:25:06.216 Malloc3 00:25:06.216 Malloc4 00:25:06.216 Malloc5 00:25:06.216 Malloc6 00:25:06.474 Malloc7 00:25:06.474 Malloc8 00:25:06.474 Malloc9 00:25:06.474 Malloc10 00:25:06.474 10:11:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:06.474 10:11:12 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:06.474 10:11:12 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:06.474 10:11:12 -- common/autotest_common.sh@10 -- # set +x 00:25:06.474 10:11:12 -- target/shutdown.sh@124 -- # perfpid=2886858 00:25:06.474 10:11:12 -- target/shutdown.sh@125 -- # waitforlisten 2886858 /var/tmp/bdevperf.sock 00:25:06.474 10:11:12 -- common/autotest_common.sh@819 -- # '[' -z 2886858 ']' 00:25:06.474 10:11:12 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:06.474 10:11:12 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:06.474 10:11:12 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:25:06.474 10:11:12 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:06.474 10:11:12 -- nvmf/common.sh@520 -- # config=() 00:25:06.474 10:11:12 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:06.474 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:06.474 10:11:12 -- nvmf/common.sh@520 -- # local subsystem config 00:25:06.474 10:11:12 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:06.474 10:11:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:06.474 10:11:12 -- common/autotest_common.sh@10 -- # set +x 00:25:06.474 10:11:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:06.474 { 00:25:06.474 "params": { 00:25:06.474 "name": "Nvme$subsystem", 00:25:06.474 "trtype": "$TEST_TRANSPORT", 00:25:06.475 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:06.475 "adrfam": "ipv4", 00:25:06.475 "trsvcid": "$NVMF_PORT", 00:25:06.475 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:06.475 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:06.475 "hdgst": ${hdgst:-false}, 00:25:06.475 "ddgst": ${ddgst:-false} 00:25:06.475 }, 00:25:06.475 "method": "bdev_nvme_attach_controller" 00:25:06.475 } 00:25:06.475 EOF 00:25:06.475 )") 00:25:06.475 10:11:12 -- nvmf/common.sh@542 -- # cat 00:25:06.475 10:11:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:06.475 10:11:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:06.475 { 00:25:06.475 "params": { 00:25:06.475 "name": "Nvme$subsystem", 00:25:06.475 "trtype": "$TEST_TRANSPORT", 00:25:06.475 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:06.475 "adrfam": "ipv4", 00:25:06.475 "trsvcid": "$NVMF_PORT", 00:25:06.475 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:06.475 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:06.475 "hdgst": ${hdgst:-false}, 00:25:06.475 "ddgst": ${ddgst:-false} 00:25:06.475 }, 00:25:06.475 "method": "bdev_nvme_attach_controller" 00:25:06.475 } 00:25:06.475 EOF 00:25:06.475 )") 00:25:06.475 10:11:12 -- nvmf/common.sh@542 -- # cat 00:25:06.475 10:11:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:06.475 10:11:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:06.475 { 00:25:06.475 "params": { 00:25:06.475 "name": "Nvme$subsystem", 00:25:06.475 "trtype": "$TEST_TRANSPORT", 00:25:06.475 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:06.475 "adrfam": "ipv4", 00:25:06.475 "trsvcid": "$NVMF_PORT", 00:25:06.475 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:06.475 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:06.475 "hdgst": ${hdgst:-false}, 00:25:06.475 "ddgst": ${ddgst:-false} 00:25:06.475 }, 00:25:06.475 "method": "bdev_nvme_attach_controller" 00:25:06.475 } 00:25:06.475 EOF 00:25:06.475 )") 00:25:06.475 10:11:12 -- nvmf/common.sh@542 -- # cat 00:25:06.475 10:11:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:06.475 10:11:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:06.475 { 00:25:06.475 "params": { 00:25:06.475 "name": "Nvme$subsystem", 00:25:06.475 "trtype": "$TEST_TRANSPORT", 00:25:06.475 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:06.475 "adrfam": "ipv4", 00:25:06.475 "trsvcid": "$NVMF_PORT", 00:25:06.475 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:06.475 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:06.475 "hdgst": ${hdgst:-false}, 00:25:06.475 "ddgst": ${ddgst:-false} 00:25:06.475 }, 00:25:06.475 "method": "bdev_nvme_attach_controller" 00:25:06.475 } 00:25:06.475 EOF 00:25:06.475 )") 00:25:06.475 10:11:12 -- nvmf/common.sh@542 -- # cat 00:25:06.475 10:11:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:06.475 10:11:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:06.475 { 00:25:06.475 "params": { 00:25:06.475 "name": "Nvme$subsystem", 00:25:06.475 "trtype": "$TEST_TRANSPORT", 00:25:06.475 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:06.475 "adrfam": "ipv4", 00:25:06.475 "trsvcid": "$NVMF_PORT", 00:25:06.475 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:06.475 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:06.475 "hdgst": ${hdgst:-false}, 00:25:06.475 "ddgst": ${ddgst:-false} 00:25:06.475 }, 00:25:06.475 "method": "bdev_nvme_attach_controller" 00:25:06.475 } 00:25:06.475 EOF 00:25:06.475 )") 00:25:06.475 10:11:12 -- nvmf/common.sh@542 -- # cat 00:25:06.475 10:11:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:06.475 10:11:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:06.475 { 00:25:06.475 "params": { 00:25:06.475 "name": "Nvme$subsystem", 00:25:06.475 "trtype": "$TEST_TRANSPORT", 00:25:06.475 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:06.475 "adrfam": "ipv4", 00:25:06.475 "trsvcid": "$NVMF_PORT", 00:25:06.475 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:06.475 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:06.475 "hdgst": ${hdgst:-false}, 00:25:06.475 "ddgst": ${ddgst:-false} 00:25:06.475 }, 00:25:06.475 "method": "bdev_nvme_attach_controller" 00:25:06.475 } 00:25:06.475 EOF 00:25:06.475 )") 00:25:06.475 10:11:12 -- nvmf/common.sh@542 -- # cat 00:25:06.475 10:11:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:06.475 10:11:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:06.475 { 00:25:06.475 "params": { 00:25:06.475 "name": "Nvme$subsystem", 00:25:06.475 "trtype": "$TEST_TRANSPORT", 00:25:06.475 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:06.475 "adrfam": "ipv4", 00:25:06.475 "trsvcid": "$NVMF_PORT", 00:25:06.475 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:06.475 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:06.475 "hdgst": ${hdgst:-false}, 00:25:06.475 "ddgst": ${ddgst:-false} 00:25:06.475 }, 00:25:06.475 "method": "bdev_nvme_attach_controller" 00:25:06.475 } 00:25:06.475 EOF 00:25:06.475 )") 00:25:06.475 10:11:12 -- nvmf/common.sh@542 -- # cat 00:25:06.475 10:11:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:06.475 10:11:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:06.475 { 00:25:06.475 "params": { 00:25:06.475 "name": "Nvme$subsystem", 00:25:06.475 "trtype": "$TEST_TRANSPORT", 00:25:06.475 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:06.475 "adrfam": "ipv4", 00:25:06.475 "trsvcid": "$NVMF_PORT", 00:25:06.475 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:06.475 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:06.475 "hdgst": ${hdgst:-false}, 00:25:06.475 "ddgst": ${ddgst:-false} 00:25:06.475 }, 00:25:06.475 "method": "bdev_nvme_attach_controller" 00:25:06.475 } 00:25:06.475 EOF 00:25:06.475 )") 00:25:06.475 10:11:12 -- nvmf/common.sh@542 -- # cat 00:25:06.475 10:11:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:06.733 10:11:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:06.733 { 00:25:06.733 "params": { 00:25:06.733 "name": "Nvme$subsystem", 00:25:06.733 "trtype": "$TEST_TRANSPORT", 00:25:06.733 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:06.733 "adrfam": "ipv4", 00:25:06.733 "trsvcid": "$NVMF_PORT", 00:25:06.733 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:06.733 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:06.733 "hdgst": ${hdgst:-false}, 00:25:06.733 "ddgst": ${ddgst:-false} 00:25:06.733 }, 00:25:06.733 "method": "bdev_nvme_attach_controller" 00:25:06.733 } 00:25:06.733 EOF 00:25:06.733 )") 00:25:06.733 10:11:12 -- nvmf/common.sh@542 -- # cat 00:25:06.733 10:11:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:06.733 10:11:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:06.733 { 00:25:06.733 "params": { 00:25:06.733 "name": "Nvme$subsystem", 00:25:06.733 "trtype": "$TEST_TRANSPORT", 00:25:06.733 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:06.733 "adrfam": "ipv4", 00:25:06.733 "trsvcid": "$NVMF_PORT", 00:25:06.733 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:06.733 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:06.733 "hdgst": ${hdgst:-false}, 00:25:06.733 "ddgst": ${ddgst:-false} 00:25:06.733 }, 00:25:06.733 "method": "bdev_nvme_attach_controller" 00:25:06.733 } 00:25:06.733 EOF 00:25:06.733 )") 00:25:06.733 10:11:12 -- nvmf/common.sh@542 -- # cat 00:25:06.733 10:11:12 -- nvmf/common.sh@544 -- # jq . 00:25:06.733 10:11:12 -- nvmf/common.sh@545 -- # IFS=, 00:25:06.733 10:11:12 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:06.733 "params": { 00:25:06.733 "name": "Nvme1", 00:25:06.734 "trtype": "tcp", 00:25:06.734 "traddr": "10.0.0.2", 00:25:06.734 "adrfam": "ipv4", 00:25:06.734 "trsvcid": "4420", 00:25:06.734 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:06.734 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:06.734 "hdgst": false, 00:25:06.734 "ddgst": false 00:25:06.734 }, 00:25:06.734 "method": "bdev_nvme_attach_controller" 00:25:06.734 },{ 00:25:06.734 "params": { 00:25:06.734 "name": "Nvme2", 00:25:06.734 "trtype": "tcp", 00:25:06.734 "traddr": "10.0.0.2", 00:25:06.734 "adrfam": "ipv4", 00:25:06.734 "trsvcid": "4420", 00:25:06.734 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:06.734 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:06.734 "hdgst": false, 00:25:06.734 "ddgst": false 00:25:06.734 }, 00:25:06.734 "method": "bdev_nvme_attach_controller" 00:25:06.734 },{ 00:25:06.734 "params": { 00:25:06.734 "name": "Nvme3", 00:25:06.734 "trtype": "tcp", 00:25:06.734 "traddr": "10.0.0.2", 00:25:06.734 "adrfam": "ipv4", 00:25:06.734 "trsvcid": "4420", 00:25:06.734 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:06.734 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:06.734 "hdgst": false, 00:25:06.734 "ddgst": false 00:25:06.734 }, 00:25:06.734 "method": "bdev_nvme_attach_controller" 00:25:06.734 },{ 00:25:06.734 "params": { 00:25:06.734 "name": "Nvme4", 00:25:06.734 "trtype": "tcp", 00:25:06.734 "traddr": "10.0.0.2", 00:25:06.734 "adrfam": "ipv4", 00:25:06.734 "trsvcid": "4420", 00:25:06.734 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:06.734 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:06.734 "hdgst": false, 00:25:06.734 "ddgst": false 00:25:06.734 }, 00:25:06.734 "method": "bdev_nvme_attach_controller" 00:25:06.734 },{ 00:25:06.734 "params": { 00:25:06.734 "name": "Nvme5", 00:25:06.734 "trtype": "tcp", 00:25:06.734 "traddr": "10.0.0.2", 00:25:06.734 "adrfam": "ipv4", 00:25:06.734 "trsvcid": "4420", 00:25:06.734 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:06.734 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:06.734 "hdgst": false, 00:25:06.734 "ddgst": false 00:25:06.734 }, 00:25:06.734 "method": "bdev_nvme_attach_controller" 00:25:06.734 },{ 00:25:06.734 "params": { 00:25:06.734 "name": "Nvme6", 00:25:06.734 "trtype": "tcp", 00:25:06.734 "traddr": "10.0.0.2", 00:25:06.734 "adrfam": "ipv4", 00:25:06.734 "trsvcid": "4420", 00:25:06.734 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:06.734 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:06.734 "hdgst": false, 00:25:06.734 "ddgst": false 00:25:06.734 }, 00:25:06.734 "method": "bdev_nvme_attach_controller" 00:25:06.734 },{ 00:25:06.734 "params": { 00:25:06.734 "name": "Nvme7", 00:25:06.734 "trtype": "tcp", 00:25:06.734 "traddr": "10.0.0.2", 00:25:06.734 "adrfam": "ipv4", 00:25:06.734 "trsvcid": "4420", 00:25:06.734 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:06.734 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:06.734 "hdgst": false, 00:25:06.734 "ddgst": false 00:25:06.734 }, 00:25:06.734 "method": "bdev_nvme_attach_controller" 00:25:06.734 },{ 00:25:06.734 "params": { 00:25:06.734 "name": "Nvme8", 00:25:06.734 "trtype": "tcp", 00:25:06.734 "traddr": "10.0.0.2", 00:25:06.734 "adrfam": "ipv4", 00:25:06.734 "trsvcid": "4420", 00:25:06.734 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:06.734 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:06.734 "hdgst": false, 00:25:06.734 "ddgst": false 00:25:06.734 }, 00:25:06.734 "method": "bdev_nvme_attach_controller" 00:25:06.734 },{ 00:25:06.734 "params": { 00:25:06.734 "name": "Nvme9", 00:25:06.734 "trtype": "tcp", 00:25:06.734 "traddr": "10.0.0.2", 00:25:06.734 "adrfam": "ipv4", 00:25:06.734 "trsvcid": "4420", 00:25:06.734 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:06.734 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:06.734 "hdgst": false, 00:25:06.734 "ddgst": false 00:25:06.734 }, 00:25:06.734 "method": "bdev_nvme_attach_controller" 00:25:06.734 },{ 00:25:06.734 "params": { 00:25:06.734 "name": "Nvme10", 00:25:06.734 "trtype": "tcp", 00:25:06.734 "traddr": "10.0.0.2", 00:25:06.734 "adrfam": "ipv4", 00:25:06.734 "trsvcid": "4420", 00:25:06.734 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:06.734 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:06.734 "hdgst": false, 00:25:06.734 "ddgst": false 00:25:06.734 }, 00:25:06.734 "method": "bdev_nvme_attach_controller" 00:25:06.734 }' 00:25:06.734 [2024-07-13 10:11:12.304687] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:25:06.734 [2024-07-13 10:11:12.304761] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2886858 ] 00:25:06.734 EAL: No free 2048 kB hugepages reported on node 1 00:25:06.734 [2024-07-13 10:11:12.368425] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:06.734 [2024-07-13 10:11:12.453078] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:08.628 Running I/O for 10 seconds... 00:25:09.205 10:11:14 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:09.205 10:11:14 -- common/autotest_common.sh@852 -- # return 0 00:25:09.205 10:11:14 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:09.205 10:11:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:09.205 10:11:14 -- common/autotest_common.sh@10 -- # set +x 00:25:09.205 10:11:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:09.205 10:11:14 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:09.205 10:11:14 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:25:09.205 10:11:14 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:25:09.205 10:11:14 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:25:09.205 10:11:14 -- target/shutdown.sh@57 -- # local ret=1 00:25:09.205 10:11:14 -- target/shutdown.sh@58 -- # local i 00:25:09.205 10:11:14 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:25:09.205 10:11:14 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:09.205 10:11:14 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:09.205 10:11:14 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:09.205 10:11:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:09.205 10:11:14 -- common/autotest_common.sh@10 -- # set +x 00:25:09.205 10:11:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:09.205 10:11:14 -- target/shutdown.sh@60 -- # read_io_count=215 00:25:09.205 10:11:14 -- target/shutdown.sh@63 -- # '[' 215 -ge 100 ']' 00:25:09.205 10:11:14 -- target/shutdown.sh@64 -- # ret=0 00:25:09.205 10:11:14 -- target/shutdown.sh@65 -- # break 00:25:09.205 10:11:14 -- target/shutdown.sh@69 -- # return 0 00:25:09.205 10:11:14 -- target/shutdown.sh@134 -- # killprocess 2886553 00:25:09.205 10:11:14 -- common/autotest_common.sh@926 -- # '[' -z 2886553 ']' 00:25:09.205 10:11:14 -- common/autotest_common.sh@930 -- # kill -0 2886553 00:25:09.205 10:11:14 -- common/autotest_common.sh@931 -- # uname 00:25:09.205 10:11:14 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:09.205 10:11:14 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2886553 00:25:09.205 10:11:14 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:25:09.205 10:11:14 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:25:09.205 10:11:14 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2886553' 00:25:09.205 killing process with pid 2886553 00:25:09.205 10:11:14 -- common/autotest_common.sh@945 -- # kill 2886553 00:25:09.205 10:11:14 -- common/autotest_common.sh@950 -- # wait 2886553 00:25:09.205 [2024-07-13 10:11:14.799559] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.205 [2024-07-13 10:11:14.799690] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.205 [2024-07-13 10:11:14.799707] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.205 [2024-07-13 10:11:14.799720] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.205 [2024-07-13 10:11:14.799732] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.205 [2024-07-13 10:11:14.799744] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.205 [2024-07-13 10:11:14.799756] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.205 [2024-07-13 10:11:14.799768] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.205 [2024-07-13 10:11:14.799780] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.205 [2024-07-13 10:11:14.799792] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.205 [2024-07-13 10:11:14.799804] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.205 [2024-07-13 10:11:14.799816] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.205 [2024-07-13 10:11:14.799827] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.205 [2024-07-13 10:11:14.799839] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.205 [2024-07-13 10:11:14.799875] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.799890] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.799903] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.799934] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.799946] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.799958] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.799970] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.799982] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.799993] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.800005] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.800017] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.800029] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.800041] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.800053] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.800064] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.800076] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.800088] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.800100] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.800112] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.800123] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.800136] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.800148] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.800160] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.800172] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.800198] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.800210] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.800222] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.800233] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.800245] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.800257] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.800271] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.800283] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.800294] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.800305] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.800317] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.800329] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.800341] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.800352] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.800364] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.800375] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.800387] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.800398] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.800410] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.800422] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.800433] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.800445] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.800456] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.800468] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.800479] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccd400 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.801796] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.801820] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.801834] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.801848] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.801860] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.801883] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.801896] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.801908] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.801930] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.801948] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.801961] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.801973] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.801984] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.801996] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.802008] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.802020] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.802032] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.802044] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.802055] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.802067] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.802079] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.802090] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.802101] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.802113] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.802125] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.802137] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.802148] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.802160] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.802172] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.802183] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.802195] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.802212] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.802224] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.802237] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.802249] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.802261] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.802278] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.802290] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.802302] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.802315] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.802327] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.802339] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.206 [2024-07-13 10:11:14.802352] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.802364] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.802376] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.802388] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.802400] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.802412] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.802424] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.802437] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.802449] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.802461] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.802473] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.802485] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.802496] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.802508] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.802520] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.802532] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.802544] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.802556] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.802568] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.802579] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.802591] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe570 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804190] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804226] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804242] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804255] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804267] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804279] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804292] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804305] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804317] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804329] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804342] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804354] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804367] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804379] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804391] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804403] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804415] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804428] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804440] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804452] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804465] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804477] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804505] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804517] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804529] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804541] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804553] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804577] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804590] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804602] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804614] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804627] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804639] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804652] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804664] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804676] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804689] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804701] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804714] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804726] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804738] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804750] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804763] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804775] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804787] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804799] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804811] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804822] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804834] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804862] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804890] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804905] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804923] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804935] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804952] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804965] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804978] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.804990] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.805002] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.805014] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.805026] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.207 [2024-07-13 10:11:14.805039] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.805051] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a701c0 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806331] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806365] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806381] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806394] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806406] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806418] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806430] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806442] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806454] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806466] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806478] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806490] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806502] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806514] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806526] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806538] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806550] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806562] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806586] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806599] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806611] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806623] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806635] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806647] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806659] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806671] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806698] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806710] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806722] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806734] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806746] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806757] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806770] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806782] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806794] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806806] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806818] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806830] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806841] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806853] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806871] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806900] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806913] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806926] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806939] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806955] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806967] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806979] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.806991] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.807003] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.807015] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.807027] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.807039] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.807051] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.807063] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.807075] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.807087] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.807099] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.807110] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.807122] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.807133] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.807145] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.807156] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70650 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.808538] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.808562] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.808576] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.808588] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.808600] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.808612] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.808624] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.808637] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.808649] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.808681] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.808694] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.808706] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.808718] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.808729] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.808741] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.808752] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.808764] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.808775] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.808787] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.808798] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.808810] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.808822] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.808833] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.808845] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.808882] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.208 [2024-07-13 10:11:14.808895] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.808908] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.808920] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.808941] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.808953] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.808966] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.808978] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.808990] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.809003] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.809015] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.809028] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.809048] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.809061] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.809073] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.809086] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.809098] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.809110] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.809122] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.809134] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.809146] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.809158] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.809171] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.809199] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.809211] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.809223] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.809236] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.809248] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.809260] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.809271] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.809283] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.809295] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.809306] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.809318] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.809330] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.809342] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.809353] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.809365] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.809376] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a70fb0 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.810853] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.810901] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.810924] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.810936] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.810949] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.810961] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.810973] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.810986] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.810998] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.811010] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.811022] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.811034] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.811046] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.811058] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.811069] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.811081] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.811097] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.209 [2024-07-13 10:11:14.811116] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.811131] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.811139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.209 [2024-07-13 10:11:14.811144] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.811156] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.811158] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.209 [2024-07-13 10:11:14.811169] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.811173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.209 [2024-07-13 10:11:14.811181] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.811187] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.209 [2024-07-13 10:11:14.811203] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.811213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 c[2024-07-13 10:11:14.811215] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.209 the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.811230] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.811231] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.209 [2024-07-13 10:11:14.811242] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.209 [2024-07-13 10:11:14.811245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.209 [2024-07-13 10:11:14.811254] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.210 [2024-07-13 10:11:14.811259] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14d6410 is same with the state(5) to be set 00:25:09.210 [2024-07-13 10:11:14.811267] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.210 [2024-07-13 10:11:14.811279] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.210 [2024-07-13 10:11:14.811291] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.210 [2024-07-13 10:11:14.811303] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.210 [2024-07-13 10:11:14.811315] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.210 [2024-07-13 10:11:14.811314] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.210 [2024-07-13 10:11:14.811327] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.210 [2024-07-13 10:11:14.811335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.210 [2024-07-13 10:11:14.811340] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.210 [2024-07-13 10:11:14.811351] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 ns[2024-07-13 10:11:14.811352] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with id:0 cdw10:00000000 cdw11:00000000 00:25:09.210 the state(5) to be set 00:25:09.210 [2024-07-13 10:11:14.811366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 c[2024-07-13 10:11:14.811366] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.210 the state(5) to be set 00:25:09.210 [2024-07-13 10:11:14.811381] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.210 [2024-07-13 10:11:14.811382] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.210 [2024-07-13 10:11:14.811395] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with [2024-07-13 10:11:14.811396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cthe state(5) to be set 00:25:09.210 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.210 [2024-07-13 10:11:14.811410] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with [2024-07-13 10:11:14.811411] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsthe state(5) to be set 00:25:09.210 id:0 cdw10:00000000 cdw11:00000000 00:25:09.210 [2024-07-13 10:11:14.811430] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with [2024-07-13 10:11:14.811430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cthe state(5) to be set 00:25:09.210 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.210 [2024-07-13 10:11:14.811445] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with [2024-07-13 10:11:14.811446] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1533530 is same the state(5) to be set 00:25:09.210 with the state(5) to be set 00:25:09.210 [2024-07-13 10:11:14.811459] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.210 [2024-07-13 10:11:14.811472] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.210 [2024-07-13 10:11:14.811486] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.210 [2024-07-13 10:11:14.811503] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.210 [2024-07-13 10:11:14.811516] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.210 [2024-07-13 10:11:14.811514] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.210 [2024-07-13 10:11:14.811529] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.210 [2024-07-13 10:11:14.811536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.210 [2024-07-13 10:11:14.811542] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.210 [2024-07-13 10:11:14.811551] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.210 [2024-07-13 10:11:14.811556] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.210 [2024-07-13 10:11:14.811565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.210 [2024-07-13 10:11:14.811568] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.210 [2024-07-13 10:11:14.811579] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 ns[2024-07-13 10:11:14.811581] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with id:0 cdw10:00000000 cdw11:00000000 00:25:09.210 the state(5) to be set 00:25:09.210 [2024-07-13 10:11:14.811594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 c[2024-07-13 10:11:14.811595] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.210 the state(5) to be set 00:25:09.210 [2024-07-13 10:11:14.811609] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with [2024-07-13 10:11:14.811610] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsthe state(5) to be set 00:25:09.210 id:0 cdw10:00000000 cdw11:00000000 00:25:09.210 [2024-07-13 10:11:14.811623] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.210 [2024-07-13 10:11:14.811625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.210 [2024-07-13 10:11:14.811637] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.210 [2024-07-13 10:11:14.811643] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16a5960 is same with the state(5) to be set 00:25:09.210 [2024-07-13 10:11:14.811650] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.210 [2024-07-13 10:11:14.811663] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.210 [2024-07-13 10:11:14.811675] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.210 [2024-07-13 10:11:14.811687] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.210 [2024-07-13 10:11:14.811689] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.210 [2024-07-13 10:11:14.811699] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.210 [2024-07-13 10:11:14.811712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 c[2024-07-13 10:11:14.811713] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.210 the state(5) to be set 00:25:09.210 [2024-07-13 10:11:14.811727] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.210 [2024-07-13 10:11:14.811730] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.210 [2024-07-13 10:11:14.811739] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ccc630 is same with the state(5) to be set 00:25:09.210 [2024-07-13 10:11:14.811744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.210 [2024-07-13 10:11:14.811759] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.210 [2024-07-13 10:11:14.811773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.210 [2024-07-13 10:11:14.811788] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.210 [2024-07-13 10:11:14.811801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.210 [2024-07-13 10:11:14.811814] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1509c80 is same with the state(5) to be set 00:25:09.210 [2024-07-13 10:11:14.811858] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.210 [2024-07-13 10:11:14.811887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.210 [2024-07-13 10:11:14.811904] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.210 [2024-07-13 10:11:14.811923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.210 [2024-07-13 10:11:14.811938] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.210 [2024-07-13 10:11:14.811952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.210 [2024-07-13 10:11:14.811966] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.210 [2024-07-13 10:11:14.811983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.210 [2024-07-13 10:11:14.811997] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14dda30 is same with the state(5) to be set 00:25:09.210 [2024-07-13 10:11:14.812040] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.210 [2024-07-13 10:11:14.812060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.210 [2024-07-13 10:11:14.812076] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.210 [2024-07-13 10:11:14.812090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.210 [2024-07-13 10:11:14.812105] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.210 [2024-07-13 10:11:14.812118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.210 [2024-07-13 10:11:14.812132] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.210 [2024-07-13 10:11:14.812146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.210 [2024-07-13 10:11:14.812159] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1507d80 is same with the state(5) to be set 00:25:09.210 [2024-07-13 10:11:14.812206] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.210 [2024-07-13 10:11:14.812226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.210 [2024-07-13 10:11:14.812242] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.211 [2024-07-13 10:11:14.812255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.211 [2024-07-13 10:11:14.812270] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.211 [2024-07-13 10:11:14.812283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.211 [2024-07-13 10:11:14.812298] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.211 [2024-07-13 10:11:14.812311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.211 [2024-07-13 10:11:14.812324] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x168c4d0 is same with the state(5) to be set 00:25:09.211 [2024-07-13 10:11:14.812368] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.211 [2024-07-13 10:11:14.812389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.211 [2024-07-13 10:11:14.812405] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.211 [2024-07-13 10:11:14.812419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.211 [2024-07-13 10:11:14.812434] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.211 [2024-07-13 10:11:14.812447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.211 [2024-07-13 10:11:14.812466] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.211 [2024-07-13 10:11:14.812481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.211 [2024-07-13 10:11:14.812494] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1690110 is same with the state(5) to be set 00:25:09.211 [2024-07-13 10:11:14.812560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.211 [2024-07-13 10:11:14.812582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.211 [2024-07-13 10:11:14.812608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.211 [2024-07-13 10:11:14.812626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.211 [2024-07-13 10:11:14.812643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.211 [2024-07-13 10:11:14.812658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.211 [2024-07-13 10:11:14.812675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.211 [2024-07-13 10:11:14.812690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.211 [2024-07-13 10:11:14.812706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.211 [2024-07-13 10:11:14.812721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.211 [2024-07-13 10:11:14.812737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.211 [2024-07-13 10:11:14.812751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.211 [2024-07-13 10:11:14.812768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.211 [2024-07-13 10:11:14.812782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.211 [2024-07-13 10:11:14.812780] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.211 [2024-07-13 10:11:14.812800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.211 [2024-07-13 10:11:14.812805] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.211 [2024-07-13 10:11:14.812816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.211 [2024-07-13 10:11:14.812818] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.211 [2024-07-13 10:11:14.812831] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.211 [2024-07-13 10:11:14.812832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.211 [2024-07-13 10:11:14.812843] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.211 [2024-07-13 10:11:14.812848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.211 [2024-07-13 10:11:14.812860] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.211 [2024-07-13 10:11:14.812873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.211 [2024-07-13 10:11:14.812891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.211 [2024-07-13 10:11:14.812892] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.211 [2024-07-13 10:11:14.812906] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.211 [2024-07-13 10:11:14.812907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.211 [2024-07-13 10:11:14.812924] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with [2024-07-13 10:11:14.812925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:09.211 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.211 [2024-07-13 10:11:14.812938] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.211 [2024-07-13 10:11:14.812943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.211 [2024-07-13 10:11:14.812951] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.211 [2024-07-13 10:11:14.812958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.211 [2024-07-13 10:11:14.812963] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.211 [2024-07-13 10:11:14.812974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:32768 len:12[2024-07-13 10:11:14.812975] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.211 the state(5) to be set 00:25:09.211 [2024-07-13 10:11:14.812990] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.211 [2024-07-13 10:11:14.812991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.211 [2024-07-13 10:11:14.813002] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.211 [2024-07-13 10:11:14.813008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.211 [2024-07-13 10:11:14.813014] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.211 [2024-07-13 10:11:14.813023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.211 [2024-07-13 10:11:14.813026] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.211 [2024-07-13 10:11:14.813038] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.211 [2024-07-13 10:11:14.813039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.211 [2024-07-13 10:11:14.813050] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.211 [2024-07-13 10:11:14.813054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.211 [2024-07-13 10:11:14.813063] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.211 [2024-07-13 10:11:14.813076] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with [2024-07-13 10:11:14.813076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:33408 len:12the state(5) to be set 00:25:09.211 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.211 [2024-07-13 10:11:14.813090] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.211 [2024-07-13 10:11:14.813092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.211 [2024-07-13 10:11:14.813103] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.211 [2024-07-13 10:11:14.813110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.211 [2024-07-13 10:11:14.813115] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.211 [2024-07-13 10:11:14.813125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.211 [2024-07-13 10:11:14.813128] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.211 [2024-07-13 10:11:14.813141] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.211 [2024-07-13 10:11:14.813142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.211 [2024-07-13 10:11:14.813153] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.211 [2024-07-13 10:11:14.813157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.211 [2024-07-13 10:11:14.813165] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.211 [2024-07-13 10:11:14.813177] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.211 [2024-07-13 10:11:14.813181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.211 [2024-07-13 10:11:14.813189] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.211 [2024-07-13 10:11:14.813196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.211 [2024-07-13 10:11:14.813201] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.211 [2024-07-13 10:11:14.813214] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with [2024-07-13 10:11:14.813213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:35968 len:12the state(5) to be set 00:25:09.211 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.211 [2024-07-13 10:11:14.813228] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.211 [2024-07-13 10:11:14.813231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.212 [2024-07-13 10:11:14.813247] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with [2024-07-13 10:11:14.813248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:36096 len:1the state(5) to be set 00:25:09.212 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.212 [2024-07-13 10:11:14.813265] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.212 [2024-07-13 10:11:14.813269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.212 [2024-07-13 10:11:14.813278] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.212 [2024-07-13 10:11:14.813286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.212 [2024-07-13 10:11:14.813290] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.212 [2024-07-13 10:11:14.813302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-07-13 10:11:14.813303] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.212 the state(5) to be set 00:25:09.212 [2024-07-13 10:11:14.813317] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.212 [2024-07-13 10:11:14.813320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.212 [2024-07-13 10:11:14.813329] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.212 [2024-07-13 10:11:14.813335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.212 [2024-07-13 10:11:14.813341] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.212 [2024-07-13 10:11:14.813352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:36352 len:12[2024-07-13 10:11:14.813354] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.212 the state(5) to be set 00:25:09.212 [2024-07-13 10:11:14.813368] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with [2024-07-13 10:11:14.813368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:09.212 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.212 [2024-07-13 10:11:14.813382] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.212 [2024-07-13 10:11:14.813387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.212 [2024-07-13 10:11:14.813394] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.212 [2024-07-13 10:11:14.813403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.212 [2024-07-13 10:11:14.813407] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.212 [2024-07-13 10:11:14.813420] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with [2024-07-13 10:11:14.813420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:36608 len:12the state(5) to be set 00:25:09.212 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.212 [2024-07-13 10:11:14.813434] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.212 [2024-07-13 10:11:14.813436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.212 [2024-07-13 10:11:14.813461] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.212 [2024-07-13 10:11:14.813468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.212 [2024-07-13 10:11:14.813476] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.212 [2024-07-13 10:11:14.813483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.212 [2024-07-13 10:11:14.813489] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.212 [2024-07-13 10:11:14.813500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:34560 len:128[2024-07-13 10:11:14.813501] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.212 the state(5) to be set 00:25:09.212 [2024-07-13 10:11:14.813516] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with [2024-07-13 10:11:14.813516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:09.212 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.212 [2024-07-13 10:11:14.813529] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.212 [2024-07-13 10:11:14.813533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.212 [2024-07-13 10:11:14.813542] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.212 [2024-07-13 10:11:14.813554] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with [2024-07-13 10:11:14.813554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:09.212 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.212 [2024-07-13 10:11:14.813567] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.212 [2024-07-13 10:11:14.813572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.212 [2024-07-13 10:11:14.813579] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.212 [2024-07-13 10:11:14.813587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.212 [2024-07-13 10:11:14.813592] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.212 [2024-07-13 10:11:14.813603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128[2024-07-13 10:11:14.813604] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.212 the state(5) to be set 00:25:09.212 [2024-07-13 10:11:14.813619] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with [2024-07-13 10:11:14.813620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:09.212 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.212 [2024-07-13 10:11:14.813633] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.212 [2024-07-13 10:11:14.813637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.212 [2024-07-13 10:11:14.813645] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccac0 is same with the state(5) to be set 00:25:09.212 [2024-07-13 10:11:14.813652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.212 [2024-07-13 10:11:14.813672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.212 [2024-07-13 10:11:14.813686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.212 [2024-07-13 10:11:14.813707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.212 [2024-07-13 10:11:14.813722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.212 [2024-07-13 10:11:14.813737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.212 [2024-07-13 10:11:14.813751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.212 [2024-07-13 10:11:14.813767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.212 [2024-07-13 10:11:14.813780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.212 [2024-07-13 10:11:14.813796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.212 [2024-07-13 10:11:14.813809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.212 [2024-07-13 10:11:14.813825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.212 [2024-07-13 10:11:14.813838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.212 [2024-07-13 10:11:14.813853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.212 [2024-07-13 10:11:14.813894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.212 [2024-07-13 10:11:14.813924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.212 [2024-07-13 10:11:14.813939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.212 [2024-07-13 10:11:14.813955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.212 [2024-07-13 10:11:14.813969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.212 [2024-07-13 10:11:14.813984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.212 [2024-07-13 10:11:14.813998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.212 [2024-07-13 10:11:14.814014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.212 [2024-07-13 10:11:14.814028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.212 [2024-07-13 10:11:14.814043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.212 [2024-07-13 10:11:14.814057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.212 [2024-07-13 10:11:14.814072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.212 [2024-07-13 10:11:14.814095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.212 [2024-07-13 10:11:14.814112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.212 [2024-07-13 10:11:14.814126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.212 [2024-07-13 10:11:14.814142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.212 [2024-07-13 10:11:14.814156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.212 [2024-07-13 10:11:14.814186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.212 [2024-07-13 10:11:14.814200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.212 [2024-07-13 10:11:14.814216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.213 [2024-07-13 10:11:14.814230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.213 [2024-07-13 10:11:14.814250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.213 [2024-07-13 10:11:14.814264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.213 [2024-07-13 10:11:14.814280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.213 [2024-07-13 10:11:14.814294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.213 [2024-07-13 10:11:14.814309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.213 [2024-07-13 10:11:14.814323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.213 [2024-07-13 10:11:14.814338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.213 [2024-07-13 10:11:14.814352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.213 [2024-07-13 10:11:14.814367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.213 [2024-07-13 10:11:14.814381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.213 [2024-07-13 10:11:14.814396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.213 [2024-07-13 10:11:14.814410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.213 [2024-07-13 10:11:14.814400] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccf50 is same with the state(5) to be set 00:25:09.213 [2024-07-13 10:11:14.814425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.213 [2024-07-13 10:11:14.814439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.213 [2024-07-13 10:11:14.814440] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cccf50 is same with the state(5) to be set 00:25:09.213 [2024-07-13 10:11:14.814455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.213 [2024-07-13 10:11:14.814469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.213 [2024-07-13 10:11:14.814485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.213 [2024-07-13 10:11:14.814498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.213 [2024-07-13 10:11:14.814513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.213 [2024-07-13 10:11:14.814527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.213 [2024-07-13 10:11:14.814542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.213 [2024-07-13 10:11:14.814555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.213 [2024-07-13 10:11:14.814571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.213 [2024-07-13 10:11:14.814589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.213 [2024-07-13 10:11:14.814605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.213 [2024-07-13 10:11:14.814618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.213 [2024-07-13 10:11:14.814633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.213 [2024-07-13 10:11:14.814646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.213 [2024-07-13 10:11:14.814662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.213 [2024-07-13 10:11:14.814675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.213 [2024-07-13 10:11:14.814689] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15abaa0 is same with the state(5) to be set 00:25:09.213 [2024-07-13 10:11:14.814774] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x15abaa0 was disconnected and freed. reset controller. 00:25:09.213 [2024-07-13 10:11:14.815232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.213 [2024-07-13 10:11:14.815257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.213 [2024-07-13 10:11:14.815278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.213 [2024-07-13 10:11:14.815294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.213 [2024-07-13 10:11:14.815310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.213 [2024-07-13 10:11:14.815326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.213 [2024-07-13 10:11:14.815342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.213 [2024-07-13 10:11:14.815360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.213 [2024-07-13 10:11:14.815376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.213 [2024-07-13 10:11:14.815390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.213 [2024-07-13 10:11:14.815407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.213 [2024-07-13 10:11:14.815421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.213 [2024-07-13 10:11:14.815437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.213 [2024-07-13 10:11:14.815450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.213 [2024-07-13 10:11:14.815466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.213 [2024-07-13 10:11:14.815480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.213 [2024-07-13 10:11:14.815496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.213 [2024-07-13 10:11:14.815509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.213 [2024-07-13 10:11:14.815525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.213 [2024-07-13 10:11:14.815538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.213 [2024-07-13 10:11:14.815554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.213 [2024-07-13 10:11:14.815568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.213 [2024-07-13 10:11:14.815584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.213 [2024-07-13 10:11:14.815603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.213 [2024-07-13 10:11:14.815620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.213 [2024-07-13 10:11:14.815634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.213 [2024-07-13 10:11:14.815650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.213 [2024-07-13 10:11:14.815664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.213 [2024-07-13 10:11:14.815679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.213 [2024-07-13 10:11:14.815693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.213 [2024-07-13 10:11:14.815709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.213 [2024-07-13 10:11:14.815723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.213 [2024-07-13 10:11:14.815739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.213 [2024-07-13 10:11:14.815756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.213 [2024-07-13 10:11:14.815772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.213 [2024-07-13 10:11:14.815786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.213 [2024-07-13 10:11:14.815802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.213 [2024-07-13 10:11:14.815817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.213 [2024-07-13 10:11:14.815833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.213 [2024-07-13 10:11:14.815847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.213 [2024-07-13 10:11:14.815862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.213 [2024-07-13 10:11:14.815884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.213 [2024-07-13 10:11:14.815901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.213 [2024-07-13 10:11:14.815918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.213 [2024-07-13 10:11:14.815934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.213 [2024-07-13 10:11:14.815948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.213 [2024-07-13 10:11:14.815963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.213 [2024-07-13 10:11:14.815977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.213 [2024-07-13 10:11:14.815993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.213 [2024-07-13 10:11:14.816007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.214 [2024-07-13 10:11:14.816022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.214 [2024-07-13 10:11:14.816037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.214 [2024-07-13 10:11:14.816052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.214 [2024-07-13 10:11:14.816066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.214 [2024-07-13 10:11:14.816082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.214 [2024-07-13 10:11:14.816101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.214 [2024-07-13 10:11:14.816117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.214 [2024-07-13 10:11:14.816131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.214 [2024-07-13 10:11:14.816150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.214 [2024-07-13 10:11:14.816189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.214 [2024-07-13 10:11:14.816205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.214 [2024-07-13 10:11:14.816219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.214 [2024-07-13 10:11:14.816234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.214 [2024-07-13 10:11:14.816247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.214 [2024-07-13 10:11:14.816262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.214 [2024-07-13 10:11:14.816282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.214 [2024-07-13 10:11:14.816297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.214 [2024-07-13 10:11:14.816311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.214 [2024-07-13 10:11:14.816327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.214 [2024-07-13 10:11:14.816341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.214 [2024-07-13 10:11:14.816356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.214 [2024-07-13 10:11:14.816369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.214 [2024-07-13 10:11:14.816385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.214 [2024-07-13 10:11:14.816399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.214 [2024-07-13 10:11:14.816414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.214 [2024-07-13 10:11:14.816427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.214 [2024-07-13 10:11:14.816442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.214 [2024-07-13 10:11:14.836727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.214 [2024-07-13 10:11:14.836808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.214 [2024-07-13 10:11:14.836825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.214 [2024-07-13 10:11:14.836842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.214 [2024-07-13 10:11:14.836857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.214 [2024-07-13 10:11:14.836884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.214 [2024-07-13 10:11:14.836910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.214 [2024-07-13 10:11:14.836927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.214 [2024-07-13 10:11:14.836942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.214 [2024-07-13 10:11:14.836959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.214 [2024-07-13 10:11:14.836975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.214 [2024-07-13 10:11:14.836992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.214 [2024-07-13 10:11:14.837007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.214 [2024-07-13 10:11:14.837024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.214 [2024-07-13 10:11:14.837039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.214 [2024-07-13 10:11:14.837056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.214 [2024-07-13 10:11:14.837070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.214 [2024-07-13 10:11:14.837087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.214 [2024-07-13 10:11:14.837102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.214 [2024-07-13 10:11:14.837119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.214 [2024-07-13 10:11:14.837135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.214 [2024-07-13 10:11:14.837152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.214 [2024-07-13 10:11:14.837167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.214 [2024-07-13 10:11:14.837183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.214 [2024-07-13 10:11:14.837198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.214 [2024-07-13 10:11:14.837215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.214 [2024-07-13 10:11:14.837229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.214 [2024-07-13 10:11:14.837245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.214 [2024-07-13 10:11:14.837259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.214 [2024-07-13 10:11:14.837276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.214 [2024-07-13 10:11:14.837291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.214 [2024-07-13 10:11:14.837311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.214 [2024-07-13 10:11:14.837326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.214 [2024-07-13 10:11:14.837343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.214 [2024-07-13 10:11:14.837359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.214 [2024-07-13 10:11:14.837375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.214 [2024-07-13 10:11:14.837390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.214 [2024-07-13 10:11:14.837407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.214 [2024-07-13 10:11:14.837421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.214 [2024-07-13 10:11:14.837438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.214 [2024-07-13 10:11:14.837453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.214 [2024-07-13 10:11:14.837469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.214 [2024-07-13 10:11:14.837483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.214 [2024-07-13 10:11:14.837500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.214 [2024-07-13 10:11:14.837515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.214 [2024-07-13 10:11:14.837532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.214 [2024-07-13 10:11:14.837547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.215 [2024-07-13 10:11:14.837563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.215 [2024-07-13 10:11:14.837577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.215 [2024-07-13 10:11:14.837593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.215 [2024-07-13 10:11:14.837608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.215 [2024-07-13 10:11:14.837625] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ad2f0 is same with the state(5) to be set 00:25:09.215 [2024-07-13 10:11:14.837734] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x15ad2f0 was disconnected and freed. reset controller. 00:25:09.215 [2024-07-13 10:11:14.846769] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14d6410 (9): Bad file descriptor 00:25:09.215 [2024-07-13 10:11:14.846874] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1533530 (9): Bad file descriptor 00:25:09.215 [2024-07-13 10:11:14.846946] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.215 [2024-07-13 10:11:14.846982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.215 [2024-07-13 10:11:14.847000] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.215 [2024-07-13 10:11:14.847013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.215 [2024-07-13 10:11:14.847028] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.215 [2024-07-13 10:11:14.847042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.215 [2024-07-13 10:11:14.847056] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.215 [2024-07-13 10:11:14.847070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.215 [2024-07-13 10:11:14.847083] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16a5d90 is same with the state(5) to be set 00:25:09.215 [2024-07-13 10:11:14.847134] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.215 [2024-07-13 10:11:14.847156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.215 [2024-07-13 10:11:14.847172] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.215 [2024-07-13 10:11:14.847186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.215 [2024-07-13 10:11:14.847199] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.215 [2024-07-13 10:11:14.847213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.215 [2024-07-13 10:11:14.847227] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:09.215 [2024-07-13 10:11:14.847241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.215 [2024-07-13 10:11:14.847254] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x168c900 is same with the state(5) to be set 00:25:09.215 [2024-07-13 10:11:14.847283] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x16a5960 (9): Bad file descriptor 00:25:09.215 [2024-07-13 10:11:14.847315] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1509c80 (9): Bad file descriptor 00:25:09.215 [2024-07-13 10:11:14.847347] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14dda30 (9): Bad file descriptor 00:25:09.215 [2024-07-13 10:11:14.847373] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1507d80 (9): Bad file descriptor 00:25:09.215 [2024-07-13 10:11:14.847402] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x168c4d0 (9): Bad file descriptor 00:25:09.215 [2024-07-13 10:11:14.847428] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1690110 (9): Bad file descriptor 00:25:09.215 [2024-07-13 10:11:14.848624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.215 [2024-07-13 10:11:14.848651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.215 [2024-07-13 10:11:14.848677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.215 [2024-07-13 10:11:14.848699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.215 [2024-07-13 10:11:14.848728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.215 [2024-07-13 10:11:14.848742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.215 [2024-07-13 10:11:14.848759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.215 [2024-07-13 10:11:14.848773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.215 [2024-07-13 10:11:14.848794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.215 [2024-07-13 10:11:14.848808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.215 [2024-07-13 10:11:14.848824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.215 [2024-07-13 10:11:14.848839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.215 [2024-07-13 10:11:14.848855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.215 [2024-07-13 10:11:14.848877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.215 [2024-07-13 10:11:14.848894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.215 [2024-07-13 10:11:14.848909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.215 [2024-07-13 10:11:14.848926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.215 [2024-07-13 10:11:14.848940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.215 [2024-07-13 10:11:14.848957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.215 [2024-07-13 10:11:14.848972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.215 [2024-07-13 10:11:14.848988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.215 [2024-07-13 10:11:14.849003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.215 [2024-07-13 10:11:14.849019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.215 [2024-07-13 10:11:14.849033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.215 [2024-07-13 10:11:14.849049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.215 [2024-07-13 10:11:14.849064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.215 [2024-07-13 10:11:14.849081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.215 [2024-07-13 10:11:14.849095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.215 [2024-07-13 10:11:14.849116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.215 [2024-07-13 10:11:14.849131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.215 [2024-07-13 10:11:14.849148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.215 [2024-07-13 10:11:14.849164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.215 [2024-07-13 10:11:14.849180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.215 [2024-07-13 10:11:14.849195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.215 [2024-07-13 10:11:14.849211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.215 [2024-07-13 10:11:14.849226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.215 [2024-07-13 10:11:14.849242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.215 [2024-07-13 10:11:14.849257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.215 [2024-07-13 10:11:14.849274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.215 [2024-07-13 10:11:14.849288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.215 [2024-07-13 10:11:14.849305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.215 [2024-07-13 10:11:14.849320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.215 [2024-07-13 10:11:14.849337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.215 [2024-07-13 10:11:14.849352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.215 [2024-07-13 10:11:14.849369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.215 [2024-07-13 10:11:14.849384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.215 [2024-07-13 10:11:14.849401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.215 [2024-07-13 10:11:14.849415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.215 [2024-07-13 10:11:14.849432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.215 [2024-07-13 10:11:14.849446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.215 [2024-07-13 10:11:14.849463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.215 [2024-07-13 10:11:14.849477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.215 [2024-07-13 10:11:14.849493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.215 [2024-07-13 10:11:14.849511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.215 [2024-07-13 10:11:14.849528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.216 [2024-07-13 10:11:14.849543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.216 [2024-07-13 10:11:14.849559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.216 [2024-07-13 10:11:14.849574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.216 [2024-07-13 10:11:14.849590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.216 [2024-07-13 10:11:14.849604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.216 [2024-07-13 10:11:14.849620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.216 [2024-07-13 10:11:14.849636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.216 [2024-07-13 10:11:14.849652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.216 [2024-07-13 10:11:14.849667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.216 [2024-07-13 10:11:14.849683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.216 [2024-07-13 10:11:14.849697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.216 [2024-07-13 10:11:14.849713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.216 [2024-07-13 10:11:14.849727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.216 [2024-07-13 10:11:14.849743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.216 [2024-07-13 10:11:14.849757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.216 [2024-07-13 10:11:14.849774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.216 [2024-07-13 10:11:14.849788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.216 [2024-07-13 10:11:14.849805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.216 [2024-07-13 10:11:14.849820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.216 [2024-07-13 10:11:14.849836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.216 [2024-07-13 10:11:14.849850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.216 [2024-07-13 10:11:14.849874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.216 [2024-07-13 10:11:14.849890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.216 [2024-07-13 10:11:14.849912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.216 [2024-07-13 10:11:14.849928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.216 [2024-07-13 10:11:14.849945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.216 [2024-07-13 10:11:14.849959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.216 [2024-07-13 10:11:14.849976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.216 [2024-07-13 10:11:14.849990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.216 [2024-07-13 10:11:14.850007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.216 [2024-07-13 10:11:14.850021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.216 [2024-07-13 10:11:14.850039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.216 [2024-07-13 10:11:14.850054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.216 [2024-07-13 10:11:14.850070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.216 [2024-07-13 10:11:14.850084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.216 [2024-07-13 10:11:14.850100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.216 [2024-07-13 10:11:14.850114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.216 [2024-07-13 10:11:14.850131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.216 [2024-07-13 10:11:14.850145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.216 [2024-07-13 10:11:14.850161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.216 [2024-07-13 10:11:14.850175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.216 [2024-07-13 10:11:14.850192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.216 [2024-07-13 10:11:14.850206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.216 [2024-07-13 10:11:14.850222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.216 [2024-07-13 10:11:14.850236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.216 [2024-07-13 10:11:14.850252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.216 [2024-07-13 10:11:14.850266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.216 [2024-07-13 10:11:14.850283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.216 [2024-07-13 10:11:14.850302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.216 [2024-07-13 10:11:14.850318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.216 [2024-07-13 10:11:14.850332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.216 [2024-07-13 10:11:14.850348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.216 [2024-07-13 10:11:14.850363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.216 [2024-07-13 10:11:14.850380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.216 [2024-07-13 10:11:14.850394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.216 [2024-07-13 10:11:14.850412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.216 [2024-07-13 10:11:14.850426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.216 [2024-07-13 10:11:14.850443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.216 [2024-07-13 10:11:14.850458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.216 [2024-07-13 10:11:14.850474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.216 [2024-07-13 10:11:14.850488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.216 [2024-07-13 10:11:14.850504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.216 [2024-07-13 10:11:14.850519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.216 [2024-07-13 10:11:14.850535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.216 [2024-07-13 10:11:14.850550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.216 [2024-07-13 10:11:14.850566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.216 [2024-07-13 10:11:14.850580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.216 [2024-07-13 10:11:14.850596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.216 [2024-07-13 10:11:14.850610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.216 [2024-07-13 10:11:14.850627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.216 [2024-07-13 10:11:14.850642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.216 [2024-07-13 10:11:14.850658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.216 [2024-07-13 10:11:14.850673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.216 [2024-07-13 10:11:14.850792] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1673650 was disconnected and freed. reset controller. 00:25:09.216 [2024-07-13 10:11:14.852239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.216 [2024-07-13 10:11:14.852265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.216 [2024-07-13 10:11:14.852288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.216 [2024-07-13 10:11:14.852304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.216 [2024-07-13 10:11:14.852321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.216 [2024-07-13 10:11:14.852337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.216 [2024-07-13 10:11:14.852353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.216 [2024-07-13 10:11:14.852367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.216 [2024-07-13 10:11:14.852383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.216 [2024-07-13 10:11:14.852398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.216 [2024-07-13 10:11:14.852414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.852428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.852445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.852460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.852476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.852490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.852507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.852521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.852538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.852552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.852568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.852583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.852599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.852614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.852634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.852650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.852666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.852680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.852696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.852710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.852726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.852740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.852756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.852770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.852787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.852802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.852818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.852832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.852849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.852863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.852888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.852903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.852919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.852933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.852950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.852965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.852981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.852996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.853012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.853034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.853051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.853066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.853083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.853097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.853113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.853128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.853144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.853158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.853174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.853188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.853205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.853220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.853236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.853251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.853267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.853282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.853298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.853313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.853329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.853343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.853360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.853374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.853391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.853405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.853425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.853440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.853457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.853471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.853488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.853502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.853518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.853533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.853549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.853563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.853580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.853595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.853611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.853626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.853642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.853657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.853672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.853687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.853704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.853718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.853733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.217 [2024-07-13 10:11:14.853748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.217 [2024-07-13 10:11:14.853764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.218 [2024-07-13 10:11:14.853778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.218 [2024-07-13 10:11:14.853795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.218 [2024-07-13 10:11:14.853813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.218 [2024-07-13 10:11:14.853830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.218 [2024-07-13 10:11:14.853844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.218 [2024-07-13 10:11:14.853861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.218 [2024-07-13 10:11:14.853883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.218 [2024-07-13 10:11:14.853901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.218 [2024-07-13 10:11:14.853916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.218 [2024-07-13 10:11:14.853932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.218 [2024-07-13 10:11:14.853946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.218 [2024-07-13 10:11:14.853963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.218 [2024-07-13 10:11:14.853978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.218 [2024-07-13 10:11:14.853995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.218 [2024-07-13 10:11:14.854010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.218 [2024-07-13 10:11:14.854027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.218 [2024-07-13 10:11:14.854041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.218 [2024-07-13 10:11:14.854057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.218 [2024-07-13 10:11:14.854071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.218 [2024-07-13 10:11:14.854087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.218 [2024-07-13 10:11:14.854102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.218 [2024-07-13 10:11:14.854119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.218 [2024-07-13 10:11:14.854134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.218 [2024-07-13 10:11:14.854150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.218 [2024-07-13 10:11:14.854165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.218 [2024-07-13 10:11:14.854181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.218 [2024-07-13 10:11:14.854195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.218 [2024-07-13 10:11:14.854215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.218 [2024-07-13 10:11:14.854231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.218 [2024-07-13 10:11:14.854247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.218 [2024-07-13 10:11:14.854262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.218 [2024-07-13 10:11:14.854362] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x15b1490 was disconnected and freed. reset controller. 00:25:09.218 [2024-07-13 10:11:14.854422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.218 [2024-07-13 10:11:14.854444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.218 [2024-07-13 10:11:14.854467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.218 [2024-07-13 10:11:14.854483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.218 [2024-07-13 10:11:14.854500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.218 [2024-07-13 10:11:14.854515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.218 [2024-07-13 10:11:14.854531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.218 [2024-07-13 10:11:14.854546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.218 [2024-07-13 10:11:14.854563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.218 [2024-07-13 10:11:14.854578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.218 [2024-07-13 10:11:14.854595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.218 [2024-07-13 10:11:14.854610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.218 [2024-07-13 10:11:14.854627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.218 [2024-07-13 10:11:14.854642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.218 [2024-07-13 10:11:14.854659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.218 [2024-07-13 10:11:14.854673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.218 [2024-07-13 10:11:14.854690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.218 [2024-07-13 10:11:14.854705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.218 [2024-07-13 10:11:14.854721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.218 [2024-07-13 10:11:14.854736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.218 [2024-07-13 10:11:14.854757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.218 [2024-07-13 10:11:14.854775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.218 [2024-07-13 10:11:14.854793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.218 [2024-07-13 10:11:14.854809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.218 [2024-07-13 10:11:14.854825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.218 [2024-07-13 10:11:14.854840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.218 [2024-07-13 10:11:14.854856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.218 [2024-07-13 10:11:14.854879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.218 [2024-07-13 10:11:14.854897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.218 [2024-07-13 10:11:14.854912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.218 [2024-07-13 10:11:14.854929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.218 [2024-07-13 10:11:14.854944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.218 [2024-07-13 10:11:14.854960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.218 [2024-07-13 10:11:14.854976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.218 [2024-07-13 10:11:14.854992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.218 [2024-07-13 10:11:14.855007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.218 [2024-07-13 10:11:14.855024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.218 [2024-07-13 10:11:14.855038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.218 [2024-07-13 10:11:14.855055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.218 [2024-07-13 10:11:14.855070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.218 [2024-07-13 10:11:14.855086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.218 [2024-07-13 10:11:14.855101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.218 [2024-07-13 10:11:14.855118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.855133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.219 [2024-07-13 10:11:14.855149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.855165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.219 [2024-07-13 10:11:14.855185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.855201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.219 [2024-07-13 10:11:14.855219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.855234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.219 [2024-07-13 10:11:14.855250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.855265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.219 [2024-07-13 10:11:14.855282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.855298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.219 [2024-07-13 10:11:14.855314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.855329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.219 [2024-07-13 10:11:14.855345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.855360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.219 [2024-07-13 10:11:14.855377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.855392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.219 [2024-07-13 10:11:14.855409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.855423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.219 [2024-07-13 10:11:14.855440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.855455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.219 [2024-07-13 10:11:14.855472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.855487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.219 [2024-07-13 10:11:14.855504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.855519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.219 [2024-07-13 10:11:14.855536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.855551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.219 [2024-07-13 10:11:14.855568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.855586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.219 [2024-07-13 10:11:14.855604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.855618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.219 [2024-07-13 10:11:14.855635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.855650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.219 [2024-07-13 10:11:14.855667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.855689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.219 [2024-07-13 10:11:14.855706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.855721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.219 [2024-07-13 10:11:14.855738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.855752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.219 [2024-07-13 10:11:14.855770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.855785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.219 [2024-07-13 10:11:14.855801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.855816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.219 [2024-07-13 10:11:14.855832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.855847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.219 [2024-07-13 10:11:14.855863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.855884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.219 [2024-07-13 10:11:14.855901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.855918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.219 [2024-07-13 10:11:14.855934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.855949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.219 [2024-07-13 10:11:14.855965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.855980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.219 [2024-07-13 10:11:14.856001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.856016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.219 [2024-07-13 10:11:14.856032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.856046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.219 [2024-07-13 10:11:14.856063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.856078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.219 [2024-07-13 10:11:14.856095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.856109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.219 [2024-07-13 10:11:14.856125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.856140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.219 [2024-07-13 10:11:14.856156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.856171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.219 [2024-07-13 10:11:14.856188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.856207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.219 [2024-07-13 10:11:14.856224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.856239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.219 [2024-07-13 10:11:14.856256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.856270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.219 [2024-07-13 10:11:14.856287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.856302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.219 [2024-07-13 10:11:14.856318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.856333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.219 [2024-07-13 10:11:14.856349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.856364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.219 [2024-07-13 10:11:14.856380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.856398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.219 [2024-07-13 10:11:14.856415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.856430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.219 [2024-07-13 10:11:14.856447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.856461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.219 [2024-07-13 10:11:14.856478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.219 [2024-07-13 10:11:14.856493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.220 [2024-07-13 10:11:14.856509] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15b2a30 is same with the state(5) to be set 00:25:09.220 [2024-07-13 10:11:14.856583] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x15b2a30 was disconnected and freed. reset controller. 00:25:09.220 [2024-07-13 10:11:14.856683] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:09.220 [2024-07-13 10:11:14.861196] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:25:09.220 [2024-07-13 10:11:14.861254] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:25:09.220 [2024-07-13 10:11:14.861458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:09.220 [2024-07-13 10:11:14.861600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:09.220 [2024-07-13 10:11:14.861626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14dda30 with addr=10.0.0.2, port=4420 00:25:09.220 [2024-07-13 10:11:14.861645] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14dda30 is same with the state(5) to be set 00:25:09.220 [2024-07-13 10:11:14.861693] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x16a5d90 (9): Bad file descriptor 00:25:09.220 [2024-07-13 10:11:14.861722] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x168c900 (9): Bad file descriptor 00:25:09.220 [2024-07-13 10:11:14.862514] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:09.220 [2024-07-13 10:11:14.862724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.220 [2024-07-13 10:11:14.862753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.220 [2024-07-13 10:11:14.862781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.220 [2024-07-13 10:11:14.862800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.220 [2024-07-13 10:11:14.862821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.220 [2024-07-13 10:11:14.862839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.220 [2024-07-13 10:11:14.862860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.220 [2024-07-13 10:11:14.862888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.220 [2024-07-13 10:11:14.862921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.220 [2024-07-13 10:11:14.862939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.220 [2024-07-13 10:11:14.862961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.220 [2024-07-13 10:11:14.862978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.220 [2024-07-13 10:11:14.862999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.220 [2024-07-13 10:11:14.863015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.220 [2024-07-13 10:11:14.863036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.220 [2024-07-13 10:11:14.863053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.220 [2024-07-13 10:11:14.863075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.220 [2024-07-13 10:11:14.863092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.220 [2024-07-13 10:11:14.863113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.220 [2024-07-13 10:11:14.863130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.220 [2024-07-13 10:11:14.863151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.220 [2024-07-13 10:11:14.863168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.220 [2024-07-13 10:11:14.863189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.220 [2024-07-13 10:11:14.863206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.220 [2024-07-13 10:11:14.863227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.220 [2024-07-13 10:11:14.863244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.220 [2024-07-13 10:11:14.863265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.220 [2024-07-13 10:11:14.863282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.220 [2024-07-13 10:11:14.863302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.220 [2024-07-13 10:11:14.863319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.220 [2024-07-13 10:11:14.863340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.220 [2024-07-13 10:11:14.863357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.220 [2024-07-13 10:11:14.863378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.220 [2024-07-13 10:11:14.863400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.220 [2024-07-13 10:11:14.863422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.220 [2024-07-13 10:11:14.863439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.220 [2024-07-13 10:11:14.863460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.220 [2024-07-13 10:11:14.863478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.220 [2024-07-13 10:11:14.863498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.220 [2024-07-13 10:11:14.863515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.220 [2024-07-13 10:11:14.863536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.220 [2024-07-13 10:11:14.863553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.220 [2024-07-13 10:11:14.863574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.220 [2024-07-13 10:11:14.863591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.220 [2024-07-13 10:11:14.863612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.220 [2024-07-13 10:11:14.863629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.220 [2024-07-13 10:11:14.864456] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15b4010 is same with the state(5) to be set 00:25:09.220 [2024-07-13 10:11:14.865743] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x15b4010 was disconnected and freed. reset controller. 00:25:09.220 [2024-07-13 10:11:14.865766] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:09.220 [2024-07-13 10:11:14.865947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:09.220 [2024-07-13 10:11:14.866092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:09.220 [2024-07-13 10:11:14.866117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x168c4d0 with addr=10.0.0.2, port=4420 00:25:09.220 [2024-07-13 10:11:14.866133] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x168c4d0 is same with the state(5) to be set 00:25:09.220 [2024-07-13 10:11:14.866245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:09.220 [2024-07-13 10:11:14.866361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:09.220 [2024-07-13 10:11:14.866386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1509c80 with addr=10.0.0.2, port=4420 00:25:09.220 [2024-07-13 10:11:14.866402] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1509c80 is same with the state(5) to be set 00:25:09.220 [2024-07-13 10:11:14.866424] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14dda30 (9): Bad file descriptor 00:25:09.220 [2024-07-13 10:11:14.866776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.220 [2024-07-13 10:11:14.866801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.220 [2024-07-13 10:11:14.866830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.220 [2024-07-13 10:11:14.866847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.220 [2024-07-13 10:11:14.866864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.220 [2024-07-13 10:11:14.866889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.220 [2024-07-13 10:11:14.866906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.220 [2024-07-13 10:11:14.866921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.220 [2024-07-13 10:11:14.866938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.220 [2024-07-13 10:11:14.866952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.220 [2024-07-13 10:11:14.866969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.220 [2024-07-13 10:11:14.866983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.220 [2024-07-13 10:11:14.867000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.220 [2024-07-13 10:11:14.867015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.220 [2024-07-13 10:11:14.867032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.220 [2024-07-13 10:11:14.867046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.220 [2024-07-13 10:11:14.867062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.220 [2024-07-13 10:11:14.867076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.220 [2024-07-13 10:11:14.867093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.867107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.867124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.867139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.867155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.867170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.867186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.867200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.867216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.867236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.867253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.867268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.867285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.867299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.867316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.867330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.867347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.867362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.867379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.867393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.867410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.867424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.867441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.867455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.867471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.867486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.867502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.867516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.867533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.867547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.867564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.867578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.867595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.867609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.867629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.867645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.867661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.867676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.867693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.867707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.867723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.867738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.867753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.867768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.867784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.867799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.867815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.867830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.867846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.867861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.867884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.867926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.867946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.867962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.867979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.867993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.868009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.868024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.868040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.868058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.868075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.868090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.868106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.868120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.868136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.868151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.868167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.868181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.868198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.868213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.868229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.868243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.868260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.868275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.868290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.868305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.868321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.868336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.868353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.868367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.868384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.868398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.868414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.868429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.868449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.221 [2024-07-13 10:11:14.868465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.221 [2024-07-13 10:11:14.868481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.222 [2024-07-13 10:11:14.868496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.222 [2024-07-13 10:11:14.868512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.222 [2024-07-13 10:11:14.868527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.222 [2024-07-13 10:11:14.868543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.222 [2024-07-13 10:11:14.868558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.222 [2024-07-13 10:11:14.868576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.222 [2024-07-13 10:11:14.868591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.222 [2024-07-13 10:11:14.868608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.222 [2024-07-13 10:11:14.868623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.222 [2024-07-13 10:11:14.868639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.222 [2024-07-13 10:11:14.868653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.222 [2024-07-13 10:11:14.868670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.222 [2024-07-13 10:11:14.868686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.222 [2024-07-13 10:11:14.868702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.222 [2024-07-13 10:11:14.868717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.222 [2024-07-13 10:11:14.868733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.222 [2024-07-13 10:11:14.868748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.222 [2024-07-13 10:11:14.868765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.222 [2024-07-13 10:11:14.868779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.222 [2024-07-13 10:11:14.868796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.222 [2024-07-13 10:11:14.868811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.222 [2024-07-13 10:11:14.868827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.222 [2024-07-13 10:11:14.868845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.222 [2024-07-13 10:11:14.870095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.222 [2024-07-13 10:11:14.870119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.222 [2024-07-13 10:11:14.870141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.222 [2024-07-13 10:11:14.870157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.222 [2024-07-13 10:11:14.870174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.222 [2024-07-13 10:11:14.870189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.222 [2024-07-13 10:11:14.870205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.222 [2024-07-13 10:11:14.870220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.222 [2024-07-13 10:11:14.870236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.222 [2024-07-13 10:11:14.870252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.222 [2024-07-13 10:11:14.870269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.222 [2024-07-13 10:11:14.870284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.222 [2024-07-13 10:11:14.870301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.222 [2024-07-13 10:11:14.870316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.222 [2024-07-13 10:11:14.870333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.222 [2024-07-13 10:11:14.870348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.222 [2024-07-13 10:11:14.870365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.222 [2024-07-13 10:11:14.870380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.222 [2024-07-13 10:11:14.870397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.222 [2024-07-13 10:11:14.870411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.222 [2024-07-13 10:11:14.870429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.222 [2024-07-13 10:11:14.870443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.222 [2024-07-13 10:11:14.870460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.222 [2024-07-13 10:11:14.870475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.222 [2024-07-13 10:11:14.870496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.222 [2024-07-13 10:11:14.870513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.222 [2024-07-13 10:11:14.870530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.222 [2024-07-13 10:11:14.870545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.222 [2024-07-13 10:11:14.870562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.222 [2024-07-13 10:11:14.870577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.222 [2024-07-13 10:11:14.870593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.222 [2024-07-13 10:11:14.870609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.222 [2024-07-13 10:11:14.870625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.222 [2024-07-13 10:11:14.870640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.222 [2024-07-13 10:11:14.870657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.222 [2024-07-13 10:11:14.870672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.222 [2024-07-13 10:11:14.870689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.222 [2024-07-13 10:11:14.870704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.222 [2024-07-13 10:11:14.870721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.222 [2024-07-13 10:11:14.870736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.222 [2024-07-13 10:11:14.870754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.222 [2024-07-13 10:11:14.870770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.222 [2024-07-13 10:11:14.870786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.222 [2024-07-13 10:11:14.870801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.222 [2024-07-13 10:11:14.870818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.222 [2024-07-13 10:11:14.870833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.222 [2024-07-13 10:11:14.870849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.222 [2024-07-13 10:11:14.870864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.222 [2024-07-13 10:11:14.870890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.222 [2024-07-13 10:11:14.870915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.222 [2024-07-13 10:11:14.870933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.222 [2024-07-13 10:11:14.870948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.870965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.870979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.870996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.871010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.871026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.871042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.871058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.871072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.871089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.871103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.871120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.871134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.871151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.871165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.871182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.871196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.871212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.871227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.871243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.871257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.871275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.871290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.871309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.871324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.871341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.871356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.871373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.871387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.871403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.871418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.871434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.871448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.871465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.871479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.871495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.871510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.871526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.871540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.871557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.871571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.871587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.871602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.871618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.871633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.871648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.871663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.871679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.871698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.871715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.871730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.871745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.871760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.871778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.871793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.871809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.871824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.871840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.871856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.871878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.871894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.871910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.871925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.871941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.871956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.871972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.871987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.872003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.872017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.872033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.872048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.872064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.872078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.872098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.872113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.872129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.872144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.873378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.873403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.873424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.873440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.873457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.873471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.873488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.873502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.223 [2024-07-13 10:11:14.873520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.223 [2024-07-13 10:11:14.873534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.873551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.224 [2024-07-13 10:11:14.873566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.873583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.224 [2024-07-13 10:11:14.873598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.873614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.224 [2024-07-13 10:11:14.873629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.873645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.224 [2024-07-13 10:11:14.873660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.873676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.224 [2024-07-13 10:11:14.873691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.873707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.224 [2024-07-13 10:11:14.873721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.873743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.224 [2024-07-13 10:11:14.873758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.873775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.224 [2024-07-13 10:11:14.873789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.873805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.224 [2024-07-13 10:11:14.873820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.873836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.224 [2024-07-13 10:11:14.873851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.873885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.224 [2024-07-13 10:11:14.873913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.873930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.224 [2024-07-13 10:11:14.873945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.873961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.224 [2024-07-13 10:11:14.873976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.873993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.224 [2024-07-13 10:11:14.874007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.874024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.224 [2024-07-13 10:11:14.874039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.874056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.224 [2024-07-13 10:11:14.874071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.874087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.224 [2024-07-13 10:11:14.874102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.874119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.224 [2024-07-13 10:11:14.874133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.874150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.224 [2024-07-13 10:11:14.874168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.874185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.224 [2024-07-13 10:11:14.874200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.874216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.224 [2024-07-13 10:11:14.874231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.874247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.224 [2024-07-13 10:11:14.874262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.874279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.224 [2024-07-13 10:11:14.874293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.874309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.224 [2024-07-13 10:11:14.874323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.874339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.224 [2024-07-13 10:11:14.874355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.874371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.224 [2024-07-13 10:11:14.874385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.874402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.224 [2024-07-13 10:11:14.874416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.874433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.224 [2024-07-13 10:11:14.874448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.874464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.224 [2024-07-13 10:11:14.874478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.874494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.224 [2024-07-13 10:11:14.874509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.874526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.224 [2024-07-13 10:11:14.874541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.874561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.224 [2024-07-13 10:11:14.874576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.874593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.224 [2024-07-13 10:11:14.874607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.874624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.224 [2024-07-13 10:11:14.874638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.874654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.224 [2024-07-13 10:11:14.874669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.874685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.224 [2024-07-13 10:11:14.874700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.874716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.224 [2024-07-13 10:11:14.874730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.874746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.224 [2024-07-13 10:11:14.874761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.874778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.224 [2024-07-13 10:11:14.874793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.874809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.224 [2024-07-13 10:11:14.874823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.874840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.224 [2024-07-13 10:11:14.874854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.874876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.224 [2024-07-13 10:11:14.874894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.224 [2024-07-13 10:11:14.874911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.874925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.225 [2024-07-13 10:11:14.874942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.874965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.225 [2024-07-13 10:11:14.874982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.874998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.225 [2024-07-13 10:11:14.875014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.875029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.225 [2024-07-13 10:11:14.875046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.875061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.225 [2024-07-13 10:11:14.875078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.875092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.225 [2024-07-13 10:11:14.875110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.875125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.225 [2024-07-13 10:11:14.875142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.875156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.225 [2024-07-13 10:11:14.875173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.875187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.225 [2024-07-13 10:11:14.875204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.875218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.225 [2024-07-13 10:11:14.875235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.875250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.225 [2024-07-13 10:11:14.875267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.875282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.225 [2024-07-13 10:11:14.875299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.875314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.225 [2024-07-13 10:11:14.875331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.875346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.225 [2024-07-13 10:11:14.875366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.875381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.225 [2024-07-13 10:11:14.875398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.875413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.225 [2024-07-13 10:11:14.875429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.875444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.225 [2024-07-13 10:11:14.875460] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ae8d0 is same with the state(5) to be set 00:25:09.225 [2024-07-13 10:11:14.876706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.876732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.225 [2024-07-13 10:11:14.876754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.876770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.225 [2024-07-13 10:11:14.876787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.876802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.225 [2024-07-13 10:11:14.876819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.876835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.225 [2024-07-13 10:11:14.876852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.876873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.225 [2024-07-13 10:11:14.876892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.876917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.225 [2024-07-13 10:11:14.876933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.876948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.225 [2024-07-13 10:11:14.876964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.876979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.225 [2024-07-13 10:11:14.876996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.877010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.225 [2024-07-13 10:11:14.877032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.877048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.225 [2024-07-13 10:11:14.877065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.877079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.225 [2024-07-13 10:11:14.877097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.877113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.225 [2024-07-13 10:11:14.877129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.877144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.225 [2024-07-13 10:11:14.877161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.877175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.225 [2024-07-13 10:11:14.877192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.877207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.225 [2024-07-13 10:11:14.877224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.877239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.225 [2024-07-13 10:11:14.877255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.877270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.225 [2024-07-13 10:11:14.877287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.877302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.225 [2024-07-13 10:11:14.877319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.877334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.225 [2024-07-13 10:11:14.877350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.877366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.225 [2024-07-13 10:11:14.877383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.877398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.225 [2024-07-13 10:11:14.877415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.877433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.225 [2024-07-13 10:11:14.877451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.877466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.225 [2024-07-13 10:11:14.877483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.877497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.225 [2024-07-13 10:11:14.877515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.877529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.225 [2024-07-13 10:11:14.877546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.225 [2024-07-13 10:11:14.877561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.226 [2024-07-13 10:11:14.877578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.226 [2024-07-13 10:11:14.877592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.226 [2024-07-13 10:11:14.877609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.226 [2024-07-13 10:11:14.877624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.226 [2024-07-13 10:11:14.877641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.226 [2024-07-13 10:11:14.877655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.226 [2024-07-13 10:11:14.877672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.226 [2024-07-13 10:11:14.877687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.226 [2024-07-13 10:11:14.877703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.226 [2024-07-13 10:11:14.877718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.226 [2024-07-13 10:11:14.877736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.226 [2024-07-13 10:11:14.877751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.226 [2024-07-13 10:11:14.877768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.226 [2024-07-13 10:11:14.877782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.226 [2024-07-13 10:11:14.877799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.226 [2024-07-13 10:11:14.877814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.226 [2024-07-13 10:11:14.877834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.226 [2024-07-13 10:11:14.877850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.226 [2024-07-13 10:11:14.877876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.226 [2024-07-13 10:11:14.877895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.226 [2024-07-13 10:11:14.877912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.226 [2024-07-13 10:11:14.877928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.226 [2024-07-13 10:11:14.877945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.226 [2024-07-13 10:11:14.877960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.226 [2024-07-13 10:11:14.877976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.226 [2024-07-13 10:11:14.877991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.226 [2024-07-13 10:11:14.878008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.226 [2024-07-13 10:11:14.878023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.226 [2024-07-13 10:11:14.878040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.226 [2024-07-13 10:11:14.878055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.226 [2024-07-13 10:11:14.878073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.226 [2024-07-13 10:11:14.878087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.226 [2024-07-13 10:11:14.878104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.226 [2024-07-13 10:11:14.878119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.226 [2024-07-13 10:11:14.878135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.226 [2024-07-13 10:11:14.878150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.226 [2024-07-13 10:11:14.878167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.226 [2024-07-13 10:11:14.878181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.226 [2024-07-13 10:11:14.878198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.226 [2024-07-13 10:11:14.878212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.226 [2024-07-13 10:11:14.878229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.226 [2024-07-13 10:11:14.878247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.226 [2024-07-13 10:11:14.878264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.226 [2024-07-13 10:11:14.878279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.226 [2024-07-13 10:11:14.878295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.226 [2024-07-13 10:11:14.878310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.226 [2024-07-13 10:11:14.878326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.226 [2024-07-13 10:11:14.878340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.226 [2024-07-13 10:11:14.878356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.226 [2024-07-13 10:11:14.878371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.226 [2024-07-13 10:11:14.878388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.226 [2024-07-13 10:11:14.878402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.226 [2024-07-13 10:11:14.878418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.226 [2024-07-13 10:11:14.878433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.226 [2024-07-13 10:11:14.878449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.226 [2024-07-13 10:11:14.878464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.226 [2024-07-13 10:11:14.878480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.226 [2024-07-13 10:11:14.878495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.226 [2024-07-13 10:11:14.878511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.226 [2024-07-13 10:11:14.878526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.226 [2024-07-13 10:11:14.878542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.226 [2024-07-13 10:11:14.878556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.226 [2024-07-13 10:11:14.878573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.226 [2024-07-13 10:11:14.878588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.226 [2024-07-13 10:11:14.878604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.226 [2024-07-13 10:11:14.878619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.226 [2024-07-13 10:11:14.878639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.226 [2024-07-13 10:11:14.878654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.226 [2024-07-13 10:11:14.878671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.226 [2024-07-13 10:11:14.878685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.226 [2024-07-13 10:11:14.878702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.226 [2024-07-13 10:11:14.878716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.226 [2024-07-13 10:11:14.878733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.226 [2024-07-13 10:11:14.878747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.227 [2024-07-13 10:11:14.878764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:09.227 [2024-07-13 10:11:14.878778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:09.227 [2024-07-13 10:11:14.880878] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:25:09.227 [2024-07-13 10:11:14.880913] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:25:09.227 [2024-07-13 10:11:14.880935] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:25:09.227 [2024-07-13 10:11:14.880953] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:25:09.227 [2024-07-13 10:11:14.881027] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x168c4d0 (9): Bad file descriptor 00:25:09.227 [2024-07-13 10:11:14.881054] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1509c80 (9): Bad file descriptor 00:25:09.227 [2024-07-13 10:11:14.881072] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:25:09.227 [2024-07-13 10:11:14.881085] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:25:09.227 [2024-07-13 10:11:14.881112] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:09.227 [2024-07-13 10:11:14.881143] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:09.227 [2024-07-13 10:11:14.881199] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:09.227 [2024-07-13 10:11:14.881227] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:09.227 [2024-07-13 10:11:14.881248] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:09.227 [2024-07-13 10:11:14.881268] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:09.227 [2024-07-13 10:11:14.881287] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:09.227 [2024-07-13 10:11:14.881650] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:25:09.227 task offset: 35328 on job bdev=Nvme1n1 fails 00:25:09.227 00:25:09.227 Latency(us) 00:25:09.227 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:09.227 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:09.227 Job: Nvme1n1 ended in about 0.69 seconds with error 00:25:09.227 Verification LBA range: start 0x0 length 0x400 00:25:09.227 Nvme1n1 : 0.69 369.86 23.12 92.11 0.00 137525.94 27379.48 147577.36 00:25:09.227 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:09.227 Job: Nvme2n1 ended in about 0.70 seconds with error 00:25:09.227 Verification LBA range: start 0x0 length 0x400 00:25:09.227 Nvme2n1 : 0.70 356.45 22.28 90.89 0.00 140476.51 66021.45 115731.72 00:25:09.227 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:09.227 Job: Nvme3n1 ended in about 0.72 seconds with error 00:25:09.227 Verification LBA range: start 0x0 length 0x400 00:25:09.227 Nvme3n1 : 0.72 290.42 18.15 89.36 0.00 163700.79 96702.01 149130.81 00:25:09.227 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:09.227 Job: Nvme4n1 ended in about 0.72 seconds with error 00:25:09.227 Verification LBA range: start 0x0 length 0x400 00:25:09.227 Nvme4n1 : 0.72 289.10 18.07 88.95 0.00 162689.19 90488.23 142140.30 00:25:09.227 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:09.227 Job: Nvme5n1 ended in about 0.70 seconds with error 00:25:09.227 Verification LBA range: start 0x0 length 0x400 00:25:09.227 Nvme5n1 : 0.70 359.42 22.46 91.64 0.00 134645.54 40583.77 111848.11 00:25:09.227 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:09.227 Job: Nvme6n1 ended in about 0.72 seconds with error 00:25:09.227 Verification LBA range: start 0x0 length 0x400 00:25:09.227 Nvme6n1 : 0.72 287.78 17.99 88.55 0.00 159964.24 98643.82 126605.84 00:25:09.227 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:09.227 Job: Nvme7n1 ended in about 0.73 seconds with error 00:25:09.227 Verification LBA range: start 0x0 length 0x400 00:25:09.227 Nvme7n1 : 0.73 286.46 17.90 88.14 0.00 158989.05 78060.66 151460.98 00:25:09.227 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:09.227 Job: Nvme8n1 ended in about 0.71 seconds with error 00:25:09.227 Verification LBA range: start 0x0 length 0x400 00:25:09.227 Nvme8n1 : 0.71 294.81 18.43 90.71 0.00 152371.91 66409.81 125829.12 00:25:09.227 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:09.227 Job: Nvme9n1 ended in about 0.71 seconds with error 00:25:09.227 Verification LBA range: start 0x0 length 0x400 00:25:09.227 Nvme9n1 : 0.71 355.22 22.20 90.57 0.00 130281.10 13010.11 134373.07 00:25:09.227 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:09.227 Job: Nvme10n1 ended in about 0.71 seconds with error 00:25:09.227 Verification LBA range: start 0x0 length 0x400 00:25:09.227 Nvme10n1 : 0.71 350.36 21.90 32.36 0.00 149729.17 2257.35 146023.92 00:25:09.227 =================================================================================================================== 00:25:09.227 Total : 3239.88 202.49 843.29 0.00 148223.84 2257.35 151460.98 00:25:09.227 [2024-07-13 10:11:14.908142] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:25:09.227 [2024-07-13 10:11:14.908237] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:25:09.227 [2024-07-13 10:11:14.908273] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:25:09.227 [2024-07-13 10:11:14.908301] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:09.227 [2024-07-13 10:11:14.908624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:09.227 [2024-07-13 10:11:14.908777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:09.227 [2024-07-13 10:11:14.908807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16a5d90 with addr=10.0.0.2, port=4420 00:25:09.227 [2024-07-13 10:11:14.908829] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16a5d90 is same with the state(5) to be set 00:25:09.227 [2024-07-13 10:11:14.908964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:09.227 [2024-07-13 10:11:14.909116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:09.227 [2024-07-13 10:11:14.909142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x168c900 with addr=10.0.0.2, port=4420 00:25:09.227 [2024-07-13 10:11:14.909158] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x168c900 is same with the state(5) to be set 00:25:09.227 [2024-07-13 10:11:14.909276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:09.227 [2024-07-13 10:11:14.909398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:09.227 [2024-07-13 10:11:14.909424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1507d80 with addr=10.0.0.2, port=4420 00:25:09.227 [2024-07-13 10:11:14.909440] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1507d80 is same with the state(5) to be set 00:25:09.227 [2024-07-13 10:11:14.909554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:09.227 [2024-07-13 10:11:14.909678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:09.227 [2024-07-13 10:11:14.909704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14d6410 with addr=10.0.0.2, port=4420 00:25:09.227 [2024-07-13 10:11:14.909720] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14d6410 is same with the state(5) to be set 00:25:09.227 [2024-07-13 10:11:14.909737] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:25:09.227 [2024-07-13 10:11:14.909751] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:25:09.227 [2024-07-13 10:11:14.909769] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:25:09.227 [2024-07-13 10:11:14.909795] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:25:09.227 [2024-07-13 10:11:14.909811] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:25:09.227 [2024-07-13 10:11:14.909825] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:25:09.227 [2024-07-13 10:11:14.910998] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:09.227 [2024-07-13 10:11:14.911023] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:09.227 [2024-07-13 10:11:14.911196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:09.227 [2024-07-13 10:11:14.911320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:09.227 [2024-07-13 10:11:14.911346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x16a5960 with addr=10.0.0.2, port=4420 00:25:09.227 [2024-07-13 10:11:14.911363] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16a5960 is same with the state(5) to be set 00:25:09.227 [2024-07-13 10:11:14.911484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:09.227 [2024-07-13 10:11:14.911611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:09.227 [2024-07-13 10:11:14.911637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1690110 with addr=10.0.0.2, port=4420 00:25:09.227 [2024-07-13 10:11:14.911653] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1690110 is same with the state(5) to be set 00:25:09.227 [2024-07-13 10:11:14.911766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:09.227 [2024-07-13 10:11:14.911881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:09.227 [2024-07-13 10:11:14.911919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1533530 with addr=10.0.0.2, port=4420 00:25:09.227 [2024-07-13 10:11:14.911936] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1533530 is same with the state(5) to be set 00:25:09.227 [2024-07-13 10:11:14.911971] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x16a5d90 (9): Bad file descriptor 00:25:09.227 [2024-07-13 10:11:14.911997] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x168c900 (9): Bad file descriptor 00:25:09.227 [2024-07-13 10:11:14.912016] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1507d80 (9): Bad file descriptor 00:25:09.227 [2024-07-13 10:11:14.912034] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14d6410 (9): Bad file descriptor 00:25:09.227 [2024-07-13 10:11:14.912109] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:09.227 [2024-07-13 10:11:14.912136] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:09.227 [2024-07-13 10:11:14.912157] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:09.227 [2024-07-13 10:11:14.912175] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:09.227 [2024-07-13 10:11:14.912282] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x16a5960 (9): Bad file descriptor 00:25:09.227 [2024-07-13 10:11:14.912311] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1690110 (9): Bad file descriptor 00:25:09.227 [2024-07-13 10:11:14.912330] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1533530 (9): Bad file descriptor 00:25:09.227 [2024-07-13 10:11:14.912348] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:25:09.228 [2024-07-13 10:11:14.912362] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:25:09.228 [2024-07-13 10:11:14.912376] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:25:09.228 [2024-07-13 10:11:14.912394] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:25:09.228 [2024-07-13 10:11:14.912408] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:25:09.228 [2024-07-13 10:11:14.912422] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:25:09.228 [2024-07-13 10:11:14.912439] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:25:09.228 [2024-07-13 10:11:14.912452] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:25:09.228 [2024-07-13 10:11:14.912466] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:25:09.228 [2024-07-13 10:11:14.912482] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:25:09.228 [2024-07-13 10:11:14.912497] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:25:09.228 [2024-07-13 10:11:14.912510] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:25:09.228 [2024-07-13 10:11:14.912587] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:09.228 [2024-07-13 10:11:14.912613] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:25:09.228 [2024-07-13 10:11:14.912631] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:25:09.228 [2024-07-13 10:11:14.912647] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:09.228 [2024-07-13 10:11:14.912660] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:09.228 [2024-07-13 10:11:14.912672] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:09.228 [2024-07-13 10:11:14.912689] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:09.228 [2024-07-13 10:11:14.912726] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:25:09.228 [2024-07-13 10:11:14.912743] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:25:09.228 [2024-07-13 10:11:14.912757] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:25:09.228 [2024-07-13 10:11:14.912775] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:25:09.228 [2024-07-13 10:11:14.912790] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:25:09.228 [2024-07-13 10:11:14.912803] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:25:09.228 [2024-07-13 10:11:14.912820] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:25:09.228 [2024-07-13 10:11:14.912834] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:25:09.228 [2024-07-13 10:11:14.912848] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:25:09.228 [2024-07-13 10:11:14.912894] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:09.228 [2024-07-13 10:11:14.912919] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:09.228 [2024-07-13 10:11:14.912932] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:09.228 [2024-07-13 10:11:14.913055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:09.228 [2024-07-13 10:11:14.913197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:09.228 [2024-07-13 10:11:14.913222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14dda30 with addr=10.0.0.2, port=4420 00:25:09.228 [2024-07-13 10:11:14.913238] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14dda30 is same with the state(5) to be set 00:25:09.228 [2024-07-13 10:11:14.913454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:09.228 [2024-07-13 10:11:14.913576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:09.228 [2024-07-13 10:11:14.913600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1509c80 with addr=10.0.0.2, port=4420 00:25:09.228 [2024-07-13 10:11:14.913616] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1509c80 is same with the state(5) to be set 00:25:09.228 [2024-07-13 10:11:14.913728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:09.228 [2024-07-13 10:11:14.913876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:09.228 [2024-07-13 10:11:14.913901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x168c4d0 with addr=10.0.0.2, port=4420 00:25:09.228 [2024-07-13 10:11:14.913917] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x168c4d0 is same with the state(5) to be set 00:25:09.228 [2024-07-13 10:11:14.913963] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14dda30 (9): Bad file descriptor 00:25:09.228 [2024-07-13 10:11:14.913989] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1509c80 (9): Bad file descriptor 00:25:09.228 [2024-07-13 10:11:14.914008] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x168c4d0 (9): Bad file descriptor 00:25:09.228 [2024-07-13 10:11:14.914052] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:25:09.228 [2024-07-13 10:11:14.914072] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:25:09.228 [2024-07-13 10:11:14.914087] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:09.228 [2024-07-13 10:11:14.914109] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:25:09.228 [2024-07-13 10:11:14.914124] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:25:09.228 [2024-07-13 10:11:14.914138] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:25:09.228 [2024-07-13 10:11:14.914153] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:25:09.228 [2024-07-13 10:11:14.914167] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:25:09.228 [2024-07-13 10:11:14.914181] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:25:09.228 [2024-07-13 10:11:14.914218] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:09.228 [2024-07-13 10:11:14.914236] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:09.228 [2024-07-13 10:11:14.914250] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:09.792 10:11:15 -- target/shutdown.sh@135 -- # nvmfpid= 00:25:09.792 10:11:15 -- target/shutdown.sh@138 -- # sleep 1 00:25:10.724 10:11:16 -- target/shutdown.sh@141 -- # kill -9 2886858 00:25:10.724 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (2886858) - No such process 00:25:10.724 10:11:16 -- target/shutdown.sh@141 -- # true 00:25:10.724 10:11:16 -- target/shutdown.sh@143 -- # stoptarget 00:25:10.724 10:11:16 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:10.724 10:11:16 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:10.724 10:11:16 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:10.724 10:11:16 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:10.724 10:11:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:10.724 10:11:16 -- nvmf/common.sh@116 -- # sync 00:25:10.724 10:11:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:10.724 10:11:16 -- nvmf/common.sh@119 -- # set +e 00:25:10.724 10:11:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:10.724 10:11:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:10.724 rmmod nvme_tcp 00:25:10.724 rmmod nvme_fabrics 00:25:10.724 rmmod nvme_keyring 00:25:10.724 10:11:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:10.724 10:11:16 -- nvmf/common.sh@123 -- # set -e 00:25:10.724 10:11:16 -- nvmf/common.sh@124 -- # return 0 00:25:10.724 10:11:16 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:25:10.724 10:11:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:10.724 10:11:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:10.724 10:11:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:10.724 10:11:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:10.724 10:11:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:10.724 10:11:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:10.724 10:11:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:10.724 10:11:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:13.258 10:11:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:13.258 00:25:13.258 real 0m7.983s 00:25:13.258 user 0m20.306s 00:25:13.258 sys 0m1.531s 00:25:13.258 10:11:18 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:25:13.258 10:11:18 -- common/autotest_common.sh@10 -- # set +x 00:25:13.258 ************************************ 00:25:13.258 END TEST nvmf_shutdown_tc3 00:25:13.258 ************************************ 00:25:13.258 10:11:18 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:25:13.258 00:25:13.258 real 0m28.524s 00:25:13.258 user 1m22.539s 00:25:13.258 sys 0m6.326s 00:25:13.258 10:11:18 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:25:13.258 10:11:18 -- common/autotest_common.sh@10 -- # set +x 00:25:13.258 ************************************ 00:25:13.258 END TEST nvmf_shutdown 00:25:13.258 ************************************ 00:25:13.258 10:11:18 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:25:13.258 10:11:18 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:13.258 10:11:18 -- common/autotest_common.sh@10 -- # set +x 00:25:13.258 10:11:18 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:25:13.258 10:11:18 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:13.258 10:11:18 -- common/autotest_common.sh@10 -- # set +x 00:25:13.258 10:11:18 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:25:13.258 10:11:18 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:25:13.258 10:11:18 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:25:13.258 10:11:18 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:25:13.258 10:11:18 -- common/autotest_common.sh@10 -- # set +x 00:25:13.258 ************************************ 00:25:13.258 START TEST nvmf_multicontroller 00:25:13.258 ************************************ 00:25:13.258 10:11:18 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:25:13.258 * Looking for test storage... 00:25:13.258 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:13.258 10:11:18 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:13.258 10:11:18 -- nvmf/common.sh@7 -- # uname -s 00:25:13.258 10:11:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:13.258 10:11:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:13.258 10:11:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:13.258 10:11:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:13.258 10:11:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:13.258 10:11:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:13.258 10:11:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:13.258 10:11:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:13.258 10:11:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:13.258 10:11:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:13.258 10:11:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:13.258 10:11:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:13.258 10:11:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:13.258 10:11:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:13.258 10:11:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:13.258 10:11:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:13.258 10:11:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:13.258 10:11:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:13.258 10:11:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:13.258 10:11:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:13.258 10:11:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:13.258 10:11:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:13.259 10:11:18 -- paths/export.sh@5 -- # export PATH 00:25:13.259 10:11:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:13.259 10:11:18 -- nvmf/common.sh@46 -- # : 0 00:25:13.259 10:11:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:13.259 10:11:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:13.259 10:11:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:13.259 10:11:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:13.259 10:11:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:13.259 10:11:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:13.259 10:11:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:13.259 10:11:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:13.259 10:11:18 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:13.259 10:11:18 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:13.259 10:11:18 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:25:13.259 10:11:18 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:25:13.259 10:11:18 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:25:13.259 10:11:18 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:25:13.259 10:11:18 -- host/multicontroller.sh@23 -- # nvmftestinit 00:25:13.259 10:11:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:13.259 10:11:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:13.259 10:11:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:13.259 10:11:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:13.259 10:11:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:13.259 10:11:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:13.259 10:11:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:13.259 10:11:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:13.259 10:11:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:13.259 10:11:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:13.259 10:11:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:13.259 10:11:18 -- common/autotest_common.sh@10 -- # set +x 00:25:15.162 10:11:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:15.162 10:11:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:15.162 10:11:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:15.162 10:11:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:15.162 10:11:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:15.162 10:11:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:15.162 10:11:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:15.162 10:11:20 -- nvmf/common.sh@294 -- # net_devs=() 00:25:15.163 10:11:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:15.163 10:11:20 -- nvmf/common.sh@295 -- # e810=() 00:25:15.163 10:11:20 -- nvmf/common.sh@295 -- # local -ga e810 00:25:15.163 10:11:20 -- nvmf/common.sh@296 -- # x722=() 00:25:15.163 10:11:20 -- nvmf/common.sh@296 -- # local -ga x722 00:25:15.163 10:11:20 -- nvmf/common.sh@297 -- # mlx=() 00:25:15.163 10:11:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:15.163 10:11:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:15.163 10:11:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:15.163 10:11:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:15.163 10:11:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:15.163 10:11:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:15.163 10:11:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:15.163 10:11:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:15.163 10:11:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:15.163 10:11:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:15.163 10:11:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:15.163 10:11:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:15.163 10:11:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:15.163 10:11:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:15.163 10:11:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:15.163 10:11:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:15.163 10:11:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:15.163 10:11:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:15.163 10:11:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:15.163 10:11:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:15.163 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:15.163 10:11:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:15.163 10:11:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:15.163 10:11:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:15.163 10:11:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:15.163 10:11:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:15.163 10:11:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:15.163 10:11:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:15.163 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:15.163 10:11:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:15.163 10:11:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:15.163 10:11:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:15.163 10:11:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:15.163 10:11:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:15.163 10:11:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:15.163 10:11:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:15.163 10:11:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:15.163 10:11:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:15.163 10:11:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:15.163 10:11:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:15.163 10:11:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:15.163 10:11:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:15.163 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:15.163 10:11:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:15.163 10:11:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:15.163 10:11:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:15.163 10:11:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:15.163 10:11:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:15.163 10:11:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:15.163 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:15.163 10:11:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:15.163 10:11:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:15.163 10:11:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:15.163 10:11:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:15.163 10:11:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:15.163 10:11:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:15.163 10:11:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:15.163 10:11:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:15.163 10:11:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:15.163 10:11:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:15.163 10:11:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:15.163 10:11:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:15.163 10:11:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:15.163 10:11:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:15.163 10:11:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:15.163 10:11:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:15.163 10:11:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:15.163 10:11:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:15.163 10:11:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:15.163 10:11:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:15.163 10:11:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:15.163 10:11:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:15.163 10:11:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:15.163 10:11:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:15.163 10:11:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:15.163 10:11:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:15.163 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:15.163 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.210 ms 00:25:15.163 00:25:15.163 --- 10.0.0.2 ping statistics --- 00:25:15.163 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:15.163 rtt min/avg/max/mdev = 0.210/0.210/0.210/0.000 ms 00:25:15.163 10:11:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:15.163 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:15.163 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.099 ms 00:25:15.163 00:25:15.163 --- 10.0.0.1 ping statistics --- 00:25:15.163 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:15.163 rtt min/avg/max/mdev = 0.099/0.099/0.099/0.000 ms 00:25:15.163 10:11:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:15.163 10:11:20 -- nvmf/common.sh@410 -- # return 0 00:25:15.163 10:11:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:15.163 10:11:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:15.163 10:11:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:15.163 10:11:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:15.163 10:11:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:15.163 10:11:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:15.163 10:11:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:15.163 10:11:20 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:25:15.163 10:11:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:15.163 10:11:20 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:15.163 10:11:20 -- common/autotest_common.sh@10 -- # set +x 00:25:15.163 10:11:20 -- nvmf/common.sh@469 -- # nvmfpid=2889273 00:25:15.163 10:11:20 -- nvmf/common.sh@470 -- # waitforlisten 2889273 00:25:15.163 10:11:20 -- common/autotest_common.sh@819 -- # '[' -z 2889273 ']' 00:25:15.163 10:11:20 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:15.163 10:11:20 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:15.163 10:11:20 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:15.163 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:15.163 10:11:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:25:15.163 10:11:20 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:15.163 10:11:20 -- common/autotest_common.sh@10 -- # set +x 00:25:15.163 [2024-07-13 10:11:20.866417] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:25:15.163 [2024-07-13 10:11:20.866498] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:15.163 EAL: No free 2048 kB hugepages reported on node 1 00:25:15.163 [2024-07-13 10:11:20.936056] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:25:15.431 [2024-07-13 10:11:21.032237] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:15.431 [2024-07-13 10:11:21.032391] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:15.431 [2024-07-13 10:11:21.032410] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:15.431 [2024-07-13 10:11:21.032422] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:15.431 [2024-07-13 10:11:21.032484] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:15.431 [2024-07-13 10:11:21.032512] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:15.431 [2024-07-13 10:11:21.032514] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:15.997 10:11:21 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:15.997 10:11:21 -- common/autotest_common.sh@852 -- # return 0 00:25:15.997 10:11:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:15.997 10:11:21 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:15.997 10:11:21 -- common/autotest_common.sh@10 -- # set +x 00:25:16.255 10:11:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:16.255 10:11:21 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:16.255 10:11:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:16.255 10:11:21 -- common/autotest_common.sh@10 -- # set +x 00:25:16.255 [2024-07-13 10:11:21.826111] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:16.255 10:11:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:16.255 10:11:21 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:25:16.255 10:11:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:16.255 10:11:21 -- common/autotest_common.sh@10 -- # set +x 00:25:16.255 Malloc0 00:25:16.255 10:11:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:16.255 10:11:21 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:16.255 10:11:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:16.255 10:11:21 -- common/autotest_common.sh@10 -- # set +x 00:25:16.255 10:11:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:16.255 10:11:21 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:16.255 10:11:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:16.255 10:11:21 -- common/autotest_common.sh@10 -- # set +x 00:25:16.255 10:11:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:16.255 10:11:21 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:16.255 10:11:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:16.255 10:11:21 -- common/autotest_common.sh@10 -- # set +x 00:25:16.255 [2024-07-13 10:11:21.883707] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:16.255 10:11:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:16.255 10:11:21 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:16.255 10:11:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:16.255 10:11:21 -- common/autotest_common.sh@10 -- # set +x 00:25:16.255 [2024-07-13 10:11:21.891602] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:16.255 10:11:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:16.255 10:11:21 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:25:16.255 10:11:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:16.255 10:11:21 -- common/autotest_common.sh@10 -- # set +x 00:25:16.255 Malloc1 00:25:16.255 10:11:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:16.255 10:11:21 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:25:16.255 10:11:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:16.255 10:11:21 -- common/autotest_common.sh@10 -- # set +x 00:25:16.255 10:11:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:16.255 10:11:21 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:25:16.255 10:11:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:16.255 10:11:21 -- common/autotest_common.sh@10 -- # set +x 00:25:16.255 10:11:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:16.256 10:11:21 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:25:16.256 10:11:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:16.256 10:11:21 -- common/autotest_common.sh@10 -- # set +x 00:25:16.256 10:11:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:16.256 10:11:21 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:25:16.256 10:11:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:16.256 10:11:21 -- common/autotest_common.sh@10 -- # set +x 00:25:16.256 10:11:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:16.256 10:11:21 -- host/multicontroller.sh@44 -- # bdevperf_pid=2889435 00:25:16.256 10:11:21 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:16.256 10:11:21 -- host/multicontroller.sh@47 -- # waitforlisten 2889435 /var/tmp/bdevperf.sock 00:25:16.256 10:11:21 -- common/autotest_common.sh@819 -- # '[' -z 2889435 ']' 00:25:16.256 10:11:21 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:16.256 10:11:21 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:16.256 10:11:21 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:25:16.256 10:11:21 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:16.256 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:16.256 10:11:21 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:16.256 10:11:21 -- common/autotest_common.sh@10 -- # set +x 00:25:17.189 10:11:22 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:17.189 10:11:22 -- common/autotest_common.sh@852 -- # return 0 00:25:17.189 10:11:22 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:25:17.189 10:11:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:17.189 10:11:22 -- common/autotest_common.sh@10 -- # set +x 00:25:17.447 NVMe0n1 00:25:17.447 10:11:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:17.447 10:11:23 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:17.447 10:11:23 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:25:17.447 10:11:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:17.447 10:11:23 -- common/autotest_common.sh@10 -- # set +x 00:25:17.447 10:11:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:17.447 1 00:25:17.447 10:11:23 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:17.447 10:11:23 -- common/autotest_common.sh@640 -- # local es=0 00:25:17.447 10:11:23 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:17.447 10:11:23 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:25:17.447 10:11:23 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:25:17.447 10:11:23 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:25:17.447 10:11:23 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:25:17.447 10:11:23 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:17.447 10:11:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:17.447 10:11:23 -- common/autotest_common.sh@10 -- # set +x 00:25:17.447 request: 00:25:17.447 { 00:25:17.447 "name": "NVMe0", 00:25:17.447 "trtype": "tcp", 00:25:17.447 "traddr": "10.0.0.2", 00:25:17.447 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:25:17.447 "hostaddr": "10.0.0.2", 00:25:17.447 "hostsvcid": "60000", 00:25:17.447 "adrfam": "ipv4", 00:25:17.447 "trsvcid": "4420", 00:25:17.447 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:17.447 "method": "bdev_nvme_attach_controller", 00:25:17.447 "req_id": 1 00:25:17.447 } 00:25:17.447 Got JSON-RPC error response 00:25:17.447 response: 00:25:17.447 { 00:25:17.447 "code": -114, 00:25:17.447 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:17.447 } 00:25:17.447 10:11:23 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:25:17.447 10:11:23 -- common/autotest_common.sh@643 -- # es=1 00:25:17.447 10:11:23 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:25:17.448 10:11:23 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:25:17.448 10:11:23 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:25:17.448 10:11:23 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:17.448 10:11:23 -- common/autotest_common.sh@640 -- # local es=0 00:25:17.448 10:11:23 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:17.448 10:11:23 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:25:17.448 10:11:23 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:25:17.448 10:11:23 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:25:17.448 10:11:23 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:25:17.448 10:11:23 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:17.448 10:11:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:17.448 10:11:23 -- common/autotest_common.sh@10 -- # set +x 00:25:17.448 request: 00:25:17.448 { 00:25:17.448 "name": "NVMe0", 00:25:17.448 "trtype": "tcp", 00:25:17.448 "traddr": "10.0.0.2", 00:25:17.448 "hostaddr": "10.0.0.2", 00:25:17.448 "hostsvcid": "60000", 00:25:17.448 "adrfam": "ipv4", 00:25:17.448 "trsvcid": "4420", 00:25:17.448 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:17.448 "method": "bdev_nvme_attach_controller", 00:25:17.448 "req_id": 1 00:25:17.448 } 00:25:17.448 Got JSON-RPC error response 00:25:17.448 response: 00:25:17.448 { 00:25:17.448 "code": -114, 00:25:17.448 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:17.448 } 00:25:17.448 10:11:23 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:25:17.448 10:11:23 -- common/autotest_common.sh@643 -- # es=1 00:25:17.448 10:11:23 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:25:17.448 10:11:23 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:25:17.448 10:11:23 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:25:17.448 10:11:23 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:17.448 10:11:23 -- common/autotest_common.sh@640 -- # local es=0 00:25:17.448 10:11:23 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:17.448 10:11:23 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:25:17.448 10:11:23 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:25:17.448 10:11:23 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:25:17.448 10:11:23 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:25:17.448 10:11:23 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:17.448 10:11:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:17.448 10:11:23 -- common/autotest_common.sh@10 -- # set +x 00:25:17.448 request: 00:25:17.448 { 00:25:17.448 "name": "NVMe0", 00:25:17.448 "trtype": "tcp", 00:25:17.448 "traddr": "10.0.0.2", 00:25:17.448 "hostaddr": "10.0.0.2", 00:25:17.448 "hostsvcid": "60000", 00:25:17.448 "adrfam": "ipv4", 00:25:17.448 "trsvcid": "4420", 00:25:17.448 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:17.448 "multipath": "disable", 00:25:17.448 "method": "bdev_nvme_attach_controller", 00:25:17.448 "req_id": 1 00:25:17.448 } 00:25:17.448 Got JSON-RPC error response 00:25:17.448 response: 00:25:17.448 { 00:25:17.448 "code": -114, 00:25:17.448 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:25:17.448 } 00:25:17.448 10:11:23 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:25:17.448 10:11:23 -- common/autotest_common.sh@643 -- # es=1 00:25:17.448 10:11:23 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:25:17.448 10:11:23 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:25:17.448 10:11:23 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:25:17.448 10:11:23 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:17.448 10:11:23 -- common/autotest_common.sh@640 -- # local es=0 00:25:17.448 10:11:23 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:17.448 10:11:23 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:25:17.448 10:11:23 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:25:17.448 10:11:23 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:25:17.448 10:11:23 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:25:17.448 10:11:23 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:17.448 10:11:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:17.448 10:11:23 -- common/autotest_common.sh@10 -- # set +x 00:25:17.448 request: 00:25:17.448 { 00:25:17.448 "name": "NVMe0", 00:25:17.448 "trtype": "tcp", 00:25:17.448 "traddr": "10.0.0.2", 00:25:17.448 "hostaddr": "10.0.0.2", 00:25:17.448 "hostsvcid": "60000", 00:25:17.448 "adrfam": "ipv4", 00:25:17.448 "trsvcid": "4420", 00:25:17.448 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:17.448 "multipath": "failover", 00:25:17.448 "method": "bdev_nvme_attach_controller", 00:25:17.448 "req_id": 1 00:25:17.448 } 00:25:17.448 Got JSON-RPC error response 00:25:17.448 response: 00:25:17.448 { 00:25:17.448 "code": -114, 00:25:17.448 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:17.448 } 00:25:17.448 10:11:23 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:25:17.448 10:11:23 -- common/autotest_common.sh@643 -- # es=1 00:25:17.448 10:11:23 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:25:17.448 10:11:23 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:25:17.448 10:11:23 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:25:17.448 10:11:23 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:17.448 10:11:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:17.448 10:11:23 -- common/autotest_common.sh@10 -- # set +x 00:25:17.705 00:25:17.705 10:11:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:17.705 10:11:23 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:17.705 10:11:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:17.705 10:11:23 -- common/autotest_common.sh@10 -- # set +x 00:25:17.705 10:11:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:17.705 10:11:23 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:25:17.705 10:11:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:17.705 10:11:23 -- common/autotest_common.sh@10 -- # set +x 00:25:17.962 00:25:17.962 10:11:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:17.962 10:11:23 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:17.962 10:11:23 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:25:17.962 10:11:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:17.962 10:11:23 -- common/autotest_common.sh@10 -- # set +x 00:25:17.962 10:11:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:17.962 10:11:23 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:25:17.962 10:11:23 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:18.895 0 00:25:18.895 10:11:24 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:25:18.895 10:11:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:18.895 10:11:24 -- common/autotest_common.sh@10 -- # set +x 00:25:19.153 10:11:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:19.153 10:11:24 -- host/multicontroller.sh@100 -- # killprocess 2889435 00:25:19.153 10:11:24 -- common/autotest_common.sh@926 -- # '[' -z 2889435 ']' 00:25:19.153 10:11:24 -- common/autotest_common.sh@930 -- # kill -0 2889435 00:25:19.153 10:11:24 -- common/autotest_common.sh@931 -- # uname 00:25:19.153 10:11:24 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:19.153 10:11:24 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2889435 00:25:19.153 10:11:24 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:25:19.153 10:11:24 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:25:19.153 10:11:24 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2889435' 00:25:19.153 killing process with pid 2889435 00:25:19.153 10:11:24 -- common/autotest_common.sh@945 -- # kill 2889435 00:25:19.153 10:11:24 -- common/autotest_common.sh@950 -- # wait 2889435 00:25:19.153 10:11:24 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:19.153 10:11:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:19.153 10:11:24 -- common/autotest_common.sh@10 -- # set +x 00:25:19.153 10:11:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:19.153 10:11:24 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:25:19.153 10:11:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:19.153 10:11:24 -- common/autotest_common.sh@10 -- # set +x 00:25:19.153 10:11:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:19.153 10:11:24 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:25:19.153 10:11:24 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:19.153 10:11:24 -- common/autotest_common.sh@1597 -- # read -r file 00:25:19.153 10:11:24 -- common/autotest_common.sh@1596 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:25:19.153 10:11:24 -- common/autotest_common.sh@1596 -- # sort -u 00:25:19.153 10:11:24 -- common/autotest_common.sh@1598 -- # cat 00:25:19.153 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:25:19.153 [2024-07-13 10:11:21.994082] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:25:19.153 [2024-07-13 10:11:21.994181] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2889435 ] 00:25:19.153 EAL: No free 2048 kB hugepages reported on node 1 00:25:19.153 [2024-07-13 10:11:22.057094] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:19.153 [2024-07-13 10:11:22.142819] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:19.153 [2024-07-13 10:11:23.547443] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name 4c045c80-8522-4e9c-87b5-27f6afed3a48 already exists 00:25:19.153 [2024-07-13 10:11:23.547484] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:4c045c80-8522-4e9c-87b5-27f6afed3a48 alias for bdev NVMe1n1 00:25:19.153 [2024-07-13 10:11:23.547503] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:25:19.153 Running I/O for 1 seconds... 00:25:19.153 00:25:19.153 Latency(us) 00:25:19.153 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:19.153 Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:25:19.153 NVMe0n1 : 1.01 19810.92 77.39 0.00 0.00 6443.81 3980.71 11893.57 00:25:19.153 =================================================================================================================== 00:25:19.153 Total : 19810.92 77.39 0.00 0.00 6443.81 3980.71 11893.57 00:25:19.153 Received shutdown signal, test time was about 1.000000 seconds 00:25:19.153 00:25:19.153 Latency(us) 00:25:19.153 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:19.153 =================================================================================================================== 00:25:19.153 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:19.153 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:25:19.153 10:11:24 -- common/autotest_common.sh@1603 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:19.153 10:11:24 -- common/autotest_common.sh@1597 -- # read -r file 00:25:19.153 10:11:24 -- host/multicontroller.sh@108 -- # nvmftestfini 00:25:19.153 10:11:24 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:19.153 10:11:24 -- nvmf/common.sh@116 -- # sync 00:25:19.153 10:11:24 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:19.153 10:11:24 -- nvmf/common.sh@119 -- # set +e 00:25:19.153 10:11:24 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:19.153 10:11:24 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:19.412 rmmod nvme_tcp 00:25:19.412 rmmod nvme_fabrics 00:25:19.412 rmmod nvme_keyring 00:25:19.412 10:11:25 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:19.412 10:11:25 -- nvmf/common.sh@123 -- # set -e 00:25:19.412 10:11:25 -- nvmf/common.sh@124 -- # return 0 00:25:19.412 10:11:25 -- nvmf/common.sh@477 -- # '[' -n 2889273 ']' 00:25:19.412 10:11:25 -- nvmf/common.sh@478 -- # killprocess 2889273 00:25:19.412 10:11:25 -- common/autotest_common.sh@926 -- # '[' -z 2889273 ']' 00:25:19.412 10:11:25 -- common/autotest_common.sh@930 -- # kill -0 2889273 00:25:19.412 10:11:25 -- common/autotest_common.sh@931 -- # uname 00:25:19.412 10:11:25 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:19.412 10:11:25 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2889273 00:25:19.412 10:11:25 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:25:19.412 10:11:25 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:25:19.412 10:11:25 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2889273' 00:25:19.412 killing process with pid 2889273 00:25:19.412 10:11:25 -- common/autotest_common.sh@945 -- # kill 2889273 00:25:19.412 10:11:25 -- common/autotest_common.sh@950 -- # wait 2889273 00:25:19.670 10:11:25 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:19.670 10:11:25 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:19.670 10:11:25 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:19.670 10:11:25 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:19.670 10:11:25 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:19.670 10:11:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:19.670 10:11:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:19.670 10:11:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:21.572 10:11:27 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:21.572 00:25:21.572 real 0m8.819s 00:25:21.572 user 0m16.981s 00:25:21.572 sys 0m2.327s 00:25:21.572 10:11:27 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:25:21.572 10:11:27 -- common/autotest_common.sh@10 -- # set +x 00:25:21.572 ************************************ 00:25:21.572 END TEST nvmf_multicontroller 00:25:21.572 ************************************ 00:25:21.830 10:11:27 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:25:21.830 10:11:27 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:25:21.830 10:11:27 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:25:21.830 10:11:27 -- common/autotest_common.sh@10 -- # set +x 00:25:21.830 ************************************ 00:25:21.830 START TEST nvmf_aer 00:25:21.830 ************************************ 00:25:21.830 10:11:27 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:25:21.830 * Looking for test storage... 00:25:21.831 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:21.831 10:11:27 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:21.831 10:11:27 -- nvmf/common.sh@7 -- # uname -s 00:25:21.831 10:11:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:21.831 10:11:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:21.831 10:11:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:21.831 10:11:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:21.831 10:11:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:21.831 10:11:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:21.831 10:11:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:21.831 10:11:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:21.831 10:11:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:21.831 10:11:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:21.831 10:11:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:21.831 10:11:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:21.831 10:11:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:21.831 10:11:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:21.831 10:11:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:21.831 10:11:27 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:21.831 10:11:27 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:21.831 10:11:27 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:21.831 10:11:27 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:21.831 10:11:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:21.831 10:11:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:21.831 10:11:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:21.831 10:11:27 -- paths/export.sh@5 -- # export PATH 00:25:21.831 10:11:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:21.831 10:11:27 -- nvmf/common.sh@46 -- # : 0 00:25:21.831 10:11:27 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:21.831 10:11:27 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:21.831 10:11:27 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:21.831 10:11:27 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:21.831 10:11:27 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:21.831 10:11:27 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:21.831 10:11:27 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:21.831 10:11:27 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:21.831 10:11:27 -- host/aer.sh@11 -- # nvmftestinit 00:25:21.831 10:11:27 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:21.831 10:11:27 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:21.831 10:11:27 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:21.831 10:11:27 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:21.831 10:11:27 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:21.831 10:11:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:21.831 10:11:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:21.831 10:11:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:21.831 10:11:27 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:21.831 10:11:27 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:21.831 10:11:27 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:21.831 10:11:27 -- common/autotest_common.sh@10 -- # set +x 00:25:24.361 10:11:29 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:24.361 10:11:29 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:24.361 10:11:29 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:24.361 10:11:29 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:24.361 10:11:29 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:24.361 10:11:29 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:24.361 10:11:29 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:24.361 10:11:29 -- nvmf/common.sh@294 -- # net_devs=() 00:25:24.361 10:11:29 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:24.361 10:11:29 -- nvmf/common.sh@295 -- # e810=() 00:25:24.361 10:11:29 -- nvmf/common.sh@295 -- # local -ga e810 00:25:24.361 10:11:29 -- nvmf/common.sh@296 -- # x722=() 00:25:24.361 10:11:29 -- nvmf/common.sh@296 -- # local -ga x722 00:25:24.361 10:11:29 -- nvmf/common.sh@297 -- # mlx=() 00:25:24.361 10:11:29 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:24.361 10:11:29 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:24.361 10:11:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:24.361 10:11:29 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:24.361 10:11:29 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:24.361 10:11:29 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:24.361 10:11:29 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:24.361 10:11:29 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:24.361 10:11:29 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:24.361 10:11:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:24.361 10:11:29 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:24.361 10:11:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:24.361 10:11:29 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:24.361 10:11:29 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:24.361 10:11:29 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:24.361 10:11:29 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:24.361 10:11:29 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:24.361 10:11:29 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:24.362 10:11:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:24.362 10:11:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:24.362 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:24.362 10:11:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:24.362 10:11:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:24.362 10:11:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:24.362 10:11:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:24.362 10:11:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:24.362 10:11:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:24.362 10:11:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:24.362 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:24.362 10:11:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:24.362 10:11:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:24.362 10:11:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:24.362 10:11:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:24.362 10:11:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:24.362 10:11:29 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:24.362 10:11:29 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:24.362 10:11:29 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:24.362 10:11:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:24.362 10:11:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:24.362 10:11:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:24.362 10:11:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:24.362 10:11:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:24.362 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:24.362 10:11:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:24.362 10:11:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:24.362 10:11:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:24.362 10:11:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:24.362 10:11:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:24.362 10:11:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:24.362 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:24.362 10:11:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:24.362 10:11:29 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:24.362 10:11:29 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:24.362 10:11:29 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:24.362 10:11:29 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:24.362 10:11:29 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:24.362 10:11:29 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:24.362 10:11:29 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:24.362 10:11:29 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:24.362 10:11:29 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:24.362 10:11:29 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:24.362 10:11:29 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:24.362 10:11:29 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:24.362 10:11:29 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:24.362 10:11:29 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:24.362 10:11:29 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:24.362 10:11:29 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:24.362 10:11:29 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:24.362 10:11:29 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:24.362 10:11:29 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:24.362 10:11:29 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:24.362 10:11:29 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:24.362 10:11:29 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:24.362 10:11:29 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:24.362 10:11:29 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:24.362 10:11:29 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:24.362 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:24.362 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.236 ms 00:25:24.362 00:25:24.362 --- 10.0.0.2 ping statistics --- 00:25:24.362 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:24.362 rtt min/avg/max/mdev = 0.236/0.236/0.236/0.000 ms 00:25:24.362 10:11:29 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:24.362 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:24.362 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.211 ms 00:25:24.362 00:25:24.362 --- 10.0.0.1 ping statistics --- 00:25:24.362 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:24.362 rtt min/avg/max/mdev = 0.211/0.211/0.211/0.000 ms 00:25:24.362 10:11:29 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:24.362 10:11:29 -- nvmf/common.sh@410 -- # return 0 00:25:24.362 10:11:29 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:24.362 10:11:29 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:24.362 10:11:29 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:24.362 10:11:29 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:24.362 10:11:29 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:24.362 10:11:29 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:24.362 10:11:29 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:24.362 10:11:29 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:25:24.362 10:11:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:24.362 10:11:29 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:24.362 10:11:29 -- common/autotest_common.sh@10 -- # set +x 00:25:24.362 10:11:29 -- nvmf/common.sh@469 -- # nvmfpid=2891798 00:25:24.362 10:11:29 -- nvmf/common.sh@470 -- # waitforlisten 2891798 00:25:24.362 10:11:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:24.362 10:11:29 -- common/autotest_common.sh@819 -- # '[' -z 2891798 ']' 00:25:24.362 10:11:29 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:24.362 10:11:29 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:24.362 10:11:29 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:24.362 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:24.362 10:11:29 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:24.362 10:11:29 -- common/autotest_common.sh@10 -- # set +x 00:25:24.362 [2024-07-13 10:11:29.812928] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:25:24.362 [2024-07-13 10:11:29.813014] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:24.362 EAL: No free 2048 kB hugepages reported on node 1 00:25:24.362 [2024-07-13 10:11:29.880575] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:24.362 [2024-07-13 10:11:29.966737] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:24.362 [2024-07-13 10:11:29.966905] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:24.362 [2024-07-13 10:11:29.966924] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:24.362 [2024-07-13 10:11:29.966937] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:24.362 [2024-07-13 10:11:29.966990] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:24.362 [2024-07-13 10:11:29.969892] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:24.362 [2024-07-13 10:11:29.969917] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:24.362 [2024-07-13 10:11:29.969920] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:25.295 10:11:30 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:25.295 10:11:30 -- common/autotest_common.sh@852 -- # return 0 00:25:25.295 10:11:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:25.295 10:11:30 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:25.295 10:11:30 -- common/autotest_common.sh@10 -- # set +x 00:25:25.295 10:11:30 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:25.295 10:11:30 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:25.295 10:11:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:25.295 10:11:30 -- common/autotest_common.sh@10 -- # set +x 00:25:25.295 [2024-07-13 10:11:30.783467] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:25.295 10:11:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:25.295 10:11:30 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:25:25.295 10:11:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:25.295 10:11:30 -- common/autotest_common.sh@10 -- # set +x 00:25:25.295 Malloc0 00:25:25.295 10:11:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:25.295 10:11:30 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:25:25.295 10:11:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:25.295 10:11:30 -- common/autotest_common.sh@10 -- # set +x 00:25:25.295 10:11:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:25.295 10:11:30 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:25.295 10:11:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:25.295 10:11:30 -- common/autotest_common.sh@10 -- # set +x 00:25:25.295 10:11:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:25.295 10:11:30 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:25.295 10:11:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:25.295 10:11:30 -- common/autotest_common.sh@10 -- # set +x 00:25:25.295 [2024-07-13 10:11:30.836613] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:25.295 10:11:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:25.295 10:11:30 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:25:25.295 10:11:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:25.295 10:11:30 -- common/autotest_common.sh@10 -- # set +x 00:25:25.295 [2024-07-13 10:11:30.844375] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:25:25.295 [ 00:25:25.295 { 00:25:25.295 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:25:25.295 "subtype": "Discovery", 00:25:25.296 "listen_addresses": [], 00:25:25.296 "allow_any_host": true, 00:25:25.296 "hosts": [] 00:25:25.296 }, 00:25:25.296 { 00:25:25.296 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:25:25.296 "subtype": "NVMe", 00:25:25.296 "listen_addresses": [ 00:25:25.296 { 00:25:25.296 "transport": "TCP", 00:25:25.296 "trtype": "TCP", 00:25:25.296 "adrfam": "IPv4", 00:25:25.296 "traddr": "10.0.0.2", 00:25:25.296 "trsvcid": "4420" 00:25:25.296 } 00:25:25.296 ], 00:25:25.296 "allow_any_host": true, 00:25:25.296 "hosts": [], 00:25:25.296 "serial_number": "SPDK00000000000001", 00:25:25.296 "model_number": "SPDK bdev Controller", 00:25:25.296 "max_namespaces": 2, 00:25:25.296 "min_cntlid": 1, 00:25:25.296 "max_cntlid": 65519, 00:25:25.296 "namespaces": [ 00:25:25.296 { 00:25:25.296 "nsid": 1, 00:25:25.296 "bdev_name": "Malloc0", 00:25:25.296 "name": "Malloc0", 00:25:25.296 "nguid": "C44A5D56A5F34D23B45ADF1456CDB7B6", 00:25:25.296 "uuid": "c44a5d56-a5f3-4d23-b45a-df1456cdb7b6" 00:25:25.296 } 00:25:25.296 ] 00:25:25.296 } 00:25:25.296 ] 00:25:25.296 10:11:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:25.296 10:11:30 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:25:25.296 10:11:30 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:25:25.296 10:11:30 -- host/aer.sh@33 -- # aerpid=2891958 00:25:25.296 10:11:30 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:25:25.296 10:11:30 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:25:25.296 10:11:30 -- common/autotest_common.sh@1244 -- # local i=0 00:25:25.296 10:11:30 -- common/autotest_common.sh@1245 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:25.296 10:11:30 -- common/autotest_common.sh@1246 -- # '[' 0 -lt 200 ']' 00:25:25.296 10:11:30 -- common/autotest_common.sh@1247 -- # i=1 00:25:25.296 10:11:30 -- common/autotest_common.sh@1248 -- # sleep 0.1 00:25:25.296 EAL: No free 2048 kB hugepages reported on node 1 00:25:25.296 10:11:30 -- common/autotest_common.sh@1245 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:25.296 10:11:30 -- common/autotest_common.sh@1246 -- # '[' 1 -lt 200 ']' 00:25:25.296 10:11:30 -- common/autotest_common.sh@1247 -- # i=2 00:25:25.296 10:11:30 -- common/autotest_common.sh@1248 -- # sleep 0.1 00:25:25.296 10:11:31 -- common/autotest_common.sh@1245 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:25.296 10:11:31 -- common/autotest_common.sh@1246 -- # '[' 2 -lt 200 ']' 00:25:25.296 10:11:31 -- common/autotest_common.sh@1247 -- # i=3 00:25:25.296 10:11:31 -- common/autotest_common.sh@1248 -- # sleep 0.1 00:25:25.554 10:11:31 -- common/autotest_common.sh@1245 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:25.554 10:11:31 -- common/autotest_common.sh@1251 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:25.554 10:11:31 -- common/autotest_common.sh@1255 -- # return 0 00:25:25.554 10:11:31 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:25:25.554 10:11:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:25.554 10:11:31 -- common/autotest_common.sh@10 -- # set +x 00:25:25.554 Malloc1 00:25:25.554 10:11:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:25.554 10:11:31 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:25:25.554 10:11:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:25.554 10:11:31 -- common/autotest_common.sh@10 -- # set +x 00:25:25.554 10:11:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:25.554 10:11:31 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:25:25.554 10:11:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:25.554 10:11:31 -- common/autotest_common.sh@10 -- # set +x 00:25:25.554 Asynchronous Event Request test 00:25:25.554 Attaching to 10.0.0.2 00:25:25.554 Attached to 10.0.0.2 00:25:25.554 Registering asynchronous event callbacks... 00:25:25.554 Starting namespace attribute notice tests for all controllers... 00:25:25.554 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:25:25.554 aer_cb - Changed Namespace 00:25:25.554 Cleaning up... 00:25:25.554 [ 00:25:25.554 { 00:25:25.554 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:25:25.554 "subtype": "Discovery", 00:25:25.554 "listen_addresses": [], 00:25:25.554 "allow_any_host": true, 00:25:25.554 "hosts": [] 00:25:25.554 }, 00:25:25.554 { 00:25:25.554 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:25:25.554 "subtype": "NVMe", 00:25:25.554 "listen_addresses": [ 00:25:25.554 { 00:25:25.554 "transport": "TCP", 00:25:25.554 "trtype": "TCP", 00:25:25.554 "adrfam": "IPv4", 00:25:25.554 "traddr": "10.0.0.2", 00:25:25.554 "trsvcid": "4420" 00:25:25.554 } 00:25:25.554 ], 00:25:25.554 "allow_any_host": true, 00:25:25.554 "hosts": [], 00:25:25.554 "serial_number": "SPDK00000000000001", 00:25:25.554 "model_number": "SPDK bdev Controller", 00:25:25.554 "max_namespaces": 2, 00:25:25.554 "min_cntlid": 1, 00:25:25.554 "max_cntlid": 65519, 00:25:25.554 "namespaces": [ 00:25:25.554 { 00:25:25.554 "nsid": 1, 00:25:25.554 "bdev_name": "Malloc0", 00:25:25.554 "name": "Malloc0", 00:25:25.554 "nguid": "C44A5D56A5F34D23B45ADF1456CDB7B6", 00:25:25.554 "uuid": "c44a5d56-a5f3-4d23-b45a-df1456cdb7b6" 00:25:25.554 }, 00:25:25.554 { 00:25:25.554 "nsid": 2, 00:25:25.554 "bdev_name": "Malloc1", 00:25:25.554 "name": "Malloc1", 00:25:25.554 "nguid": "A1A87F42E62E4F6AABF6033C8DD3F20A", 00:25:25.554 "uuid": "a1a87f42-e62e-4f6a-abf6-033c8dd3f20a" 00:25:25.554 } 00:25:25.554 ] 00:25:25.554 } 00:25:25.554 ] 00:25:25.554 10:11:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:25.554 10:11:31 -- host/aer.sh@43 -- # wait 2891958 00:25:25.554 10:11:31 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:25:25.554 10:11:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:25.554 10:11:31 -- common/autotest_common.sh@10 -- # set +x 00:25:25.554 10:11:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:25.554 10:11:31 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:25:25.554 10:11:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:25.554 10:11:31 -- common/autotest_common.sh@10 -- # set +x 00:25:25.554 10:11:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:25.554 10:11:31 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:25.554 10:11:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:25.554 10:11:31 -- common/autotest_common.sh@10 -- # set +x 00:25:25.554 10:11:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:25.554 10:11:31 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:25:25.554 10:11:31 -- host/aer.sh@51 -- # nvmftestfini 00:25:25.554 10:11:31 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:25.554 10:11:31 -- nvmf/common.sh@116 -- # sync 00:25:25.554 10:11:31 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:25.554 10:11:31 -- nvmf/common.sh@119 -- # set +e 00:25:25.554 10:11:31 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:25.554 10:11:31 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:25.554 rmmod nvme_tcp 00:25:25.554 rmmod nvme_fabrics 00:25:25.554 rmmod nvme_keyring 00:25:25.812 10:11:31 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:25.812 10:11:31 -- nvmf/common.sh@123 -- # set -e 00:25:25.812 10:11:31 -- nvmf/common.sh@124 -- # return 0 00:25:25.812 10:11:31 -- nvmf/common.sh@477 -- # '[' -n 2891798 ']' 00:25:25.812 10:11:31 -- nvmf/common.sh@478 -- # killprocess 2891798 00:25:25.812 10:11:31 -- common/autotest_common.sh@926 -- # '[' -z 2891798 ']' 00:25:25.812 10:11:31 -- common/autotest_common.sh@930 -- # kill -0 2891798 00:25:25.812 10:11:31 -- common/autotest_common.sh@931 -- # uname 00:25:25.812 10:11:31 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:25.812 10:11:31 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2891798 00:25:25.812 10:11:31 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:25:25.812 10:11:31 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:25:25.812 10:11:31 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2891798' 00:25:25.812 killing process with pid 2891798 00:25:25.812 10:11:31 -- common/autotest_common.sh@945 -- # kill 2891798 00:25:25.812 [2024-07-13 10:11:31.408260] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:25:25.812 10:11:31 -- common/autotest_common.sh@950 -- # wait 2891798 00:25:25.812 10:11:31 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:25.812 10:11:31 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:25.812 10:11:31 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:25.812 10:11:31 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:26.070 10:11:31 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:26.070 10:11:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:26.070 10:11:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:26.070 10:11:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:27.971 10:11:33 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:27.971 00:25:27.971 real 0m6.251s 00:25:27.971 user 0m7.443s 00:25:27.971 sys 0m2.052s 00:25:27.971 10:11:33 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:25:27.971 10:11:33 -- common/autotest_common.sh@10 -- # set +x 00:25:27.971 ************************************ 00:25:27.971 END TEST nvmf_aer 00:25:27.971 ************************************ 00:25:27.971 10:11:33 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:25:27.971 10:11:33 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:25:27.971 10:11:33 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:25:27.971 10:11:33 -- common/autotest_common.sh@10 -- # set +x 00:25:27.971 ************************************ 00:25:27.971 START TEST nvmf_async_init 00:25:27.971 ************************************ 00:25:27.971 10:11:33 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:25:27.971 * Looking for test storage... 00:25:27.971 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:27.971 10:11:33 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:27.971 10:11:33 -- nvmf/common.sh@7 -- # uname -s 00:25:27.971 10:11:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:27.971 10:11:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:27.971 10:11:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:27.971 10:11:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:27.971 10:11:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:27.971 10:11:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:27.971 10:11:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:27.971 10:11:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:27.971 10:11:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:27.971 10:11:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:27.971 10:11:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:27.971 10:11:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:27.971 10:11:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:27.971 10:11:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:27.971 10:11:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:27.971 10:11:33 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:27.971 10:11:33 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:27.971 10:11:33 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:27.971 10:11:33 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:27.971 10:11:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:27.971 10:11:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:27.971 10:11:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:27.971 10:11:33 -- paths/export.sh@5 -- # export PATH 00:25:27.971 10:11:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:27.971 10:11:33 -- nvmf/common.sh@46 -- # : 0 00:25:27.971 10:11:33 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:27.971 10:11:33 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:27.971 10:11:33 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:27.971 10:11:33 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:27.971 10:11:33 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:27.971 10:11:33 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:27.971 10:11:33 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:27.971 10:11:33 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:27.971 10:11:33 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:25:27.971 10:11:33 -- host/async_init.sh@14 -- # null_block_size=512 00:25:27.971 10:11:33 -- host/async_init.sh@15 -- # null_bdev=null0 00:25:27.971 10:11:33 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:25:27.971 10:11:33 -- host/async_init.sh@20 -- # uuidgen 00:25:27.971 10:11:33 -- host/async_init.sh@20 -- # tr -d - 00:25:27.971 10:11:33 -- host/async_init.sh@20 -- # nguid=11d98b51abe9447cb0bc5c7e19bd1467 00:25:27.971 10:11:33 -- host/async_init.sh@22 -- # nvmftestinit 00:25:27.971 10:11:33 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:27.971 10:11:33 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:27.971 10:11:33 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:27.971 10:11:33 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:27.971 10:11:33 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:27.971 10:11:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:27.971 10:11:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:27.971 10:11:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:27.971 10:11:33 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:27.971 10:11:33 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:27.971 10:11:33 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:27.971 10:11:33 -- common/autotest_common.sh@10 -- # set +x 00:25:30.497 10:11:35 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:30.497 10:11:35 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:30.497 10:11:35 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:30.497 10:11:35 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:30.497 10:11:35 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:30.497 10:11:35 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:30.497 10:11:35 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:30.497 10:11:35 -- nvmf/common.sh@294 -- # net_devs=() 00:25:30.497 10:11:35 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:30.497 10:11:35 -- nvmf/common.sh@295 -- # e810=() 00:25:30.497 10:11:35 -- nvmf/common.sh@295 -- # local -ga e810 00:25:30.497 10:11:35 -- nvmf/common.sh@296 -- # x722=() 00:25:30.497 10:11:35 -- nvmf/common.sh@296 -- # local -ga x722 00:25:30.497 10:11:35 -- nvmf/common.sh@297 -- # mlx=() 00:25:30.497 10:11:35 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:30.497 10:11:35 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:30.497 10:11:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:30.497 10:11:35 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:30.497 10:11:35 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:30.497 10:11:35 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:30.497 10:11:35 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:30.497 10:11:35 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:30.498 10:11:35 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:30.498 10:11:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:30.498 10:11:35 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:30.498 10:11:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:30.498 10:11:35 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:30.498 10:11:35 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:30.498 10:11:35 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:30.498 10:11:35 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:30.498 10:11:35 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:30.498 10:11:35 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:30.498 10:11:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:30.498 10:11:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:30.498 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:30.498 10:11:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:30.498 10:11:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:30.498 10:11:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:30.498 10:11:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:30.498 10:11:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:30.498 10:11:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:30.498 10:11:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:30.498 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:30.498 10:11:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:30.498 10:11:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:30.498 10:11:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:30.498 10:11:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:30.498 10:11:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:30.498 10:11:35 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:30.498 10:11:35 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:30.498 10:11:35 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:30.498 10:11:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:30.498 10:11:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:30.498 10:11:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:30.498 10:11:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:30.498 10:11:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:30.498 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:30.498 10:11:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:30.498 10:11:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:30.498 10:11:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:30.498 10:11:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:30.498 10:11:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:30.498 10:11:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:30.498 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:30.498 10:11:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:30.498 10:11:35 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:30.498 10:11:35 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:30.498 10:11:35 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:30.498 10:11:35 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:30.498 10:11:35 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:30.498 10:11:35 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:30.498 10:11:35 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:30.498 10:11:35 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:30.498 10:11:35 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:30.498 10:11:35 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:30.498 10:11:35 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:30.498 10:11:35 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:30.498 10:11:35 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:30.498 10:11:35 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:30.498 10:11:35 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:30.498 10:11:35 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:30.498 10:11:35 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:30.498 10:11:35 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:30.498 10:11:35 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:30.498 10:11:35 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:30.498 10:11:35 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:30.498 10:11:35 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:30.498 10:11:35 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:30.498 10:11:35 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:30.498 10:11:35 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:30.498 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:30.498 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.113 ms 00:25:30.498 00:25:30.498 --- 10.0.0.2 ping statistics --- 00:25:30.498 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:30.498 rtt min/avg/max/mdev = 0.113/0.113/0.113/0.000 ms 00:25:30.498 10:11:35 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:30.498 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:30.498 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.173 ms 00:25:30.498 00:25:30.498 --- 10.0.0.1 ping statistics --- 00:25:30.498 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:30.498 rtt min/avg/max/mdev = 0.173/0.173/0.173/0.000 ms 00:25:30.498 10:11:35 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:30.498 10:11:35 -- nvmf/common.sh@410 -- # return 0 00:25:30.498 10:11:35 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:30.498 10:11:35 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:30.498 10:11:35 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:30.498 10:11:35 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:30.498 10:11:35 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:30.498 10:11:35 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:30.498 10:11:35 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:30.498 10:11:35 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:25:30.498 10:11:35 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:30.498 10:11:35 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:30.498 10:11:35 -- common/autotest_common.sh@10 -- # set +x 00:25:30.498 10:11:35 -- nvmf/common.sh@469 -- # nvmfpid=2894027 00:25:30.498 10:11:35 -- nvmf/common.sh@470 -- # waitforlisten 2894027 00:25:30.498 10:11:35 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:25:30.498 10:11:35 -- common/autotest_common.sh@819 -- # '[' -z 2894027 ']' 00:25:30.498 10:11:35 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:30.498 10:11:35 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:30.498 10:11:35 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:30.498 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:30.498 10:11:35 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:30.498 10:11:35 -- common/autotest_common.sh@10 -- # set +x 00:25:30.498 [2024-07-13 10:11:35.909650] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:25:30.498 [2024-07-13 10:11:35.909729] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:30.498 EAL: No free 2048 kB hugepages reported on node 1 00:25:30.498 [2024-07-13 10:11:35.978576] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:30.498 [2024-07-13 10:11:36.070112] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:30.498 [2024-07-13 10:11:36.070260] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:30.498 [2024-07-13 10:11:36.070277] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:30.498 [2024-07-13 10:11:36.070297] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:30.498 [2024-07-13 10:11:36.070330] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:31.063 10:11:36 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:31.064 10:11:36 -- common/autotest_common.sh@852 -- # return 0 00:25:31.064 10:11:36 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:31.064 10:11:36 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:31.064 10:11:36 -- common/autotest_common.sh@10 -- # set +x 00:25:31.064 10:11:36 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:31.064 10:11:36 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:25:31.064 10:11:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:31.064 10:11:36 -- common/autotest_common.sh@10 -- # set +x 00:25:31.064 [2024-07-13 10:11:36.852707] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:31.064 10:11:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:31.064 10:11:36 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:25:31.064 10:11:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:31.064 10:11:36 -- common/autotest_common.sh@10 -- # set +x 00:25:31.064 null0 00:25:31.064 10:11:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:31.064 10:11:36 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:25:31.064 10:11:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:31.064 10:11:36 -- common/autotest_common.sh@10 -- # set +x 00:25:31.064 10:11:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:31.064 10:11:36 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:25:31.064 10:11:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:31.064 10:11:36 -- common/autotest_common.sh@10 -- # set +x 00:25:31.321 10:11:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:31.321 10:11:36 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g 11d98b51abe9447cb0bc5c7e19bd1467 00:25:31.321 10:11:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:31.321 10:11:36 -- common/autotest_common.sh@10 -- # set +x 00:25:31.321 10:11:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:31.321 10:11:36 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:25:31.321 10:11:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:31.321 10:11:36 -- common/autotest_common.sh@10 -- # set +x 00:25:31.321 [2024-07-13 10:11:36.892942] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:31.321 10:11:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:31.321 10:11:36 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:25:31.321 10:11:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:31.321 10:11:36 -- common/autotest_common.sh@10 -- # set +x 00:25:31.321 nvme0n1 00:25:31.321 10:11:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:31.321 10:11:37 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:25:31.321 10:11:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:31.321 10:11:37 -- common/autotest_common.sh@10 -- # set +x 00:25:31.321 [ 00:25:31.321 { 00:25:31.321 "name": "nvme0n1", 00:25:31.321 "aliases": [ 00:25:31.321 "11d98b51-abe9-447c-b0bc-5c7e19bd1467" 00:25:31.321 ], 00:25:31.321 "product_name": "NVMe disk", 00:25:31.321 "block_size": 512, 00:25:31.321 "num_blocks": 2097152, 00:25:31.321 "uuid": "11d98b51-abe9-447c-b0bc-5c7e19bd1467", 00:25:31.321 "assigned_rate_limits": { 00:25:31.321 "rw_ios_per_sec": 0, 00:25:31.321 "rw_mbytes_per_sec": 0, 00:25:31.321 "r_mbytes_per_sec": 0, 00:25:31.321 "w_mbytes_per_sec": 0 00:25:31.321 }, 00:25:31.321 "claimed": false, 00:25:31.321 "zoned": false, 00:25:31.321 "supported_io_types": { 00:25:31.321 "read": true, 00:25:31.321 "write": true, 00:25:31.321 "unmap": false, 00:25:31.321 "write_zeroes": true, 00:25:31.321 "flush": true, 00:25:31.321 "reset": true, 00:25:31.321 "compare": true, 00:25:31.321 "compare_and_write": true, 00:25:31.321 "abort": true, 00:25:31.321 "nvme_admin": true, 00:25:31.321 "nvme_io": true 00:25:31.322 }, 00:25:31.322 "driver_specific": { 00:25:31.322 "nvme": [ 00:25:31.322 { 00:25:31.322 "trid": { 00:25:31.322 "trtype": "TCP", 00:25:31.322 "adrfam": "IPv4", 00:25:31.322 "traddr": "10.0.0.2", 00:25:31.322 "trsvcid": "4420", 00:25:31.322 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:25:31.322 }, 00:25:31.322 "ctrlr_data": { 00:25:31.322 "cntlid": 1, 00:25:31.322 "vendor_id": "0x8086", 00:25:31.322 "model_number": "SPDK bdev Controller", 00:25:31.322 "serial_number": "00000000000000000000", 00:25:31.322 "firmware_revision": "24.01.1", 00:25:31.322 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:25:31.322 "oacs": { 00:25:31.322 "security": 0, 00:25:31.322 "format": 0, 00:25:31.322 "firmware": 0, 00:25:31.322 "ns_manage": 0 00:25:31.322 }, 00:25:31.322 "multi_ctrlr": true, 00:25:31.322 "ana_reporting": false 00:25:31.322 }, 00:25:31.580 "vs": { 00:25:31.580 "nvme_version": "1.3" 00:25:31.580 }, 00:25:31.580 "ns_data": { 00:25:31.580 "id": 1, 00:25:31.580 "can_share": true 00:25:31.580 } 00:25:31.580 } 00:25:31.580 ], 00:25:31.580 "mp_policy": "active_passive" 00:25:31.580 } 00:25:31.580 } 00:25:31.580 ] 00:25:31.580 10:11:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:31.580 10:11:37 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:25:31.580 10:11:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:31.580 10:11:37 -- common/autotest_common.sh@10 -- # set +x 00:25:31.580 [2024-07-13 10:11:37.141543] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:31.580 [2024-07-13 10:11:37.141644] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1332480 (9): Bad file descriptor 00:25:31.580 [2024-07-13 10:11:37.274053] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:31.580 10:11:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:31.580 10:11:37 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:25:31.580 10:11:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:31.580 10:11:37 -- common/autotest_common.sh@10 -- # set +x 00:25:31.580 [ 00:25:31.580 { 00:25:31.580 "name": "nvme0n1", 00:25:31.580 "aliases": [ 00:25:31.580 "11d98b51-abe9-447c-b0bc-5c7e19bd1467" 00:25:31.580 ], 00:25:31.580 "product_name": "NVMe disk", 00:25:31.580 "block_size": 512, 00:25:31.580 "num_blocks": 2097152, 00:25:31.580 "uuid": "11d98b51-abe9-447c-b0bc-5c7e19bd1467", 00:25:31.580 "assigned_rate_limits": { 00:25:31.580 "rw_ios_per_sec": 0, 00:25:31.580 "rw_mbytes_per_sec": 0, 00:25:31.580 "r_mbytes_per_sec": 0, 00:25:31.580 "w_mbytes_per_sec": 0 00:25:31.580 }, 00:25:31.580 "claimed": false, 00:25:31.580 "zoned": false, 00:25:31.580 "supported_io_types": { 00:25:31.580 "read": true, 00:25:31.580 "write": true, 00:25:31.580 "unmap": false, 00:25:31.580 "write_zeroes": true, 00:25:31.580 "flush": true, 00:25:31.580 "reset": true, 00:25:31.580 "compare": true, 00:25:31.580 "compare_and_write": true, 00:25:31.580 "abort": true, 00:25:31.580 "nvme_admin": true, 00:25:31.580 "nvme_io": true 00:25:31.580 }, 00:25:31.580 "driver_specific": { 00:25:31.580 "nvme": [ 00:25:31.580 { 00:25:31.580 "trid": { 00:25:31.580 "trtype": "TCP", 00:25:31.580 "adrfam": "IPv4", 00:25:31.580 "traddr": "10.0.0.2", 00:25:31.580 "trsvcid": "4420", 00:25:31.580 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:25:31.580 }, 00:25:31.580 "ctrlr_data": { 00:25:31.580 "cntlid": 2, 00:25:31.580 "vendor_id": "0x8086", 00:25:31.580 "model_number": "SPDK bdev Controller", 00:25:31.580 "serial_number": "00000000000000000000", 00:25:31.580 "firmware_revision": "24.01.1", 00:25:31.580 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:25:31.580 "oacs": { 00:25:31.580 "security": 0, 00:25:31.580 "format": 0, 00:25:31.580 "firmware": 0, 00:25:31.580 "ns_manage": 0 00:25:31.580 }, 00:25:31.580 "multi_ctrlr": true, 00:25:31.580 "ana_reporting": false 00:25:31.580 }, 00:25:31.580 "vs": { 00:25:31.580 "nvme_version": "1.3" 00:25:31.580 }, 00:25:31.580 "ns_data": { 00:25:31.580 "id": 1, 00:25:31.580 "can_share": true 00:25:31.580 } 00:25:31.580 } 00:25:31.580 ], 00:25:31.580 "mp_policy": "active_passive" 00:25:31.580 } 00:25:31.580 } 00:25:31.580 ] 00:25:31.580 10:11:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:31.580 10:11:37 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:25:31.580 10:11:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:31.580 10:11:37 -- common/autotest_common.sh@10 -- # set +x 00:25:31.580 10:11:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:31.580 10:11:37 -- host/async_init.sh@53 -- # mktemp 00:25:31.580 10:11:37 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.Q7INlRaAQp 00:25:31.580 10:11:37 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:25:31.580 10:11:37 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.Q7INlRaAQp 00:25:31.580 10:11:37 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:25:31.580 10:11:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:31.580 10:11:37 -- common/autotest_common.sh@10 -- # set +x 00:25:31.580 10:11:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:31.580 10:11:37 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:25:31.580 10:11:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:31.580 10:11:37 -- common/autotest_common.sh@10 -- # set +x 00:25:31.580 [2024-07-13 10:11:37.326199] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:25:31.580 [2024-07-13 10:11:37.326382] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:31.580 10:11:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:31.580 10:11:37 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.Q7INlRaAQp 00:25:31.580 10:11:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:31.580 10:11:37 -- common/autotest_common.sh@10 -- # set +x 00:25:31.580 10:11:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:31.580 10:11:37 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.Q7INlRaAQp 00:25:31.580 10:11:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:31.580 10:11:37 -- common/autotest_common.sh@10 -- # set +x 00:25:31.580 [2024-07-13 10:11:37.342218] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:25:31.849 nvme0n1 00:25:31.849 10:11:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:31.849 10:11:37 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:25:31.849 10:11:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:31.849 10:11:37 -- common/autotest_common.sh@10 -- # set +x 00:25:31.849 [ 00:25:31.849 { 00:25:31.849 "name": "nvme0n1", 00:25:31.849 "aliases": [ 00:25:31.849 "11d98b51-abe9-447c-b0bc-5c7e19bd1467" 00:25:31.849 ], 00:25:31.849 "product_name": "NVMe disk", 00:25:31.849 "block_size": 512, 00:25:31.849 "num_blocks": 2097152, 00:25:31.849 "uuid": "11d98b51-abe9-447c-b0bc-5c7e19bd1467", 00:25:31.849 "assigned_rate_limits": { 00:25:31.849 "rw_ios_per_sec": 0, 00:25:31.849 "rw_mbytes_per_sec": 0, 00:25:31.849 "r_mbytes_per_sec": 0, 00:25:31.849 "w_mbytes_per_sec": 0 00:25:31.849 }, 00:25:31.849 "claimed": false, 00:25:31.849 "zoned": false, 00:25:31.849 "supported_io_types": { 00:25:31.849 "read": true, 00:25:31.849 "write": true, 00:25:31.849 "unmap": false, 00:25:31.849 "write_zeroes": true, 00:25:31.849 "flush": true, 00:25:31.849 "reset": true, 00:25:31.849 "compare": true, 00:25:31.849 "compare_and_write": true, 00:25:31.849 "abort": true, 00:25:31.849 "nvme_admin": true, 00:25:31.849 "nvme_io": true 00:25:31.849 }, 00:25:31.849 "driver_specific": { 00:25:31.849 "nvme": [ 00:25:31.849 { 00:25:31.849 "trid": { 00:25:31.849 "trtype": "TCP", 00:25:31.849 "adrfam": "IPv4", 00:25:31.849 "traddr": "10.0.0.2", 00:25:31.849 "trsvcid": "4421", 00:25:31.849 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:25:31.849 }, 00:25:31.849 "ctrlr_data": { 00:25:31.849 "cntlid": 3, 00:25:31.849 "vendor_id": "0x8086", 00:25:31.849 "model_number": "SPDK bdev Controller", 00:25:31.849 "serial_number": "00000000000000000000", 00:25:31.849 "firmware_revision": "24.01.1", 00:25:31.849 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:25:31.849 "oacs": { 00:25:31.849 "security": 0, 00:25:31.849 "format": 0, 00:25:31.849 "firmware": 0, 00:25:31.849 "ns_manage": 0 00:25:31.849 }, 00:25:31.849 "multi_ctrlr": true, 00:25:31.849 "ana_reporting": false 00:25:31.849 }, 00:25:31.849 "vs": { 00:25:31.849 "nvme_version": "1.3" 00:25:31.849 }, 00:25:31.849 "ns_data": { 00:25:31.849 "id": 1, 00:25:31.849 "can_share": true 00:25:31.849 } 00:25:31.849 } 00:25:31.849 ], 00:25:31.849 "mp_policy": "active_passive" 00:25:31.849 } 00:25:31.849 } 00:25:31.849 ] 00:25:31.849 10:11:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:31.849 10:11:37 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:25:31.849 10:11:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:31.849 10:11:37 -- common/autotest_common.sh@10 -- # set +x 00:25:31.850 10:11:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:31.850 10:11:37 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.Q7INlRaAQp 00:25:31.850 10:11:37 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:25:31.850 10:11:37 -- host/async_init.sh@78 -- # nvmftestfini 00:25:31.850 10:11:37 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:31.850 10:11:37 -- nvmf/common.sh@116 -- # sync 00:25:31.850 10:11:37 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:31.850 10:11:37 -- nvmf/common.sh@119 -- # set +e 00:25:31.850 10:11:37 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:31.850 10:11:37 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:31.850 rmmod nvme_tcp 00:25:31.850 rmmod nvme_fabrics 00:25:31.850 rmmod nvme_keyring 00:25:31.850 10:11:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:31.850 10:11:37 -- nvmf/common.sh@123 -- # set -e 00:25:31.850 10:11:37 -- nvmf/common.sh@124 -- # return 0 00:25:31.850 10:11:37 -- nvmf/common.sh@477 -- # '[' -n 2894027 ']' 00:25:31.850 10:11:37 -- nvmf/common.sh@478 -- # killprocess 2894027 00:25:31.850 10:11:37 -- common/autotest_common.sh@926 -- # '[' -z 2894027 ']' 00:25:31.850 10:11:37 -- common/autotest_common.sh@930 -- # kill -0 2894027 00:25:31.850 10:11:37 -- common/autotest_common.sh@931 -- # uname 00:25:31.850 10:11:37 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:31.850 10:11:37 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2894027 00:25:31.850 10:11:37 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:25:31.850 10:11:37 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:25:31.850 10:11:37 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2894027' 00:25:31.850 killing process with pid 2894027 00:25:31.850 10:11:37 -- common/autotest_common.sh@945 -- # kill 2894027 00:25:31.850 10:11:37 -- common/autotest_common.sh@950 -- # wait 2894027 00:25:32.167 10:11:37 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:32.167 10:11:37 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:32.167 10:11:37 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:32.167 10:11:37 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:32.167 10:11:37 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:32.167 10:11:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:32.167 10:11:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:32.167 10:11:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:34.068 10:11:39 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:34.068 00:25:34.068 real 0m6.100s 00:25:34.068 user 0m2.839s 00:25:34.068 sys 0m1.835s 00:25:34.068 10:11:39 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:25:34.068 10:11:39 -- common/autotest_common.sh@10 -- # set +x 00:25:34.068 ************************************ 00:25:34.068 END TEST nvmf_async_init 00:25:34.068 ************************************ 00:25:34.068 10:11:39 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:25:34.068 10:11:39 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:25:34.068 10:11:39 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:25:34.068 10:11:39 -- common/autotest_common.sh@10 -- # set +x 00:25:34.068 ************************************ 00:25:34.068 START TEST dma 00:25:34.068 ************************************ 00:25:34.068 10:11:39 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:25:34.068 * Looking for test storage... 00:25:34.068 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:34.068 10:11:39 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:34.068 10:11:39 -- nvmf/common.sh@7 -- # uname -s 00:25:34.068 10:11:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:34.068 10:11:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:34.068 10:11:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:34.068 10:11:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:34.068 10:11:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:34.068 10:11:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:34.068 10:11:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:34.068 10:11:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:34.068 10:11:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:34.325 10:11:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:34.325 10:11:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:34.325 10:11:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:34.325 10:11:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:34.325 10:11:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:34.325 10:11:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:34.325 10:11:39 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:34.325 10:11:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:34.325 10:11:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:34.325 10:11:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:34.325 10:11:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:34.325 10:11:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:34.325 10:11:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:34.325 10:11:39 -- paths/export.sh@5 -- # export PATH 00:25:34.325 10:11:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:34.325 10:11:39 -- nvmf/common.sh@46 -- # : 0 00:25:34.325 10:11:39 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:34.325 10:11:39 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:34.325 10:11:39 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:34.325 10:11:39 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:34.325 10:11:39 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:34.325 10:11:39 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:34.325 10:11:39 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:34.325 10:11:39 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:34.325 10:11:39 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:25:34.325 10:11:39 -- host/dma.sh@13 -- # exit 0 00:25:34.325 00:25:34.325 real 0m0.068s 00:25:34.325 user 0m0.027s 00:25:34.325 sys 0m0.047s 00:25:34.325 10:11:39 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:25:34.325 10:11:39 -- common/autotest_common.sh@10 -- # set +x 00:25:34.325 ************************************ 00:25:34.325 END TEST dma 00:25:34.325 ************************************ 00:25:34.325 10:11:39 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:25:34.325 10:11:39 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:25:34.325 10:11:39 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:25:34.325 10:11:39 -- common/autotest_common.sh@10 -- # set +x 00:25:34.325 ************************************ 00:25:34.325 START TEST nvmf_identify 00:25:34.325 ************************************ 00:25:34.325 10:11:39 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:25:34.325 * Looking for test storage... 00:25:34.325 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:34.325 10:11:39 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:34.325 10:11:39 -- nvmf/common.sh@7 -- # uname -s 00:25:34.325 10:11:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:34.325 10:11:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:34.325 10:11:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:34.325 10:11:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:34.325 10:11:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:34.325 10:11:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:34.325 10:11:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:34.325 10:11:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:34.325 10:11:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:34.325 10:11:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:34.325 10:11:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:34.325 10:11:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:34.325 10:11:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:34.325 10:11:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:34.325 10:11:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:34.325 10:11:39 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:34.325 10:11:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:34.325 10:11:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:34.325 10:11:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:34.325 10:11:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:34.325 10:11:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:34.325 10:11:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:34.325 10:11:39 -- paths/export.sh@5 -- # export PATH 00:25:34.325 10:11:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:34.325 10:11:39 -- nvmf/common.sh@46 -- # : 0 00:25:34.325 10:11:39 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:34.326 10:11:39 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:34.326 10:11:39 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:34.326 10:11:39 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:34.326 10:11:39 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:34.326 10:11:39 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:34.326 10:11:39 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:34.326 10:11:39 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:34.326 10:11:39 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:34.326 10:11:39 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:34.326 10:11:39 -- host/identify.sh@14 -- # nvmftestinit 00:25:34.326 10:11:39 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:34.326 10:11:39 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:34.326 10:11:39 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:34.326 10:11:39 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:34.326 10:11:39 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:34.326 10:11:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:34.326 10:11:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:34.326 10:11:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:34.326 10:11:39 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:34.326 10:11:39 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:34.326 10:11:39 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:34.326 10:11:39 -- common/autotest_common.sh@10 -- # set +x 00:25:36.219 10:11:41 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:36.219 10:11:41 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:36.219 10:11:41 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:36.219 10:11:41 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:36.219 10:11:41 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:36.219 10:11:41 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:36.219 10:11:41 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:36.219 10:11:41 -- nvmf/common.sh@294 -- # net_devs=() 00:25:36.219 10:11:41 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:36.219 10:11:41 -- nvmf/common.sh@295 -- # e810=() 00:25:36.219 10:11:41 -- nvmf/common.sh@295 -- # local -ga e810 00:25:36.219 10:11:41 -- nvmf/common.sh@296 -- # x722=() 00:25:36.219 10:11:41 -- nvmf/common.sh@296 -- # local -ga x722 00:25:36.219 10:11:41 -- nvmf/common.sh@297 -- # mlx=() 00:25:36.219 10:11:41 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:36.219 10:11:41 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:36.219 10:11:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:36.219 10:11:41 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:36.219 10:11:41 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:36.219 10:11:41 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:36.219 10:11:41 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:36.219 10:11:41 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:36.219 10:11:41 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:36.219 10:11:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:36.219 10:11:41 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:36.219 10:11:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:36.219 10:11:41 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:36.219 10:11:41 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:36.219 10:11:41 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:36.219 10:11:41 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:36.219 10:11:41 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:36.219 10:11:41 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:36.219 10:11:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:36.219 10:11:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:36.219 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:36.219 10:11:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:36.219 10:11:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:36.219 10:11:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:36.219 10:11:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:36.219 10:11:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:36.219 10:11:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:36.219 10:11:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:36.219 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:36.219 10:11:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:36.219 10:11:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:36.219 10:11:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:36.219 10:11:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:36.219 10:11:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:36.219 10:11:41 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:36.219 10:11:41 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:36.219 10:11:41 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:36.219 10:11:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:36.219 10:11:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:36.219 10:11:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:36.219 10:11:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:36.219 10:11:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:36.219 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:36.219 10:11:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:36.219 10:11:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:36.219 10:11:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:36.219 10:11:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:36.219 10:11:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:36.219 10:11:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:36.219 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:36.219 10:11:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:36.219 10:11:41 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:36.219 10:11:41 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:36.219 10:11:41 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:36.219 10:11:41 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:36.219 10:11:41 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:36.219 10:11:41 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:36.219 10:11:41 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:36.219 10:11:41 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:36.219 10:11:41 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:36.219 10:11:41 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:36.219 10:11:41 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:36.220 10:11:41 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:36.220 10:11:41 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:36.220 10:11:41 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:36.220 10:11:41 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:36.220 10:11:41 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:36.220 10:11:41 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:36.220 10:11:41 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:36.220 10:11:41 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:36.220 10:11:41 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:36.220 10:11:41 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:36.220 10:11:41 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:36.220 10:11:41 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:36.220 10:11:41 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:36.220 10:11:42 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:36.220 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:36.220 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.138 ms 00:25:36.220 00:25:36.220 --- 10.0.0.2 ping statistics --- 00:25:36.220 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:36.220 rtt min/avg/max/mdev = 0.138/0.138/0.138/0.000 ms 00:25:36.220 10:11:42 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:36.220 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:36.220 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.144 ms 00:25:36.220 00:25:36.220 --- 10.0.0.1 ping statistics --- 00:25:36.220 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:36.220 rtt min/avg/max/mdev = 0.144/0.144/0.144/0.000 ms 00:25:36.220 10:11:42 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:36.220 10:11:42 -- nvmf/common.sh@410 -- # return 0 00:25:36.220 10:11:42 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:36.220 10:11:42 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:36.220 10:11:42 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:36.220 10:11:42 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:36.220 10:11:42 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:36.220 10:11:42 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:36.220 10:11:42 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:36.477 10:11:42 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:25:36.477 10:11:42 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:36.477 10:11:42 -- common/autotest_common.sh@10 -- # set +x 00:25:36.477 10:11:42 -- host/identify.sh@19 -- # nvmfpid=2896177 00:25:36.477 10:11:42 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:36.477 10:11:42 -- host/identify.sh@23 -- # waitforlisten 2896177 00:25:36.477 10:11:42 -- common/autotest_common.sh@819 -- # '[' -z 2896177 ']' 00:25:36.477 10:11:42 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:36.477 10:11:42 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:36.477 10:11:42 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:36.477 10:11:42 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:36.477 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:36.477 10:11:42 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:36.477 10:11:42 -- common/autotest_common.sh@10 -- # set +x 00:25:36.477 [2024-07-13 10:11:42.088287] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:25:36.477 [2024-07-13 10:11:42.088371] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:36.477 EAL: No free 2048 kB hugepages reported on node 1 00:25:36.477 [2024-07-13 10:11:42.157988] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:36.477 [2024-07-13 10:11:42.249088] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:36.477 [2024-07-13 10:11:42.249248] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:36.477 [2024-07-13 10:11:42.249266] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:36.477 [2024-07-13 10:11:42.249278] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:36.477 [2024-07-13 10:11:42.249351] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:36.477 [2024-07-13 10:11:42.249378] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:36.477 [2024-07-13 10:11:42.249443] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:36.477 [2024-07-13 10:11:42.249446] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:37.409 10:11:43 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:37.409 10:11:43 -- common/autotest_common.sh@852 -- # return 0 00:25:37.409 10:11:43 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:37.409 10:11:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:37.409 10:11:43 -- common/autotest_common.sh@10 -- # set +x 00:25:37.409 [2024-07-13 10:11:43.021274] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:37.409 10:11:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:37.409 10:11:43 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:25:37.409 10:11:43 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:37.409 10:11:43 -- common/autotest_common.sh@10 -- # set +x 00:25:37.409 10:11:43 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:25:37.409 10:11:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:37.409 10:11:43 -- common/autotest_common.sh@10 -- # set +x 00:25:37.409 Malloc0 00:25:37.409 10:11:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:37.409 10:11:43 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:37.409 10:11:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:37.409 10:11:43 -- common/autotest_common.sh@10 -- # set +x 00:25:37.409 10:11:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:37.409 10:11:43 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:25:37.409 10:11:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:37.409 10:11:43 -- common/autotest_common.sh@10 -- # set +x 00:25:37.409 10:11:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:37.409 10:11:43 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:37.409 10:11:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:37.409 10:11:43 -- common/autotest_common.sh@10 -- # set +x 00:25:37.409 [2024-07-13 10:11:43.088232] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:37.409 10:11:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:37.409 10:11:43 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:25:37.409 10:11:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:37.409 10:11:43 -- common/autotest_common.sh@10 -- # set +x 00:25:37.409 10:11:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:37.409 10:11:43 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:25:37.409 10:11:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:37.409 10:11:43 -- common/autotest_common.sh@10 -- # set +x 00:25:37.409 [2024-07-13 10:11:43.103984] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:25:37.409 [ 00:25:37.409 { 00:25:37.409 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:25:37.409 "subtype": "Discovery", 00:25:37.409 "listen_addresses": [ 00:25:37.409 { 00:25:37.409 "transport": "TCP", 00:25:37.409 "trtype": "TCP", 00:25:37.409 "adrfam": "IPv4", 00:25:37.409 "traddr": "10.0.0.2", 00:25:37.409 "trsvcid": "4420" 00:25:37.409 } 00:25:37.409 ], 00:25:37.409 "allow_any_host": true, 00:25:37.409 "hosts": [] 00:25:37.409 }, 00:25:37.409 { 00:25:37.409 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:25:37.409 "subtype": "NVMe", 00:25:37.409 "listen_addresses": [ 00:25:37.409 { 00:25:37.409 "transport": "TCP", 00:25:37.409 "trtype": "TCP", 00:25:37.409 "adrfam": "IPv4", 00:25:37.409 "traddr": "10.0.0.2", 00:25:37.409 "trsvcid": "4420" 00:25:37.409 } 00:25:37.409 ], 00:25:37.409 "allow_any_host": true, 00:25:37.409 "hosts": [], 00:25:37.409 "serial_number": "SPDK00000000000001", 00:25:37.409 "model_number": "SPDK bdev Controller", 00:25:37.409 "max_namespaces": 32, 00:25:37.409 "min_cntlid": 1, 00:25:37.409 "max_cntlid": 65519, 00:25:37.409 "namespaces": [ 00:25:37.409 { 00:25:37.409 "nsid": 1, 00:25:37.409 "bdev_name": "Malloc0", 00:25:37.409 "name": "Malloc0", 00:25:37.409 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:25:37.409 "eui64": "ABCDEF0123456789", 00:25:37.409 "uuid": "be085283-1f6e-4441-bec3-c323db50912c" 00:25:37.409 } 00:25:37.409 ] 00:25:37.409 } 00:25:37.409 ] 00:25:37.409 10:11:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:37.409 10:11:43 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:25:37.409 [2024-07-13 10:11:43.124965] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:25:37.409 [2024-07-13 10:11:43.125003] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2896338 ] 00:25:37.409 EAL: No free 2048 kB hugepages reported on node 1 00:25:37.409 [2024-07-13 10:11:43.158190] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:25:37.409 [2024-07-13 10:11:43.158258] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:25:37.409 [2024-07-13 10:11:43.158267] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:25:37.409 [2024-07-13 10:11:43.158282] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:25:37.409 [2024-07-13 10:11:43.158294] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:25:37.409 [2024-07-13 10:11:43.158632] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:25:37.409 [2024-07-13 10:11:43.158695] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x1d1aeb0 0 00:25:37.409 [2024-07-13 10:11:43.164885] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:25:37.409 [2024-07-13 10:11:43.164907] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:25:37.409 [2024-07-13 10:11:43.164916] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:25:37.409 [2024-07-13 10:11:43.164922] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:25:37.409 [2024-07-13 10:11:43.164973] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.409 [2024-07-13 10:11:43.164986] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.409 [2024-07-13 10:11:43.164994] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1d1aeb0) 00:25:37.409 [2024-07-13 10:11:43.165014] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:25:37.409 [2024-07-13 10:11:43.165040] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d73f80, cid 0, qid 0 00:25:37.409 [2024-07-13 10:11:43.172881] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.409 [2024-07-13 10:11:43.172899] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.409 [2024-07-13 10:11:43.172906] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.409 [2024-07-13 10:11:43.172914] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d73f80) on tqpair=0x1d1aeb0 00:25:37.409 [2024-07-13 10:11:43.172931] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:25:37.409 [2024-07-13 10:11:43.172941] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:25:37.409 [2024-07-13 10:11:43.172950] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:25:37.409 [2024-07-13 10:11:43.172969] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.409 [2024-07-13 10:11:43.172977] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.409 [2024-07-13 10:11:43.172983] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1d1aeb0) 00:25:37.409 [2024-07-13 10:11:43.172994] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.410 [2024-07-13 10:11:43.173021] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d73f80, cid 0, qid 0 00:25:37.410 [2024-07-13 10:11:43.173194] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.410 [2024-07-13 10:11:43.173206] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.410 [2024-07-13 10:11:43.173213] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.410 [2024-07-13 10:11:43.173219] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d73f80) on tqpair=0x1d1aeb0 00:25:37.410 [2024-07-13 10:11:43.173229] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:25:37.410 [2024-07-13 10:11:43.173242] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:25:37.410 [2024-07-13 10:11:43.173254] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.410 [2024-07-13 10:11:43.173261] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.410 [2024-07-13 10:11:43.173268] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1d1aeb0) 00:25:37.410 [2024-07-13 10:11:43.173278] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.410 [2024-07-13 10:11:43.173299] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d73f80, cid 0, qid 0 00:25:37.410 [2024-07-13 10:11:43.173422] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.410 [2024-07-13 10:11:43.173433] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.410 [2024-07-13 10:11:43.173440] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.410 [2024-07-13 10:11:43.173447] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d73f80) on tqpair=0x1d1aeb0 00:25:37.410 [2024-07-13 10:11:43.173456] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:25:37.410 [2024-07-13 10:11:43.173470] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:25:37.410 [2024-07-13 10:11:43.173481] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.410 [2024-07-13 10:11:43.173488] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.410 [2024-07-13 10:11:43.173495] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1d1aeb0) 00:25:37.410 [2024-07-13 10:11:43.173505] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.410 [2024-07-13 10:11:43.173525] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d73f80, cid 0, qid 0 00:25:37.410 [2024-07-13 10:11:43.173641] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.410 [2024-07-13 10:11:43.173653] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.410 [2024-07-13 10:11:43.173660] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.410 [2024-07-13 10:11:43.173667] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d73f80) on tqpair=0x1d1aeb0 00:25:37.410 [2024-07-13 10:11:43.173676] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:25:37.410 [2024-07-13 10:11:43.173692] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.410 [2024-07-13 10:11:43.173701] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.410 [2024-07-13 10:11:43.173707] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1d1aeb0) 00:25:37.410 [2024-07-13 10:11:43.173717] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.410 [2024-07-13 10:11:43.173737] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d73f80, cid 0, qid 0 00:25:37.410 [2024-07-13 10:11:43.173860] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.410 [2024-07-13 10:11:43.173886] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.410 [2024-07-13 10:11:43.173894] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.410 [2024-07-13 10:11:43.173901] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d73f80) on tqpair=0x1d1aeb0 00:25:37.410 [2024-07-13 10:11:43.173911] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:25:37.410 [2024-07-13 10:11:43.173920] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:25:37.410 [2024-07-13 10:11:43.173933] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:25:37.410 [2024-07-13 10:11:43.174044] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:25:37.410 [2024-07-13 10:11:43.174052] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:25:37.410 [2024-07-13 10:11:43.174068] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.410 [2024-07-13 10:11:43.174075] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.410 [2024-07-13 10:11:43.174081] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1d1aeb0) 00:25:37.410 [2024-07-13 10:11:43.174091] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.410 [2024-07-13 10:11:43.174112] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d73f80, cid 0, qid 0 00:25:37.410 [2024-07-13 10:11:43.174275] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.410 [2024-07-13 10:11:43.174287] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.410 [2024-07-13 10:11:43.174294] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.410 [2024-07-13 10:11:43.174300] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d73f80) on tqpair=0x1d1aeb0 00:25:37.410 [2024-07-13 10:11:43.174310] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:25:37.410 [2024-07-13 10:11:43.174326] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.410 [2024-07-13 10:11:43.174334] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.410 [2024-07-13 10:11:43.174341] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1d1aeb0) 00:25:37.410 [2024-07-13 10:11:43.174351] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.410 [2024-07-13 10:11:43.174371] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d73f80, cid 0, qid 0 00:25:37.410 [2024-07-13 10:11:43.174486] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.410 [2024-07-13 10:11:43.174501] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.410 [2024-07-13 10:11:43.174507] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.410 [2024-07-13 10:11:43.174514] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d73f80) on tqpair=0x1d1aeb0 00:25:37.410 [2024-07-13 10:11:43.174524] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:25:37.410 [2024-07-13 10:11:43.174533] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:25:37.410 [2024-07-13 10:11:43.174545] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:25:37.410 [2024-07-13 10:11:43.174564] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:25:37.410 [2024-07-13 10:11:43.174582] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.410 [2024-07-13 10:11:43.174591] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.410 [2024-07-13 10:11:43.174597] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1d1aeb0) 00:25:37.410 [2024-07-13 10:11:43.174608] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.410 [2024-07-13 10:11:43.174629] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d73f80, cid 0, qid 0 00:25:37.410 [2024-07-13 10:11:43.174909] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:37.410 [2024-07-13 10:11:43.174923] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:37.410 [2024-07-13 10:11:43.174930] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:37.410 [2024-07-13 10:11:43.174937] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1d1aeb0): datao=0, datal=4096, cccid=0 00:25:37.410 [2024-07-13 10:11:43.174945] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1d73f80) on tqpair(0x1d1aeb0): expected_datao=0, payload_size=4096 00:25:37.410 [2024-07-13 10:11:43.174958] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:37.410 [2024-07-13 10:11:43.174967] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:37.410 [2024-07-13 10:11:43.174992] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.410 [2024-07-13 10:11:43.175002] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.410 [2024-07-13 10:11:43.175009] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.410 [2024-07-13 10:11:43.175016] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d73f80) on tqpair=0x1d1aeb0 00:25:37.410 [2024-07-13 10:11:43.175029] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:25:37.410 [2024-07-13 10:11:43.175038] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:25:37.410 [2024-07-13 10:11:43.175046] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:25:37.410 [2024-07-13 10:11:43.175054] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:25:37.410 [2024-07-13 10:11:43.175062] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:25:37.410 [2024-07-13 10:11:43.175070] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:25:37.410 [2024-07-13 10:11:43.175089] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:25:37.410 [2024-07-13 10:11:43.175102] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.410 [2024-07-13 10:11:43.175110] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.410 [2024-07-13 10:11:43.175116] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1d1aeb0) 00:25:37.410 [2024-07-13 10:11:43.175127] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:25:37.410 [2024-07-13 10:11:43.175148] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d73f80, cid 0, qid 0 00:25:37.410 [2024-07-13 10:11:43.175272] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.410 [2024-07-13 10:11:43.175283] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.410 [2024-07-13 10:11:43.175290] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.410 [2024-07-13 10:11:43.175297] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d73f80) on tqpair=0x1d1aeb0 00:25:37.410 [2024-07-13 10:11:43.175310] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.410 [2024-07-13 10:11:43.175317] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.410 [2024-07-13 10:11:43.175324] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1d1aeb0) 00:25:37.410 [2024-07-13 10:11:43.175337] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.410 [2024-07-13 10:11:43.175348] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.410 [2024-07-13 10:11:43.175354] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.410 [2024-07-13 10:11:43.175361] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x1d1aeb0) 00:25:37.411 [2024-07-13 10:11:43.175369] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.411 [2024-07-13 10:11:43.175379] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.411 [2024-07-13 10:11:43.175385] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.411 [2024-07-13 10:11:43.175391] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x1d1aeb0) 00:25:37.411 [2024-07-13 10:11:43.175400] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.411 [2024-07-13 10:11:43.175409] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.411 [2024-07-13 10:11:43.175416] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.411 [2024-07-13 10:11:43.175438] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1d1aeb0) 00:25:37.411 [2024-07-13 10:11:43.175447] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.411 [2024-07-13 10:11:43.175455] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:25:37.411 [2024-07-13 10:11:43.175474] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:25:37.411 [2024-07-13 10:11:43.175500] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.411 [2024-07-13 10:11:43.175507] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.411 [2024-07-13 10:11:43.175513] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1d1aeb0) 00:25:37.411 [2024-07-13 10:11:43.175523] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.411 [2024-07-13 10:11:43.175544] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d73f80, cid 0, qid 0 00:25:37.411 [2024-07-13 10:11:43.175569] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d740e0, cid 1, qid 0 00:25:37.411 [2024-07-13 10:11:43.175577] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d74240, cid 2, qid 0 00:25:37.411 [2024-07-13 10:11:43.175585] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d743a0, cid 3, qid 0 00:25:37.411 [2024-07-13 10:11:43.175592] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d74500, cid 4, qid 0 00:25:37.411 [2024-07-13 10:11:43.175769] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.411 [2024-07-13 10:11:43.175784] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.411 [2024-07-13 10:11:43.175791] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.411 [2024-07-13 10:11:43.175798] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d74500) on tqpair=0x1d1aeb0 00:25:37.411 [2024-07-13 10:11:43.175808] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:25:37.411 [2024-07-13 10:11:43.175817] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:25:37.411 [2024-07-13 10:11:43.175834] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.411 [2024-07-13 10:11:43.175843] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.411 [2024-07-13 10:11:43.175864] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1d1aeb0) 00:25:37.411 [2024-07-13 10:11:43.175891] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.411 [2024-07-13 10:11:43.175912] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d74500, cid 4, qid 0 00:25:37.411 [2024-07-13 10:11:43.176087] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:37.411 [2024-07-13 10:11:43.176102] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:37.411 [2024-07-13 10:11:43.176109] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:37.411 [2024-07-13 10:11:43.176116] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1d1aeb0): datao=0, datal=4096, cccid=4 00:25:37.411 [2024-07-13 10:11:43.176123] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1d74500) on tqpair(0x1d1aeb0): expected_datao=0, payload_size=4096 00:25:37.411 [2024-07-13 10:11:43.176141] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:37.411 [2024-07-13 10:11:43.176150] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:37.411 [2024-07-13 10:11:43.220881] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.411 [2024-07-13 10:11:43.220899] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.411 [2024-07-13 10:11:43.220906] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.411 [2024-07-13 10:11:43.220913] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d74500) on tqpair=0x1d1aeb0 00:25:37.411 [2024-07-13 10:11:43.220933] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:25:37.411 [2024-07-13 10:11:43.220970] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.411 [2024-07-13 10:11:43.220980] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.411 [2024-07-13 10:11:43.220986] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1d1aeb0) 00:25:37.411 [2024-07-13 10:11:43.220997] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.411 [2024-07-13 10:11:43.221008] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.411 [2024-07-13 10:11:43.221015] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.411 [2024-07-13 10:11:43.221021] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1d1aeb0) 00:25:37.411 [2024-07-13 10:11:43.221030] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.411 [2024-07-13 10:11:43.221058] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d74500, cid 4, qid 0 00:25:37.411 [2024-07-13 10:11:43.221085] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d74660, cid 5, qid 0 00:25:37.411 [2024-07-13 10:11:43.221289] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:37.411 [2024-07-13 10:11:43.221305] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:37.411 [2024-07-13 10:11:43.221312] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:37.411 [2024-07-13 10:11:43.221323] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1d1aeb0): datao=0, datal=1024, cccid=4 00:25:37.411 [2024-07-13 10:11:43.221339] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1d74500) on tqpair(0x1d1aeb0): expected_datao=0, payload_size=1024 00:25:37.411 [2024-07-13 10:11:43.221358] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:37.411 [2024-07-13 10:11:43.221384] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:37.411 [2024-07-13 10:11:43.221401] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.411 [2024-07-13 10:11:43.221419] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.411 [2024-07-13 10:11:43.221426] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.411 [2024-07-13 10:11:43.221433] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d74660) on tqpair=0x1d1aeb0 00:25:37.672 [2024-07-13 10:11:43.263058] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.672 [2024-07-13 10:11:43.263078] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.672 [2024-07-13 10:11:43.263086] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.672 [2024-07-13 10:11:43.263093] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d74500) on tqpair=0x1d1aeb0 00:25:37.672 [2024-07-13 10:11:43.263118] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.672 [2024-07-13 10:11:43.263128] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.672 [2024-07-13 10:11:43.263134] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1d1aeb0) 00:25:37.672 [2024-07-13 10:11:43.263146] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.672 [2024-07-13 10:11:43.263201] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d74500, cid 4, qid 0 00:25:37.672 [2024-07-13 10:11:43.263448] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:37.672 [2024-07-13 10:11:43.263464] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:37.672 [2024-07-13 10:11:43.263471] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:37.672 [2024-07-13 10:11:43.263478] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1d1aeb0): datao=0, datal=3072, cccid=4 00:25:37.672 [2024-07-13 10:11:43.263485] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1d74500) on tqpair(0x1d1aeb0): expected_datao=0, payload_size=3072 00:25:37.672 [2024-07-13 10:11:43.263497] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:37.672 [2024-07-13 10:11:43.263504] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:37.672 [2024-07-13 10:11:43.263530] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.672 [2024-07-13 10:11:43.263541] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.672 [2024-07-13 10:11:43.263548] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.672 [2024-07-13 10:11:43.263555] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d74500) on tqpair=0x1d1aeb0 00:25:37.672 [2024-07-13 10:11:43.263570] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.672 [2024-07-13 10:11:43.263578] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.672 [2024-07-13 10:11:43.263584] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1d1aeb0) 00:25:37.672 [2024-07-13 10:11:43.263595] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.672 [2024-07-13 10:11:43.263622] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d74500, cid 4, qid 0 00:25:37.672 [2024-07-13 10:11:43.263758] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:37.672 [2024-07-13 10:11:43.263771] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:37.672 [2024-07-13 10:11:43.263777] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:37.672 [2024-07-13 10:11:43.263784] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1d1aeb0): datao=0, datal=8, cccid=4 00:25:37.672 [2024-07-13 10:11:43.263791] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1d74500) on tqpair(0x1d1aeb0): expected_datao=0, payload_size=8 00:25:37.672 [2024-07-13 10:11:43.263802] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:37.672 [2024-07-13 10:11:43.263809] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:37.672 [2024-07-13 10:11:43.305032] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.672 [2024-07-13 10:11:43.305051] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.672 [2024-07-13 10:11:43.305059] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.672 [2024-07-13 10:11:43.305066] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d74500) on tqpair=0x1d1aeb0 00:25:37.672 ===================================================== 00:25:37.672 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:25:37.672 ===================================================== 00:25:37.672 Controller Capabilities/Features 00:25:37.672 ================================ 00:25:37.672 Vendor ID: 0000 00:25:37.672 Subsystem Vendor ID: 0000 00:25:37.672 Serial Number: .................... 00:25:37.672 Model Number: ........................................ 00:25:37.672 Firmware Version: 24.01.1 00:25:37.672 Recommended Arb Burst: 0 00:25:37.672 IEEE OUI Identifier: 00 00 00 00:25:37.672 Multi-path I/O 00:25:37.672 May have multiple subsystem ports: No 00:25:37.672 May have multiple controllers: No 00:25:37.672 Associated with SR-IOV VF: No 00:25:37.672 Max Data Transfer Size: 131072 00:25:37.672 Max Number of Namespaces: 0 00:25:37.672 Max Number of I/O Queues: 1024 00:25:37.672 NVMe Specification Version (VS): 1.3 00:25:37.672 NVMe Specification Version (Identify): 1.3 00:25:37.672 Maximum Queue Entries: 128 00:25:37.672 Contiguous Queues Required: Yes 00:25:37.672 Arbitration Mechanisms Supported 00:25:37.672 Weighted Round Robin: Not Supported 00:25:37.672 Vendor Specific: Not Supported 00:25:37.672 Reset Timeout: 15000 ms 00:25:37.672 Doorbell Stride: 4 bytes 00:25:37.672 NVM Subsystem Reset: Not Supported 00:25:37.672 Command Sets Supported 00:25:37.672 NVM Command Set: Supported 00:25:37.672 Boot Partition: Not Supported 00:25:37.672 Memory Page Size Minimum: 4096 bytes 00:25:37.672 Memory Page Size Maximum: 4096 bytes 00:25:37.672 Persistent Memory Region: Not Supported 00:25:37.672 Optional Asynchronous Events Supported 00:25:37.672 Namespace Attribute Notices: Not Supported 00:25:37.672 Firmware Activation Notices: Not Supported 00:25:37.672 ANA Change Notices: Not Supported 00:25:37.672 PLE Aggregate Log Change Notices: Not Supported 00:25:37.672 LBA Status Info Alert Notices: Not Supported 00:25:37.672 EGE Aggregate Log Change Notices: Not Supported 00:25:37.672 Normal NVM Subsystem Shutdown event: Not Supported 00:25:37.672 Zone Descriptor Change Notices: Not Supported 00:25:37.672 Discovery Log Change Notices: Supported 00:25:37.672 Controller Attributes 00:25:37.672 128-bit Host Identifier: Not Supported 00:25:37.672 Non-Operational Permissive Mode: Not Supported 00:25:37.672 NVM Sets: Not Supported 00:25:37.672 Read Recovery Levels: Not Supported 00:25:37.672 Endurance Groups: Not Supported 00:25:37.672 Predictable Latency Mode: Not Supported 00:25:37.672 Traffic Based Keep ALive: Not Supported 00:25:37.672 Namespace Granularity: Not Supported 00:25:37.672 SQ Associations: Not Supported 00:25:37.673 UUID List: Not Supported 00:25:37.673 Multi-Domain Subsystem: Not Supported 00:25:37.673 Fixed Capacity Management: Not Supported 00:25:37.673 Variable Capacity Management: Not Supported 00:25:37.673 Delete Endurance Group: Not Supported 00:25:37.673 Delete NVM Set: Not Supported 00:25:37.673 Extended LBA Formats Supported: Not Supported 00:25:37.673 Flexible Data Placement Supported: Not Supported 00:25:37.673 00:25:37.673 Controller Memory Buffer Support 00:25:37.673 ================================ 00:25:37.673 Supported: No 00:25:37.673 00:25:37.673 Persistent Memory Region Support 00:25:37.673 ================================ 00:25:37.673 Supported: No 00:25:37.673 00:25:37.673 Admin Command Set Attributes 00:25:37.673 ============================ 00:25:37.673 Security Send/Receive: Not Supported 00:25:37.673 Format NVM: Not Supported 00:25:37.673 Firmware Activate/Download: Not Supported 00:25:37.673 Namespace Management: Not Supported 00:25:37.673 Device Self-Test: Not Supported 00:25:37.673 Directives: Not Supported 00:25:37.673 NVMe-MI: Not Supported 00:25:37.673 Virtualization Management: Not Supported 00:25:37.673 Doorbell Buffer Config: Not Supported 00:25:37.673 Get LBA Status Capability: Not Supported 00:25:37.673 Command & Feature Lockdown Capability: Not Supported 00:25:37.673 Abort Command Limit: 1 00:25:37.673 Async Event Request Limit: 4 00:25:37.673 Number of Firmware Slots: N/A 00:25:37.673 Firmware Slot 1 Read-Only: N/A 00:25:37.673 Firmware Activation Without Reset: N/A 00:25:37.673 Multiple Update Detection Support: N/A 00:25:37.673 Firmware Update Granularity: No Information Provided 00:25:37.673 Per-Namespace SMART Log: No 00:25:37.673 Asymmetric Namespace Access Log Page: Not Supported 00:25:37.673 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:25:37.673 Command Effects Log Page: Not Supported 00:25:37.673 Get Log Page Extended Data: Supported 00:25:37.673 Telemetry Log Pages: Not Supported 00:25:37.673 Persistent Event Log Pages: Not Supported 00:25:37.673 Supported Log Pages Log Page: May Support 00:25:37.673 Commands Supported & Effects Log Page: Not Supported 00:25:37.673 Feature Identifiers & Effects Log Page:May Support 00:25:37.673 NVMe-MI Commands & Effects Log Page: May Support 00:25:37.673 Data Area 4 for Telemetry Log: Not Supported 00:25:37.673 Error Log Page Entries Supported: 128 00:25:37.673 Keep Alive: Not Supported 00:25:37.673 00:25:37.673 NVM Command Set Attributes 00:25:37.673 ========================== 00:25:37.673 Submission Queue Entry Size 00:25:37.673 Max: 1 00:25:37.673 Min: 1 00:25:37.673 Completion Queue Entry Size 00:25:37.673 Max: 1 00:25:37.673 Min: 1 00:25:37.673 Number of Namespaces: 0 00:25:37.673 Compare Command: Not Supported 00:25:37.673 Write Uncorrectable Command: Not Supported 00:25:37.673 Dataset Management Command: Not Supported 00:25:37.673 Write Zeroes Command: Not Supported 00:25:37.673 Set Features Save Field: Not Supported 00:25:37.673 Reservations: Not Supported 00:25:37.673 Timestamp: Not Supported 00:25:37.673 Copy: Not Supported 00:25:37.673 Volatile Write Cache: Not Present 00:25:37.673 Atomic Write Unit (Normal): 1 00:25:37.673 Atomic Write Unit (PFail): 1 00:25:37.673 Atomic Compare & Write Unit: 1 00:25:37.673 Fused Compare & Write: Supported 00:25:37.673 Scatter-Gather List 00:25:37.673 SGL Command Set: Supported 00:25:37.673 SGL Keyed: Supported 00:25:37.673 SGL Bit Bucket Descriptor: Not Supported 00:25:37.673 SGL Metadata Pointer: Not Supported 00:25:37.673 Oversized SGL: Not Supported 00:25:37.673 SGL Metadata Address: Not Supported 00:25:37.673 SGL Offset: Supported 00:25:37.673 Transport SGL Data Block: Not Supported 00:25:37.673 Replay Protected Memory Block: Not Supported 00:25:37.673 00:25:37.673 Firmware Slot Information 00:25:37.673 ========================= 00:25:37.673 Active slot: 0 00:25:37.673 00:25:37.673 00:25:37.673 Error Log 00:25:37.673 ========= 00:25:37.673 00:25:37.673 Active Namespaces 00:25:37.673 ================= 00:25:37.673 Discovery Log Page 00:25:37.673 ================== 00:25:37.673 Generation Counter: 2 00:25:37.673 Number of Records: 2 00:25:37.673 Record Format: 0 00:25:37.673 00:25:37.673 Discovery Log Entry 0 00:25:37.673 ---------------------- 00:25:37.673 Transport Type: 3 (TCP) 00:25:37.673 Address Family: 1 (IPv4) 00:25:37.673 Subsystem Type: 3 (Current Discovery Subsystem) 00:25:37.673 Entry Flags: 00:25:37.673 Duplicate Returned Information: 1 00:25:37.673 Explicit Persistent Connection Support for Discovery: 1 00:25:37.673 Transport Requirements: 00:25:37.673 Secure Channel: Not Required 00:25:37.673 Port ID: 0 (0x0000) 00:25:37.673 Controller ID: 65535 (0xffff) 00:25:37.673 Admin Max SQ Size: 128 00:25:37.673 Transport Service Identifier: 4420 00:25:37.673 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:25:37.673 Transport Address: 10.0.0.2 00:25:37.673 Discovery Log Entry 1 00:25:37.673 ---------------------- 00:25:37.673 Transport Type: 3 (TCP) 00:25:37.673 Address Family: 1 (IPv4) 00:25:37.673 Subsystem Type: 2 (NVM Subsystem) 00:25:37.673 Entry Flags: 00:25:37.673 Duplicate Returned Information: 0 00:25:37.673 Explicit Persistent Connection Support for Discovery: 0 00:25:37.673 Transport Requirements: 00:25:37.673 Secure Channel: Not Required 00:25:37.673 Port ID: 0 (0x0000) 00:25:37.673 Controller ID: 65535 (0xffff) 00:25:37.673 Admin Max SQ Size: 128 00:25:37.673 Transport Service Identifier: 4420 00:25:37.673 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:25:37.673 Transport Address: 10.0.0.2 [2024-07-13 10:11:43.305192] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:25:37.673 [2024-07-13 10:11:43.305221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.673 [2024-07-13 10:11:43.305234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.673 [2024-07-13 10:11:43.305244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.673 [2024-07-13 10:11:43.305253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.673 [2024-07-13 10:11:43.305267] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.673 [2024-07-13 10:11:43.305274] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.673 [2024-07-13 10:11:43.305281] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1d1aeb0) 00:25:37.673 [2024-07-13 10:11:43.305292] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.673 [2024-07-13 10:11:43.305334] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d743a0, cid 3, qid 0 00:25:37.673 [2024-07-13 10:11:43.305519] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.673 [2024-07-13 10:11:43.305535] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.673 [2024-07-13 10:11:43.305542] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.673 [2024-07-13 10:11:43.305549] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d743a0) on tqpair=0x1d1aeb0 00:25:37.673 [2024-07-13 10:11:43.305563] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.673 [2024-07-13 10:11:43.305571] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.673 [2024-07-13 10:11:43.305577] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1d1aeb0) 00:25:37.673 [2024-07-13 10:11:43.305587] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.673 [2024-07-13 10:11:43.305614] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d743a0, cid 3, qid 0 00:25:37.673 [2024-07-13 10:11:43.305773] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.673 [2024-07-13 10:11:43.305788] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.673 [2024-07-13 10:11:43.305795] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.673 [2024-07-13 10:11:43.305801] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d743a0) on tqpair=0x1d1aeb0 00:25:37.673 [2024-07-13 10:11:43.305811] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:25:37.673 [2024-07-13 10:11:43.305820] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:25:37.673 [2024-07-13 10:11:43.305836] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.673 [2024-07-13 10:11:43.305844] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.673 [2024-07-13 10:11:43.305851] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1d1aeb0) 00:25:37.673 [2024-07-13 10:11:43.305861] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.673 [2024-07-13 10:11:43.305891] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d743a0, cid 3, qid 0 00:25:37.673 [2024-07-13 10:11:43.306043] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.673 [2024-07-13 10:11:43.306055] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.673 [2024-07-13 10:11:43.306062] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.673 [2024-07-13 10:11:43.306069] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d743a0) on tqpair=0x1d1aeb0 00:25:37.673 [2024-07-13 10:11:43.306087] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.673 [2024-07-13 10:11:43.306100] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.673 [2024-07-13 10:11:43.306107] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1d1aeb0) 00:25:37.673 [2024-07-13 10:11:43.306117] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.673 [2024-07-13 10:11:43.306138] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d743a0, cid 3, qid 0 00:25:37.674 [2024-07-13 10:11:43.306258] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.674 [2024-07-13 10:11:43.306273] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.674 [2024-07-13 10:11:43.306280] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.674 [2024-07-13 10:11:43.306286] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d743a0) on tqpair=0x1d1aeb0 00:25:37.674 [2024-07-13 10:11:43.306304] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.674 [2024-07-13 10:11:43.306313] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.674 [2024-07-13 10:11:43.306319] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1d1aeb0) 00:25:37.674 [2024-07-13 10:11:43.306329] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.674 [2024-07-13 10:11:43.306350] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d743a0, cid 3, qid 0 00:25:37.674 [2024-07-13 10:11:43.306468] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.674 [2024-07-13 10:11:43.306483] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.674 [2024-07-13 10:11:43.306490] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.674 [2024-07-13 10:11:43.306496] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d743a0) on tqpair=0x1d1aeb0 00:25:37.674 [2024-07-13 10:11:43.306514] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.674 [2024-07-13 10:11:43.306522] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.674 [2024-07-13 10:11:43.306529] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1d1aeb0) 00:25:37.674 [2024-07-13 10:11:43.306539] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.674 [2024-07-13 10:11:43.306559] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d743a0, cid 3, qid 0 00:25:37.674 [2024-07-13 10:11:43.306675] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.674 [2024-07-13 10:11:43.306690] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.674 [2024-07-13 10:11:43.306696] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.674 [2024-07-13 10:11:43.306703] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d743a0) on tqpair=0x1d1aeb0 00:25:37.674 [2024-07-13 10:11:43.306721] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.674 [2024-07-13 10:11:43.306729] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.674 [2024-07-13 10:11:43.306736] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1d1aeb0) 00:25:37.674 [2024-07-13 10:11:43.306746] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.674 [2024-07-13 10:11:43.306767] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d743a0, cid 3, qid 0 00:25:37.674 [2024-07-13 10:11:43.310895] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.674 [2024-07-13 10:11:43.310911] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.674 [2024-07-13 10:11:43.310918] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.674 [2024-07-13 10:11:43.310925] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d743a0) on tqpair=0x1d1aeb0 00:25:37.674 [2024-07-13 10:11:43.310943] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.674 [2024-07-13 10:11:43.310951] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.674 [2024-07-13 10:11:43.310962] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1d1aeb0) 00:25:37.674 [2024-07-13 10:11:43.310973] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.674 [2024-07-13 10:11:43.310994] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d743a0, cid 3, qid 0 00:25:37.674 [2024-07-13 10:11:43.311149] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.674 [2024-07-13 10:11:43.311161] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.674 [2024-07-13 10:11:43.311168] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.674 [2024-07-13 10:11:43.311175] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d743a0) on tqpair=0x1d1aeb0 00:25:37.674 [2024-07-13 10:11:43.311189] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 5 milliseconds 00:25:37.674 00:25:37.674 10:11:43 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:25:37.674 [2024-07-13 10:11:43.342929] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:25:37.674 [2024-07-13 10:11:43.342967] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2896347 ] 00:25:37.674 EAL: No free 2048 kB hugepages reported on node 1 00:25:37.674 [2024-07-13 10:11:43.376661] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:25:37.674 [2024-07-13 10:11:43.376708] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:25:37.674 [2024-07-13 10:11:43.376718] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:25:37.674 [2024-07-13 10:11:43.376732] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:25:37.674 [2024-07-13 10:11:43.376743] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:25:37.674 [2024-07-13 10:11:43.377017] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:25:37.674 [2024-07-13 10:11:43.377063] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x1429eb0 0 00:25:37.674 [2024-07-13 10:11:43.390890] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:25:37.674 [2024-07-13 10:11:43.390910] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:25:37.674 [2024-07-13 10:11:43.390918] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:25:37.674 [2024-07-13 10:11:43.390924] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:25:37.674 [2024-07-13 10:11:43.390961] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.674 [2024-07-13 10:11:43.390972] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.674 [2024-07-13 10:11:43.390979] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1429eb0) 00:25:37.674 [2024-07-13 10:11:43.390992] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:25:37.674 [2024-07-13 10:11:43.391017] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1482f80, cid 0, qid 0 00:25:37.674 [2024-07-13 10:11:43.398878] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.674 [2024-07-13 10:11:43.398895] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.674 [2024-07-13 10:11:43.398902] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.674 [2024-07-13 10:11:43.398909] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1482f80) on tqpair=0x1429eb0 00:25:37.674 [2024-07-13 10:11:43.398932] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:25:37.674 [2024-07-13 10:11:43.398943] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:25:37.674 [2024-07-13 10:11:43.398952] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:25:37.674 [2024-07-13 10:11:43.398968] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.674 [2024-07-13 10:11:43.398976] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.674 [2024-07-13 10:11:43.398982] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1429eb0) 00:25:37.674 [2024-07-13 10:11:43.398993] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.674 [2024-07-13 10:11:43.399016] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1482f80, cid 0, qid 0 00:25:37.674 [2024-07-13 10:11:43.399178] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.674 [2024-07-13 10:11:43.399193] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.674 [2024-07-13 10:11:43.399200] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.674 [2024-07-13 10:11:43.399207] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1482f80) on tqpair=0x1429eb0 00:25:37.674 [2024-07-13 10:11:43.399216] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:25:37.674 [2024-07-13 10:11:43.399230] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:25:37.674 [2024-07-13 10:11:43.399242] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.674 [2024-07-13 10:11:43.399250] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.674 [2024-07-13 10:11:43.399256] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1429eb0) 00:25:37.674 [2024-07-13 10:11:43.399267] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.674 [2024-07-13 10:11:43.399288] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1482f80, cid 0, qid 0 00:25:37.674 [2024-07-13 10:11:43.399422] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.674 [2024-07-13 10:11:43.399437] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.674 [2024-07-13 10:11:43.399445] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.674 [2024-07-13 10:11:43.399451] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1482f80) on tqpair=0x1429eb0 00:25:37.674 [2024-07-13 10:11:43.399461] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:25:37.674 [2024-07-13 10:11:43.399475] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:25:37.674 [2024-07-13 10:11:43.399487] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.674 [2024-07-13 10:11:43.399494] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.674 [2024-07-13 10:11:43.399500] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1429eb0) 00:25:37.674 [2024-07-13 10:11:43.399511] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.674 [2024-07-13 10:11:43.399532] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1482f80, cid 0, qid 0 00:25:37.674 [2024-07-13 10:11:43.399647] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.674 [2024-07-13 10:11:43.399659] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.674 [2024-07-13 10:11:43.399666] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.674 [2024-07-13 10:11:43.399673] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1482f80) on tqpair=0x1429eb0 00:25:37.674 [2024-07-13 10:11:43.399687] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:25:37.674 [2024-07-13 10:11:43.399704] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.674 [2024-07-13 10:11:43.399713] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.674 [2024-07-13 10:11:43.399719] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1429eb0) 00:25:37.674 [2024-07-13 10:11:43.399729] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.674 [2024-07-13 10:11:43.399750] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1482f80, cid 0, qid 0 00:25:37.674 [2024-07-13 10:11:43.399873] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.674 [2024-07-13 10:11:43.399889] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.674 [2024-07-13 10:11:43.399896] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.675 [2024-07-13 10:11:43.399903] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1482f80) on tqpair=0x1429eb0 00:25:37.675 [2024-07-13 10:11:43.399911] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:25:37.675 [2024-07-13 10:11:43.399920] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:25:37.675 [2024-07-13 10:11:43.399933] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:25:37.675 [2024-07-13 10:11:43.400043] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:25:37.675 [2024-07-13 10:11:43.400051] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:25:37.675 [2024-07-13 10:11:43.400063] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.675 [2024-07-13 10:11:43.400070] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.675 [2024-07-13 10:11:43.400076] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1429eb0) 00:25:37.675 [2024-07-13 10:11:43.400086] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.675 [2024-07-13 10:11:43.400107] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1482f80, cid 0, qid 0 00:25:37.675 [2024-07-13 10:11:43.400266] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.675 [2024-07-13 10:11:43.400278] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.675 [2024-07-13 10:11:43.400285] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.675 [2024-07-13 10:11:43.400292] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1482f80) on tqpair=0x1429eb0 00:25:37.675 [2024-07-13 10:11:43.400301] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:25:37.675 [2024-07-13 10:11:43.400318] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.675 [2024-07-13 10:11:43.400326] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.675 [2024-07-13 10:11:43.400333] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1429eb0) 00:25:37.675 [2024-07-13 10:11:43.400343] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.675 [2024-07-13 10:11:43.400363] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1482f80, cid 0, qid 0 00:25:37.675 [2024-07-13 10:11:43.400478] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.675 [2024-07-13 10:11:43.400494] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.675 [2024-07-13 10:11:43.400501] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.675 [2024-07-13 10:11:43.400511] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1482f80) on tqpair=0x1429eb0 00:25:37.675 [2024-07-13 10:11:43.400521] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:25:37.675 [2024-07-13 10:11:43.400529] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:25:37.675 [2024-07-13 10:11:43.400542] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:25:37.675 [2024-07-13 10:11:43.400556] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:25:37.675 [2024-07-13 10:11:43.400569] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.675 [2024-07-13 10:11:43.400576] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.675 [2024-07-13 10:11:43.400582] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1429eb0) 00:25:37.675 [2024-07-13 10:11:43.400593] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.675 [2024-07-13 10:11:43.400613] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1482f80, cid 0, qid 0 00:25:37.675 [2024-07-13 10:11:43.400780] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:37.675 [2024-07-13 10:11:43.400792] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:37.675 [2024-07-13 10:11:43.400799] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:37.675 [2024-07-13 10:11:43.400806] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1429eb0): datao=0, datal=4096, cccid=0 00:25:37.675 [2024-07-13 10:11:43.400813] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1482f80) on tqpair(0x1429eb0): expected_datao=0, payload_size=4096 00:25:37.675 [2024-07-13 10:11:43.400824] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:37.675 [2024-07-13 10:11:43.400832] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:37.675 [2024-07-13 10:11:43.400863] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.675 [2024-07-13 10:11:43.400885] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.675 [2024-07-13 10:11:43.400893] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.675 [2024-07-13 10:11:43.400899] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1482f80) on tqpair=0x1429eb0 00:25:37.675 [2024-07-13 10:11:43.400911] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:25:37.675 [2024-07-13 10:11:43.400919] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:25:37.675 [2024-07-13 10:11:43.400927] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:25:37.675 [2024-07-13 10:11:43.400933] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:25:37.675 [2024-07-13 10:11:43.400941] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:25:37.675 [2024-07-13 10:11:43.400949] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:25:37.675 [2024-07-13 10:11:43.400967] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:25:37.675 [2024-07-13 10:11:43.400980] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.675 [2024-07-13 10:11:43.400987] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.675 [2024-07-13 10:11:43.400993] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1429eb0) 00:25:37.675 [2024-07-13 10:11:43.401004] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:25:37.675 [2024-07-13 10:11:43.401029] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1482f80, cid 0, qid 0 00:25:37.675 [2024-07-13 10:11:43.401161] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.675 [2024-07-13 10:11:43.401174] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.675 [2024-07-13 10:11:43.401181] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.675 [2024-07-13 10:11:43.401187] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1482f80) on tqpair=0x1429eb0 00:25:37.675 [2024-07-13 10:11:43.401198] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.675 [2024-07-13 10:11:43.401205] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.675 [2024-07-13 10:11:43.401212] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1429eb0) 00:25:37.675 [2024-07-13 10:11:43.401221] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.675 [2024-07-13 10:11:43.401231] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.675 [2024-07-13 10:11:43.401238] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.675 [2024-07-13 10:11:43.401244] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x1429eb0) 00:25:37.675 [2024-07-13 10:11:43.401252] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.675 [2024-07-13 10:11:43.401262] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.675 [2024-07-13 10:11:43.401268] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.675 [2024-07-13 10:11:43.401274] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x1429eb0) 00:25:37.675 [2024-07-13 10:11:43.401283] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.675 [2024-07-13 10:11:43.401292] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.675 [2024-07-13 10:11:43.401299] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.675 [2024-07-13 10:11:43.401305] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1429eb0) 00:25:37.675 [2024-07-13 10:11:43.401313] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.675 [2024-07-13 10:11:43.401322] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:25:37.675 [2024-07-13 10:11:43.401355] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:25:37.675 [2024-07-13 10:11:43.401367] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.675 [2024-07-13 10:11:43.401374] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.675 [2024-07-13 10:11:43.401380] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1429eb0) 00:25:37.675 [2024-07-13 10:11:43.401389] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.675 [2024-07-13 10:11:43.401411] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1482f80, cid 0, qid 0 00:25:37.675 [2024-07-13 10:11:43.401437] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14830e0, cid 1, qid 0 00:25:37.675 [2024-07-13 10:11:43.401445] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1483240, cid 2, qid 0 00:25:37.675 [2024-07-13 10:11:43.401453] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14833a0, cid 3, qid 0 00:25:37.675 [2024-07-13 10:11:43.401460] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1483500, cid 4, qid 0 00:25:37.675 [2024-07-13 10:11:43.401641] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.675 [2024-07-13 10:11:43.401654] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.675 [2024-07-13 10:11:43.401661] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.675 [2024-07-13 10:11:43.401671] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1483500) on tqpair=0x1429eb0 00:25:37.675 [2024-07-13 10:11:43.401681] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:25:37.675 [2024-07-13 10:11:43.401690] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:25:37.675 [2024-07-13 10:11:43.401703] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:25:37.675 [2024-07-13 10:11:43.401719] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:25:37.675 [2024-07-13 10:11:43.401745] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.675 [2024-07-13 10:11:43.401752] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.675 [2024-07-13 10:11:43.401758] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1429eb0) 00:25:37.675 [2024-07-13 10:11:43.401769] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:25:37.675 [2024-07-13 10:11:43.401789] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1483500, cid 4, qid 0 00:25:37.675 [2024-07-13 10:11:43.401956] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.675 [2024-07-13 10:11:43.401972] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.675 [2024-07-13 10:11:43.401980] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.675 [2024-07-13 10:11:43.401986] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1483500) on tqpair=0x1429eb0 00:25:37.675 [2024-07-13 10:11:43.402053] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:25:37.676 [2024-07-13 10:11:43.402071] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:25:37.676 [2024-07-13 10:11:43.402085] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.676 [2024-07-13 10:11:43.402092] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.676 [2024-07-13 10:11:43.402098] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1429eb0) 00:25:37.676 [2024-07-13 10:11:43.402123] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.676 [2024-07-13 10:11:43.402144] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1483500, cid 4, qid 0 00:25:37.676 [2024-07-13 10:11:43.402339] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:37.676 [2024-07-13 10:11:43.402352] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:37.676 [2024-07-13 10:11:43.402359] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:37.676 [2024-07-13 10:11:43.402365] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1429eb0): datao=0, datal=4096, cccid=4 00:25:37.676 [2024-07-13 10:11:43.402373] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1483500) on tqpair(0x1429eb0): expected_datao=0, payload_size=4096 00:25:37.676 [2024-07-13 10:11:43.402392] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:37.676 [2024-07-13 10:11:43.402401] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:37.676 [2024-07-13 10:11:43.402484] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.676 [2024-07-13 10:11:43.402499] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.676 [2024-07-13 10:11:43.402506] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.676 [2024-07-13 10:11:43.402512] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1483500) on tqpair=0x1429eb0 00:25:37.676 [2024-07-13 10:11:43.402538] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:25:37.676 [2024-07-13 10:11:43.402558] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:25:37.676 [2024-07-13 10:11:43.402577] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:25:37.676 [2024-07-13 10:11:43.402590] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.676 [2024-07-13 10:11:43.402597] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.676 [2024-07-13 10:11:43.402603] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1429eb0) 00:25:37.676 [2024-07-13 10:11:43.402614] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.676 [2024-07-13 10:11:43.402636] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1483500, cid 4, qid 0 00:25:37.676 [2024-07-13 10:11:43.402811] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:37.676 [2024-07-13 10:11:43.402823] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:37.676 [2024-07-13 10:11:43.402831] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:37.676 [2024-07-13 10:11:43.402837] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1429eb0): datao=0, datal=4096, cccid=4 00:25:37.676 [2024-07-13 10:11:43.402844] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1483500) on tqpair(0x1429eb0): expected_datao=0, payload_size=4096 00:25:37.676 [2024-07-13 10:11:43.402855] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:37.676 [2024-07-13 10:11:43.402862] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:37.676 [2024-07-13 10:11:43.406902] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.676 [2024-07-13 10:11:43.406914] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.676 [2024-07-13 10:11:43.406920] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.676 [2024-07-13 10:11:43.406927] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1483500) on tqpair=0x1429eb0 00:25:37.676 [2024-07-13 10:11:43.406953] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:25:37.676 [2024-07-13 10:11:43.406972] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:25:37.676 [2024-07-13 10:11:43.406985] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.676 [2024-07-13 10:11:43.406993] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.676 [2024-07-13 10:11:43.406999] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1429eb0) 00:25:37.676 [2024-07-13 10:11:43.407009] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.676 [2024-07-13 10:11:43.407030] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1483500, cid 4, qid 0 00:25:37.676 [2024-07-13 10:11:43.407228] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:37.676 [2024-07-13 10:11:43.407241] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:37.676 [2024-07-13 10:11:43.407248] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:37.676 [2024-07-13 10:11:43.407255] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1429eb0): datao=0, datal=4096, cccid=4 00:25:37.676 [2024-07-13 10:11:43.407262] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1483500) on tqpair(0x1429eb0): expected_datao=0, payload_size=4096 00:25:37.676 [2024-07-13 10:11:43.407273] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:37.676 [2024-07-13 10:11:43.407281] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:37.676 [2024-07-13 10:11:43.407312] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.676 [2024-07-13 10:11:43.407323] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.676 [2024-07-13 10:11:43.407334] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.676 [2024-07-13 10:11:43.407341] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1483500) on tqpair=0x1429eb0 00:25:37.676 [2024-07-13 10:11:43.407356] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:25:37.676 [2024-07-13 10:11:43.407371] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:25:37.676 [2024-07-13 10:11:43.407386] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:25:37.676 [2024-07-13 10:11:43.407398] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:25:37.676 [2024-07-13 10:11:43.407407] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:25:37.676 [2024-07-13 10:11:43.407416] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:25:37.676 [2024-07-13 10:11:43.407424] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:25:37.676 [2024-07-13 10:11:43.407432] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:25:37.676 [2024-07-13 10:11:43.407452] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.676 [2024-07-13 10:11:43.407460] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.676 [2024-07-13 10:11:43.407467] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1429eb0) 00:25:37.676 [2024-07-13 10:11:43.407477] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.676 [2024-07-13 10:11:43.407488] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.676 [2024-07-13 10:11:43.407495] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.676 [2024-07-13 10:11:43.407501] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1429eb0) 00:25:37.676 [2024-07-13 10:11:43.407525] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:25:37.676 [2024-07-13 10:11:43.407550] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1483500, cid 4, qid 0 00:25:37.676 [2024-07-13 10:11:43.407561] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1483660, cid 5, qid 0 00:25:37.676 [2024-07-13 10:11:43.407791] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.676 [2024-07-13 10:11:43.407803] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.676 [2024-07-13 10:11:43.407810] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.676 [2024-07-13 10:11:43.407817] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1483500) on tqpair=0x1429eb0 00:25:37.676 [2024-07-13 10:11:43.407828] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.676 [2024-07-13 10:11:43.407837] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.676 [2024-07-13 10:11:43.407844] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.676 [2024-07-13 10:11:43.407850] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1483660) on tqpair=0x1429eb0 00:25:37.676 [2024-07-13 10:11:43.407873] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.676 [2024-07-13 10:11:43.407898] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.676 [2024-07-13 10:11:43.407905] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1429eb0) 00:25:37.676 [2024-07-13 10:11:43.407915] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.676 [2024-07-13 10:11:43.407935] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1483660, cid 5, qid 0 00:25:37.676 [2024-07-13 10:11:43.408121] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.676 [2024-07-13 10:11:43.408134] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.676 [2024-07-13 10:11:43.408142] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.676 [2024-07-13 10:11:43.408148] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1483660) on tqpair=0x1429eb0 00:25:37.677 [2024-07-13 10:11:43.408165] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.677 [2024-07-13 10:11:43.408173] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.677 [2024-07-13 10:11:43.408179] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1429eb0) 00:25:37.677 [2024-07-13 10:11:43.408189] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.677 [2024-07-13 10:11:43.408210] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1483660, cid 5, qid 0 00:25:37.677 [2024-07-13 10:11:43.408325] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.677 [2024-07-13 10:11:43.408338] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.677 [2024-07-13 10:11:43.408344] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.677 [2024-07-13 10:11:43.408351] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1483660) on tqpair=0x1429eb0 00:25:37.677 [2024-07-13 10:11:43.408367] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.677 [2024-07-13 10:11:43.408376] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.677 [2024-07-13 10:11:43.408382] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1429eb0) 00:25:37.677 [2024-07-13 10:11:43.408392] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.677 [2024-07-13 10:11:43.408412] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1483660, cid 5, qid 0 00:25:37.677 [2024-07-13 10:11:43.408536] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.677 [2024-07-13 10:11:43.408551] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.677 [2024-07-13 10:11:43.408558] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.677 [2024-07-13 10:11:43.408565] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1483660) on tqpair=0x1429eb0 00:25:37.677 [2024-07-13 10:11:43.408585] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.677 [2024-07-13 10:11:43.408594] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.677 [2024-07-13 10:11:43.408601] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1429eb0) 00:25:37.677 [2024-07-13 10:11:43.408611] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.677 [2024-07-13 10:11:43.408622] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.677 [2024-07-13 10:11:43.408630] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.677 [2024-07-13 10:11:43.408636] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1429eb0) 00:25:37.677 [2024-07-13 10:11:43.408644] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.677 [2024-07-13 10:11:43.408655] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.677 [2024-07-13 10:11:43.408662] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.677 [2024-07-13 10:11:43.408668] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x1429eb0) 00:25:37.677 [2024-07-13 10:11:43.408677] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.677 [2024-07-13 10:11:43.408708] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.677 [2024-07-13 10:11:43.408716] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.677 [2024-07-13 10:11:43.408722] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x1429eb0) 00:25:37.677 [2024-07-13 10:11:43.408731] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.677 [2024-07-13 10:11:43.408752] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1483660, cid 5, qid 0 00:25:37.677 [2024-07-13 10:11:43.408778] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1483500, cid 4, qid 0 00:25:37.677 [2024-07-13 10:11:43.408786] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14837c0, cid 6, qid 0 00:25:37.677 [2024-07-13 10:11:43.408793] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1483920, cid 7, qid 0 00:25:37.677 [2024-07-13 10:11:43.409034] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:37.677 [2024-07-13 10:11:43.409050] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:37.677 [2024-07-13 10:11:43.409058] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:37.677 [2024-07-13 10:11:43.409064] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1429eb0): datao=0, datal=8192, cccid=5 00:25:37.677 [2024-07-13 10:11:43.409071] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1483660) on tqpair(0x1429eb0): expected_datao=0, payload_size=8192 00:25:37.677 [2024-07-13 10:11:43.409156] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:37.677 [2024-07-13 10:11:43.409166] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:37.677 [2024-07-13 10:11:43.409175] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:37.677 [2024-07-13 10:11:43.409184] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:37.677 [2024-07-13 10:11:43.409191] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:37.677 [2024-07-13 10:11:43.409197] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1429eb0): datao=0, datal=512, cccid=4 00:25:37.677 [2024-07-13 10:11:43.409205] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1483500) on tqpair(0x1429eb0): expected_datao=0, payload_size=512 00:25:37.677 [2024-07-13 10:11:43.409215] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:37.677 [2024-07-13 10:11:43.409222] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:37.677 [2024-07-13 10:11:43.409230] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:37.677 [2024-07-13 10:11:43.409239] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:37.677 [2024-07-13 10:11:43.409246] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:37.677 [2024-07-13 10:11:43.409252] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1429eb0): datao=0, datal=512, cccid=6 00:25:37.677 [2024-07-13 10:11:43.409259] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x14837c0) on tqpair(0x1429eb0): expected_datao=0, payload_size=512 00:25:37.677 [2024-07-13 10:11:43.409269] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:37.677 [2024-07-13 10:11:43.409276] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:37.677 [2024-07-13 10:11:43.409284] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:37.677 [2024-07-13 10:11:43.409293] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:37.677 [2024-07-13 10:11:43.409299] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:37.677 [2024-07-13 10:11:43.409305] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1429eb0): datao=0, datal=4096, cccid=7 00:25:37.677 [2024-07-13 10:11:43.409313] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1483920) on tqpair(0x1429eb0): expected_datao=0, payload_size=4096 00:25:37.677 [2024-07-13 10:11:43.409323] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:37.677 [2024-07-13 10:11:43.409330] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:37.677 [2024-07-13 10:11:43.409341] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.677 [2024-07-13 10:11:43.409355] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.677 [2024-07-13 10:11:43.409362] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.677 [2024-07-13 10:11:43.409369] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1483660) on tqpair=0x1429eb0 00:25:37.677 [2024-07-13 10:11:43.409389] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.677 [2024-07-13 10:11:43.409400] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.677 [2024-07-13 10:11:43.409406] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.677 [2024-07-13 10:11:43.409413] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1483500) on tqpair=0x1429eb0 00:25:37.677 [2024-07-13 10:11:43.409427] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.677 [2024-07-13 10:11:43.409453] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.677 [2024-07-13 10:11:43.409460] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.677 [2024-07-13 10:11:43.409466] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14837c0) on tqpair=0x1429eb0 00:25:37.677 [2024-07-13 10:11:43.409477] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.677 [2024-07-13 10:11:43.409486] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.677 [2024-07-13 10:11:43.409492] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.677 [2024-07-13 10:11:43.409498] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1483920) on tqpair=0x1429eb0 00:25:37.677 ===================================================== 00:25:37.677 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:37.677 ===================================================== 00:25:37.677 Controller Capabilities/Features 00:25:37.677 ================================ 00:25:37.677 Vendor ID: 8086 00:25:37.677 Subsystem Vendor ID: 8086 00:25:37.677 Serial Number: SPDK00000000000001 00:25:37.677 Model Number: SPDK bdev Controller 00:25:37.677 Firmware Version: 24.01.1 00:25:37.677 Recommended Arb Burst: 6 00:25:37.677 IEEE OUI Identifier: e4 d2 5c 00:25:37.677 Multi-path I/O 00:25:37.677 May have multiple subsystem ports: Yes 00:25:37.677 May have multiple controllers: Yes 00:25:37.677 Associated with SR-IOV VF: No 00:25:37.677 Max Data Transfer Size: 131072 00:25:37.677 Max Number of Namespaces: 32 00:25:37.677 Max Number of I/O Queues: 127 00:25:37.677 NVMe Specification Version (VS): 1.3 00:25:37.677 NVMe Specification Version (Identify): 1.3 00:25:37.677 Maximum Queue Entries: 128 00:25:37.677 Contiguous Queues Required: Yes 00:25:37.677 Arbitration Mechanisms Supported 00:25:37.677 Weighted Round Robin: Not Supported 00:25:37.677 Vendor Specific: Not Supported 00:25:37.677 Reset Timeout: 15000 ms 00:25:37.677 Doorbell Stride: 4 bytes 00:25:37.677 NVM Subsystem Reset: Not Supported 00:25:37.677 Command Sets Supported 00:25:37.677 NVM Command Set: Supported 00:25:37.677 Boot Partition: Not Supported 00:25:37.677 Memory Page Size Minimum: 4096 bytes 00:25:37.677 Memory Page Size Maximum: 4096 bytes 00:25:37.677 Persistent Memory Region: Not Supported 00:25:37.677 Optional Asynchronous Events Supported 00:25:37.677 Namespace Attribute Notices: Supported 00:25:37.677 Firmware Activation Notices: Not Supported 00:25:37.677 ANA Change Notices: Not Supported 00:25:37.677 PLE Aggregate Log Change Notices: Not Supported 00:25:37.677 LBA Status Info Alert Notices: Not Supported 00:25:37.677 EGE Aggregate Log Change Notices: Not Supported 00:25:37.677 Normal NVM Subsystem Shutdown event: Not Supported 00:25:37.677 Zone Descriptor Change Notices: Not Supported 00:25:37.677 Discovery Log Change Notices: Not Supported 00:25:37.677 Controller Attributes 00:25:37.677 128-bit Host Identifier: Supported 00:25:37.677 Non-Operational Permissive Mode: Not Supported 00:25:37.677 NVM Sets: Not Supported 00:25:37.677 Read Recovery Levels: Not Supported 00:25:37.677 Endurance Groups: Not Supported 00:25:37.677 Predictable Latency Mode: Not Supported 00:25:37.677 Traffic Based Keep ALive: Not Supported 00:25:37.677 Namespace Granularity: Not Supported 00:25:37.677 SQ Associations: Not Supported 00:25:37.677 UUID List: Not Supported 00:25:37.678 Multi-Domain Subsystem: Not Supported 00:25:37.678 Fixed Capacity Management: Not Supported 00:25:37.678 Variable Capacity Management: Not Supported 00:25:37.678 Delete Endurance Group: Not Supported 00:25:37.678 Delete NVM Set: Not Supported 00:25:37.678 Extended LBA Formats Supported: Not Supported 00:25:37.678 Flexible Data Placement Supported: Not Supported 00:25:37.678 00:25:37.678 Controller Memory Buffer Support 00:25:37.678 ================================ 00:25:37.678 Supported: No 00:25:37.678 00:25:37.678 Persistent Memory Region Support 00:25:37.678 ================================ 00:25:37.678 Supported: No 00:25:37.678 00:25:37.678 Admin Command Set Attributes 00:25:37.678 ============================ 00:25:37.678 Security Send/Receive: Not Supported 00:25:37.678 Format NVM: Not Supported 00:25:37.678 Firmware Activate/Download: Not Supported 00:25:37.678 Namespace Management: Not Supported 00:25:37.678 Device Self-Test: Not Supported 00:25:37.678 Directives: Not Supported 00:25:37.678 NVMe-MI: Not Supported 00:25:37.678 Virtualization Management: Not Supported 00:25:37.678 Doorbell Buffer Config: Not Supported 00:25:37.678 Get LBA Status Capability: Not Supported 00:25:37.678 Command & Feature Lockdown Capability: Not Supported 00:25:37.678 Abort Command Limit: 4 00:25:37.678 Async Event Request Limit: 4 00:25:37.678 Number of Firmware Slots: N/A 00:25:37.678 Firmware Slot 1 Read-Only: N/A 00:25:37.678 Firmware Activation Without Reset: N/A 00:25:37.678 Multiple Update Detection Support: N/A 00:25:37.678 Firmware Update Granularity: No Information Provided 00:25:37.678 Per-Namespace SMART Log: No 00:25:37.678 Asymmetric Namespace Access Log Page: Not Supported 00:25:37.678 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:25:37.678 Command Effects Log Page: Supported 00:25:37.678 Get Log Page Extended Data: Supported 00:25:37.678 Telemetry Log Pages: Not Supported 00:25:37.678 Persistent Event Log Pages: Not Supported 00:25:37.678 Supported Log Pages Log Page: May Support 00:25:37.678 Commands Supported & Effects Log Page: Not Supported 00:25:37.678 Feature Identifiers & Effects Log Page:May Support 00:25:37.678 NVMe-MI Commands & Effects Log Page: May Support 00:25:37.678 Data Area 4 for Telemetry Log: Not Supported 00:25:37.678 Error Log Page Entries Supported: 128 00:25:37.678 Keep Alive: Supported 00:25:37.678 Keep Alive Granularity: 10000 ms 00:25:37.678 00:25:37.678 NVM Command Set Attributes 00:25:37.678 ========================== 00:25:37.678 Submission Queue Entry Size 00:25:37.678 Max: 64 00:25:37.678 Min: 64 00:25:37.678 Completion Queue Entry Size 00:25:37.678 Max: 16 00:25:37.678 Min: 16 00:25:37.678 Number of Namespaces: 32 00:25:37.678 Compare Command: Supported 00:25:37.678 Write Uncorrectable Command: Not Supported 00:25:37.678 Dataset Management Command: Supported 00:25:37.678 Write Zeroes Command: Supported 00:25:37.678 Set Features Save Field: Not Supported 00:25:37.678 Reservations: Supported 00:25:37.678 Timestamp: Not Supported 00:25:37.678 Copy: Supported 00:25:37.678 Volatile Write Cache: Present 00:25:37.678 Atomic Write Unit (Normal): 1 00:25:37.678 Atomic Write Unit (PFail): 1 00:25:37.678 Atomic Compare & Write Unit: 1 00:25:37.678 Fused Compare & Write: Supported 00:25:37.678 Scatter-Gather List 00:25:37.678 SGL Command Set: Supported 00:25:37.678 SGL Keyed: Supported 00:25:37.678 SGL Bit Bucket Descriptor: Not Supported 00:25:37.678 SGL Metadata Pointer: Not Supported 00:25:37.678 Oversized SGL: Not Supported 00:25:37.678 SGL Metadata Address: Not Supported 00:25:37.678 SGL Offset: Supported 00:25:37.678 Transport SGL Data Block: Not Supported 00:25:37.678 Replay Protected Memory Block: Not Supported 00:25:37.678 00:25:37.678 Firmware Slot Information 00:25:37.678 ========================= 00:25:37.678 Active slot: 1 00:25:37.678 Slot 1 Firmware Revision: 24.01.1 00:25:37.678 00:25:37.678 00:25:37.678 Commands Supported and Effects 00:25:37.678 ============================== 00:25:37.678 Admin Commands 00:25:37.678 -------------- 00:25:37.678 Get Log Page (02h): Supported 00:25:37.678 Identify (06h): Supported 00:25:37.678 Abort (08h): Supported 00:25:37.678 Set Features (09h): Supported 00:25:37.678 Get Features (0Ah): Supported 00:25:37.678 Asynchronous Event Request (0Ch): Supported 00:25:37.678 Keep Alive (18h): Supported 00:25:37.678 I/O Commands 00:25:37.678 ------------ 00:25:37.678 Flush (00h): Supported LBA-Change 00:25:37.678 Write (01h): Supported LBA-Change 00:25:37.678 Read (02h): Supported 00:25:37.678 Compare (05h): Supported 00:25:37.678 Write Zeroes (08h): Supported LBA-Change 00:25:37.678 Dataset Management (09h): Supported LBA-Change 00:25:37.678 Copy (19h): Supported LBA-Change 00:25:37.678 Unknown (79h): Supported LBA-Change 00:25:37.678 Unknown (7Ah): Supported 00:25:37.678 00:25:37.678 Error Log 00:25:37.678 ========= 00:25:37.678 00:25:37.678 Arbitration 00:25:37.678 =========== 00:25:37.678 Arbitration Burst: 1 00:25:37.678 00:25:37.678 Power Management 00:25:37.678 ================ 00:25:37.678 Number of Power States: 1 00:25:37.678 Current Power State: Power State #0 00:25:37.678 Power State #0: 00:25:37.678 Max Power: 0.00 W 00:25:37.678 Non-Operational State: Operational 00:25:37.678 Entry Latency: Not Reported 00:25:37.678 Exit Latency: Not Reported 00:25:37.678 Relative Read Throughput: 0 00:25:37.678 Relative Read Latency: 0 00:25:37.678 Relative Write Throughput: 0 00:25:37.678 Relative Write Latency: 0 00:25:37.678 Idle Power: Not Reported 00:25:37.678 Active Power: Not Reported 00:25:37.678 Non-Operational Permissive Mode: Not Supported 00:25:37.678 00:25:37.678 Health Information 00:25:37.678 ================== 00:25:37.678 Critical Warnings: 00:25:37.678 Available Spare Space: OK 00:25:37.678 Temperature: OK 00:25:37.678 Device Reliability: OK 00:25:37.678 Read Only: No 00:25:37.678 Volatile Memory Backup: OK 00:25:37.678 Current Temperature: 0 Kelvin (-273 Celsius) 00:25:37.678 Temperature Threshold: [2024-07-13 10:11:43.409646] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.678 [2024-07-13 10:11:43.409658] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.678 [2024-07-13 10:11:43.409664] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x1429eb0) 00:25:37.678 [2024-07-13 10:11:43.409674] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.678 [2024-07-13 10:11:43.409696] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1483920, cid 7, qid 0 00:25:37.678 [2024-07-13 10:11:43.409874] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.678 [2024-07-13 10:11:43.409891] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.678 [2024-07-13 10:11:43.409898] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.678 [2024-07-13 10:11:43.409905] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1483920) on tqpair=0x1429eb0 00:25:37.678 [2024-07-13 10:11:43.409949] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:25:37.678 [2024-07-13 10:11:43.409969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.678 [2024-07-13 10:11:43.409981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.678 [2024-07-13 10:11:43.409991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.678 [2024-07-13 10:11:43.410000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:37.678 [2024-07-13 10:11:43.410027] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.678 [2024-07-13 10:11:43.410035] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.678 [2024-07-13 10:11:43.410042] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1429eb0) 00:25:37.678 [2024-07-13 10:11:43.410052] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.678 [2024-07-13 10:11:43.410074] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14833a0, cid 3, qid 0 00:25:37.678 [2024-07-13 10:11:43.410259] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.678 [2024-07-13 10:11:43.410279] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.678 [2024-07-13 10:11:43.410286] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.678 [2024-07-13 10:11:43.410293] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14833a0) on tqpair=0x1429eb0 00:25:37.678 [2024-07-13 10:11:43.410306] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.678 [2024-07-13 10:11:43.410313] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.678 [2024-07-13 10:11:43.410319] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1429eb0) 00:25:37.678 [2024-07-13 10:11:43.410330] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.678 [2024-07-13 10:11:43.410355] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14833a0, cid 3, qid 0 00:25:37.678 [2024-07-13 10:11:43.410500] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.678 [2024-07-13 10:11:43.410515] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.678 [2024-07-13 10:11:43.410522] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.678 [2024-07-13 10:11:43.410529] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14833a0) on tqpair=0x1429eb0 00:25:37.678 [2024-07-13 10:11:43.410538] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:25:37.678 [2024-07-13 10:11:43.410545] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:25:37.678 [2024-07-13 10:11:43.410561] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.678 [2024-07-13 10:11:43.410570] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.679 [2024-07-13 10:11:43.410576] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1429eb0) 00:25:37.679 [2024-07-13 10:11:43.410586] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.679 [2024-07-13 10:11:43.410607] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14833a0, cid 3, qid 0 00:25:37.679 [2024-07-13 10:11:43.410751] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.679 [2024-07-13 10:11:43.410766] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.679 [2024-07-13 10:11:43.410773] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.679 [2024-07-13 10:11:43.410780] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14833a0) on tqpair=0x1429eb0 00:25:37.679 [2024-07-13 10:11:43.410797] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.679 [2024-07-13 10:11:43.410806] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.679 [2024-07-13 10:11:43.410812] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1429eb0) 00:25:37.679 [2024-07-13 10:11:43.410822] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.679 [2024-07-13 10:11:43.410843] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14833a0, cid 3, qid 0 00:25:37.679 [2024-07-13 10:11:43.414879] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.679 [2024-07-13 10:11:43.414895] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.679 [2024-07-13 10:11:43.414902] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.679 [2024-07-13 10:11:43.414908] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14833a0) on tqpair=0x1429eb0 00:25:37.679 [2024-07-13 10:11:43.414925] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:37.679 [2024-07-13 10:11:43.414949] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:37.679 [2024-07-13 10:11:43.414955] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1429eb0) 00:25:37.679 [2024-07-13 10:11:43.414966] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:37.679 [2024-07-13 10:11:43.414987] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x14833a0, cid 3, qid 0 00:25:37.679 [2024-07-13 10:11:43.415177] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:37.679 [2024-07-13 10:11:43.415193] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:37.679 [2024-07-13 10:11:43.415200] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:37.679 [2024-07-13 10:11:43.415207] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x14833a0) on tqpair=0x1429eb0 00:25:37.679 [2024-07-13 10:11:43.415221] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 4 milliseconds 00:25:37.679 0 Kelvin (-273 Celsius) 00:25:37.679 Available Spare: 0% 00:25:37.679 Available Spare Threshold: 0% 00:25:37.679 Life Percentage Used: 0% 00:25:37.679 Data Units Read: 0 00:25:37.679 Data Units Written: 0 00:25:37.679 Host Read Commands: 0 00:25:37.679 Host Write Commands: 0 00:25:37.679 Controller Busy Time: 0 minutes 00:25:37.679 Power Cycles: 0 00:25:37.679 Power On Hours: 0 hours 00:25:37.679 Unsafe Shutdowns: 0 00:25:37.679 Unrecoverable Media Errors: 0 00:25:37.679 Lifetime Error Log Entries: 0 00:25:37.679 Warning Temperature Time: 0 minutes 00:25:37.679 Critical Temperature Time: 0 minutes 00:25:37.679 00:25:37.679 Number of Queues 00:25:37.679 ================ 00:25:37.679 Number of I/O Submission Queues: 127 00:25:37.679 Number of I/O Completion Queues: 127 00:25:37.679 00:25:37.679 Active Namespaces 00:25:37.679 ================= 00:25:37.679 Namespace ID:1 00:25:37.679 Error Recovery Timeout: Unlimited 00:25:37.679 Command Set Identifier: NVM (00h) 00:25:37.679 Deallocate: Supported 00:25:37.679 Deallocated/Unwritten Error: Not Supported 00:25:37.679 Deallocated Read Value: Unknown 00:25:37.679 Deallocate in Write Zeroes: Not Supported 00:25:37.679 Deallocated Guard Field: 0xFFFF 00:25:37.679 Flush: Supported 00:25:37.679 Reservation: Supported 00:25:37.679 Namespace Sharing Capabilities: Multiple Controllers 00:25:37.679 Size (in LBAs): 131072 (0GiB) 00:25:37.679 Capacity (in LBAs): 131072 (0GiB) 00:25:37.679 Utilization (in LBAs): 131072 (0GiB) 00:25:37.679 NGUID: ABCDEF0123456789ABCDEF0123456789 00:25:37.679 EUI64: ABCDEF0123456789 00:25:37.679 UUID: be085283-1f6e-4441-bec3-c323db50912c 00:25:37.679 Thin Provisioning: Not Supported 00:25:37.679 Per-NS Atomic Units: Yes 00:25:37.679 Atomic Boundary Size (Normal): 0 00:25:37.679 Atomic Boundary Size (PFail): 0 00:25:37.679 Atomic Boundary Offset: 0 00:25:37.679 Maximum Single Source Range Length: 65535 00:25:37.679 Maximum Copy Length: 65535 00:25:37.679 Maximum Source Range Count: 1 00:25:37.679 NGUID/EUI64 Never Reused: No 00:25:37.679 Namespace Write Protected: No 00:25:37.679 Number of LBA Formats: 1 00:25:37.679 Current LBA Format: LBA Format #00 00:25:37.679 LBA Format #00: Data Size: 512 Metadata Size: 0 00:25:37.679 00:25:37.679 10:11:43 -- host/identify.sh@51 -- # sync 00:25:37.679 10:11:43 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:37.679 10:11:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:37.679 10:11:43 -- common/autotest_common.sh@10 -- # set +x 00:25:37.679 10:11:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:37.679 10:11:43 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:25:37.679 10:11:43 -- host/identify.sh@56 -- # nvmftestfini 00:25:37.679 10:11:43 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:37.679 10:11:43 -- nvmf/common.sh@116 -- # sync 00:25:37.679 10:11:43 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:37.679 10:11:43 -- nvmf/common.sh@119 -- # set +e 00:25:37.679 10:11:43 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:37.679 10:11:43 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:37.679 rmmod nvme_tcp 00:25:37.679 rmmod nvme_fabrics 00:25:37.679 rmmod nvme_keyring 00:25:37.937 10:11:43 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:37.937 10:11:43 -- nvmf/common.sh@123 -- # set -e 00:25:37.937 10:11:43 -- nvmf/common.sh@124 -- # return 0 00:25:37.937 10:11:43 -- nvmf/common.sh@477 -- # '[' -n 2896177 ']' 00:25:37.937 10:11:43 -- nvmf/common.sh@478 -- # killprocess 2896177 00:25:37.937 10:11:43 -- common/autotest_common.sh@926 -- # '[' -z 2896177 ']' 00:25:37.937 10:11:43 -- common/autotest_common.sh@930 -- # kill -0 2896177 00:25:37.937 10:11:43 -- common/autotest_common.sh@931 -- # uname 00:25:37.937 10:11:43 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:37.937 10:11:43 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2896177 00:25:37.937 10:11:43 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:25:37.937 10:11:43 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:25:37.937 10:11:43 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2896177' 00:25:37.937 killing process with pid 2896177 00:25:37.937 10:11:43 -- common/autotest_common.sh@945 -- # kill 2896177 00:25:37.937 [2024-07-13 10:11:43.539422] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:25:37.937 10:11:43 -- common/autotest_common.sh@950 -- # wait 2896177 00:25:38.195 10:11:43 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:38.195 10:11:43 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:38.195 10:11:43 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:38.195 10:11:43 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:38.195 10:11:43 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:38.195 10:11:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:38.195 10:11:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:38.195 10:11:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:40.097 10:11:45 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:40.097 00:25:40.097 real 0m5.912s 00:25:40.097 user 0m6.887s 00:25:40.097 sys 0m1.870s 00:25:40.097 10:11:45 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:25:40.097 10:11:45 -- common/autotest_common.sh@10 -- # set +x 00:25:40.097 ************************************ 00:25:40.097 END TEST nvmf_identify 00:25:40.097 ************************************ 00:25:40.097 10:11:45 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:25:40.097 10:11:45 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:25:40.097 10:11:45 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:25:40.097 10:11:45 -- common/autotest_common.sh@10 -- # set +x 00:25:40.097 ************************************ 00:25:40.097 START TEST nvmf_perf 00:25:40.097 ************************************ 00:25:40.097 10:11:45 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:25:40.097 * Looking for test storage... 00:25:40.355 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:40.355 10:11:45 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:40.355 10:11:45 -- nvmf/common.sh@7 -- # uname -s 00:25:40.355 10:11:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:40.355 10:11:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:40.355 10:11:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:40.355 10:11:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:40.355 10:11:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:40.355 10:11:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:40.355 10:11:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:40.355 10:11:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:40.355 10:11:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:40.355 10:11:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:40.355 10:11:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:40.355 10:11:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:40.355 10:11:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:40.355 10:11:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:40.355 10:11:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:40.355 10:11:45 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:40.355 10:11:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:40.355 10:11:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:40.355 10:11:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:40.355 10:11:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:40.355 10:11:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:40.356 10:11:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:40.356 10:11:45 -- paths/export.sh@5 -- # export PATH 00:25:40.356 10:11:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:40.356 10:11:45 -- nvmf/common.sh@46 -- # : 0 00:25:40.356 10:11:45 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:40.356 10:11:45 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:40.356 10:11:45 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:40.356 10:11:45 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:40.356 10:11:45 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:40.356 10:11:45 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:40.356 10:11:45 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:40.356 10:11:45 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:40.356 10:11:45 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:25:40.356 10:11:45 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:25:40.356 10:11:45 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:25:40.356 10:11:45 -- host/perf.sh@17 -- # nvmftestinit 00:25:40.356 10:11:45 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:40.356 10:11:45 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:40.356 10:11:45 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:40.356 10:11:45 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:40.356 10:11:45 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:40.356 10:11:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:40.356 10:11:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:40.356 10:11:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:40.356 10:11:45 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:40.356 10:11:45 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:40.356 10:11:45 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:40.356 10:11:45 -- common/autotest_common.sh@10 -- # set +x 00:25:42.256 10:11:47 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:42.256 10:11:47 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:42.256 10:11:47 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:42.256 10:11:47 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:42.256 10:11:47 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:42.256 10:11:47 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:42.256 10:11:47 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:42.256 10:11:47 -- nvmf/common.sh@294 -- # net_devs=() 00:25:42.256 10:11:47 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:42.256 10:11:47 -- nvmf/common.sh@295 -- # e810=() 00:25:42.256 10:11:47 -- nvmf/common.sh@295 -- # local -ga e810 00:25:42.256 10:11:47 -- nvmf/common.sh@296 -- # x722=() 00:25:42.256 10:11:47 -- nvmf/common.sh@296 -- # local -ga x722 00:25:42.256 10:11:47 -- nvmf/common.sh@297 -- # mlx=() 00:25:42.256 10:11:47 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:42.256 10:11:47 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:42.256 10:11:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:42.256 10:11:47 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:42.256 10:11:47 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:42.256 10:11:47 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:42.256 10:11:47 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:42.256 10:11:47 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:42.256 10:11:47 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:42.256 10:11:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:42.256 10:11:47 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:42.256 10:11:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:42.256 10:11:47 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:42.256 10:11:47 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:42.256 10:11:47 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:42.256 10:11:47 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:42.256 10:11:47 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:42.256 10:11:47 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:42.256 10:11:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:42.256 10:11:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:42.256 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:42.256 10:11:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:42.256 10:11:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:42.256 10:11:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:42.256 10:11:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:42.256 10:11:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:42.256 10:11:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:42.256 10:11:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:42.256 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:42.256 10:11:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:42.256 10:11:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:42.256 10:11:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:42.256 10:11:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:42.256 10:11:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:42.256 10:11:47 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:42.256 10:11:47 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:42.256 10:11:47 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:42.256 10:11:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:42.256 10:11:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:42.256 10:11:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:42.256 10:11:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:42.256 10:11:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:42.256 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:42.256 10:11:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:42.256 10:11:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:42.256 10:11:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:42.256 10:11:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:42.256 10:11:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:42.256 10:11:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:42.256 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:42.256 10:11:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:42.256 10:11:47 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:42.256 10:11:47 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:42.256 10:11:47 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:42.256 10:11:47 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:42.256 10:11:47 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:42.256 10:11:47 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:42.256 10:11:47 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:42.256 10:11:47 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:42.256 10:11:47 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:42.256 10:11:47 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:42.256 10:11:47 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:42.256 10:11:47 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:42.256 10:11:47 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:42.256 10:11:47 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:42.256 10:11:47 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:42.256 10:11:47 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:42.256 10:11:47 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:42.256 10:11:47 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:42.256 10:11:47 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:42.256 10:11:47 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:42.256 10:11:47 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:42.257 10:11:47 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:42.257 10:11:47 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:42.257 10:11:47 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:42.257 10:11:47 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:42.257 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:42.257 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.177 ms 00:25:42.257 00:25:42.257 --- 10.0.0.2 ping statistics --- 00:25:42.257 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:42.257 rtt min/avg/max/mdev = 0.177/0.177/0.177/0.000 ms 00:25:42.257 10:11:47 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:42.257 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:42.257 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.193 ms 00:25:42.257 00:25:42.257 --- 10.0.0.1 ping statistics --- 00:25:42.257 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:42.257 rtt min/avg/max/mdev = 0.193/0.193/0.193/0.000 ms 00:25:42.257 10:11:47 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:42.257 10:11:47 -- nvmf/common.sh@410 -- # return 0 00:25:42.257 10:11:47 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:42.257 10:11:47 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:42.257 10:11:47 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:42.257 10:11:47 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:42.257 10:11:47 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:42.257 10:11:47 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:42.257 10:11:47 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:42.257 10:11:47 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:25:42.257 10:11:47 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:42.257 10:11:47 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:42.257 10:11:47 -- common/autotest_common.sh@10 -- # set +x 00:25:42.257 10:11:47 -- nvmf/common.sh@469 -- # nvmfpid=2898284 00:25:42.257 10:11:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:42.257 10:11:47 -- nvmf/common.sh@470 -- # waitforlisten 2898284 00:25:42.257 10:11:47 -- common/autotest_common.sh@819 -- # '[' -z 2898284 ']' 00:25:42.257 10:11:47 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:42.257 10:11:47 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:42.257 10:11:47 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:42.257 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:42.257 10:11:47 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:42.257 10:11:47 -- common/autotest_common.sh@10 -- # set +x 00:25:42.257 [2024-07-13 10:11:47.996226] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:25:42.257 [2024-07-13 10:11:47.996310] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:42.257 EAL: No free 2048 kB hugepages reported on node 1 00:25:42.257 [2024-07-13 10:11:48.066570] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:42.515 [2024-07-13 10:11:48.157527] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:42.515 [2024-07-13 10:11:48.157686] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:42.515 [2024-07-13 10:11:48.157702] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:42.515 [2024-07-13 10:11:48.157720] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:42.515 [2024-07-13 10:11:48.159890] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:42.515 [2024-07-13 10:11:48.159932] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:42.515 [2024-07-13 10:11:48.160015] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:42.515 [2024-07-13 10:11:48.160018] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:43.447 10:11:48 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:43.447 10:11:48 -- common/autotest_common.sh@852 -- # return 0 00:25:43.447 10:11:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:43.447 10:11:48 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:43.447 10:11:48 -- common/autotest_common.sh@10 -- # set +x 00:25:43.447 10:11:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:43.447 10:11:48 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:25:43.447 10:11:48 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:25:46.722 10:11:52 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:25:46.722 10:11:52 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:25:46.722 10:11:52 -- host/perf.sh@30 -- # local_nvme_trid=0000:88:00.0 00:25:46.722 10:11:52 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:25:46.979 10:11:52 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:25:46.979 10:11:52 -- host/perf.sh@33 -- # '[' -n 0000:88:00.0 ']' 00:25:46.979 10:11:52 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:25:46.979 10:11:52 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:25:46.979 10:11:52 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:25:47.236 [2024-07-13 10:11:52.873640] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:47.236 10:11:52 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:47.492 10:11:53 -- host/perf.sh@45 -- # for bdev in $bdevs 00:25:47.492 10:11:53 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:47.750 10:11:53 -- host/perf.sh@45 -- # for bdev in $bdevs 00:25:47.750 10:11:53 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:25:48.007 10:11:53 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:48.290 [2024-07-13 10:11:53.845328] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:48.290 10:11:53 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:25:48.547 10:11:54 -- host/perf.sh@52 -- # '[' -n 0000:88:00.0 ']' 00:25:48.547 10:11:54 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:25:48.547 10:11:54 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:25:48.547 10:11:54 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:25:49.917 Initializing NVMe Controllers 00:25:49.917 Attached to NVMe Controller at 0000:88:00.0 [8086:0a54] 00:25:49.917 Associating PCIE (0000:88:00.0) NSID 1 with lcore 0 00:25:49.917 Initialization complete. Launching workers. 00:25:49.917 ======================================================== 00:25:49.917 Latency(us) 00:25:49.917 Device Information : IOPS MiB/s Average min max 00:25:49.917 PCIE (0000:88:00.0) NSID 1 from core 0: 86152.87 336.53 370.87 41.69 6266.99 00:25:49.917 ======================================================== 00:25:49.917 Total : 86152.87 336.53 370.87 41.69 6266.99 00:25:49.917 00:25:49.917 10:11:55 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:25:49.917 EAL: No free 2048 kB hugepages reported on node 1 00:25:50.847 Initializing NVMe Controllers 00:25:50.847 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:50.847 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:25:50.847 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:25:50.847 Initialization complete. Launching workers. 00:25:50.847 ======================================================== 00:25:50.847 Latency(us) 00:25:50.847 Device Information : IOPS MiB/s Average min max 00:25:50.847 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 424.00 1.66 2390.24 179.83 44953.53 00:25:50.847 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 62.00 0.24 16330.15 7893.53 47904.78 00:25:50.847 ======================================================== 00:25:50.847 Total : 486.00 1.90 4168.58 179.83 47904.78 00:25:50.847 00:25:50.847 10:11:56 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:25:51.104 EAL: No free 2048 kB hugepages reported on node 1 00:25:52.476 Initializing NVMe Controllers 00:25:52.476 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:52.476 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:25:52.476 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:25:52.476 Initialization complete. Launching workers. 00:25:52.476 ======================================================== 00:25:52.476 Latency(us) 00:25:52.476 Device Information : IOPS MiB/s Average min max 00:25:52.477 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8513.99 33.26 3759.99 423.88 7834.23 00:25:52.477 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3951.00 15.43 8142.45 7003.39 15936.20 00:25:52.477 ======================================================== 00:25:52.477 Total : 12464.99 48.69 5149.09 423.88 15936.20 00:25:52.477 00:25:52.477 10:11:57 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:25:52.477 10:11:57 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:25:52.477 10:11:57 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:25:52.477 EAL: No free 2048 kB hugepages reported on node 1 00:25:55.003 Initializing NVMe Controllers 00:25:55.003 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:55.003 Controller IO queue size 128, less than required. 00:25:55.003 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:25:55.003 Controller IO queue size 128, less than required. 00:25:55.003 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:25:55.003 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:25:55.003 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:25:55.003 Initialization complete. Launching workers. 00:25:55.003 ======================================================== 00:25:55.003 Latency(us) 00:25:55.003 Device Information : IOPS MiB/s Average min max 00:25:55.003 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 932.89 233.22 142018.71 72198.57 182691.49 00:25:55.003 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 576.43 144.11 227899.91 82750.32 349454.04 00:25:55.003 ======================================================== 00:25:55.003 Total : 1509.32 377.33 174817.99 72198.57 349454.04 00:25:55.003 00:25:55.003 10:12:00 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:25:55.003 EAL: No free 2048 kB hugepages reported on node 1 00:25:55.003 No valid NVMe controllers or AIO or URING devices found 00:25:55.003 Initializing NVMe Controllers 00:25:55.004 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:55.004 Controller IO queue size 128, less than required. 00:25:55.004 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:25:55.004 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:25:55.004 Controller IO queue size 128, less than required. 00:25:55.004 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:25:55.004 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:25:55.004 WARNING: Some requested NVMe devices were skipped 00:25:55.004 10:12:00 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:25:55.004 EAL: No free 2048 kB hugepages reported on node 1 00:25:57.530 Initializing NVMe Controllers 00:25:57.530 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:57.530 Controller IO queue size 128, less than required. 00:25:57.530 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:25:57.530 Controller IO queue size 128, less than required. 00:25:57.530 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:25:57.530 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:25:57.530 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:25:57.530 Initialization complete. Launching workers. 00:25:57.530 00:25:57.530 ==================== 00:25:57.530 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:25:57.530 TCP transport: 00:25:57.530 polls: 20709 00:25:57.530 idle_polls: 9217 00:25:57.530 sock_completions: 11492 00:25:57.530 nvme_completions: 4618 00:25:57.530 submitted_requests: 7107 00:25:57.530 queued_requests: 1 00:25:57.530 00:25:57.530 ==================== 00:25:57.530 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:25:57.530 TCP transport: 00:25:57.530 polls: 20887 00:25:57.530 idle_polls: 9565 00:25:57.530 sock_completions: 11322 00:25:57.530 nvme_completions: 4469 00:25:57.530 submitted_requests: 6897 00:25:57.530 queued_requests: 1 00:25:57.530 ======================================================== 00:25:57.530 Latency(us) 00:25:57.530 Device Information : IOPS MiB/s Average min max 00:25:57.530 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1217.99 304.50 107539.54 62121.50 165387.64 00:25:57.530 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1180.99 295.25 109712.76 59230.28 147822.78 00:25:57.530 ======================================================== 00:25:57.530 Total : 2398.98 599.75 108609.39 59230.28 165387.64 00:25:57.530 00:25:57.530 10:12:03 -- host/perf.sh@66 -- # sync 00:25:57.530 10:12:03 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:57.787 10:12:03 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:25:57.787 10:12:03 -- host/perf.sh@71 -- # '[' -n 0000:88:00.0 ']' 00:25:57.787 10:12:03 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:26:01.063 10:12:06 -- host/perf.sh@72 -- # ls_guid=6be20e97-8e0a-42b1-afca-b7f808f6005f 00:26:01.063 10:12:06 -- host/perf.sh@73 -- # get_lvs_free_mb 6be20e97-8e0a-42b1-afca-b7f808f6005f 00:26:01.063 10:12:06 -- common/autotest_common.sh@1343 -- # local lvs_uuid=6be20e97-8e0a-42b1-afca-b7f808f6005f 00:26:01.063 10:12:06 -- common/autotest_common.sh@1344 -- # local lvs_info 00:26:01.063 10:12:06 -- common/autotest_common.sh@1345 -- # local fc 00:26:01.063 10:12:06 -- common/autotest_common.sh@1346 -- # local cs 00:26:01.063 10:12:06 -- common/autotest_common.sh@1347 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:26:01.320 10:12:06 -- common/autotest_common.sh@1347 -- # lvs_info='[ 00:26:01.320 { 00:26:01.320 "uuid": "6be20e97-8e0a-42b1-afca-b7f808f6005f", 00:26:01.320 "name": "lvs_0", 00:26:01.320 "base_bdev": "Nvme0n1", 00:26:01.320 "total_data_clusters": 238234, 00:26:01.320 "free_clusters": 238234, 00:26:01.320 "block_size": 512, 00:26:01.320 "cluster_size": 4194304 00:26:01.320 } 00:26:01.320 ]' 00:26:01.320 10:12:06 -- common/autotest_common.sh@1348 -- # jq '.[] | select(.uuid=="6be20e97-8e0a-42b1-afca-b7f808f6005f") .free_clusters' 00:26:01.320 10:12:07 -- common/autotest_common.sh@1348 -- # fc=238234 00:26:01.320 10:12:07 -- common/autotest_common.sh@1349 -- # jq '.[] | select(.uuid=="6be20e97-8e0a-42b1-afca-b7f808f6005f") .cluster_size' 00:26:01.320 10:12:07 -- common/autotest_common.sh@1349 -- # cs=4194304 00:26:01.320 10:12:07 -- common/autotest_common.sh@1352 -- # free_mb=952936 00:26:01.320 10:12:07 -- common/autotest_common.sh@1353 -- # echo 952936 00:26:01.320 952936 00:26:01.320 10:12:07 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:26:01.320 10:12:07 -- host/perf.sh@78 -- # free_mb=20480 00:26:01.320 10:12:07 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 6be20e97-8e0a-42b1-afca-b7f808f6005f lbd_0 20480 00:26:02.252 10:12:07 -- host/perf.sh@80 -- # lb_guid=2f6f74b0-7140-4beb-93c8-8ab05b57732f 00:26:02.252 10:12:07 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore 2f6f74b0-7140-4beb-93c8-8ab05b57732f lvs_n_0 00:26:02.815 10:12:08 -- host/perf.sh@83 -- # ls_nested_guid=a0576e7c-d381-4bfb-a230-51cf2005d643 00:26:02.815 10:12:08 -- host/perf.sh@84 -- # get_lvs_free_mb a0576e7c-d381-4bfb-a230-51cf2005d643 00:26:02.815 10:12:08 -- common/autotest_common.sh@1343 -- # local lvs_uuid=a0576e7c-d381-4bfb-a230-51cf2005d643 00:26:02.815 10:12:08 -- common/autotest_common.sh@1344 -- # local lvs_info 00:26:02.815 10:12:08 -- common/autotest_common.sh@1345 -- # local fc 00:26:02.815 10:12:08 -- common/autotest_common.sh@1346 -- # local cs 00:26:02.815 10:12:08 -- common/autotest_common.sh@1347 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:26:03.073 10:12:08 -- common/autotest_common.sh@1347 -- # lvs_info='[ 00:26:03.073 { 00:26:03.073 "uuid": "6be20e97-8e0a-42b1-afca-b7f808f6005f", 00:26:03.073 "name": "lvs_0", 00:26:03.073 "base_bdev": "Nvme0n1", 00:26:03.073 "total_data_clusters": 238234, 00:26:03.073 "free_clusters": 233114, 00:26:03.073 "block_size": 512, 00:26:03.073 "cluster_size": 4194304 00:26:03.073 }, 00:26:03.073 { 00:26:03.073 "uuid": "a0576e7c-d381-4bfb-a230-51cf2005d643", 00:26:03.073 "name": "lvs_n_0", 00:26:03.073 "base_bdev": "2f6f74b0-7140-4beb-93c8-8ab05b57732f", 00:26:03.073 "total_data_clusters": 5114, 00:26:03.073 "free_clusters": 5114, 00:26:03.073 "block_size": 512, 00:26:03.073 "cluster_size": 4194304 00:26:03.073 } 00:26:03.073 ]' 00:26:03.073 10:12:08 -- common/autotest_common.sh@1348 -- # jq '.[] | select(.uuid=="a0576e7c-d381-4bfb-a230-51cf2005d643") .free_clusters' 00:26:03.073 10:12:08 -- common/autotest_common.sh@1348 -- # fc=5114 00:26:03.073 10:12:08 -- common/autotest_common.sh@1349 -- # jq '.[] | select(.uuid=="a0576e7c-d381-4bfb-a230-51cf2005d643") .cluster_size' 00:26:03.073 10:12:08 -- common/autotest_common.sh@1349 -- # cs=4194304 00:26:03.073 10:12:08 -- common/autotest_common.sh@1352 -- # free_mb=20456 00:26:03.073 10:12:08 -- common/autotest_common.sh@1353 -- # echo 20456 00:26:03.073 20456 00:26:03.073 10:12:08 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:26:03.073 10:12:08 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u a0576e7c-d381-4bfb-a230-51cf2005d643 lbd_nest_0 20456 00:26:03.330 10:12:09 -- host/perf.sh@88 -- # lb_nested_guid=0373b811-959d-4191-8574-201f2df99dc7 00:26:03.330 10:12:09 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:03.587 10:12:09 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:26:03.587 10:12:09 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 0373b811-959d-4191-8574-201f2df99dc7 00:26:03.844 10:12:09 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:04.102 10:12:09 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:26:04.102 10:12:09 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:26:04.102 10:12:09 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:04.102 10:12:09 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:04.102 10:12:09 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:04.102 EAL: No free 2048 kB hugepages reported on node 1 00:26:16.325 Initializing NVMe Controllers 00:26:16.325 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:16.325 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:16.325 Initialization complete. Launching workers. 00:26:16.325 ======================================================== 00:26:16.325 Latency(us) 00:26:16.325 Device Information : IOPS MiB/s Average min max 00:26:16.325 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 44.60 0.02 22473.28 225.44 45791.30 00:26:16.325 ======================================================== 00:26:16.325 Total : 44.60 0.02 22473.28 225.44 45791.30 00:26:16.325 00:26:16.325 10:12:20 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:16.325 10:12:20 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:16.325 EAL: No free 2048 kB hugepages reported on node 1 00:26:26.307 Initializing NVMe Controllers 00:26:26.307 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:26.307 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:26.307 Initialization complete. Launching workers. 00:26:26.307 ======================================================== 00:26:26.307 Latency(us) 00:26:26.307 Device Information : IOPS MiB/s Average min max 00:26:26.307 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 66.60 8.32 15033.21 5528.22 49864.06 00:26:26.307 ======================================================== 00:26:26.307 Total : 66.60 8.32 15033.21 5528.22 49864.06 00:26:26.307 00:26:26.307 10:12:30 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:26.308 10:12:30 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:26.308 10:12:30 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:26.308 EAL: No free 2048 kB hugepages reported on node 1 00:26:36.302 Initializing NVMe Controllers 00:26:36.302 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:36.302 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:36.302 Initialization complete. Launching workers. 00:26:36.302 ======================================================== 00:26:36.302 Latency(us) 00:26:36.302 Device Information : IOPS MiB/s Average min max 00:26:36.302 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7601.02 3.71 4210.61 297.04 11077.52 00:26:36.302 ======================================================== 00:26:36.302 Total : 7601.02 3.71 4210.61 297.04 11077.52 00:26:36.302 00:26:36.302 10:12:40 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:36.302 10:12:40 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:36.302 EAL: No free 2048 kB hugepages reported on node 1 00:26:46.278 Initializing NVMe Controllers 00:26:46.278 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:46.278 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:46.278 Initialization complete. Launching workers. 00:26:46.278 ======================================================== 00:26:46.278 Latency(us) 00:26:46.278 Device Information : IOPS MiB/s Average min max 00:26:46.278 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 2208.54 276.07 14498.48 1271.77 30722.01 00:26:46.278 ======================================================== 00:26:46.278 Total : 2208.54 276.07 14498.48 1271.77 30722.01 00:26:46.278 00:26:46.278 10:12:51 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:46.278 10:12:51 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:46.278 10:12:51 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:46.278 EAL: No free 2048 kB hugepages reported on node 1 00:26:56.301 Initializing NVMe Controllers 00:26:56.301 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:56.301 Controller IO queue size 128, less than required. 00:26:56.301 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:56.301 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:56.301 Initialization complete. Launching workers. 00:26:56.301 ======================================================== 00:26:56.301 Latency(us) 00:26:56.301 Device Information : IOPS MiB/s Average min max 00:26:56.301 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 11993.00 5.86 10676.56 1745.69 30784.73 00:26:56.301 ======================================================== 00:26:56.301 Total : 11993.00 5.86 10676.56 1745.69 30784.73 00:26:56.301 00:26:56.301 10:13:01 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:56.301 10:13:01 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:56.301 EAL: No free 2048 kB hugepages reported on node 1 00:27:06.276 Initializing NVMe Controllers 00:27:06.276 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:06.276 Controller IO queue size 128, less than required. 00:27:06.276 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:06.276 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:06.276 Initialization complete. Launching workers. 00:27:06.276 ======================================================== 00:27:06.276 Latency(us) 00:27:06.276 Device Information : IOPS MiB/s Average min max 00:27:06.276 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1205.60 150.70 107087.92 15602.41 214935.07 00:27:06.276 ======================================================== 00:27:06.276 Total : 1205.60 150.70 107087.92 15602.41 214935.07 00:27:06.276 00:27:06.276 10:13:11 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:06.534 10:13:12 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 0373b811-959d-4191-8574-201f2df99dc7 00:27:07.101 10:13:12 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:27:07.358 10:13:13 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 2f6f74b0-7140-4beb-93c8-8ab05b57732f 00:27:07.923 10:13:13 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:27:07.923 10:13:13 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:27:07.923 10:13:13 -- host/perf.sh@114 -- # nvmftestfini 00:27:07.923 10:13:13 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:07.923 10:13:13 -- nvmf/common.sh@116 -- # sync 00:27:07.923 10:13:13 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:07.923 10:13:13 -- nvmf/common.sh@119 -- # set +e 00:27:07.923 10:13:13 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:07.923 10:13:13 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:07.923 rmmod nvme_tcp 00:27:07.923 rmmod nvme_fabrics 00:27:07.923 rmmod nvme_keyring 00:27:07.923 10:13:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:07.923 10:13:13 -- nvmf/common.sh@123 -- # set -e 00:27:07.923 10:13:13 -- nvmf/common.sh@124 -- # return 0 00:27:07.923 10:13:13 -- nvmf/common.sh@477 -- # '[' -n 2898284 ']' 00:27:07.923 10:13:13 -- nvmf/common.sh@478 -- # killprocess 2898284 00:27:07.923 10:13:13 -- common/autotest_common.sh@926 -- # '[' -z 2898284 ']' 00:27:07.923 10:13:13 -- common/autotest_common.sh@930 -- # kill -0 2898284 00:27:07.923 10:13:13 -- common/autotest_common.sh@931 -- # uname 00:27:07.923 10:13:13 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:27:07.923 10:13:13 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2898284 00:27:08.183 10:13:13 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:27:08.183 10:13:13 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:27:08.183 10:13:13 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2898284' 00:27:08.183 killing process with pid 2898284 00:27:08.183 10:13:13 -- common/autotest_common.sh@945 -- # kill 2898284 00:27:08.183 10:13:13 -- common/autotest_common.sh@950 -- # wait 2898284 00:27:09.563 10:13:15 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:09.563 10:13:15 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:09.563 10:13:15 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:09.563 10:13:15 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:09.563 10:13:15 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:09.563 10:13:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:09.563 10:13:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:09.563 10:13:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:12.100 10:13:17 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:12.100 00:27:12.100 real 1m31.498s 00:27:12.100 user 5m37.157s 00:27:12.100 sys 0m16.537s 00:27:12.100 10:13:17 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:27:12.100 10:13:17 -- common/autotest_common.sh@10 -- # set +x 00:27:12.100 ************************************ 00:27:12.100 END TEST nvmf_perf 00:27:12.100 ************************************ 00:27:12.100 10:13:17 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:27:12.100 10:13:17 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:27:12.100 10:13:17 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:27:12.100 10:13:17 -- common/autotest_common.sh@10 -- # set +x 00:27:12.100 ************************************ 00:27:12.100 START TEST nvmf_fio_host 00:27:12.100 ************************************ 00:27:12.100 10:13:17 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:27:12.100 * Looking for test storage... 00:27:12.100 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:12.100 10:13:17 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:12.100 10:13:17 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:12.100 10:13:17 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:12.100 10:13:17 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:12.100 10:13:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:12.100 10:13:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:12.100 10:13:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:12.100 10:13:17 -- paths/export.sh@5 -- # export PATH 00:27:12.100 10:13:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:12.100 10:13:17 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:12.100 10:13:17 -- nvmf/common.sh@7 -- # uname -s 00:27:12.100 10:13:17 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:12.100 10:13:17 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:12.100 10:13:17 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:12.100 10:13:17 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:12.100 10:13:17 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:12.100 10:13:17 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:12.100 10:13:17 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:12.100 10:13:17 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:12.100 10:13:17 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:12.100 10:13:17 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:12.100 10:13:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:12.100 10:13:17 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:12.100 10:13:17 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:12.100 10:13:17 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:12.100 10:13:17 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:12.100 10:13:17 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:12.100 10:13:17 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:12.100 10:13:17 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:12.100 10:13:17 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:12.100 10:13:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:12.100 10:13:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:12.100 10:13:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:12.100 10:13:17 -- paths/export.sh@5 -- # export PATH 00:27:12.100 10:13:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:12.100 10:13:17 -- nvmf/common.sh@46 -- # : 0 00:27:12.100 10:13:17 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:12.100 10:13:17 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:12.100 10:13:17 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:12.100 10:13:17 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:12.100 10:13:17 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:12.100 10:13:17 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:12.100 10:13:17 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:12.100 10:13:17 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:12.100 10:13:17 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:27:12.100 10:13:17 -- host/fio.sh@14 -- # nvmftestinit 00:27:12.100 10:13:17 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:12.100 10:13:17 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:12.100 10:13:17 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:12.100 10:13:17 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:12.100 10:13:17 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:12.100 10:13:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:12.100 10:13:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:12.100 10:13:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:12.100 10:13:17 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:12.100 10:13:17 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:12.100 10:13:17 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:12.100 10:13:17 -- common/autotest_common.sh@10 -- # set +x 00:27:14.006 10:13:19 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:14.006 10:13:19 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:14.006 10:13:19 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:14.006 10:13:19 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:14.006 10:13:19 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:14.006 10:13:19 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:14.006 10:13:19 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:14.006 10:13:19 -- nvmf/common.sh@294 -- # net_devs=() 00:27:14.006 10:13:19 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:14.006 10:13:19 -- nvmf/common.sh@295 -- # e810=() 00:27:14.006 10:13:19 -- nvmf/common.sh@295 -- # local -ga e810 00:27:14.006 10:13:19 -- nvmf/common.sh@296 -- # x722=() 00:27:14.006 10:13:19 -- nvmf/common.sh@296 -- # local -ga x722 00:27:14.006 10:13:19 -- nvmf/common.sh@297 -- # mlx=() 00:27:14.006 10:13:19 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:14.006 10:13:19 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:14.006 10:13:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:14.006 10:13:19 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:14.006 10:13:19 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:14.006 10:13:19 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:14.006 10:13:19 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:14.006 10:13:19 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:14.006 10:13:19 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:14.006 10:13:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:14.006 10:13:19 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:14.006 10:13:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:14.006 10:13:19 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:14.006 10:13:19 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:14.006 10:13:19 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:14.006 10:13:19 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:14.006 10:13:19 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:14.006 10:13:19 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:14.006 10:13:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:14.006 10:13:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:14.006 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:14.006 10:13:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:14.006 10:13:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:14.006 10:13:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:14.006 10:13:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:14.006 10:13:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:14.006 10:13:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:14.006 10:13:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:14.006 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:14.006 10:13:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:14.006 10:13:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:14.006 10:13:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:14.006 10:13:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:14.006 10:13:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:14.006 10:13:19 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:14.006 10:13:19 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:14.006 10:13:19 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:14.006 10:13:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:14.006 10:13:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:14.006 10:13:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:14.006 10:13:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:14.006 10:13:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:14.006 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:14.006 10:13:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:14.006 10:13:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:14.006 10:13:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:14.006 10:13:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:14.006 10:13:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:14.006 10:13:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:14.006 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:14.006 10:13:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:14.006 10:13:19 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:14.006 10:13:19 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:14.006 10:13:19 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:14.006 10:13:19 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:14.006 10:13:19 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:14.006 10:13:19 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:14.006 10:13:19 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:14.006 10:13:19 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:14.006 10:13:19 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:14.006 10:13:19 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:14.006 10:13:19 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:14.006 10:13:19 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:14.006 10:13:19 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:14.006 10:13:19 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:14.006 10:13:19 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:14.006 10:13:19 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:14.006 10:13:19 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:14.006 10:13:19 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:14.006 10:13:19 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:14.006 10:13:19 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:14.006 10:13:19 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:14.006 10:13:19 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:14.006 10:13:19 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:14.006 10:13:19 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:14.006 10:13:19 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:14.006 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:14.006 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.202 ms 00:27:14.006 00:27:14.006 --- 10.0.0.2 ping statistics --- 00:27:14.006 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:14.006 rtt min/avg/max/mdev = 0.202/0.202/0.202/0.000 ms 00:27:14.006 10:13:19 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:14.006 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:14.006 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.174 ms 00:27:14.006 00:27:14.006 --- 10.0.0.1 ping statistics --- 00:27:14.006 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:14.006 rtt min/avg/max/mdev = 0.174/0.174/0.174/0.000 ms 00:27:14.006 10:13:19 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:14.006 10:13:19 -- nvmf/common.sh@410 -- # return 0 00:27:14.006 10:13:19 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:14.006 10:13:19 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:14.006 10:13:19 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:14.006 10:13:19 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:14.006 10:13:19 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:14.006 10:13:19 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:14.006 10:13:19 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:14.006 10:13:19 -- host/fio.sh@16 -- # [[ y != y ]] 00:27:14.006 10:13:19 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:27:14.006 10:13:19 -- common/autotest_common.sh@712 -- # xtrace_disable 00:27:14.006 10:13:19 -- common/autotest_common.sh@10 -- # set +x 00:27:14.006 10:13:19 -- host/fio.sh@24 -- # nvmfpid=2911334 00:27:14.006 10:13:19 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:27:14.006 10:13:19 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:27:14.006 10:13:19 -- host/fio.sh@28 -- # waitforlisten 2911334 00:27:14.006 10:13:19 -- common/autotest_common.sh@819 -- # '[' -z 2911334 ']' 00:27:14.006 10:13:19 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:14.006 10:13:19 -- common/autotest_common.sh@824 -- # local max_retries=100 00:27:14.006 10:13:19 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:14.006 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:14.006 10:13:19 -- common/autotest_common.sh@828 -- # xtrace_disable 00:27:14.006 10:13:19 -- common/autotest_common.sh@10 -- # set +x 00:27:14.006 [2024-07-13 10:13:19.646325] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:27:14.006 [2024-07-13 10:13:19.646403] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:14.006 EAL: No free 2048 kB hugepages reported on node 1 00:27:14.006 [2024-07-13 10:13:19.718649] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:14.006 [2024-07-13 10:13:19.810068] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:14.006 [2024-07-13 10:13:19.810251] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:14.006 [2024-07-13 10:13:19.810272] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:14.006 [2024-07-13 10:13:19.810288] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:14.006 [2024-07-13 10:13:19.810348] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:14.006 [2024-07-13 10:13:19.810414] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:14.006 [2024-07-13 10:13:19.810451] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:14.006 [2024-07-13 10:13:19.810455] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:14.941 10:13:20 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:27:14.941 10:13:20 -- common/autotest_common.sh@852 -- # return 0 00:27:14.941 10:13:20 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:27:15.199 [2024-07-13 10:13:20.822226] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:15.199 10:13:20 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:27:15.199 10:13:20 -- common/autotest_common.sh@718 -- # xtrace_disable 00:27:15.199 10:13:20 -- common/autotest_common.sh@10 -- # set +x 00:27:15.199 10:13:20 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:27:15.457 Malloc1 00:27:15.457 10:13:21 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:15.715 10:13:21 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:27:15.972 10:13:21 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:16.231 [2024-07-13 10:13:21.816014] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:16.231 10:13:21 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:16.520 10:13:22 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:27:16.520 10:13:22 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:16.520 10:13:22 -- common/autotest_common.sh@1339 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:16.520 10:13:22 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:27:16.520 10:13:22 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:16.520 10:13:22 -- common/autotest_common.sh@1318 -- # local sanitizers 00:27:16.520 10:13:22 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:16.520 10:13:22 -- common/autotest_common.sh@1320 -- # shift 00:27:16.520 10:13:22 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:27:16.520 10:13:22 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:27:16.520 10:13:22 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:16.520 10:13:22 -- common/autotest_common.sh@1324 -- # grep libasan 00:27:16.520 10:13:22 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:27:16.520 10:13:22 -- common/autotest_common.sh@1324 -- # asan_lib= 00:27:16.520 10:13:22 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:27:16.520 10:13:22 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:27:16.520 10:13:22 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:16.520 10:13:22 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:27:16.520 10:13:22 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:27:16.520 10:13:22 -- common/autotest_common.sh@1324 -- # asan_lib= 00:27:16.520 10:13:22 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:27:16.520 10:13:22 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:16.520 10:13:22 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:16.520 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:16.520 fio-3.35 00:27:16.520 Starting 1 thread 00:27:16.778 EAL: No free 2048 kB hugepages reported on node 1 00:27:19.304 00:27:19.304 test: (groupid=0, jobs=1): err= 0: pid=2911836: Sat Jul 13 10:13:24 2024 00:27:19.304 read: IOPS=9686, BW=37.8MiB/s (39.7MB/s)(75.9MiB/2006msec) 00:27:19.304 slat (nsec): min=1909, max=111140, avg=2395.83, stdev=1368.18 00:27:19.304 clat (usec): min=2300, max=12583, avg=7312.45, stdev=539.26 00:27:19.304 lat (usec): min=2318, max=12586, avg=7314.85, stdev=539.20 00:27:19.304 clat percentiles (usec): 00:27:19.304 | 1.00th=[ 6063], 5.00th=[ 6456], 10.00th=[ 6652], 20.00th=[ 6915], 00:27:19.304 | 30.00th=[ 7046], 40.00th=[ 7177], 50.00th=[ 7308], 60.00th=[ 7439], 00:27:19.304 | 70.00th=[ 7570], 80.00th=[ 7701], 90.00th=[ 7963], 95.00th=[ 8160], 00:27:19.304 | 99.00th=[ 8455], 99.50th=[ 8717], 99.90th=[11076], 99.95th=[11600], 00:27:19.304 | 99.99th=[12518] 00:27:19.304 bw ( KiB/s): min=37912, max=39208, per=99.96%, avg=38732.00, stdev=604.85, samples=4 00:27:19.304 iops : min= 9478, max= 9802, avg=9683.00, stdev=151.21, samples=4 00:27:19.304 write: IOPS=9695, BW=37.9MiB/s (39.7MB/s)(76.0MiB/2006msec); 0 zone resets 00:27:19.304 slat (nsec): min=2022, max=95754, avg=2494.62, stdev=1213.87 00:27:19.304 clat (usec): min=1145, max=11507, avg=5851.19, stdev=487.72 00:27:19.304 lat (usec): min=1151, max=11509, avg=5853.68, stdev=487.70 00:27:19.304 clat percentiles (usec): 00:27:19.304 | 1.00th=[ 4752], 5.00th=[ 5145], 10.00th=[ 5276], 20.00th=[ 5473], 00:27:19.304 | 30.00th=[ 5604], 40.00th=[ 5735], 50.00th=[ 5866], 60.00th=[ 5932], 00:27:19.304 | 70.00th=[ 6063], 80.00th=[ 6194], 90.00th=[ 6390], 95.00th=[ 6521], 00:27:19.304 | 99.00th=[ 6849], 99.50th=[ 7046], 99.90th=[ 9896], 99.95th=[11076], 00:27:19.304 | 99.99th=[11469] 00:27:19.304 bw ( KiB/s): min=38488, max=39176, per=99.98%, avg=38776.00, stdev=306.59, samples=4 00:27:19.304 iops : min= 9622, max= 9794, avg=9694.00, stdev=76.65, samples=4 00:27:19.304 lat (msec) : 2=0.03%, 4=0.11%, 10=99.76%, 20=0.11% 00:27:19.304 cpu : usr=59.65%, sys=34.46%, ctx=71, majf=0, minf=32 00:27:19.304 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:27:19.304 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:19.304 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:19.304 issued rwts: total=19431,19450,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:19.304 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:19.304 00:27:19.304 Run status group 0 (all jobs): 00:27:19.304 READ: bw=37.8MiB/s (39.7MB/s), 37.8MiB/s-37.8MiB/s (39.7MB/s-39.7MB/s), io=75.9MiB (79.6MB), run=2006-2006msec 00:27:19.304 WRITE: bw=37.9MiB/s (39.7MB/s), 37.9MiB/s-37.9MiB/s (39.7MB/s-39.7MB/s), io=76.0MiB (79.7MB), run=2006-2006msec 00:27:19.304 10:13:24 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:19.304 10:13:24 -- common/autotest_common.sh@1339 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:19.304 10:13:24 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:27:19.304 10:13:24 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:19.304 10:13:24 -- common/autotest_common.sh@1318 -- # local sanitizers 00:27:19.304 10:13:24 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:19.304 10:13:24 -- common/autotest_common.sh@1320 -- # shift 00:27:19.304 10:13:24 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:27:19.304 10:13:24 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:27:19.304 10:13:24 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:19.304 10:13:24 -- common/autotest_common.sh@1324 -- # grep libasan 00:27:19.304 10:13:24 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:27:19.304 10:13:24 -- common/autotest_common.sh@1324 -- # asan_lib= 00:27:19.304 10:13:24 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:27:19.304 10:13:24 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:27:19.304 10:13:24 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:19.304 10:13:24 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:27:19.304 10:13:24 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:27:19.304 10:13:24 -- common/autotest_common.sh@1324 -- # asan_lib= 00:27:19.304 10:13:24 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:27:19.304 10:13:24 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:19.304 10:13:24 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:19.304 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:27:19.304 fio-3.35 00:27:19.304 Starting 1 thread 00:27:19.304 EAL: No free 2048 kB hugepages reported on node 1 00:27:21.833 00:27:21.833 test: (groupid=0, jobs=1): err= 0: pid=2912173: Sat Jul 13 10:13:27 2024 00:27:21.833 read: IOPS=8232, BW=129MiB/s (135MB/s)(258MiB/2008msec) 00:27:21.833 slat (nsec): min=2800, max=92838, avg=3713.77, stdev=1776.58 00:27:21.833 clat (usec): min=2281, max=18490, avg=9066.15, stdev=2241.72 00:27:21.833 lat (usec): min=2284, max=18494, avg=9069.86, stdev=2241.79 00:27:21.833 clat percentiles (usec): 00:27:21.833 | 1.00th=[ 4817], 5.00th=[ 5473], 10.00th=[ 6063], 20.00th=[ 7046], 00:27:21.833 | 30.00th=[ 7832], 40.00th=[ 8455], 50.00th=[ 9110], 60.00th=[ 9634], 00:27:21.833 | 70.00th=[10159], 80.00th=[10814], 90.00th=[11994], 95.00th=[12911], 00:27:21.833 | 99.00th=[14877], 99.50th=[15795], 99.90th=[16319], 99.95th=[16450], 00:27:21.833 | 99.99th=[16712] 00:27:21.833 bw ( KiB/s): min=63616, max=78464, per=51.91%, avg=68376.00, stdev=6905.25, samples=4 00:27:21.833 iops : min= 3976, max= 4904, avg=4273.50, stdev=431.58, samples=4 00:27:21.833 write: IOPS=4888, BW=76.4MiB/s (80.1MB/s)(140MiB/1831msec); 0 zone resets 00:27:21.833 slat (usec): min=30, max=190, avg=34.34, stdev= 5.99 00:27:21.833 clat (usec): min=4776, max=22665, avg=11167.47, stdev=2128.71 00:27:21.833 lat (usec): min=4807, max=22697, avg=11201.80, stdev=2129.24 00:27:21.833 clat percentiles (usec): 00:27:21.833 | 1.00th=[ 7242], 5.00th=[ 8225], 10.00th=[ 8717], 20.00th=[ 9372], 00:27:21.833 | 30.00th=[ 9896], 40.00th=[10290], 50.00th=[10814], 60.00th=[11469], 00:27:21.833 | 70.00th=[12125], 80.00th=[13042], 90.00th=[14222], 95.00th=[15008], 00:27:21.833 | 99.00th=[16319], 99.50th=[17171], 99.90th=[22152], 99.95th=[22414], 00:27:21.833 | 99.99th=[22676] 00:27:21.833 bw ( KiB/s): min=65984, max=81664, per=91.03%, avg=71192.00, stdev=7289.89, samples=4 00:27:21.833 iops : min= 4124, max= 5104, avg=4449.50, stdev=455.62, samples=4 00:27:21.834 lat (msec) : 4=0.16%, 10=55.81%, 20=43.97%, 50=0.05% 00:27:21.834 cpu : usr=70.95%, sys=25.26%, ctx=39, majf=0, minf=52 00:27:21.834 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:27:21.834 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:21.834 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:21.834 issued rwts: total=16531,8950,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:21.834 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:21.834 00:27:21.834 Run status group 0 (all jobs): 00:27:21.834 READ: bw=129MiB/s (135MB/s), 129MiB/s-129MiB/s (135MB/s-135MB/s), io=258MiB (271MB), run=2008-2008msec 00:27:21.834 WRITE: bw=76.4MiB/s (80.1MB/s), 76.4MiB/s-76.4MiB/s (80.1MB/s-80.1MB/s), io=140MiB (147MB), run=1831-1831msec 00:27:21.834 10:13:27 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:21.834 10:13:27 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:27:21.834 10:13:27 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:27:21.834 10:13:27 -- host/fio.sh@51 -- # get_nvme_bdfs 00:27:21.834 10:13:27 -- common/autotest_common.sh@1498 -- # bdfs=() 00:27:21.834 10:13:27 -- common/autotest_common.sh@1498 -- # local bdfs 00:27:21.834 10:13:27 -- common/autotest_common.sh@1499 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:27:21.834 10:13:27 -- common/autotest_common.sh@1499 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:27:21.834 10:13:27 -- common/autotest_common.sh@1499 -- # jq -r '.config[].params.traddr' 00:27:21.834 10:13:27 -- common/autotest_common.sh@1500 -- # (( 1 == 0 )) 00:27:21.834 10:13:27 -- common/autotest_common.sh@1504 -- # printf '%s\n' 0000:88:00.0 00:27:21.834 10:13:27 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 -i 10.0.0.2 00:27:25.118 Nvme0n1 00:27:25.118 10:13:30 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:27:27.647 10:13:33 -- host/fio.sh@53 -- # ls_guid=06ff73b5-0d40-454a-a750-23b5d0f008a8 00:27:27.647 10:13:33 -- host/fio.sh@54 -- # get_lvs_free_mb 06ff73b5-0d40-454a-a750-23b5d0f008a8 00:27:27.647 10:13:33 -- common/autotest_common.sh@1343 -- # local lvs_uuid=06ff73b5-0d40-454a-a750-23b5d0f008a8 00:27:27.647 10:13:33 -- common/autotest_common.sh@1344 -- # local lvs_info 00:27:27.647 10:13:33 -- common/autotest_common.sh@1345 -- # local fc 00:27:27.647 10:13:33 -- common/autotest_common.sh@1346 -- # local cs 00:27:27.647 10:13:33 -- common/autotest_common.sh@1347 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:27:27.905 10:13:33 -- common/autotest_common.sh@1347 -- # lvs_info='[ 00:27:27.905 { 00:27:27.905 "uuid": "06ff73b5-0d40-454a-a750-23b5d0f008a8", 00:27:27.905 "name": "lvs_0", 00:27:27.905 "base_bdev": "Nvme0n1", 00:27:27.905 "total_data_clusters": 930, 00:27:27.905 "free_clusters": 930, 00:27:27.905 "block_size": 512, 00:27:27.905 "cluster_size": 1073741824 00:27:27.905 } 00:27:27.905 ]' 00:27:27.905 10:13:33 -- common/autotest_common.sh@1348 -- # jq '.[] | select(.uuid=="06ff73b5-0d40-454a-a750-23b5d0f008a8") .free_clusters' 00:27:27.905 10:13:33 -- common/autotest_common.sh@1348 -- # fc=930 00:27:27.905 10:13:33 -- common/autotest_common.sh@1349 -- # jq '.[] | select(.uuid=="06ff73b5-0d40-454a-a750-23b5d0f008a8") .cluster_size' 00:27:28.164 10:13:33 -- common/autotest_common.sh@1349 -- # cs=1073741824 00:27:28.164 10:13:33 -- common/autotest_common.sh@1352 -- # free_mb=952320 00:27:28.164 10:13:33 -- common/autotest_common.sh@1353 -- # echo 952320 00:27:28.164 952320 00:27:28.164 10:13:33 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:27:28.422 03c7df70-c80b-490d-a663-be0294d05665 00:27:28.422 10:13:34 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:27:28.680 10:13:34 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:27:28.939 10:13:34 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:27:29.197 10:13:34 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:29.197 10:13:34 -- common/autotest_common.sh@1339 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:29.197 10:13:34 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:27:29.197 10:13:34 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:29.197 10:13:34 -- common/autotest_common.sh@1318 -- # local sanitizers 00:27:29.197 10:13:34 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:29.197 10:13:34 -- common/autotest_common.sh@1320 -- # shift 00:27:29.197 10:13:34 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:27:29.197 10:13:34 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:27:29.197 10:13:34 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:29.198 10:13:34 -- common/autotest_common.sh@1324 -- # grep libasan 00:27:29.198 10:13:34 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:27:29.198 10:13:34 -- common/autotest_common.sh@1324 -- # asan_lib= 00:27:29.198 10:13:34 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:27:29.198 10:13:34 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:27:29.198 10:13:34 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:29.198 10:13:34 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:27:29.198 10:13:34 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:27:29.198 10:13:34 -- common/autotest_common.sh@1324 -- # asan_lib= 00:27:29.198 10:13:34 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:27:29.198 10:13:34 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:29.198 10:13:34 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:29.457 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:29.457 fio-3.35 00:27:29.457 Starting 1 thread 00:27:29.457 EAL: No free 2048 kB hugepages reported on node 1 00:27:31.989 [2024-07-13 10:13:37.492232] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b3b0 is same with the state(5) to be set 00:27:31.989 [2024-07-13 10:13:37.492291] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b3b0 is same with the state(5) to be set 00:27:31.989 [2024-07-13 10:13:37.492307] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b3b0 is same with the state(5) to be set 00:27:31.989 [2024-07-13 10:13:37.492321] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b3b0 is same with the state(5) to be set 00:27:31.989 [2024-07-13 10:13:37.492334] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b3b0 is same with the state(5) to be set 00:27:31.989 00:27:31.989 test: (groupid=0, jobs=1): err= 0: pid=2913504: Sat Jul 13 10:13:37 2024 00:27:31.989 read: IOPS=5699, BW=22.3MiB/s (23.3MB/s)(44.7MiB/2008msec) 00:27:31.989 slat (nsec): min=1960, max=171816, avg=2594.93, stdev=2569.02 00:27:31.989 clat (usec): min=1117, max=171989, avg=12377.13, stdev=11877.35 00:27:31.989 lat (usec): min=1121, max=172039, avg=12379.73, stdev=11877.76 00:27:31.989 clat percentiles (msec): 00:27:31.989 | 1.00th=[ 10], 5.00th=[ 11], 10.00th=[ 11], 20.00th=[ 11], 00:27:31.989 | 30.00th=[ 12], 40.00th=[ 12], 50.00th=[ 12], 60.00th=[ 12], 00:27:31.989 | 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 13], 95.00th=[ 14], 00:27:31.989 | 99.00th=[ 14], 99.50th=[ 157], 99.90th=[ 171], 99.95th=[ 171], 00:27:31.989 | 99.99th=[ 171] 00:27:31.989 bw ( KiB/s): min=15480, max=25472, per=99.88%, avg=22772.00, stdev=4872.25, samples=4 00:27:31.989 iops : min= 3870, max= 6368, avg=5693.00, stdev=1218.06, samples=4 00:27:31.989 write: IOPS=5680, BW=22.2MiB/s (23.3MB/s)(44.6MiB/2008msec); 0 zone resets 00:27:31.989 slat (usec): min=2, max=137, avg= 2.74, stdev= 1.99 00:27:31.989 clat (usec): min=388, max=169792, avg=9908.60, stdev=11180.61 00:27:31.989 lat (usec): min=391, max=169799, avg=9911.34, stdev=11180.99 00:27:31.989 clat percentiles (msec): 00:27:31.989 | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9], 00:27:31.989 | 30.00th=[ 9], 40.00th=[ 9], 50.00th=[ 10], 60.00th=[ 10], 00:27:31.989 | 70.00th=[ 10], 80.00th=[ 10], 90.00th=[ 11], 95.00th=[ 11], 00:27:31.989 | 99.00th=[ 12], 99.50th=[ 153], 99.90th=[ 169], 99.95th=[ 169], 00:27:31.989 | 99.99th=[ 169] 00:27:31.989 bw ( KiB/s): min=16424, max=25024, per=99.80%, avg=22678.00, stdev=4173.84, samples=4 00:27:31.989 iops : min= 4106, max= 6256, avg=5669.50, stdev=1043.46, samples=4 00:27:31.989 lat (usec) : 500=0.01%, 750=0.01% 00:27:31.989 lat (msec) : 2=0.03%, 4=0.09%, 10=45.76%, 20=53.55%, 250=0.56% 00:27:31.989 cpu : usr=55.46%, sys=40.96%, ctx=115, majf=0, minf=32 00:27:31.989 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:27:31.989 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:31.989 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:31.990 issued rwts: total=11445,11407,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:31.990 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:31.990 00:27:31.990 Run status group 0 (all jobs): 00:27:31.990 READ: bw=22.3MiB/s (23.3MB/s), 22.3MiB/s-22.3MiB/s (23.3MB/s-23.3MB/s), io=44.7MiB (46.9MB), run=2008-2008msec 00:27:31.990 WRITE: bw=22.2MiB/s (23.3MB/s), 22.2MiB/s-22.2MiB/s (23.3MB/s-23.3MB/s), io=44.6MiB (46.7MB), run=2008-2008msec 00:27:31.990 10:13:37 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:27:31.990 10:13:37 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:27:33.369 10:13:38 -- host/fio.sh@64 -- # ls_nested_guid=c23570e3-7783-4d06-ab70-c1d10a75a7c5 00:27:33.369 10:13:38 -- host/fio.sh@65 -- # get_lvs_free_mb c23570e3-7783-4d06-ab70-c1d10a75a7c5 00:27:33.369 10:13:38 -- common/autotest_common.sh@1343 -- # local lvs_uuid=c23570e3-7783-4d06-ab70-c1d10a75a7c5 00:27:33.369 10:13:38 -- common/autotest_common.sh@1344 -- # local lvs_info 00:27:33.369 10:13:38 -- common/autotest_common.sh@1345 -- # local fc 00:27:33.369 10:13:38 -- common/autotest_common.sh@1346 -- # local cs 00:27:33.369 10:13:38 -- common/autotest_common.sh@1347 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:27:33.369 10:13:39 -- common/autotest_common.sh@1347 -- # lvs_info='[ 00:27:33.369 { 00:27:33.369 "uuid": "06ff73b5-0d40-454a-a750-23b5d0f008a8", 00:27:33.369 "name": "lvs_0", 00:27:33.369 "base_bdev": "Nvme0n1", 00:27:33.369 "total_data_clusters": 930, 00:27:33.369 "free_clusters": 0, 00:27:33.369 "block_size": 512, 00:27:33.369 "cluster_size": 1073741824 00:27:33.369 }, 00:27:33.369 { 00:27:33.369 "uuid": "c23570e3-7783-4d06-ab70-c1d10a75a7c5", 00:27:33.369 "name": "lvs_n_0", 00:27:33.369 "base_bdev": "03c7df70-c80b-490d-a663-be0294d05665", 00:27:33.369 "total_data_clusters": 237847, 00:27:33.369 "free_clusters": 237847, 00:27:33.369 "block_size": 512, 00:27:33.369 "cluster_size": 4194304 00:27:33.369 } 00:27:33.369 ]' 00:27:33.369 10:13:39 -- common/autotest_common.sh@1348 -- # jq '.[] | select(.uuid=="c23570e3-7783-4d06-ab70-c1d10a75a7c5") .free_clusters' 00:27:33.369 10:13:39 -- common/autotest_common.sh@1348 -- # fc=237847 00:27:33.369 10:13:39 -- common/autotest_common.sh@1349 -- # jq '.[] | select(.uuid=="c23570e3-7783-4d06-ab70-c1d10a75a7c5") .cluster_size' 00:27:33.629 10:13:39 -- common/autotest_common.sh@1349 -- # cs=4194304 00:27:33.629 10:13:39 -- common/autotest_common.sh@1352 -- # free_mb=951388 00:27:33.629 10:13:39 -- common/autotest_common.sh@1353 -- # echo 951388 00:27:33.629 951388 00:27:33.629 10:13:39 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:27:34.197 79e688af-f2a1-4c3a-8616-2ac59a869f18 00:27:34.197 10:13:39 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:27:34.454 10:13:40 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:27:34.711 10:13:40 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:27:34.999 10:13:40 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:34.999 10:13:40 -- common/autotest_common.sh@1339 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:34.999 10:13:40 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:27:34.999 10:13:40 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:34.999 10:13:40 -- common/autotest_common.sh@1318 -- # local sanitizers 00:27:34.999 10:13:40 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:34.999 10:13:40 -- common/autotest_common.sh@1320 -- # shift 00:27:34.999 10:13:40 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:27:34.999 10:13:40 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:27:34.999 10:13:40 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:34.999 10:13:40 -- common/autotest_common.sh@1324 -- # grep libasan 00:27:34.999 10:13:40 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:27:34.999 10:13:40 -- common/autotest_common.sh@1324 -- # asan_lib= 00:27:34.999 10:13:40 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:27:34.999 10:13:40 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:27:34.999 10:13:40 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:34.999 10:13:40 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:27:34.999 10:13:40 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:27:34.999 10:13:40 -- common/autotest_common.sh@1324 -- # asan_lib= 00:27:34.999 10:13:40 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:27:34.999 10:13:40 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:34.999 10:13:40 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:34.999 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:34.999 fio-3.35 00:27:34.999 Starting 1 thread 00:27:35.256 EAL: No free 2048 kB hugepages reported on node 1 00:27:37.791 00:27:37.791 test: (groupid=0, jobs=1): err= 0: pid=2914263: Sat Jul 13 10:13:43 2024 00:27:37.791 read: IOPS=6095, BW=23.8MiB/s (25.0MB/s)(47.8MiB/2009msec) 00:27:37.791 slat (usec): min=2, max=175, avg= 2.58, stdev= 2.30 00:27:37.791 clat (usec): min=4195, max=19140, avg=11609.17, stdev=953.51 00:27:37.791 lat (usec): min=4203, max=19142, avg=11611.75, stdev=953.39 00:27:37.791 clat percentiles (usec): 00:27:37.791 | 1.00th=[ 9372], 5.00th=[10028], 10.00th=[10421], 20.00th=[10814], 00:27:37.791 | 30.00th=[11207], 40.00th=[11338], 50.00th=[11600], 60.00th=[11863], 00:27:37.791 | 70.00th=[12125], 80.00th=[12387], 90.00th=[12780], 95.00th=[13042], 00:27:37.791 | 99.00th=[13698], 99.50th=[13960], 99.90th=[16712], 99.95th=[17957], 00:27:37.791 | 99.99th=[19006] 00:27:37.791 bw ( KiB/s): min=23096, max=24928, per=99.87%, avg=24348.00, stdev=845.34, samples=4 00:27:37.791 iops : min= 5774, max= 6232, avg=6087.00, stdev=211.34, samples=4 00:27:37.791 write: IOPS=6073, BW=23.7MiB/s (24.9MB/s)(47.7MiB/2009msec); 0 zone resets 00:27:37.791 slat (usec): min=2, max=157, avg= 2.66, stdev= 1.74 00:27:37.791 clat (usec): min=2257, max=16803, avg=9232.62, stdev=847.67 00:27:37.791 lat (usec): min=2268, max=16806, avg=9235.28, stdev=847.67 00:27:37.791 clat percentiles (usec): 00:27:37.791 | 1.00th=[ 7308], 5.00th=[ 7963], 10.00th=[ 8225], 20.00th=[ 8586], 00:27:37.791 | 30.00th=[ 8848], 40.00th=[ 8979], 50.00th=[ 9241], 60.00th=[ 9372], 00:27:37.791 | 70.00th=[ 9634], 80.00th=[ 9896], 90.00th=[10159], 95.00th=[10552], 00:27:37.791 | 99.00th=[11076], 99.50th=[11338], 99.90th=[15401], 99.95th=[16450], 00:27:37.791 | 99.99th=[16712] 00:27:37.791 bw ( KiB/s): min=24072, max=24512, per=99.99%, avg=24290.00, stdev=181.53, samples=4 00:27:37.791 iops : min= 6018, max= 6128, avg=6072.50, stdev=45.38, samples=4 00:27:37.791 lat (msec) : 4=0.04%, 10=43.94%, 20=56.02% 00:27:37.792 cpu : usr=58.47%, sys=37.50%, ctx=115, majf=0, minf=32 00:27:37.792 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:27:37.792 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:37.792 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:37.792 issued rwts: total=12245,12201,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:37.792 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:37.792 00:27:37.792 Run status group 0 (all jobs): 00:27:37.792 READ: bw=23.8MiB/s (25.0MB/s), 23.8MiB/s-23.8MiB/s (25.0MB/s-25.0MB/s), io=47.8MiB (50.2MB), run=2009-2009msec 00:27:37.792 WRITE: bw=23.7MiB/s (24.9MB/s), 23.7MiB/s-23.7MiB/s (24.9MB/s-24.9MB/s), io=47.7MiB (50.0MB), run=2009-2009msec 00:27:37.792 10:13:43 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:27:37.792 10:13:43 -- host/fio.sh@74 -- # sync 00:27:37.792 10:13:43 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_n_0/lbd_nest_0 00:27:41.980 10:13:47 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:27:41.980 10:13:47 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:27:44.511 10:13:50 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:27:44.769 10:13:50 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:27:47.305 10:13:52 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:27:47.305 10:13:52 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:27:47.305 10:13:52 -- host/fio.sh@86 -- # nvmftestfini 00:27:47.305 10:13:52 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:47.305 10:13:52 -- nvmf/common.sh@116 -- # sync 00:27:47.305 10:13:52 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:47.305 10:13:52 -- nvmf/common.sh@119 -- # set +e 00:27:47.305 10:13:52 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:47.305 10:13:52 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:47.305 rmmod nvme_tcp 00:27:47.305 rmmod nvme_fabrics 00:27:47.305 rmmod nvme_keyring 00:27:47.305 10:13:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:47.305 10:13:52 -- nvmf/common.sh@123 -- # set -e 00:27:47.305 10:13:52 -- nvmf/common.sh@124 -- # return 0 00:27:47.305 10:13:52 -- nvmf/common.sh@477 -- # '[' -n 2911334 ']' 00:27:47.305 10:13:52 -- nvmf/common.sh@478 -- # killprocess 2911334 00:27:47.305 10:13:52 -- common/autotest_common.sh@926 -- # '[' -z 2911334 ']' 00:27:47.305 10:13:52 -- common/autotest_common.sh@930 -- # kill -0 2911334 00:27:47.305 10:13:52 -- common/autotest_common.sh@931 -- # uname 00:27:47.305 10:13:52 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:27:47.305 10:13:52 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2911334 00:27:47.305 10:13:52 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:27:47.305 10:13:52 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:27:47.305 10:13:52 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2911334' 00:27:47.305 killing process with pid 2911334 00:27:47.305 10:13:52 -- common/autotest_common.sh@945 -- # kill 2911334 00:27:47.305 10:13:52 -- common/autotest_common.sh@950 -- # wait 2911334 00:27:47.305 10:13:52 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:47.305 10:13:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:47.305 10:13:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:47.305 10:13:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:47.305 10:13:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:47.305 10:13:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:47.305 10:13:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:47.305 10:13:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:49.208 10:13:54 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:49.208 00:27:49.208 real 0m37.443s 00:27:49.208 user 2m23.173s 00:27:49.208 sys 0m7.091s 00:27:49.208 10:13:54 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:27:49.208 10:13:54 -- common/autotest_common.sh@10 -- # set +x 00:27:49.208 ************************************ 00:27:49.208 END TEST nvmf_fio_host 00:27:49.208 ************************************ 00:27:49.208 10:13:54 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:27:49.208 10:13:54 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:27:49.208 10:13:54 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:27:49.208 10:13:54 -- common/autotest_common.sh@10 -- # set +x 00:27:49.208 ************************************ 00:27:49.208 START TEST nvmf_failover 00:27:49.208 ************************************ 00:27:49.208 10:13:54 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:27:49.208 * Looking for test storage... 00:27:49.208 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:49.208 10:13:54 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:49.208 10:13:54 -- nvmf/common.sh@7 -- # uname -s 00:27:49.208 10:13:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:49.208 10:13:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:49.208 10:13:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:49.208 10:13:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:49.208 10:13:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:49.208 10:13:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:49.208 10:13:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:49.208 10:13:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:49.208 10:13:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:49.208 10:13:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:49.208 10:13:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:49.208 10:13:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:49.208 10:13:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:49.208 10:13:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:49.208 10:13:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:49.208 10:13:54 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:49.208 10:13:54 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:49.208 10:13:54 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:49.208 10:13:54 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:49.208 10:13:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:49.209 10:13:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:49.209 10:13:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:49.209 10:13:54 -- paths/export.sh@5 -- # export PATH 00:27:49.209 10:13:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:49.209 10:13:54 -- nvmf/common.sh@46 -- # : 0 00:27:49.209 10:13:54 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:49.209 10:13:54 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:49.209 10:13:54 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:49.209 10:13:54 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:49.209 10:13:54 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:49.209 10:13:54 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:49.209 10:13:54 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:49.209 10:13:54 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:49.209 10:13:54 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:27:49.209 10:13:54 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:27:49.209 10:13:54 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:27:49.209 10:13:54 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:27:49.209 10:13:54 -- host/failover.sh@18 -- # nvmftestinit 00:27:49.209 10:13:54 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:49.209 10:13:54 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:49.209 10:13:54 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:49.209 10:13:54 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:49.209 10:13:54 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:49.209 10:13:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:49.209 10:13:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:49.209 10:13:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:49.209 10:13:54 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:49.209 10:13:54 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:49.209 10:13:54 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:49.209 10:13:54 -- common/autotest_common.sh@10 -- # set +x 00:27:51.112 10:13:56 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:51.112 10:13:56 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:51.112 10:13:56 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:51.112 10:13:56 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:51.112 10:13:56 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:51.112 10:13:56 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:51.112 10:13:56 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:51.112 10:13:56 -- nvmf/common.sh@294 -- # net_devs=() 00:27:51.112 10:13:56 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:51.112 10:13:56 -- nvmf/common.sh@295 -- # e810=() 00:27:51.112 10:13:56 -- nvmf/common.sh@295 -- # local -ga e810 00:27:51.112 10:13:56 -- nvmf/common.sh@296 -- # x722=() 00:27:51.112 10:13:56 -- nvmf/common.sh@296 -- # local -ga x722 00:27:51.112 10:13:56 -- nvmf/common.sh@297 -- # mlx=() 00:27:51.112 10:13:56 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:51.112 10:13:56 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:51.112 10:13:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:51.112 10:13:56 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:51.112 10:13:56 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:51.112 10:13:56 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:51.112 10:13:56 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:51.112 10:13:56 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:51.112 10:13:56 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:51.112 10:13:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:51.112 10:13:56 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:51.112 10:13:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:51.112 10:13:56 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:51.112 10:13:56 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:51.112 10:13:56 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:51.112 10:13:56 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:51.112 10:13:56 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:51.112 10:13:56 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:51.112 10:13:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:51.112 10:13:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:51.112 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:51.112 10:13:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:51.112 10:13:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:51.112 10:13:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:51.112 10:13:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:51.112 10:13:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:51.112 10:13:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:51.112 10:13:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:51.112 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:51.112 10:13:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:51.112 10:13:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:51.112 10:13:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:51.112 10:13:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:51.112 10:13:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:51.112 10:13:56 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:51.112 10:13:56 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:51.112 10:13:56 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:51.112 10:13:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:51.112 10:13:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:51.112 10:13:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:51.112 10:13:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:51.112 10:13:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:51.112 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:51.112 10:13:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:51.112 10:13:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:51.112 10:13:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:51.112 10:13:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:51.112 10:13:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:51.112 10:13:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:51.112 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:51.112 10:13:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:51.112 10:13:56 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:51.112 10:13:56 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:51.112 10:13:56 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:51.112 10:13:56 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:51.112 10:13:56 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:51.112 10:13:56 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:51.112 10:13:56 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:51.113 10:13:56 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:51.113 10:13:56 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:51.113 10:13:56 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:51.113 10:13:56 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:51.113 10:13:56 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:51.113 10:13:56 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:51.113 10:13:56 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:51.113 10:13:56 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:51.113 10:13:56 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:51.113 10:13:56 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:51.113 10:13:56 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:51.373 10:13:56 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:51.373 10:13:56 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:51.373 10:13:56 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:51.373 10:13:56 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:51.373 10:13:56 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:51.373 10:13:56 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:51.373 10:13:57 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:51.373 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:51.373 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.253 ms 00:27:51.373 00:27:51.373 --- 10.0.0.2 ping statistics --- 00:27:51.373 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:51.373 rtt min/avg/max/mdev = 0.253/0.253/0.253/0.000 ms 00:27:51.373 10:13:57 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:51.373 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:51.373 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.168 ms 00:27:51.373 00:27:51.373 --- 10.0.0.1 ping statistics --- 00:27:51.373 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:51.373 rtt min/avg/max/mdev = 0.168/0.168/0.168/0.000 ms 00:27:51.373 10:13:57 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:51.373 10:13:57 -- nvmf/common.sh@410 -- # return 0 00:27:51.373 10:13:57 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:51.373 10:13:57 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:51.373 10:13:57 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:51.373 10:13:57 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:51.373 10:13:57 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:51.373 10:13:57 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:51.373 10:13:57 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:51.373 10:13:57 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:27:51.373 10:13:57 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:51.373 10:13:57 -- common/autotest_common.sh@712 -- # xtrace_disable 00:27:51.373 10:13:57 -- common/autotest_common.sh@10 -- # set +x 00:27:51.373 10:13:57 -- nvmf/common.sh@469 -- # nvmfpid=2917558 00:27:51.373 10:13:57 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:51.373 10:13:57 -- nvmf/common.sh@470 -- # waitforlisten 2917558 00:27:51.373 10:13:57 -- common/autotest_common.sh@819 -- # '[' -z 2917558 ']' 00:27:51.373 10:13:57 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:51.373 10:13:57 -- common/autotest_common.sh@824 -- # local max_retries=100 00:27:51.373 10:13:57 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:51.373 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:51.373 10:13:57 -- common/autotest_common.sh@828 -- # xtrace_disable 00:27:51.373 10:13:57 -- common/autotest_common.sh@10 -- # set +x 00:27:51.373 [2024-07-13 10:13:57.089753] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:27:51.373 [2024-07-13 10:13:57.089832] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:51.373 EAL: No free 2048 kB hugepages reported on node 1 00:27:51.373 [2024-07-13 10:13:57.155997] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:51.633 [2024-07-13 10:13:57.246884] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:51.633 [2024-07-13 10:13:57.247053] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:51.633 [2024-07-13 10:13:57.247070] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:51.633 [2024-07-13 10:13:57.247083] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:51.633 [2024-07-13 10:13:57.247148] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:51.633 [2024-07-13 10:13:57.247240] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:51.633 [2024-07-13 10:13:57.247242] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:52.570 10:13:58 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:27:52.570 10:13:58 -- common/autotest_common.sh@852 -- # return 0 00:27:52.570 10:13:58 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:52.570 10:13:58 -- common/autotest_common.sh@718 -- # xtrace_disable 00:27:52.570 10:13:58 -- common/autotest_common.sh@10 -- # set +x 00:27:52.570 10:13:58 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:52.570 10:13:58 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:27:52.570 [2024-07-13 10:13:58.272047] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:52.570 10:13:58 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:27:52.829 Malloc0 00:27:52.829 10:13:58 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:53.087 10:13:58 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:53.345 10:13:59 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:53.604 [2024-07-13 10:13:59.262457] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:53.604 10:13:59 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:27:53.864 [2024-07-13 10:13:59.511251] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:27:53.864 10:13:59 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:27:54.153 [2024-07-13 10:13:59.752043] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:27:54.153 10:13:59 -- host/failover.sh@31 -- # bdevperf_pid=2917983 00:27:54.154 10:13:59 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:27:54.154 10:13:59 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:27:54.154 10:13:59 -- host/failover.sh@34 -- # waitforlisten 2917983 /var/tmp/bdevperf.sock 00:27:54.154 10:13:59 -- common/autotest_common.sh@819 -- # '[' -z 2917983 ']' 00:27:54.154 10:13:59 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:27:54.154 10:13:59 -- common/autotest_common.sh@824 -- # local max_retries=100 00:27:54.154 10:13:59 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:27:54.154 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:27:54.154 10:13:59 -- common/autotest_common.sh@828 -- # xtrace_disable 00:27:54.154 10:13:59 -- common/autotest_common.sh@10 -- # set +x 00:27:55.091 10:14:00 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:27:55.091 10:14:00 -- common/autotest_common.sh@852 -- # return 0 00:27:55.091 10:14:00 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:27:55.659 NVMe0n1 00:27:55.659 10:14:01 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:27:55.917 00:27:55.917 10:14:01 -- host/failover.sh@39 -- # run_test_pid=2918136 00:27:55.917 10:14:01 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:27:55.917 10:14:01 -- host/failover.sh@41 -- # sleep 1 00:27:56.852 10:14:02 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:57.111 [2024-07-13 10:14:02.731720] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.111 [2024-07-13 10:14:02.731796] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.111 [2024-07-13 10:14:02.731819] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.111 [2024-07-13 10:14:02.731831] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.731843] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.731856] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.731882] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.731896] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.731908] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.731921] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.731933] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.731945] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.731957] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.731977] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.731989] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732016] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732028] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732039] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732050] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732062] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732073] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732085] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732096] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732108] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732120] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732131] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732143] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732169] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732180] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732197] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732208] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732219] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732230] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732241] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732252] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732263] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732274] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732285] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732296] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732307] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732321] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732332] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732343] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732354] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732365] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732376] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732389] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732401] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732412] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732424] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732435] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732446] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732457] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732469] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732480] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732491] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732502] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732514] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732525] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732536] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732547] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732559] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 [2024-07-13 10:14:02.732570] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172e8d0 is same with the state(5) to be set 00:27:57.112 10:14:02 -- host/failover.sh@45 -- # sleep 3 00:28:00.395 10:14:05 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:00.395 00:28:00.395 10:14:06 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:00.654 [2024-07-13 10:14:06.330806] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.654 [2024-07-13 10:14:06.330926] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.654 [2024-07-13 10:14:06.330943] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.654 [2024-07-13 10:14:06.330955] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.654 [2024-07-13 10:14:06.330967] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.654 [2024-07-13 10:14:06.330979] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.654 [2024-07-13 10:14:06.330990] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.655 [2024-07-13 10:14:06.331002] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.655 [2024-07-13 10:14:06.331013] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.655 [2024-07-13 10:14:06.331025] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.655 [2024-07-13 10:14:06.331036] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.655 [2024-07-13 10:14:06.331047] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.655 [2024-07-13 10:14:06.331060] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.655 [2024-07-13 10:14:06.331071] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.655 [2024-07-13 10:14:06.331083] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.655 [2024-07-13 10:14:06.331095] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.655 [2024-07-13 10:14:06.331108] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.655 [2024-07-13 10:14:06.331119] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.655 [2024-07-13 10:14:06.331130] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.655 [2024-07-13 10:14:06.331144] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.655 [2024-07-13 10:14:06.331157] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.655 [2024-07-13 10:14:06.331169] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.655 [2024-07-13 10:14:06.331182] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.655 [2024-07-13 10:14:06.331194] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.655 [2024-07-13 10:14:06.331222] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.655 [2024-07-13 10:14:06.331234] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.655 [2024-07-13 10:14:06.331246] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.655 [2024-07-13 10:14:06.331257] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.655 [2024-07-13 10:14:06.331271] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.655 [2024-07-13 10:14:06.331283] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.655 [2024-07-13 10:14:06.331294] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.655 [2024-07-13 10:14:06.331306] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.655 [2024-07-13 10:14:06.331317] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.655 [2024-07-13 10:14:06.331328] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.655 [2024-07-13 10:14:06.331340] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.655 [2024-07-13 10:14:06.331352] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.655 [2024-07-13 10:14:06.331363] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.655 [2024-07-13 10:14:06.331374] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.655 [2024-07-13 10:14:06.331385] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.655 [2024-07-13 10:14:06.331397] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.655 [2024-07-13 10:14:06.331409] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.655 [2024-07-13 10:14:06.331420] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.655 [2024-07-13 10:14:06.331431] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.655 [2024-07-13 10:14:06.331442] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.655 [2024-07-13 10:14:06.331454] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x172fe20 is same with the state(5) to be set 00:28:00.655 10:14:06 -- host/failover.sh@50 -- # sleep 3 00:28:03.945 10:14:09 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:03.945 [2024-07-13 10:14:09.574464] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:03.945 10:14:09 -- host/failover.sh@55 -- # sleep 1 00:28:04.882 10:14:10 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:05.140 [2024-07-13 10:14:10.828682] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.828745] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.828760] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.828772] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.828783] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.828794] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.828815] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.828826] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.828837] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.828849] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.828895] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.828910] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.828921] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.828933] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.828946] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.828957] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.828969] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.828980] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.828992] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.829004] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.829016] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.829028] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.829039] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.829052] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.829064] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.829076] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.829088] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.829099] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.829111] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.829123] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.829134] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.829146] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.829158] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.829172] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.829201] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.829212] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.829223] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.829234] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.829245] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.829256] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.829267] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.829277] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.829288] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.829299] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.829310] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.829321] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.829333] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.829344] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.829355] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 [2024-07-13 10:14:10.829366] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1730f00 is same with the state(5) to be set 00:28:05.140 10:14:10 -- host/failover.sh@59 -- # wait 2918136 00:28:11.711 0 00:28:11.711 10:14:16 -- host/failover.sh@61 -- # killprocess 2917983 00:28:11.711 10:14:16 -- common/autotest_common.sh@926 -- # '[' -z 2917983 ']' 00:28:11.711 10:14:16 -- common/autotest_common.sh@930 -- # kill -0 2917983 00:28:11.711 10:14:16 -- common/autotest_common.sh@931 -- # uname 00:28:11.711 10:14:16 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:28:11.711 10:14:16 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2917983 00:28:11.711 10:14:16 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:28:11.711 10:14:16 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:28:11.711 10:14:16 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2917983' 00:28:11.711 killing process with pid 2917983 00:28:11.711 10:14:16 -- common/autotest_common.sh@945 -- # kill 2917983 00:28:11.711 10:14:16 -- common/autotest_common.sh@950 -- # wait 2917983 00:28:11.711 10:14:16 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:11.711 [2024-07-13 10:13:59.809980] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:28:11.711 [2024-07-13 10:13:59.810081] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2917983 ] 00:28:11.711 EAL: No free 2048 kB hugepages reported on node 1 00:28:11.711 [2024-07-13 10:13:59.872792] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:11.711 [2024-07-13 10:13:59.957892] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:11.711 Running I/O for 15 seconds... 00:28:11.711 [2024-07-13 10:14:02.732885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:115400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.711 [2024-07-13 10:14:02.732939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.711 [2024-07-13 10:14:02.732966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:114888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.711 [2024-07-13 10:14:02.732982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.711 [2024-07-13 10:14:02.732999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:114896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.711 [2024-07-13 10:14:02.733013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.711 [2024-07-13 10:14:02.733028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:114904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.711 [2024-07-13 10:14:02.733041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.711 [2024-07-13 10:14:02.733056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:114912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.711 [2024-07-13 10:14:02.733069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.711 [2024-07-13 10:14:02.733084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:114936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.711 [2024-07-13 10:14:02.733098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.711 [2024-07-13 10:14:02.733113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:114960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.711 [2024-07-13 10:14:02.733126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.711 [2024-07-13 10:14:02.733141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:114976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.711 [2024-07-13 10:14:02.733154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.711 [2024-07-13 10:14:02.733171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:114992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.711 [2024-07-13 10:14:02.733198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.711 [2024-07-13 10:14:02.733222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:115432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.711 [2024-07-13 10:14:02.733236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.711 [2024-07-13 10:14:02.733250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:115440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.711 [2024-07-13 10:14:02.733263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.711 [2024-07-13 10:14:02.733284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:115448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.711 [2024-07-13 10:14:02.733299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.711 [2024-07-13 10:14:02.733313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:115464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.711 [2024-07-13 10:14:02.733325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.711 [2024-07-13 10:14:02.733339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:115472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.711 [2024-07-13 10:14:02.733352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.711 [2024-07-13 10:14:02.733366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:115480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.711 [2024-07-13 10:14:02.733379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.711 [2024-07-13 10:14:02.733393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:115496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.711 [2024-07-13 10:14:02.733406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.711 [2024-07-13 10:14:02.733421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:115528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.711 [2024-07-13 10:14:02.733435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.711 [2024-07-13 10:14:02.733449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:115544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.711 [2024-07-13 10:14:02.733462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.711 [2024-07-13 10:14:02.733476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:115560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.711 [2024-07-13 10:14:02.733489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.711 [2024-07-13 10:14:02.733503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:115568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.711 [2024-07-13 10:14:02.733515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.711 [2024-07-13 10:14:02.733529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:115576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.711 [2024-07-13 10:14:02.733542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.711 [2024-07-13 10:14:02.733555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:115584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.711 [2024-07-13 10:14:02.733568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.711 [2024-07-13 10:14:02.733582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:115000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.711 [2024-07-13 10:14:02.733595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.711 [2024-07-13 10:14:02.733609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:115016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.711 [2024-07-13 10:14:02.733626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.711 [2024-07-13 10:14:02.733640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:115024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.711 [2024-07-13 10:14:02.733653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.712 [2024-07-13 10:14:02.733667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:115048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.712 [2024-07-13 10:14:02.733680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.712 [2024-07-13 10:14:02.733694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:115096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.712 [2024-07-13 10:14:02.733706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.712 [2024-07-13 10:14:02.733721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:115104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.712 [2024-07-13 10:14:02.733733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.712 [2024-07-13 10:14:02.733747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:115120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.712 [2024-07-13 10:14:02.733760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.712 [2024-07-13 10:14:02.733774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:115136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.712 [2024-07-13 10:14:02.733787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.712 [2024-07-13 10:14:02.733801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:115592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.712 [2024-07-13 10:14:02.733814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.712 [2024-07-13 10:14:02.733828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:115600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.712 [2024-07-13 10:14:02.733840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.712 [2024-07-13 10:14:02.733878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:115608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.712 [2024-07-13 10:14:02.733894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.712 [2024-07-13 10:14:02.733908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:115616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.712 [2024-07-13 10:14:02.733922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.712 [2024-07-13 10:14:02.733937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:115176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.712 [2024-07-13 10:14:02.733950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.712 [2024-07-13 10:14:02.733965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:115184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.712 [2024-07-13 10:14:02.733979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.712 [2024-07-13 10:14:02.733998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:115208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.712 [2024-07-13 10:14:02.734013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.712 [2024-07-13 10:14:02.734029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:115224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.712 [2024-07-13 10:14:02.734043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.712 [2024-07-13 10:14:02.734059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:115232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.712 [2024-07-13 10:14:02.734073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.712 [2024-07-13 10:14:02.734088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:115264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.712 [2024-07-13 10:14:02.734101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.712 [2024-07-13 10:14:02.734115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:115280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.712 [2024-07-13 10:14:02.734128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.712 [2024-07-13 10:14:02.734142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:115288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.712 [2024-07-13 10:14:02.734156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.712 [2024-07-13 10:14:02.734170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:115664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.712 [2024-07-13 10:14:02.734183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.712 [2024-07-13 10:14:02.734198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:115672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.712 [2024-07-13 10:14:02.734211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.712 [2024-07-13 10:14:02.734225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:115680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.712 [2024-07-13 10:14:02.734238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.712 [2024-07-13 10:14:02.734254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:115688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.712 [2024-07-13 10:14:02.734267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.712 [2024-07-13 10:14:02.734282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:115696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.712 [2024-07-13 10:14:02.734295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.712 [2024-07-13 10:14:02.734310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:115704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.712 [2024-07-13 10:14:02.734323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.712 [2024-07-13 10:14:02.734338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:115712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.712 [2024-07-13 10:14:02.734355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.712 [2024-07-13 10:14:02.734370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:115720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.712 [2024-07-13 10:14:02.734383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.712 [2024-07-13 10:14:02.734398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:115728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.712 [2024-07-13 10:14:02.734412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.712 [2024-07-13 10:14:02.734426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:115736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.712 [2024-07-13 10:14:02.734440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.712 [2024-07-13 10:14:02.734454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:115744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.712 [2024-07-13 10:14:02.734467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.712 [2024-07-13 10:14:02.734481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:115752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.712 [2024-07-13 10:14:02.734495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.712 [2024-07-13 10:14:02.734520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:115760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.712 [2024-07-13 10:14:02.734533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.712 [2024-07-13 10:14:02.734548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:115768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.712 [2024-07-13 10:14:02.734561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.712 [2024-07-13 10:14:02.734575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:115776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.712 [2024-07-13 10:14:02.734589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.712 [2024-07-13 10:14:02.734603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:115784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.712 [2024-07-13 10:14:02.734616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.712 [2024-07-13 10:14:02.734630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:115792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.712 [2024-07-13 10:14:02.734644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.712 [2024-07-13 10:14:02.734658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:115800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.712 [2024-07-13 10:14:02.734671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.712 [2024-07-13 10:14:02.734687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:115808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.712 [2024-07-13 10:14:02.734700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.712 [2024-07-13 10:14:02.734718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:115816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.712 [2024-07-13 10:14:02.734731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.712 [2024-07-13 10:14:02.734746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:115824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.712 [2024-07-13 10:14:02.734759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.712 [2024-07-13 10:14:02.734774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:115832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.712 [2024-07-13 10:14:02.734787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.712 [2024-07-13 10:14:02.734802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:115840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.712 [2024-07-13 10:14:02.734816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.713 [2024-07-13 10:14:02.734839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:115848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.713 [2024-07-13 10:14:02.734852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.713 [2024-07-13 10:14:02.734889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:115856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.713 [2024-07-13 10:14:02.734906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.713 [2024-07-13 10:14:02.734923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:115864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.713 [2024-07-13 10:14:02.734937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.713 [2024-07-13 10:14:02.734952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:115872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.713 [2024-07-13 10:14:02.734965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.713 [2024-07-13 10:14:02.734980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:115304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.713 [2024-07-13 10:14:02.734995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.713 [2024-07-13 10:14:02.735010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:115312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.713 [2024-07-13 10:14:02.735023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.713 [2024-07-13 10:14:02.735038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:115320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.713 [2024-07-13 10:14:02.735052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.713 [2024-07-13 10:14:02.735067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:115336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.713 [2024-07-13 10:14:02.735080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.713 [2024-07-13 10:14:02.735095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:115344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.713 [2024-07-13 10:14:02.735113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.713 [2024-07-13 10:14:02.735128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:115352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.713 [2024-07-13 10:14:02.735142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.713 [2024-07-13 10:14:02.735158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:115368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.713 [2024-07-13 10:14:02.735172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.713 [2024-07-13 10:14:02.735201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:115376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.713 [2024-07-13 10:14:02.735215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.713 [2024-07-13 10:14:02.735230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:115880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.713 [2024-07-13 10:14:02.735243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.713 [2024-07-13 10:14:02.735258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:115888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.713 [2024-07-13 10:14:02.735271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.713 [2024-07-13 10:14:02.735286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:115896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.713 [2024-07-13 10:14:02.735299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.713 [2024-07-13 10:14:02.735315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:115904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.713 [2024-07-13 10:14:02.735329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.713 [2024-07-13 10:14:02.735344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:115912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.713 [2024-07-13 10:14:02.735358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.713 [2024-07-13 10:14:02.735372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:115920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.713 [2024-07-13 10:14:02.735385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.713 [2024-07-13 10:14:02.735400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:115928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.713 [2024-07-13 10:14:02.735413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.713 [2024-07-13 10:14:02.735428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:115936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.713 [2024-07-13 10:14:02.735441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.713 [2024-07-13 10:14:02.735455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:115944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.713 [2024-07-13 10:14:02.735469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.713 [2024-07-13 10:14:02.735483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:115952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.713 [2024-07-13 10:14:02.735499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.713 [2024-07-13 10:14:02.735514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:115960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.713 [2024-07-13 10:14:02.735528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.713 [2024-07-13 10:14:02.735542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:115968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.713 [2024-07-13 10:14:02.735556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.713 [2024-07-13 10:14:02.735570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:115976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.713 [2024-07-13 10:14:02.735584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.713 [2024-07-13 10:14:02.735598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:115984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.713 [2024-07-13 10:14:02.735612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.713 [2024-07-13 10:14:02.735627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:115992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.713 [2024-07-13 10:14:02.735640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.713 [2024-07-13 10:14:02.735655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:116000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.713 [2024-07-13 10:14:02.735668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.713 [2024-07-13 10:14:02.735682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:116008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.713 [2024-07-13 10:14:02.735695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.713 [2024-07-13 10:14:02.735710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:116016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.713 [2024-07-13 10:14:02.735723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.713 [2024-07-13 10:14:02.735738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:116024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.713 [2024-07-13 10:14:02.735751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.713 [2024-07-13 10:14:02.735765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:116032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.713 [2024-07-13 10:14:02.735778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.713 [2024-07-13 10:14:02.735793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:116040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.713 [2024-07-13 10:14:02.735806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.713 [2024-07-13 10:14:02.735821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:116048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.713 [2024-07-13 10:14:02.735834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.713 [2024-07-13 10:14:02.735853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:116056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.713 [2024-07-13 10:14:02.735873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.713 [2024-07-13 10:14:02.735907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:116064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.713 [2024-07-13 10:14:02.735921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.713 [2024-07-13 10:14:02.735936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:115392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.713 [2024-07-13 10:14:02.735950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.713 [2024-07-13 10:14:02.735966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:115408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.713 [2024-07-13 10:14:02.735980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.714 [2024-07-13 10:14:02.735995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:115416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.714 [2024-07-13 10:14:02.736009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.714 [2024-07-13 10:14:02.736024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:115424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.714 [2024-07-13 10:14:02.736038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.714 [2024-07-13 10:14:02.736053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:115456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.714 [2024-07-13 10:14:02.736067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.714 [2024-07-13 10:14:02.736082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:115488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.714 [2024-07-13 10:14:02.736096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.714 [2024-07-13 10:14:02.736111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:115504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.714 [2024-07-13 10:14:02.736125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.714 [2024-07-13 10:14:02.736140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:115512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.714 [2024-07-13 10:14:02.736154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.714 [2024-07-13 10:14:02.736169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:116072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.714 [2024-07-13 10:14:02.736199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.714 [2024-07-13 10:14:02.736215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:116080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.714 [2024-07-13 10:14:02.736228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.714 [2024-07-13 10:14:02.736242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:116088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.714 [2024-07-13 10:14:02.736260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.714 [2024-07-13 10:14:02.736275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:116096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.714 [2024-07-13 10:14:02.736289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.714 [2024-07-13 10:14:02.736304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:116104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.714 [2024-07-13 10:14:02.736318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.714 [2024-07-13 10:14:02.736333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:116112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.714 [2024-07-13 10:14:02.736346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.714 [2024-07-13 10:14:02.736360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:116120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.714 [2024-07-13 10:14:02.736374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.714 [2024-07-13 10:14:02.736389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:116128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.714 [2024-07-13 10:14:02.736402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.714 [2024-07-13 10:14:02.736417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:116136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.714 [2024-07-13 10:14:02.736430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.714 [2024-07-13 10:14:02.736445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:116144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.714 [2024-07-13 10:14:02.736458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.714 [2024-07-13 10:14:02.736473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:116152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.714 [2024-07-13 10:14:02.736486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.714 [2024-07-13 10:14:02.736501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:115520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.714 [2024-07-13 10:14:02.736514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.714 [2024-07-13 10:14:02.736529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:115536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.714 [2024-07-13 10:14:02.736542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.714 [2024-07-13 10:14:02.736556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:115552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.714 [2024-07-13 10:14:02.736569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.714 [2024-07-13 10:14:02.736584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:115624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.714 [2024-07-13 10:14:02.736598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.714 [2024-07-13 10:14:02.736620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:115632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.714 [2024-07-13 10:14:02.736635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.714 [2024-07-13 10:14:02.736650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:115640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.714 [2024-07-13 10:14:02.736664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.714 [2024-07-13 10:14:02.736678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:115648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.714 [2024-07-13 10:14:02.736692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.714 [2024-07-13 10:14:02.736706] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1db1710 is same with the state(5) to be set 00:28:11.714 [2024-07-13 10:14:02.736723] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:11.714 [2024-07-13 10:14:02.736735] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:11.714 [2024-07-13 10:14:02.736746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:115656 len:8 PRP1 0x0 PRP2 0x0 00:28:11.714 [2024-07-13 10:14:02.736758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.714 [2024-07-13 10:14:02.736817] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1db1710 was disconnected and freed. reset controller. 00:28:11.714 [2024-07-13 10:14:02.736842] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:28:11.714 [2024-07-13 10:14:02.736905] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:11.714 [2024-07-13 10:14:02.736925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.714 [2024-07-13 10:14:02.736940] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:11.714 [2024-07-13 10:14:02.736954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.714 [2024-07-13 10:14:02.736978] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:11.714 [2024-07-13 10:14:02.737000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.714 [2024-07-13 10:14:02.737024] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:11.714 [2024-07-13 10:14:02.737046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.714 [2024-07-13 10:14:02.737060] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:11.714 [2024-07-13 10:14:02.737098] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d920a0 (9): Bad file descriptor 00:28:11.714 [2024-07-13 10:14:02.739410] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:11.714 [2024-07-13 10:14:02.813447] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:11.714 [2024-07-13 10:14:06.331642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:119224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.714 [2024-07-13 10:14:06.331685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.714 [2024-07-13 10:14:06.331717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:119240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.714 [2024-07-13 10:14:06.331734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.714 [2024-07-13 10:14:06.331750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:119272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.714 [2024-07-13 10:14:06.331764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.714 [2024-07-13 10:14:06.331780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:119304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.714 [2024-07-13 10:14:06.331793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.714 [2024-07-13 10:14:06.331808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:119312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.714 [2024-07-13 10:14:06.331821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.714 [2024-07-13 10:14:06.331836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:119320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.714 [2024-07-13 10:14:06.331849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.715 [2024-07-13 10:14:06.331864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:119336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.715 [2024-07-13 10:14:06.331901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.715 [2024-07-13 10:14:06.331917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:119352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.715 [2024-07-13 10:14:06.331930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.715 [2024-07-13 10:14:06.331960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:119376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.715 [2024-07-13 10:14:06.331973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.715 [2024-07-13 10:14:06.331988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:119384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.715 [2024-07-13 10:14:06.332001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.715 [2024-07-13 10:14:06.332016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:118584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.715 [2024-07-13 10:14:06.332030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.715 [2024-07-13 10:14:06.332044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:118608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.715 [2024-07-13 10:14:06.332057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.715 [2024-07-13 10:14:06.332072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:118616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.715 [2024-07-13 10:14:06.332085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.715 [2024-07-13 10:14:06.332099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:118632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.715 [2024-07-13 10:14:06.332124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.715 [2024-07-13 10:14:06.332139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:118640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.715 [2024-07-13 10:14:06.332153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.715 [2024-07-13 10:14:06.332167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:118688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.715 [2024-07-13 10:14:06.332181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.715 [2024-07-13 10:14:06.332196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:118696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.715 [2024-07-13 10:14:06.332211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.715 [2024-07-13 10:14:06.332226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:118720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.715 [2024-07-13 10:14:06.332253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.715 [2024-07-13 10:14:06.332269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:118744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.715 [2024-07-13 10:14:06.332282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.715 [2024-07-13 10:14:06.332296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:118768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.715 [2024-07-13 10:14:06.332309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.715 [2024-07-13 10:14:06.332323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:118816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.715 [2024-07-13 10:14:06.332336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.715 [2024-07-13 10:14:06.332350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:118824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.715 [2024-07-13 10:14:06.332363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.715 [2024-07-13 10:14:06.332377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:118832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.715 [2024-07-13 10:14:06.332390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.715 [2024-07-13 10:14:06.332404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:118840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.715 [2024-07-13 10:14:06.332417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.715 [2024-07-13 10:14:06.332431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:118848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.715 [2024-07-13 10:14:06.332443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.715 [2024-07-13 10:14:06.332458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:118856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.715 [2024-07-13 10:14:06.332471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.715 [2024-07-13 10:14:06.332490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:119424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.715 [2024-07-13 10:14:06.332503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.715 [2024-07-13 10:14:06.332517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:119432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.715 [2024-07-13 10:14:06.332531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.715 [2024-07-13 10:14:06.332544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:119440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.715 [2024-07-13 10:14:06.332558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.715 [2024-07-13 10:14:06.332572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:119448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.715 [2024-07-13 10:14:06.332584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.715 [2024-07-13 10:14:06.332599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:119456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.715 [2024-07-13 10:14:06.332612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.715 [2024-07-13 10:14:06.332626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:119464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.715 [2024-07-13 10:14:06.332638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.715 [2024-07-13 10:14:06.332652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:119472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.716 [2024-07-13 10:14:06.332666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.716 [2024-07-13 10:14:06.332680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:119480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.716 [2024-07-13 10:14:06.332693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.716 [2024-07-13 10:14:06.332707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:119488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.716 [2024-07-13 10:14:06.332720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.716 [2024-07-13 10:14:06.332734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:119496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.716 [2024-07-13 10:14:06.332747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.716 [2024-07-13 10:14:06.332761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:119504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.716 [2024-07-13 10:14:06.332773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.716 [2024-07-13 10:14:06.332788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:119512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.716 [2024-07-13 10:14:06.332800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.716 [2024-07-13 10:14:06.332815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:119520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.716 [2024-07-13 10:14:06.332832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.716 [2024-07-13 10:14:06.332847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:119528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.716 [2024-07-13 10:14:06.332860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.716 [2024-07-13 10:14:06.332897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:119536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.716 [2024-07-13 10:14:06.332919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.716 [2024-07-13 10:14:06.332933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:119544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.716 [2024-07-13 10:14:06.332947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.716 [2024-07-13 10:14:06.332962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:119552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.716 [2024-07-13 10:14:06.332975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.716 [2024-07-13 10:14:06.332989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:119560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.716 [2024-07-13 10:14:06.333003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.716 [2024-07-13 10:14:06.333017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:119568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.716 [2024-07-13 10:14:06.333030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.716 [2024-07-13 10:14:06.333045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:118864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.716 [2024-07-13 10:14:06.333058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.716 [2024-07-13 10:14:06.333073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:118888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.716 [2024-07-13 10:14:06.333086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.716 [2024-07-13 10:14:06.333100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:118896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.716 [2024-07-13 10:14:06.333114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.716 [2024-07-13 10:14:06.333128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:118920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.716 [2024-07-13 10:14:06.333142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.716 [2024-07-13 10:14:06.333166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:118936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.716 [2024-07-13 10:14:06.333179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.716 [2024-07-13 10:14:06.333209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:118944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.716 [2024-07-13 10:14:06.333222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.716 [2024-07-13 10:14:06.333237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:118952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.716 [2024-07-13 10:14:06.333254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.716 [2024-07-13 10:14:06.333269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:118992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.716 [2024-07-13 10:14:06.333282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.716 [2024-07-13 10:14:06.333296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:119576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.716 [2024-07-13 10:14:06.333309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.716 [2024-07-13 10:14:06.333323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:119584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.716 [2024-07-13 10:14:06.333336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.716 [2024-07-13 10:14:06.333350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:119592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.716 [2024-07-13 10:14:06.333363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.716 [2024-07-13 10:14:06.333376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:119600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.716 [2024-07-13 10:14:06.333389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.716 [2024-07-13 10:14:06.333403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:119608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.716 [2024-07-13 10:14:06.333416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.716 [2024-07-13 10:14:06.333430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:119616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.716 [2024-07-13 10:14:06.333442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.716 [2024-07-13 10:14:06.333457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:119624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.716 [2024-07-13 10:14:06.333470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.716 [2024-07-13 10:14:06.333484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:119000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.716 [2024-07-13 10:14:06.333497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.716 [2024-07-13 10:14:06.333511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:119008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.716 [2024-07-13 10:14:06.333523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.716 [2024-07-13 10:14:06.333537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:119016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.716 [2024-07-13 10:14:06.333550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.716 [2024-07-13 10:14:06.333564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:119040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.716 [2024-07-13 10:14:06.333576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.716 [2024-07-13 10:14:06.333594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:119088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.716 [2024-07-13 10:14:06.333612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.716 [2024-07-13 10:14:06.333627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:119096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.716 [2024-07-13 10:14:06.333640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.716 [2024-07-13 10:14:06.333653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:119104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.716 [2024-07-13 10:14:06.333666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.716 [2024-07-13 10:14:06.333680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:119112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.716 [2024-07-13 10:14:06.333693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.716 [2024-07-13 10:14:06.333707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:119632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.716 [2024-07-13 10:14:06.333721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.716 [2024-07-13 10:14:06.333736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:119640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.716 [2024-07-13 10:14:06.333749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.716 [2024-07-13 10:14:06.333764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:119648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.716 [2024-07-13 10:14:06.333778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.716 [2024-07-13 10:14:06.333792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:119656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.717 [2024-07-13 10:14:06.333804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.717 [2024-07-13 10:14:06.333818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:119664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.717 [2024-07-13 10:14:06.333833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.717 [2024-07-13 10:14:06.333848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:119672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.717 [2024-07-13 10:14:06.333861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.717 [2024-07-13 10:14:06.333899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:119680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.717 [2024-07-13 10:14:06.333914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.717 [2024-07-13 10:14:06.333929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:119688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.717 [2024-07-13 10:14:06.333944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.717 [2024-07-13 10:14:06.333959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:119696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.717 [2024-07-13 10:14:06.333977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.717 [2024-07-13 10:14:06.333992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:119704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.717 [2024-07-13 10:14:06.334005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.717 [2024-07-13 10:14:06.334020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:119712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.717 [2024-07-13 10:14:06.334034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.717 [2024-07-13 10:14:06.334048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:119720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.717 [2024-07-13 10:14:06.334061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.717 [2024-07-13 10:14:06.334076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:119728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.717 [2024-07-13 10:14:06.334093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.717 [2024-07-13 10:14:06.334107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:119736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.717 [2024-07-13 10:14:06.334121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.717 [2024-07-13 10:14:06.334135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:119744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.717 [2024-07-13 10:14:06.334148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.717 [2024-07-13 10:14:06.334163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:119752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.717 [2024-07-13 10:14:06.334177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.717 [2024-07-13 10:14:06.334207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:119760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.717 [2024-07-13 10:14:06.334219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.717 [2024-07-13 10:14:06.334233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:119120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.717 [2024-07-13 10:14:06.334246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.717 [2024-07-13 10:14:06.334260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:119128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.717 [2024-07-13 10:14:06.334272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.717 [2024-07-13 10:14:06.334286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:119136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.717 [2024-07-13 10:14:06.334298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.717 [2024-07-13 10:14:06.334312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:119152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.717 [2024-07-13 10:14:06.334325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.717 [2024-07-13 10:14:06.334342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:119160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.717 [2024-07-13 10:14:06.334355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.717 [2024-07-13 10:14:06.334369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:119176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.717 [2024-07-13 10:14:06.334381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.717 [2024-07-13 10:14:06.334395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:119192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.717 [2024-07-13 10:14:06.334408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.717 [2024-07-13 10:14:06.334422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:119208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.717 [2024-07-13 10:14:06.334434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.717 [2024-07-13 10:14:06.334448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:119768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.717 [2024-07-13 10:14:06.334460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.717 [2024-07-13 10:14:06.334474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:119776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.717 [2024-07-13 10:14:06.334487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.717 [2024-07-13 10:14:06.334501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:119784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.717 [2024-07-13 10:14:06.334513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.717 [2024-07-13 10:14:06.334527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:119792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.717 [2024-07-13 10:14:06.334543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.717 [2024-07-13 10:14:06.334558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:119800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.717 [2024-07-13 10:14:06.334570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.717 [2024-07-13 10:14:06.334589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:119808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.717 [2024-07-13 10:14:06.334603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.717 [2024-07-13 10:14:06.334616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:119816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.717 [2024-07-13 10:14:06.334630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.717 [2024-07-13 10:14:06.334643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:119216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.717 [2024-07-13 10:14:06.334656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.717 [2024-07-13 10:14:06.334670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:119232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.717 [2024-07-13 10:14:06.334686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.717 [2024-07-13 10:14:06.334701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:119248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.717 [2024-07-13 10:14:06.334714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.717 [2024-07-13 10:14:06.334728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:119256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.717 [2024-07-13 10:14:06.334741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.717 [2024-07-13 10:14:06.334754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:119264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.717 [2024-07-13 10:14:06.334768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.717 [2024-07-13 10:14:06.334781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:119280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.717 [2024-07-13 10:14:06.334794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.717 [2024-07-13 10:14:06.334807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:119288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.717 [2024-07-13 10:14:06.334820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.717 [2024-07-13 10:14:06.334834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:119296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.718 [2024-07-13 10:14:06.334847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.718 [2024-07-13 10:14:06.334860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:119824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.718 [2024-07-13 10:14:06.334897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.718 [2024-07-13 10:14:06.334916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:119832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.718 [2024-07-13 10:14:06.334929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.718 [2024-07-13 10:14:06.334944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:119840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.718 [2024-07-13 10:14:06.334957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.718 [2024-07-13 10:14:06.334971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:119848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.718 [2024-07-13 10:14:06.334984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.718 [2024-07-13 10:14:06.334998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:119856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.718 [2024-07-13 10:14:06.335015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.718 [2024-07-13 10:14:06.335030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:119864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.718 [2024-07-13 10:14:06.335043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.718 [2024-07-13 10:14:06.335066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:119872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.718 [2024-07-13 10:14:06.335081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.718 [2024-07-13 10:14:06.335096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:119880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.718 [2024-07-13 10:14:06.335110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.718 [2024-07-13 10:14:06.335124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:119888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.718 [2024-07-13 10:14:06.335137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.718 [2024-07-13 10:14:06.335151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:119896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.718 [2024-07-13 10:14:06.335164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.718 [2024-07-13 10:14:06.335179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:119904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.718 [2024-07-13 10:14:06.335207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.718 [2024-07-13 10:14:06.335221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:119912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.718 [2024-07-13 10:14:06.335234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.718 [2024-07-13 10:14:06.335248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:119328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.718 [2024-07-13 10:14:06.335261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.718 [2024-07-13 10:14:06.335275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:119344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.718 [2024-07-13 10:14:06.335287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.718 [2024-07-13 10:14:06.335301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:119360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.718 [2024-07-13 10:14:06.335314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.718 [2024-07-13 10:14:06.335327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:119368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.718 [2024-07-13 10:14:06.335340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.718 [2024-07-13 10:14:06.335354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:119392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.718 [2024-07-13 10:14:06.335367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.718 [2024-07-13 10:14:06.335381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:119400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.718 [2024-07-13 10:14:06.335394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.718 [2024-07-13 10:14:06.335407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:119408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.718 [2024-07-13 10:14:06.335423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.718 [2024-07-13 10:14:06.335437] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d9e510 is same with the state(5) to be set 00:28:11.718 [2024-07-13 10:14:06.335454] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:11.718 [2024-07-13 10:14:06.335465] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:11.718 [2024-07-13 10:14:06.335479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:119416 len:8 PRP1 0x0 PRP2 0x0 00:28:11.718 [2024-07-13 10:14:06.335492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.718 [2024-07-13 10:14:06.335571] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1d9e510 was disconnected and freed. reset controller. 00:28:11.718 [2024-07-13 10:14:06.335590] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:28:11.718 [2024-07-13 10:14:06.335638] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:11.718 [2024-07-13 10:14:06.335658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.718 [2024-07-13 10:14:06.335672] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:11.718 [2024-07-13 10:14:06.335686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.718 [2024-07-13 10:14:06.335699] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:11.718 [2024-07-13 10:14:06.335712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.718 [2024-07-13 10:14:06.335725] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:11.718 [2024-07-13 10:14:06.335738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.718 [2024-07-13 10:14:06.335752] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:11.718 [2024-07-13 10:14:06.335794] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d920a0 (9): Bad file descriptor 00:28:11.718 [2024-07-13 10:14:06.337965] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:11.718 [2024-07-13 10:14:06.529703] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:11.718 [2024-07-13 10:14:10.829528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:126784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.718 [2024-07-13 10:14:10.829568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.718 [2024-07-13 10:14:10.829593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:126792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.718 [2024-07-13 10:14:10.829609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.718 [2024-07-13 10:14:10.829625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:126816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.718 [2024-07-13 10:14:10.829638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.718 [2024-07-13 10:14:10.829653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:126864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.718 [2024-07-13 10:14:10.829672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.718 [2024-07-13 10:14:10.829687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:126880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.718 [2024-07-13 10:14:10.829700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.718 [2024-07-13 10:14:10.829714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:126888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.718 [2024-07-13 10:14:10.829727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.718 [2024-07-13 10:14:10.829741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:126904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.718 [2024-07-13 10:14:10.829754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.718 [2024-07-13 10:14:10.829768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:126912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.718 [2024-07-13 10:14:10.829781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.718 [2024-07-13 10:14:10.829795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:126928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.718 [2024-07-13 10:14:10.829808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.719 [2024-07-13 10:14:10.829822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:126936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.719 [2024-07-13 10:14:10.829835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.719 [2024-07-13 10:14:10.829849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:126952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.719 [2024-07-13 10:14:10.829890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.719 [2024-07-13 10:14:10.829908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:126968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.719 [2024-07-13 10:14:10.829922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.719 [2024-07-13 10:14:10.829936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:126976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.719 [2024-07-13 10:14:10.829950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.719 [2024-07-13 10:14:10.829964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:126992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.719 [2024-07-13 10:14:10.829977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.719 [2024-07-13 10:14:10.829992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:126248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.719 [2024-07-13 10:14:10.830005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.719 [2024-07-13 10:14:10.830019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:126256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.719 [2024-07-13 10:14:10.830033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.719 [2024-07-13 10:14:10.830047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:126280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.719 [2024-07-13 10:14:10.830070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.719 [2024-07-13 10:14:10.830086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:126320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.719 [2024-07-13 10:14:10.830100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.719 [2024-07-13 10:14:10.830115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:126352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.719 [2024-07-13 10:14:10.830129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.719 [2024-07-13 10:14:10.830144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:126360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.719 [2024-07-13 10:14:10.830157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.719 [2024-07-13 10:14:10.830192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:126368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.719 [2024-07-13 10:14:10.830205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.719 [2024-07-13 10:14:10.830219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:126376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.719 [2024-07-13 10:14:10.830232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.719 [2024-07-13 10:14:10.830246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:127000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.719 [2024-07-13 10:14:10.830259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.719 [2024-07-13 10:14:10.830273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:126384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.719 [2024-07-13 10:14:10.830285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.719 [2024-07-13 10:14:10.830301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:126392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.719 [2024-07-13 10:14:10.830314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.719 [2024-07-13 10:14:10.830328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:126416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.719 [2024-07-13 10:14:10.830341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.719 [2024-07-13 10:14:10.830355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:126432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.719 [2024-07-13 10:14:10.830367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.719 [2024-07-13 10:14:10.830382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:126440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.719 [2024-07-13 10:14:10.830394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.719 [2024-07-13 10:14:10.830408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:126448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.719 [2024-07-13 10:14:10.830421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.719 [2024-07-13 10:14:10.830438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:126456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.719 [2024-07-13 10:14:10.830452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.719 [2024-07-13 10:14:10.830466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:126496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.719 [2024-07-13 10:14:10.830480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.719 [2024-07-13 10:14:10.830494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:127024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.719 [2024-07-13 10:14:10.830507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.719 [2024-07-13 10:14:10.830521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:127032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.719 [2024-07-13 10:14:10.830534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.719 [2024-07-13 10:14:10.830548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:127040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.719 [2024-07-13 10:14:10.830561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.719 [2024-07-13 10:14:10.830575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:127048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.719 [2024-07-13 10:14:10.830588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.719 [2024-07-13 10:14:10.830601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:127056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.719 [2024-07-13 10:14:10.830614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.719 [2024-07-13 10:14:10.830628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:127064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.719 [2024-07-13 10:14:10.830641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.719 [2024-07-13 10:14:10.830655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:127072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.719 [2024-07-13 10:14:10.830668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.719 [2024-07-13 10:14:10.830682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:127080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.719 [2024-07-13 10:14:10.830694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.719 [2024-07-13 10:14:10.830709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:127088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.719 [2024-07-13 10:14:10.830722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.719 [2024-07-13 10:14:10.830736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:127096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.719 [2024-07-13 10:14:10.830749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.719 [2024-07-13 10:14:10.830762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:127104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.719 [2024-07-13 10:14:10.830778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.719 [2024-07-13 10:14:10.830793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:127112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.719 [2024-07-13 10:14:10.830806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.720 [2024-07-13 10:14:10.830820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:127120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.720 [2024-07-13 10:14:10.830833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.720 [2024-07-13 10:14:10.830848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:127128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.720 [2024-07-13 10:14:10.830894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.720 [2024-07-13 10:14:10.830912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:127136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.720 [2024-07-13 10:14:10.830926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.720 [2024-07-13 10:14:10.830941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:127144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.720 [2024-07-13 10:14:10.830956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.720 [2024-07-13 10:14:10.830971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:126520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.720 [2024-07-13 10:14:10.830985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.720 [2024-07-13 10:14:10.830999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:126528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.720 [2024-07-13 10:14:10.831012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.720 [2024-07-13 10:14:10.831026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:126568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.720 [2024-07-13 10:14:10.831039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.720 [2024-07-13 10:14:10.831054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:126584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.720 [2024-07-13 10:14:10.831067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.720 [2024-07-13 10:14:10.831081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:126600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.720 [2024-07-13 10:14:10.831094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.720 [2024-07-13 10:14:10.831108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:126616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.720 [2024-07-13 10:14:10.831121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.720 [2024-07-13 10:14:10.831135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:126664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.720 [2024-07-13 10:14:10.831149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.720 [2024-07-13 10:14:10.831167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:126672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.720 [2024-07-13 10:14:10.831198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.720 [2024-07-13 10:14:10.831213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:127152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.720 [2024-07-13 10:14:10.831226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.720 [2024-07-13 10:14:10.831245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:127160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.720 [2024-07-13 10:14:10.831258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.720 [2024-07-13 10:14:10.831272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:127168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.720 [2024-07-13 10:14:10.831285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.720 [2024-07-13 10:14:10.831300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:127176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.720 [2024-07-13 10:14:10.831312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.720 [2024-07-13 10:14:10.831326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:127184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.720 [2024-07-13 10:14:10.831339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.720 [2024-07-13 10:14:10.831353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:127192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.720 [2024-07-13 10:14:10.831365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.720 [2024-07-13 10:14:10.831379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:127200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.720 [2024-07-13 10:14:10.831392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.720 [2024-07-13 10:14:10.831405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:127208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.720 [2024-07-13 10:14:10.831419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.720 [2024-07-13 10:14:10.831433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:127216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.720 [2024-07-13 10:14:10.831446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.720 [2024-07-13 10:14:10.831459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:127224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.720 [2024-07-13 10:14:10.831473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.720 [2024-07-13 10:14:10.831487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:127232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.720 [2024-07-13 10:14:10.831500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.720 [2024-07-13 10:14:10.831514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:127240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.720 [2024-07-13 10:14:10.831530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.720 [2024-07-13 10:14:10.831545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:127248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.720 [2024-07-13 10:14:10.831558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.721 [2024-07-13 10:14:10.831571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:127256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.721 [2024-07-13 10:14:10.831584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.721 [2024-07-13 10:14:10.831598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:127264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.721 [2024-07-13 10:14:10.831611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.721 [2024-07-13 10:14:10.831630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:127272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.721 [2024-07-13 10:14:10.831642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.721 [2024-07-13 10:14:10.831656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:127280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.721 [2024-07-13 10:14:10.831669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.721 [2024-07-13 10:14:10.831694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:126680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.721 [2024-07-13 10:14:10.831707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.721 [2024-07-13 10:14:10.831721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:126696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.721 [2024-07-13 10:14:10.831734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.721 [2024-07-13 10:14:10.831747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:126704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.721 [2024-07-13 10:14:10.831760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.721 [2024-07-13 10:14:10.831774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:126712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.721 [2024-07-13 10:14:10.831786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.721 [2024-07-13 10:14:10.831800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:126728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.721 [2024-07-13 10:14:10.831813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.721 [2024-07-13 10:14:10.831827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:126744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.721 [2024-07-13 10:14:10.831839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.721 [2024-07-13 10:14:10.831853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:126752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.721 [2024-07-13 10:14:10.831892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.721 [2024-07-13 10:14:10.831914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:126768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.721 [2024-07-13 10:14:10.831928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.721 [2024-07-13 10:14:10.831943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:127288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.721 [2024-07-13 10:14:10.831962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.721 [2024-07-13 10:14:10.831977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:127296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.721 [2024-07-13 10:14:10.831990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.721 [2024-07-13 10:14:10.832005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:127304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.721 [2024-07-13 10:14:10.832018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.721 [2024-07-13 10:14:10.832032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:127312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.721 [2024-07-13 10:14:10.832046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.721 [2024-07-13 10:14:10.832060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:127320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.721 [2024-07-13 10:14:10.832074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.721 [2024-07-13 10:14:10.832088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:127328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.721 [2024-07-13 10:14:10.832101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.721 [2024-07-13 10:14:10.832116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:127336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.721 [2024-07-13 10:14:10.832129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.721 [2024-07-13 10:14:10.832144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:127344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.721 [2024-07-13 10:14:10.832157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.721 [2024-07-13 10:14:10.832172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:127352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.721 [2024-07-13 10:14:10.832211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.721 [2024-07-13 10:14:10.832226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:127360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.721 [2024-07-13 10:14:10.832239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.721 [2024-07-13 10:14:10.832254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:127368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.721 [2024-07-13 10:14:10.832266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.721 [2024-07-13 10:14:10.832280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:127376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.721 [2024-07-13 10:14:10.832296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.721 [2024-07-13 10:14:10.832311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:127384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.721 [2024-07-13 10:14:10.832331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.721 [2024-07-13 10:14:10.832345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:127392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.721 [2024-07-13 10:14:10.832357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.721 [2024-07-13 10:14:10.832372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:127400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.722 [2024-07-13 10:14:10.832384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.722 [2024-07-13 10:14:10.832399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:127408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.722 [2024-07-13 10:14:10.832411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.722 [2024-07-13 10:14:10.832437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:127416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.722 [2024-07-13 10:14:10.832451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.722 [2024-07-13 10:14:10.832465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:127424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.722 [2024-07-13 10:14:10.832478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.722 [2024-07-13 10:14:10.832502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:127432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.722 [2024-07-13 10:14:10.832515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.722 [2024-07-13 10:14:10.832529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:127440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.722 [2024-07-13 10:14:10.832542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.722 [2024-07-13 10:14:10.832556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:126776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.722 [2024-07-13 10:14:10.832569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.722 [2024-07-13 10:14:10.832592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:126800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.722 [2024-07-13 10:14:10.832604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.722 [2024-07-13 10:14:10.832619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:126808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.722 [2024-07-13 10:14:10.832632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.722 [2024-07-13 10:14:10.832657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:126824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.722 [2024-07-13 10:14:10.832670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.722 [2024-07-13 10:14:10.832685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:126832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.722 [2024-07-13 10:14:10.832701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.722 [2024-07-13 10:14:10.832716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:126840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.722 [2024-07-13 10:14:10.832729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.722 [2024-07-13 10:14:10.832744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:126848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.722 [2024-07-13 10:14:10.832757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.722 [2024-07-13 10:14:10.832771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:126856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.722 [2024-07-13 10:14:10.832784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.722 [2024-07-13 10:14:10.832798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:127448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.722 [2024-07-13 10:14:10.832812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.722 [2024-07-13 10:14:10.832826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:127456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.722 [2024-07-13 10:14:10.832839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.722 [2024-07-13 10:14:10.832854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:127464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.722 [2024-07-13 10:14:10.832888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.722 [2024-07-13 10:14:10.832906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:127472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.722 [2024-07-13 10:14:10.832921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.722 [2024-07-13 10:14:10.832935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:127480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.722 [2024-07-13 10:14:10.832949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.722 [2024-07-13 10:14:10.832964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:127488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.722 [2024-07-13 10:14:10.832978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.722 [2024-07-13 10:14:10.832993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:127496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.722 [2024-07-13 10:14:10.833007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.722 [2024-07-13 10:14:10.833022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:127504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.722 [2024-07-13 10:14:10.833035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.722 [2024-07-13 10:14:10.833050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:127512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.722 [2024-07-13 10:14:10.833064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.722 [2024-07-13 10:14:10.833082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:127520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.722 [2024-07-13 10:14:10.833096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.722 [2024-07-13 10:14:10.833111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:127528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.722 [2024-07-13 10:14:10.833125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.722 [2024-07-13 10:14:10.833139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:127536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:11.722 [2024-07-13 10:14:10.833153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.722 [2024-07-13 10:14:10.833179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:126872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.722 [2024-07-13 10:14:10.833208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.722 [2024-07-13 10:14:10.833223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:126896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.722 [2024-07-13 10:14:10.833236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.722 [2024-07-13 10:14:10.833250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:126920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.722 [2024-07-13 10:14:10.833263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.722 [2024-07-13 10:14:10.833278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:126944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.722 [2024-07-13 10:14:10.833291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.722 [2024-07-13 10:14:10.833305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:126960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.722 [2024-07-13 10:14:10.833318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.722 [2024-07-13 10:14:10.833332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:126984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.722 [2024-07-13 10:14:10.833345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.722 [2024-07-13 10:14:10.833359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:127008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:11.722 [2024-07-13 10:14:10.833372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.722 [2024-07-13 10:14:10.833386] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1db3820 is same with the state(5) to be set 00:28:11.722 [2024-07-13 10:14:10.833403] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:11.722 [2024-07-13 10:14:10.833414] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:11.722 [2024-07-13 10:14:10.833440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:127016 len:8 PRP1 0x0 PRP2 0x0 00:28:11.722 [2024-07-13 10:14:10.833453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.722 [2024-07-13 10:14:10.833522] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1db3820 was disconnected and freed. reset controller. 00:28:11.722 [2024-07-13 10:14:10.833544] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:28:11.722 [2024-07-13 10:14:10.833593] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:11.722 [2024-07-13 10:14:10.833613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.723 [2024-07-13 10:14:10.833628] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:11.723 [2024-07-13 10:14:10.833641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.723 [2024-07-13 10:14:10.833655] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:11.723 [2024-07-13 10:14:10.833668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.723 [2024-07-13 10:14:10.833683] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:11.723 [2024-07-13 10:14:10.833696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:11.723 [2024-07-13 10:14:10.833709] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:11.723 [2024-07-13 10:14:10.833761] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d920a0 (9): Bad file descriptor 00:28:11.723 [2024-07-13 10:14:10.836011] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:11.723 [2024-07-13 10:14:10.905920] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:11.723 00:28:11.723 Latency(us) 00:28:11.723 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:11.723 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:28:11.723 Verification LBA range: start 0x0 length 0x4000 00:28:11.723 NVMe0n1 : 15.01 12599.19 49.22 1303.17 0.00 9188.63 861.68 14563.56 00:28:11.723 =================================================================================================================== 00:28:11.723 Total : 12599.19 49.22 1303.17 0.00 9188.63 861.68 14563.56 00:28:11.723 Received shutdown signal, test time was about 15.000000 seconds 00:28:11.723 00:28:11.723 Latency(us) 00:28:11.723 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:11.723 =================================================================================================================== 00:28:11.723 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:28:11.723 10:14:16 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:28:11.723 10:14:16 -- host/failover.sh@65 -- # count=3 00:28:11.723 10:14:16 -- host/failover.sh@67 -- # (( count != 3 )) 00:28:11.723 10:14:16 -- host/failover.sh@73 -- # bdevperf_pid=2920028 00:28:11.723 10:14:16 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:28:11.723 10:14:16 -- host/failover.sh@75 -- # waitforlisten 2920028 /var/tmp/bdevperf.sock 00:28:11.723 10:14:16 -- common/autotest_common.sh@819 -- # '[' -z 2920028 ']' 00:28:11.723 10:14:16 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:28:11.723 10:14:16 -- common/autotest_common.sh@824 -- # local max_retries=100 00:28:11.723 10:14:16 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:28:11.723 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:28:11.723 10:14:16 -- common/autotest_common.sh@828 -- # xtrace_disable 00:28:11.723 10:14:16 -- common/autotest_common.sh@10 -- # set +x 00:28:12.289 10:14:17 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:28:12.289 10:14:17 -- common/autotest_common.sh@852 -- # return 0 00:28:12.289 10:14:17 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:12.548 [2024-07-13 10:14:18.126181] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:12.548 10:14:18 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:12.548 [2024-07-13 10:14:18.358775] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:28:12.808 10:14:18 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:13.067 NVMe0n1 00:28:13.067 10:14:18 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:13.325 00:28:13.325 10:14:19 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:13.892 00:28:13.893 10:14:19 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:13.893 10:14:19 -- host/failover.sh@82 -- # grep -q NVMe0 00:28:14.184 10:14:19 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:14.464 10:14:20 -- host/failover.sh@87 -- # sleep 3 00:28:17.752 10:14:23 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:17.752 10:14:23 -- host/failover.sh@88 -- # grep -q NVMe0 00:28:17.752 10:14:23 -- host/failover.sh@90 -- # run_test_pid=2920854 00:28:17.752 10:14:23 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:28:17.752 10:14:23 -- host/failover.sh@92 -- # wait 2920854 00:28:18.684 0 00:28:18.684 10:14:24 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:18.684 [2024-07-13 10:14:16.955425] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:28:18.684 [2024-07-13 10:14:16.955528] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2920028 ] 00:28:18.684 EAL: No free 2048 kB hugepages reported on node 1 00:28:18.684 [2024-07-13 10:14:17.017670] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:18.684 [2024-07-13 10:14:17.101843] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:18.684 [2024-07-13 10:14:20.052034] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:28:18.684 [2024-07-13 10:14:20.052156] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:18.684 [2024-07-13 10:14:20.052180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:18.684 [2024-07-13 10:14:20.052200] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:18.684 [2024-07-13 10:14:20.052213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:18.684 [2024-07-13 10:14:20.052228] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:18.684 [2024-07-13 10:14:20.052241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:18.684 [2024-07-13 10:14:20.052255] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:18.684 [2024-07-13 10:14:20.052269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:18.684 [2024-07-13 10:14:20.052284] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:18.684 [2024-07-13 10:14:20.052332] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:18.684 [2024-07-13 10:14:20.052372] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fb30a0 (9): Bad file descriptor 00:28:18.684 [2024-07-13 10:14:20.058266] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:18.684 Running I/O for 1 seconds... 00:28:18.684 00:28:18.684 Latency(us) 00:28:18.684 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:18.684 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:28:18.684 Verification LBA range: start 0x0 length 0x4000 00:28:18.684 NVMe0n1 : 1.01 12999.81 50.78 0.00 0.00 9802.78 1341.06 11068.30 00:28:18.684 =================================================================================================================== 00:28:18.684 Total : 12999.81 50.78 0.00 0.00 9802.78 1341.06 11068.30 00:28:18.684 10:14:24 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:18.684 10:14:24 -- host/failover.sh@95 -- # grep -q NVMe0 00:28:18.941 10:14:24 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:19.198 10:14:24 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:19.198 10:14:24 -- host/failover.sh@99 -- # grep -q NVMe0 00:28:19.454 10:14:25 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:19.712 10:14:25 -- host/failover.sh@101 -- # sleep 3 00:28:22.999 10:14:28 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:22.999 10:14:28 -- host/failover.sh@103 -- # grep -q NVMe0 00:28:22.999 10:14:28 -- host/failover.sh@108 -- # killprocess 2920028 00:28:22.999 10:14:28 -- common/autotest_common.sh@926 -- # '[' -z 2920028 ']' 00:28:22.999 10:14:28 -- common/autotest_common.sh@930 -- # kill -0 2920028 00:28:22.999 10:14:28 -- common/autotest_common.sh@931 -- # uname 00:28:22.999 10:14:28 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:28:22.999 10:14:28 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2920028 00:28:22.999 10:14:28 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:28:22.999 10:14:28 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:28:22.999 10:14:28 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2920028' 00:28:22.999 killing process with pid 2920028 00:28:22.999 10:14:28 -- common/autotest_common.sh@945 -- # kill 2920028 00:28:22.999 10:14:28 -- common/autotest_common.sh@950 -- # wait 2920028 00:28:23.257 10:14:28 -- host/failover.sh@110 -- # sync 00:28:23.257 10:14:28 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:23.517 10:14:29 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:28:23.517 10:14:29 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:23.517 10:14:29 -- host/failover.sh@116 -- # nvmftestfini 00:28:23.517 10:14:29 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:23.517 10:14:29 -- nvmf/common.sh@116 -- # sync 00:28:23.517 10:14:29 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:23.517 10:14:29 -- nvmf/common.sh@119 -- # set +e 00:28:23.517 10:14:29 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:23.517 10:14:29 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:23.517 rmmod nvme_tcp 00:28:23.517 rmmod nvme_fabrics 00:28:23.517 rmmod nvme_keyring 00:28:23.517 10:14:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:23.517 10:14:29 -- nvmf/common.sh@123 -- # set -e 00:28:23.517 10:14:29 -- nvmf/common.sh@124 -- # return 0 00:28:23.517 10:14:29 -- nvmf/common.sh@477 -- # '[' -n 2917558 ']' 00:28:23.517 10:14:29 -- nvmf/common.sh@478 -- # killprocess 2917558 00:28:23.517 10:14:29 -- common/autotest_common.sh@926 -- # '[' -z 2917558 ']' 00:28:23.517 10:14:29 -- common/autotest_common.sh@930 -- # kill -0 2917558 00:28:23.517 10:14:29 -- common/autotest_common.sh@931 -- # uname 00:28:23.517 10:14:29 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:28:23.517 10:14:29 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2917558 00:28:23.517 10:14:29 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:28:23.517 10:14:29 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:28:23.517 10:14:29 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2917558' 00:28:23.517 killing process with pid 2917558 00:28:23.517 10:14:29 -- common/autotest_common.sh@945 -- # kill 2917558 00:28:23.517 10:14:29 -- common/autotest_common.sh@950 -- # wait 2917558 00:28:23.778 10:14:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:23.778 10:14:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:23.778 10:14:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:23.778 10:14:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:23.778 10:14:29 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:23.778 10:14:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:23.778 10:14:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:23.778 10:14:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:26.315 10:14:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:26.315 00:28:26.315 real 0m36.691s 00:28:26.315 user 2m9.364s 00:28:26.315 sys 0m6.217s 00:28:26.315 10:14:31 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:28:26.315 10:14:31 -- common/autotest_common.sh@10 -- # set +x 00:28:26.315 ************************************ 00:28:26.315 END TEST nvmf_failover 00:28:26.315 ************************************ 00:28:26.315 10:14:31 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:28:26.315 10:14:31 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:28:26.315 10:14:31 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:28:26.315 10:14:31 -- common/autotest_common.sh@10 -- # set +x 00:28:26.315 ************************************ 00:28:26.315 START TEST nvmf_discovery 00:28:26.315 ************************************ 00:28:26.315 10:14:31 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:28:26.315 * Looking for test storage... 00:28:26.315 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:26.315 10:14:31 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:26.315 10:14:31 -- nvmf/common.sh@7 -- # uname -s 00:28:26.315 10:14:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:26.315 10:14:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:26.315 10:14:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:26.315 10:14:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:26.315 10:14:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:26.315 10:14:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:26.315 10:14:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:26.315 10:14:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:26.315 10:14:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:26.315 10:14:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:26.315 10:14:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:26.315 10:14:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:26.315 10:14:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:26.316 10:14:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:26.316 10:14:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:26.316 10:14:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:26.316 10:14:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:26.316 10:14:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:26.316 10:14:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:26.316 10:14:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:26.316 10:14:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:26.316 10:14:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:26.316 10:14:31 -- paths/export.sh@5 -- # export PATH 00:28:26.316 10:14:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:26.316 10:14:31 -- nvmf/common.sh@46 -- # : 0 00:28:26.316 10:14:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:26.316 10:14:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:26.316 10:14:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:26.316 10:14:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:26.316 10:14:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:26.316 10:14:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:26.316 10:14:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:26.316 10:14:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:26.316 10:14:31 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:28:26.316 10:14:31 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:28:26.316 10:14:31 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:28:26.316 10:14:31 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:28:26.316 10:14:31 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:28:26.316 10:14:31 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:28:26.316 10:14:31 -- host/discovery.sh@25 -- # nvmftestinit 00:28:26.316 10:14:31 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:26.316 10:14:31 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:26.316 10:14:31 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:26.316 10:14:31 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:26.316 10:14:31 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:26.316 10:14:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:26.316 10:14:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:26.316 10:14:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:26.316 10:14:31 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:26.316 10:14:31 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:26.316 10:14:31 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:26.316 10:14:31 -- common/autotest_common.sh@10 -- # set +x 00:28:28.216 10:14:33 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:28.216 10:14:33 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:28.216 10:14:33 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:28.216 10:14:33 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:28.216 10:14:33 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:28.216 10:14:33 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:28.216 10:14:33 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:28.216 10:14:33 -- nvmf/common.sh@294 -- # net_devs=() 00:28:28.216 10:14:33 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:28.216 10:14:33 -- nvmf/common.sh@295 -- # e810=() 00:28:28.216 10:14:33 -- nvmf/common.sh@295 -- # local -ga e810 00:28:28.216 10:14:33 -- nvmf/common.sh@296 -- # x722=() 00:28:28.216 10:14:33 -- nvmf/common.sh@296 -- # local -ga x722 00:28:28.216 10:14:33 -- nvmf/common.sh@297 -- # mlx=() 00:28:28.216 10:14:33 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:28.216 10:14:33 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:28.216 10:14:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:28.216 10:14:33 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:28.216 10:14:33 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:28.216 10:14:33 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:28.216 10:14:33 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:28.216 10:14:33 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:28.216 10:14:33 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:28.216 10:14:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:28.216 10:14:33 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:28.216 10:14:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:28.216 10:14:33 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:28.216 10:14:33 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:28.216 10:14:33 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:28.216 10:14:33 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:28.216 10:14:33 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:28.216 10:14:33 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:28.216 10:14:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:28.216 10:14:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:28.216 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:28.216 10:14:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:28.216 10:14:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:28.216 10:14:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:28.216 10:14:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:28.216 10:14:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:28.216 10:14:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:28.216 10:14:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:28.216 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:28.216 10:14:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:28.216 10:14:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:28.216 10:14:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:28.216 10:14:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:28.216 10:14:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:28.216 10:14:33 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:28.216 10:14:33 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:28.216 10:14:33 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:28.216 10:14:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:28.216 10:14:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:28.216 10:14:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:28.216 10:14:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:28.216 10:14:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:28.216 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:28.216 10:14:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:28.216 10:14:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:28.216 10:14:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:28.216 10:14:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:28.216 10:14:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:28.216 10:14:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:28.216 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:28.216 10:14:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:28.216 10:14:33 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:28.216 10:14:33 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:28.216 10:14:33 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:28.216 10:14:33 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:28.216 10:14:33 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:28.216 10:14:33 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:28.216 10:14:33 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:28.216 10:14:33 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:28.216 10:14:33 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:28.216 10:14:33 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:28.216 10:14:33 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:28.216 10:14:33 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:28.216 10:14:33 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:28.216 10:14:33 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:28.216 10:14:33 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:28.216 10:14:33 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:28.216 10:14:33 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:28.216 10:14:33 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:28.216 10:14:33 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:28.216 10:14:33 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:28.216 10:14:33 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:28.216 10:14:33 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:28.216 10:14:33 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:28.216 10:14:33 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:28.216 10:14:33 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:28.216 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:28.216 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.182 ms 00:28:28.216 00:28:28.216 --- 10.0.0.2 ping statistics --- 00:28:28.216 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:28.216 rtt min/avg/max/mdev = 0.182/0.182/0.182/0.000 ms 00:28:28.216 10:14:33 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:28.216 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:28.217 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.122 ms 00:28:28.217 00:28:28.217 --- 10.0.0.1 ping statistics --- 00:28:28.217 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:28.217 rtt min/avg/max/mdev = 0.122/0.122/0.122/0.000 ms 00:28:28.217 10:14:33 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:28.217 10:14:33 -- nvmf/common.sh@410 -- # return 0 00:28:28.217 10:14:33 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:28.217 10:14:33 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:28.217 10:14:33 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:28.217 10:14:33 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:28.217 10:14:33 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:28.217 10:14:33 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:28.217 10:14:33 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:28.217 10:14:33 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:28:28.217 10:14:33 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:28.217 10:14:33 -- common/autotest_common.sh@712 -- # xtrace_disable 00:28:28.217 10:14:33 -- common/autotest_common.sh@10 -- # set +x 00:28:28.217 10:14:33 -- nvmf/common.sh@469 -- # nvmfpid=2923481 00:28:28.217 10:14:33 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:28:28.217 10:14:33 -- nvmf/common.sh@470 -- # waitforlisten 2923481 00:28:28.217 10:14:33 -- common/autotest_common.sh@819 -- # '[' -z 2923481 ']' 00:28:28.217 10:14:33 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:28.217 10:14:33 -- common/autotest_common.sh@824 -- # local max_retries=100 00:28:28.217 10:14:33 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:28.217 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:28.217 10:14:33 -- common/autotest_common.sh@828 -- # xtrace_disable 00:28:28.217 10:14:33 -- common/autotest_common.sh@10 -- # set +x 00:28:28.217 [2024-07-13 10:14:33.810032] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:28:28.217 [2024-07-13 10:14:33.810119] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:28.217 EAL: No free 2048 kB hugepages reported on node 1 00:28:28.217 [2024-07-13 10:14:33.888767] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:28.217 [2024-07-13 10:14:33.982351] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:28.217 [2024-07-13 10:14:33.982520] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:28.217 [2024-07-13 10:14:33.982538] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:28.217 [2024-07-13 10:14:33.982549] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:28.217 [2024-07-13 10:14:33.982577] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:29.150 10:14:34 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:28:29.151 10:14:34 -- common/autotest_common.sh@852 -- # return 0 00:28:29.151 10:14:34 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:29.151 10:14:34 -- common/autotest_common.sh@718 -- # xtrace_disable 00:28:29.151 10:14:34 -- common/autotest_common.sh@10 -- # set +x 00:28:29.151 10:14:34 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:29.151 10:14:34 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:28:29.151 10:14:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:29.151 10:14:34 -- common/autotest_common.sh@10 -- # set +x 00:28:29.151 [2024-07-13 10:14:34.807731] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:29.151 10:14:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:29.151 10:14:34 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:28:29.151 10:14:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:29.151 10:14:34 -- common/autotest_common.sh@10 -- # set +x 00:28:29.151 [2024-07-13 10:14:34.815894] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:28:29.151 10:14:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:29.151 10:14:34 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:28:29.151 10:14:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:29.151 10:14:34 -- common/autotest_common.sh@10 -- # set +x 00:28:29.151 null0 00:28:29.151 10:14:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:29.151 10:14:34 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:28:29.151 10:14:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:29.151 10:14:34 -- common/autotest_common.sh@10 -- # set +x 00:28:29.151 null1 00:28:29.151 10:14:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:29.151 10:14:34 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:28:29.151 10:14:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:29.151 10:14:34 -- common/autotest_common.sh@10 -- # set +x 00:28:29.151 10:14:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:29.151 10:14:34 -- host/discovery.sh@45 -- # hostpid=2923638 00:28:29.151 10:14:34 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:28:29.151 10:14:34 -- host/discovery.sh@46 -- # waitforlisten 2923638 /tmp/host.sock 00:28:29.151 10:14:34 -- common/autotest_common.sh@819 -- # '[' -z 2923638 ']' 00:28:29.151 10:14:34 -- common/autotest_common.sh@823 -- # local rpc_addr=/tmp/host.sock 00:28:29.151 10:14:34 -- common/autotest_common.sh@824 -- # local max_retries=100 00:28:29.151 10:14:34 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:28:29.151 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:28:29.151 10:14:34 -- common/autotest_common.sh@828 -- # xtrace_disable 00:28:29.151 10:14:34 -- common/autotest_common.sh@10 -- # set +x 00:28:29.151 [2024-07-13 10:14:34.887919] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:28:29.151 [2024-07-13 10:14:34.887995] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2923638 ] 00:28:29.151 EAL: No free 2048 kB hugepages reported on node 1 00:28:29.151 [2024-07-13 10:14:34.954196] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:29.409 [2024-07-13 10:14:35.042769] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:29.409 [2024-07-13 10:14:35.042976] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:30.346 10:14:35 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:28:30.346 10:14:35 -- common/autotest_common.sh@852 -- # return 0 00:28:30.346 10:14:35 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:30.346 10:14:35 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:28:30.346 10:14:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:30.346 10:14:35 -- common/autotest_common.sh@10 -- # set +x 00:28:30.346 10:14:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:30.346 10:14:35 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:28:30.346 10:14:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:30.346 10:14:35 -- common/autotest_common.sh@10 -- # set +x 00:28:30.346 10:14:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:30.346 10:14:35 -- host/discovery.sh@72 -- # notify_id=0 00:28:30.346 10:14:35 -- host/discovery.sh@78 -- # get_subsystem_names 00:28:30.346 10:14:35 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:30.346 10:14:35 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:30.346 10:14:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:30.346 10:14:35 -- common/autotest_common.sh@10 -- # set +x 00:28:30.346 10:14:35 -- host/discovery.sh@59 -- # sort 00:28:30.346 10:14:35 -- host/discovery.sh@59 -- # xargs 00:28:30.346 10:14:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:30.346 10:14:35 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:28:30.346 10:14:35 -- host/discovery.sh@79 -- # get_bdev_list 00:28:30.346 10:14:35 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:30.346 10:14:35 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:30.346 10:14:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:30.346 10:14:35 -- common/autotest_common.sh@10 -- # set +x 00:28:30.346 10:14:35 -- host/discovery.sh@55 -- # sort 00:28:30.346 10:14:35 -- host/discovery.sh@55 -- # xargs 00:28:30.346 10:14:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:30.346 10:14:35 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:28:30.347 10:14:35 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:28:30.347 10:14:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:30.347 10:14:35 -- common/autotest_common.sh@10 -- # set +x 00:28:30.347 10:14:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:30.347 10:14:35 -- host/discovery.sh@82 -- # get_subsystem_names 00:28:30.347 10:14:35 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:30.347 10:14:35 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:30.347 10:14:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:30.347 10:14:35 -- host/discovery.sh@59 -- # sort 00:28:30.347 10:14:35 -- common/autotest_common.sh@10 -- # set +x 00:28:30.347 10:14:35 -- host/discovery.sh@59 -- # xargs 00:28:30.347 10:14:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:30.347 10:14:35 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:28:30.347 10:14:35 -- host/discovery.sh@83 -- # get_bdev_list 00:28:30.347 10:14:35 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:30.347 10:14:35 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:30.347 10:14:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:30.347 10:14:35 -- host/discovery.sh@55 -- # sort 00:28:30.347 10:14:35 -- common/autotest_common.sh@10 -- # set +x 00:28:30.347 10:14:35 -- host/discovery.sh@55 -- # xargs 00:28:30.347 10:14:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:30.347 10:14:36 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:28:30.347 10:14:36 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:28:30.347 10:14:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:30.347 10:14:36 -- common/autotest_common.sh@10 -- # set +x 00:28:30.347 10:14:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:30.347 10:14:36 -- host/discovery.sh@86 -- # get_subsystem_names 00:28:30.347 10:14:36 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:30.347 10:14:36 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:30.347 10:14:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:30.347 10:14:36 -- host/discovery.sh@59 -- # sort 00:28:30.347 10:14:36 -- common/autotest_common.sh@10 -- # set +x 00:28:30.347 10:14:36 -- host/discovery.sh@59 -- # xargs 00:28:30.347 10:14:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:30.347 10:14:36 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:28:30.347 10:14:36 -- host/discovery.sh@87 -- # get_bdev_list 00:28:30.347 10:14:36 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:30.347 10:14:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:30.347 10:14:36 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:30.347 10:14:36 -- common/autotest_common.sh@10 -- # set +x 00:28:30.347 10:14:36 -- host/discovery.sh@55 -- # sort 00:28:30.347 10:14:36 -- host/discovery.sh@55 -- # xargs 00:28:30.347 10:14:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:30.347 10:14:36 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:28:30.347 10:14:36 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:30.347 10:14:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:30.347 10:14:36 -- common/autotest_common.sh@10 -- # set +x 00:28:30.347 [2024-07-13 10:14:36.123526] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:30.347 10:14:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:30.347 10:14:36 -- host/discovery.sh@92 -- # get_subsystem_names 00:28:30.347 10:14:36 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:30.347 10:14:36 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:30.347 10:14:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:30.347 10:14:36 -- common/autotest_common.sh@10 -- # set +x 00:28:30.347 10:14:36 -- host/discovery.sh@59 -- # sort 00:28:30.347 10:14:36 -- host/discovery.sh@59 -- # xargs 00:28:30.347 10:14:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:30.606 10:14:36 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:28:30.606 10:14:36 -- host/discovery.sh@93 -- # get_bdev_list 00:28:30.606 10:14:36 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:30.606 10:14:36 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:30.606 10:14:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:30.606 10:14:36 -- common/autotest_common.sh@10 -- # set +x 00:28:30.606 10:14:36 -- host/discovery.sh@55 -- # sort 00:28:30.606 10:14:36 -- host/discovery.sh@55 -- # xargs 00:28:30.606 10:14:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:30.606 10:14:36 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:28:30.606 10:14:36 -- host/discovery.sh@94 -- # get_notification_count 00:28:30.606 10:14:36 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:28:30.606 10:14:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:30.606 10:14:36 -- host/discovery.sh@74 -- # jq '. | length' 00:28:30.606 10:14:36 -- common/autotest_common.sh@10 -- # set +x 00:28:30.606 10:14:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:30.606 10:14:36 -- host/discovery.sh@74 -- # notification_count=0 00:28:30.606 10:14:36 -- host/discovery.sh@75 -- # notify_id=0 00:28:30.606 10:14:36 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:28:30.606 10:14:36 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:28:30.606 10:14:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:30.606 10:14:36 -- common/autotest_common.sh@10 -- # set +x 00:28:30.606 10:14:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:30.606 10:14:36 -- host/discovery.sh@100 -- # sleep 1 00:28:31.176 [2024-07-13 10:14:36.897727] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:28:31.176 [2024-07-13 10:14:36.897775] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:28:31.176 [2024-07-13 10:14:36.897815] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:31.436 [2024-07-13 10:14:37.025208] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:28:31.436 [2024-07-13 10:14:37.210520] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:28:31.436 [2024-07-13 10:14:37.210548] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:28:31.696 10:14:37 -- host/discovery.sh@101 -- # get_subsystem_names 00:28:31.696 10:14:37 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:31.696 10:14:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:31.696 10:14:37 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:31.696 10:14:37 -- common/autotest_common.sh@10 -- # set +x 00:28:31.696 10:14:37 -- host/discovery.sh@59 -- # sort 00:28:31.696 10:14:37 -- host/discovery.sh@59 -- # xargs 00:28:31.696 10:14:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:31.696 10:14:37 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:31.696 10:14:37 -- host/discovery.sh@102 -- # get_bdev_list 00:28:31.696 10:14:37 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:31.696 10:14:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:31.696 10:14:37 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:31.696 10:14:37 -- common/autotest_common.sh@10 -- # set +x 00:28:31.696 10:14:37 -- host/discovery.sh@55 -- # sort 00:28:31.696 10:14:37 -- host/discovery.sh@55 -- # xargs 00:28:31.696 10:14:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:31.696 10:14:37 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:28:31.697 10:14:37 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:28:31.697 10:14:37 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:28:31.697 10:14:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:31.697 10:14:37 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:28:31.697 10:14:37 -- common/autotest_common.sh@10 -- # set +x 00:28:31.697 10:14:37 -- host/discovery.sh@63 -- # sort -n 00:28:31.697 10:14:37 -- host/discovery.sh@63 -- # xargs 00:28:31.697 10:14:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:31.697 10:14:37 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:28:31.697 10:14:37 -- host/discovery.sh@104 -- # get_notification_count 00:28:31.697 10:14:37 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:28:31.697 10:14:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:31.697 10:14:37 -- host/discovery.sh@74 -- # jq '. | length' 00:28:31.697 10:14:37 -- common/autotest_common.sh@10 -- # set +x 00:28:31.697 10:14:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:31.697 10:14:37 -- host/discovery.sh@74 -- # notification_count=1 00:28:31.697 10:14:37 -- host/discovery.sh@75 -- # notify_id=1 00:28:31.697 10:14:37 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:28:31.697 10:14:37 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:28:31.697 10:14:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:31.697 10:14:37 -- common/autotest_common.sh@10 -- # set +x 00:28:31.697 10:14:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:31.697 10:14:37 -- host/discovery.sh@109 -- # sleep 1 00:28:32.715 10:14:38 -- host/discovery.sh@110 -- # get_bdev_list 00:28:32.715 10:14:38 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:32.715 10:14:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:32.715 10:14:38 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:32.715 10:14:38 -- common/autotest_common.sh@10 -- # set +x 00:28:32.715 10:14:38 -- host/discovery.sh@55 -- # sort 00:28:32.715 10:14:38 -- host/discovery.sh@55 -- # xargs 00:28:32.715 10:14:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:32.715 10:14:38 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:32.715 10:14:38 -- host/discovery.sh@111 -- # get_notification_count 00:28:32.715 10:14:38 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:28:32.715 10:14:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:32.715 10:14:38 -- host/discovery.sh@74 -- # jq '. | length' 00:28:32.715 10:14:38 -- common/autotest_common.sh@10 -- # set +x 00:28:32.715 10:14:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:32.715 10:14:38 -- host/discovery.sh@74 -- # notification_count=1 00:28:32.715 10:14:38 -- host/discovery.sh@75 -- # notify_id=2 00:28:32.715 10:14:38 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:28:32.715 10:14:38 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:28:32.715 10:14:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:32.715 10:14:38 -- common/autotest_common.sh@10 -- # set +x 00:28:32.715 [2024-07-13 10:14:38.530775] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:32.715 [2024-07-13 10:14:38.531327] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:28:32.715 [2024-07-13 10:14:38.531373] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:32.974 10:14:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:32.974 10:14:38 -- host/discovery.sh@117 -- # sleep 1 00:28:32.974 [2024-07-13 10:14:38.657745] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:28:32.974 [2024-07-13 10:14:38.763454] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:28:32.974 [2024-07-13 10:14:38.763480] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:28:32.974 [2024-07-13 10:14:38.763491] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:28:33.911 10:14:39 -- host/discovery.sh@118 -- # get_subsystem_names 00:28:33.911 10:14:39 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:33.911 10:14:39 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:33.911 10:14:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:33.911 10:14:39 -- common/autotest_common.sh@10 -- # set +x 00:28:33.911 10:14:39 -- host/discovery.sh@59 -- # sort 00:28:33.911 10:14:39 -- host/discovery.sh@59 -- # xargs 00:28:33.911 10:14:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:33.911 10:14:39 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:33.911 10:14:39 -- host/discovery.sh@119 -- # get_bdev_list 00:28:33.911 10:14:39 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:33.911 10:14:39 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:33.911 10:14:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:33.911 10:14:39 -- common/autotest_common.sh@10 -- # set +x 00:28:33.911 10:14:39 -- host/discovery.sh@55 -- # sort 00:28:33.911 10:14:39 -- host/discovery.sh@55 -- # xargs 00:28:33.911 10:14:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:33.911 10:14:39 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:33.911 10:14:39 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:28:33.911 10:14:39 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:28:33.911 10:14:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:33.911 10:14:39 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:28:33.911 10:14:39 -- common/autotest_common.sh@10 -- # set +x 00:28:33.911 10:14:39 -- host/discovery.sh@63 -- # sort -n 00:28:33.911 10:14:39 -- host/discovery.sh@63 -- # xargs 00:28:33.911 10:14:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:33.911 10:14:39 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:28:33.911 10:14:39 -- host/discovery.sh@121 -- # get_notification_count 00:28:33.911 10:14:39 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:28:33.911 10:14:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:33.911 10:14:39 -- host/discovery.sh@74 -- # jq '. | length' 00:28:33.911 10:14:39 -- common/autotest_common.sh@10 -- # set +x 00:28:33.911 10:14:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:33.911 10:14:39 -- host/discovery.sh@74 -- # notification_count=0 00:28:33.911 10:14:39 -- host/discovery.sh@75 -- # notify_id=2 00:28:33.911 10:14:39 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:28:33.911 10:14:39 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:33.911 10:14:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:33.911 10:14:39 -- common/autotest_common.sh@10 -- # set +x 00:28:33.911 [2024-07-13 10:14:39.710602] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:28:33.911 [2024-07-13 10:14:39.710632] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:33.911 [2024-07-13 10:14:39.713862] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:33.911 [2024-07-13 10:14:39.713902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.911 [2024-07-13 10:14:39.713945] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:33.911 [2024-07-13 10:14:39.713965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.911 [2024-07-13 10:14:39.713979] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:33.911 [2024-07-13 10:14:39.713992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.911 [2024-07-13 10:14:39.714006] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:33.911 [2024-07-13 10:14:39.714020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:33.911 [2024-07-13 10:14:39.714034] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e14590 is same with the state(5) to be set 00:28:33.911 10:14:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:33.911 10:14:39 -- host/discovery.sh@127 -- # sleep 1 00:28:33.911 [2024-07-13 10:14:39.723880] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e14590 (9): Bad file descriptor 00:28:34.172 [2024-07-13 10:14:39.733938] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:34.172 [2024-07-13 10:14:39.734175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:34.172 [2024-07-13 10:14:39.734371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:34.172 [2024-07-13 10:14:39.734402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1e14590 with addr=10.0.0.2, port=4420 00:28:34.172 [2024-07-13 10:14:39.734421] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e14590 is same with the state(5) to be set 00:28:34.172 [2024-07-13 10:14:39.734448] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e14590 (9): Bad file descriptor 00:28:34.172 [2024-07-13 10:14:39.734471] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:34.172 [2024-07-13 10:14:39.734487] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:34.172 [2024-07-13 10:14:39.734504] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:34.172 [2024-07-13 10:14:39.734527] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:34.172 [2024-07-13 10:14:39.744031] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:34.172 [2024-07-13 10:14:39.744339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:34.172 [2024-07-13 10:14:39.744542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:34.172 [2024-07-13 10:14:39.744571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1e14590 with addr=10.0.0.2, port=4420 00:28:34.172 [2024-07-13 10:14:39.744590] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e14590 is same with the state(5) to be set 00:28:34.172 [2024-07-13 10:14:39.744615] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e14590 (9): Bad file descriptor 00:28:34.172 [2024-07-13 10:14:39.744637] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:34.172 [2024-07-13 10:14:39.744652] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:34.172 [2024-07-13 10:14:39.744667] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:34.172 [2024-07-13 10:14:39.744688] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:34.172 [2024-07-13 10:14:39.754102] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:34.172 [2024-07-13 10:14:39.754287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:34.172 [2024-07-13 10:14:39.754514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:34.172 [2024-07-13 10:14:39.754555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1e14590 with addr=10.0.0.2, port=4420 00:28:34.172 [2024-07-13 10:14:39.754575] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e14590 is same with the state(5) to be set 00:28:34.172 [2024-07-13 10:14:39.754600] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e14590 (9): Bad file descriptor 00:28:34.172 [2024-07-13 10:14:39.754638] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:34.172 [2024-07-13 10:14:39.754653] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:34.172 [2024-07-13 10:14:39.754666] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:34.172 [2024-07-13 10:14:39.754701] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:34.172 [2024-07-13 10:14:39.764191] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:34.172 [2024-07-13 10:14:39.764420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:34.172 [2024-07-13 10:14:39.764551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:34.172 [2024-07-13 10:14:39.764578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1e14590 with addr=10.0.0.2, port=4420 00:28:34.172 [2024-07-13 10:14:39.764594] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e14590 is same with the state(5) to be set 00:28:34.172 [2024-07-13 10:14:39.764618] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e14590 (9): Bad file descriptor 00:28:34.172 [2024-07-13 10:14:39.764653] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:34.172 [2024-07-13 10:14:39.764667] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:34.172 [2024-07-13 10:14:39.764680] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:34.172 [2024-07-13 10:14:39.764699] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:34.172 [2024-07-13 10:14:39.774260] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:34.172 [2024-07-13 10:14:39.774482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:34.172 [2024-07-13 10:14:39.774635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:34.172 [2024-07-13 10:14:39.774662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1e14590 with addr=10.0.0.2, port=4420 00:28:34.172 [2024-07-13 10:14:39.774679] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e14590 is same with the state(5) to be set 00:28:34.172 [2024-07-13 10:14:39.774702] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e14590 (9): Bad file descriptor 00:28:34.172 [2024-07-13 10:14:39.774721] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:34.172 [2024-07-13 10:14:39.774735] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:34.172 [2024-07-13 10:14:39.774749] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:34.172 [2024-07-13 10:14:39.774768] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:34.172 [2024-07-13 10:14:39.784327] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:34.172 [2024-07-13 10:14:39.784532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:34.172 [2024-07-13 10:14:39.784657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:34.172 [2024-07-13 10:14:39.784684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1e14590 with addr=10.0.0.2, port=4420 00:28:34.172 [2024-07-13 10:14:39.784705] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e14590 is same with the state(5) to be set 00:28:34.172 [2024-07-13 10:14:39.784729] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e14590 (9): Bad file descriptor 00:28:34.172 [2024-07-13 10:14:39.784749] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:34.172 [2024-07-13 10:14:39.784778] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:34.173 [2024-07-13 10:14:39.784792] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:34.173 [2024-07-13 10:14:39.784811] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:34.173 [2024-07-13 10:14:39.794394] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:34.173 [2024-07-13 10:14:39.794680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:34.173 [2024-07-13 10:14:39.794838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:34.173 [2024-07-13 10:14:39.794874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1e14590 with addr=10.0.0.2, port=4420 00:28:34.173 [2024-07-13 10:14:39.794893] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e14590 is same with the state(5) to be set 00:28:34.173 [2024-07-13 10:14:39.794916] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e14590 (9): Bad file descriptor 00:28:34.173 [2024-07-13 10:14:39.794949] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:34.173 [2024-07-13 10:14:39.794966] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:34.173 [2024-07-13 10:14:39.794980] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:34.173 [2024-07-13 10:14:39.795000] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:34.173 [2024-07-13 10:14:39.797953] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:28:34.173 [2024-07-13 10:14:39.797979] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:28:35.113 10:14:40 -- host/discovery.sh@128 -- # get_subsystem_names 00:28:35.113 10:14:40 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:35.113 10:14:40 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:35.113 10:14:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:35.113 10:14:40 -- common/autotest_common.sh@10 -- # set +x 00:28:35.113 10:14:40 -- host/discovery.sh@59 -- # sort 00:28:35.113 10:14:40 -- host/discovery.sh@59 -- # xargs 00:28:35.113 10:14:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:35.113 10:14:40 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:35.113 10:14:40 -- host/discovery.sh@129 -- # get_bdev_list 00:28:35.113 10:14:40 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:35.113 10:14:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:35.113 10:14:40 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:35.113 10:14:40 -- common/autotest_common.sh@10 -- # set +x 00:28:35.113 10:14:40 -- host/discovery.sh@55 -- # sort 00:28:35.113 10:14:40 -- host/discovery.sh@55 -- # xargs 00:28:35.113 10:14:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:35.113 10:14:40 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:35.113 10:14:40 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:28:35.113 10:14:40 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:28:35.113 10:14:40 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:28:35.113 10:14:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:35.113 10:14:40 -- common/autotest_common.sh@10 -- # set +x 00:28:35.113 10:14:40 -- host/discovery.sh@63 -- # sort -n 00:28:35.113 10:14:40 -- host/discovery.sh@63 -- # xargs 00:28:35.113 10:14:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:35.113 10:14:40 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:28:35.113 10:14:40 -- host/discovery.sh@131 -- # get_notification_count 00:28:35.113 10:14:40 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:28:35.113 10:14:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:35.113 10:14:40 -- common/autotest_common.sh@10 -- # set +x 00:28:35.113 10:14:40 -- host/discovery.sh@74 -- # jq '. | length' 00:28:35.113 10:14:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:35.113 10:14:40 -- host/discovery.sh@74 -- # notification_count=0 00:28:35.113 10:14:40 -- host/discovery.sh@75 -- # notify_id=2 00:28:35.113 10:14:40 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:28:35.113 10:14:40 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:28:35.113 10:14:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:35.113 10:14:40 -- common/autotest_common.sh@10 -- # set +x 00:28:35.113 10:14:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:35.113 10:14:40 -- host/discovery.sh@135 -- # sleep 1 00:28:36.490 10:14:41 -- host/discovery.sh@136 -- # get_subsystem_names 00:28:36.490 10:14:41 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:36.490 10:14:41 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:36.490 10:14:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:36.490 10:14:41 -- common/autotest_common.sh@10 -- # set +x 00:28:36.490 10:14:41 -- host/discovery.sh@59 -- # sort 00:28:36.490 10:14:41 -- host/discovery.sh@59 -- # xargs 00:28:36.490 10:14:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:36.490 10:14:41 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:28:36.490 10:14:41 -- host/discovery.sh@137 -- # get_bdev_list 00:28:36.490 10:14:41 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:36.490 10:14:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:36.490 10:14:41 -- common/autotest_common.sh@10 -- # set +x 00:28:36.490 10:14:41 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:36.490 10:14:41 -- host/discovery.sh@55 -- # sort 00:28:36.490 10:14:41 -- host/discovery.sh@55 -- # xargs 00:28:36.490 10:14:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:36.490 10:14:41 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:28:36.490 10:14:41 -- host/discovery.sh@138 -- # get_notification_count 00:28:36.490 10:14:41 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:28:36.490 10:14:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:36.490 10:14:41 -- host/discovery.sh@74 -- # jq '. | length' 00:28:36.490 10:14:41 -- common/autotest_common.sh@10 -- # set +x 00:28:36.490 10:14:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:36.490 10:14:42 -- host/discovery.sh@74 -- # notification_count=2 00:28:36.490 10:14:42 -- host/discovery.sh@75 -- # notify_id=4 00:28:36.490 10:14:42 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:28:36.490 10:14:42 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:36.490 10:14:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:36.490 10:14:42 -- common/autotest_common.sh@10 -- # set +x 00:28:37.429 [2024-07-13 10:14:43.074047] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:28:37.429 [2024-07-13 10:14:43.074073] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:28:37.429 [2024-07-13 10:14:43.074095] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:37.429 [2024-07-13 10:14:43.160399] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:28:37.429 [2024-07-13 10:14:43.227583] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:28:37.429 [2024-07-13 10:14:43.227622] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:28:37.429 10:14:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:37.429 10:14:43 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:37.429 10:14:43 -- common/autotest_common.sh@640 -- # local es=0 00:28:37.429 10:14:43 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:37.429 10:14:43 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:28:37.429 10:14:43 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:28:37.429 10:14:43 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:28:37.429 10:14:43 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:28:37.429 10:14:43 -- common/autotest_common.sh@643 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:37.429 10:14:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:37.429 10:14:43 -- common/autotest_common.sh@10 -- # set +x 00:28:37.429 request: 00:28:37.429 { 00:28:37.429 "name": "nvme", 00:28:37.429 "trtype": "tcp", 00:28:37.429 "traddr": "10.0.0.2", 00:28:37.429 "hostnqn": "nqn.2021-12.io.spdk:test", 00:28:37.429 "adrfam": "ipv4", 00:28:37.429 "trsvcid": "8009", 00:28:37.429 "wait_for_attach": true, 00:28:37.429 "method": "bdev_nvme_start_discovery", 00:28:37.429 "req_id": 1 00:28:37.429 } 00:28:37.429 Got JSON-RPC error response 00:28:37.429 response: 00:28:37.429 { 00:28:37.429 "code": -17, 00:28:37.429 "message": "File exists" 00:28:37.429 } 00:28:37.429 10:14:43 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:28:37.429 10:14:43 -- common/autotest_common.sh@643 -- # es=1 00:28:37.429 10:14:43 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:28:37.429 10:14:43 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:28:37.429 10:14:43 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:28:37.691 10:14:43 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:28:37.691 10:14:43 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:28:37.691 10:14:43 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:28:37.691 10:14:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:37.691 10:14:43 -- common/autotest_common.sh@10 -- # set +x 00:28:37.691 10:14:43 -- host/discovery.sh@67 -- # sort 00:28:37.691 10:14:43 -- host/discovery.sh@67 -- # xargs 00:28:37.691 10:14:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:37.691 10:14:43 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:28:37.691 10:14:43 -- host/discovery.sh@147 -- # get_bdev_list 00:28:37.691 10:14:43 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:37.691 10:14:43 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:37.691 10:14:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:37.691 10:14:43 -- common/autotest_common.sh@10 -- # set +x 00:28:37.691 10:14:43 -- host/discovery.sh@55 -- # sort 00:28:37.691 10:14:43 -- host/discovery.sh@55 -- # xargs 00:28:37.691 10:14:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:37.691 10:14:43 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:37.691 10:14:43 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:37.691 10:14:43 -- common/autotest_common.sh@640 -- # local es=0 00:28:37.691 10:14:43 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:37.691 10:14:43 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:28:37.691 10:14:43 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:28:37.691 10:14:43 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:28:37.691 10:14:43 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:28:37.691 10:14:43 -- common/autotest_common.sh@643 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:37.691 10:14:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:37.691 10:14:43 -- common/autotest_common.sh@10 -- # set +x 00:28:37.691 request: 00:28:37.691 { 00:28:37.691 "name": "nvme_second", 00:28:37.691 "trtype": "tcp", 00:28:37.691 "traddr": "10.0.0.2", 00:28:37.691 "hostnqn": "nqn.2021-12.io.spdk:test", 00:28:37.691 "adrfam": "ipv4", 00:28:37.691 "trsvcid": "8009", 00:28:37.691 "wait_for_attach": true, 00:28:37.691 "method": "bdev_nvme_start_discovery", 00:28:37.691 "req_id": 1 00:28:37.691 } 00:28:37.691 Got JSON-RPC error response 00:28:37.691 response: 00:28:37.691 { 00:28:37.691 "code": -17, 00:28:37.691 "message": "File exists" 00:28:37.691 } 00:28:37.691 10:14:43 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:28:37.691 10:14:43 -- common/autotest_common.sh@643 -- # es=1 00:28:37.691 10:14:43 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:28:37.691 10:14:43 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:28:37.691 10:14:43 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:28:37.691 10:14:43 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:28:37.691 10:14:43 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:28:37.691 10:14:43 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:28:37.691 10:14:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:37.691 10:14:43 -- common/autotest_common.sh@10 -- # set +x 00:28:37.691 10:14:43 -- host/discovery.sh@67 -- # sort 00:28:37.691 10:14:43 -- host/discovery.sh@67 -- # xargs 00:28:37.691 10:14:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:37.691 10:14:43 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:28:37.691 10:14:43 -- host/discovery.sh@153 -- # get_bdev_list 00:28:37.691 10:14:43 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:37.691 10:14:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:37.691 10:14:43 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:37.691 10:14:43 -- common/autotest_common.sh@10 -- # set +x 00:28:37.691 10:14:43 -- host/discovery.sh@55 -- # sort 00:28:37.691 10:14:43 -- host/discovery.sh@55 -- # xargs 00:28:37.691 10:14:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:37.691 10:14:43 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:37.691 10:14:43 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:28:37.691 10:14:43 -- common/autotest_common.sh@640 -- # local es=0 00:28:37.691 10:14:43 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:28:37.691 10:14:43 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:28:37.691 10:14:43 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:28:37.691 10:14:43 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:28:37.691 10:14:43 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:28:37.691 10:14:43 -- common/autotest_common.sh@643 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:28:37.691 10:14:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:37.691 10:14:43 -- common/autotest_common.sh@10 -- # set +x 00:28:38.625 [2024-07-13 10:14:44.439073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:38.625 [2024-07-13 10:14:44.439294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:38.625 [2024-07-13 10:14:44.439327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1e12a80 with addr=10.0.0.2, port=8010 00:28:38.625 [2024-07-13 10:14:44.439365] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:28:38.625 [2024-07-13 10:14:44.439385] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:28:38.625 [2024-07-13 10:14:44.439399] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:28:40.006 [2024-07-13 10:14:45.441396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:40.006 [2024-07-13 10:14:45.441585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:40.006 [2024-07-13 10:14:45.441615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1e12a80 with addr=10.0.0.2, port=8010 00:28:40.006 [2024-07-13 10:14:45.441637] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:28:40.006 [2024-07-13 10:14:45.441653] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:28:40.006 [2024-07-13 10:14:45.441667] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:28:40.944 [2024-07-13 10:14:46.443693] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:28:40.944 request: 00:28:40.944 { 00:28:40.944 "name": "nvme_second", 00:28:40.944 "trtype": "tcp", 00:28:40.944 "traddr": "10.0.0.2", 00:28:40.944 "hostnqn": "nqn.2021-12.io.spdk:test", 00:28:40.944 "adrfam": "ipv4", 00:28:40.944 "trsvcid": "8010", 00:28:40.944 "attach_timeout_ms": 3000, 00:28:40.944 "method": "bdev_nvme_start_discovery", 00:28:40.944 "req_id": 1 00:28:40.944 } 00:28:40.944 Got JSON-RPC error response 00:28:40.944 response: 00:28:40.944 { 00:28:40.944 "code": -110, 00:28:40.944 "message": "Connection timed out" 00:28:40.944 } 00:28:40.944 10:14:46 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:28:40.944 10:14:46 -- common/autotest_common.sh@643 -- # es=1 00:28:40.944 10:14:46 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:28:40.944 10:14:46 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:28:40.944 10:14:46 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:28:40.944 10:14:46 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:28:40.944 10:14:46 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:28:40.944 10:14:46 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:28:40.944 10:14:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:40.944 10:14:46 -- common/autotest_common.sh@10 -- # set +x 00:28:40.944 10:14:46 -- host/discovery.sh@67 -- # sort 00:28:40.944 10:14:46 -- host/discovery.sh@67 -- # xargs 00:28:40.944 10:14:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:40.944 10:14:46 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:28:40.944 10:14:46 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:28:40.944 10:14:46 -- host/discovery.sh@162 -- # kill 2923638 00:28:40.944 10:14:46 -- host/discovery.sh@163 -- # nvmftestfini 00:28:40.944 10:14:46 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:40.944 10:14:46 -- nvmf/common.sh@116 -- # sync 00:28:40.944 10:14:46 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:40.944 10:14:46 -- nvmf/common.sh@119 -- # set +e 00:28:40.944 10:14:46 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:40.944 10:14:46 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:40.944 rmmod nvme_tcp 00:28:40.944 rmmod nvme_fabrics 00:28:40.944 rmmod nvme_keyring 00:28:40.944 10:14:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:40.944 10:14:46 -- nvmf/common.sh@123 -- # set -e 00:28:40.944 10:14:46 -- nvmf/common.sh@124 -- # return 0 00:28:40.944 10:14:46 -- nvmf/common.sh@477 -- # '[' -n 2923481 ']' 00:28:40.944 10:14:46 -- nvmf/common.sh@478 -- # killprocess 2923481 00:28:40.944 10:14:46 -- common/autotest_common.sh@926 -- # '[' -z 2923481 ']' 00:28:40.944 10:14:46 -- common/autotest_common.sh@930 -- # kill -0 2923481 00:28:40.944 10:14:46 -- common/autotest_common.sh@931 -- # uname 00:28:40.944 10:14:46 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:28:40.944 10:14:46 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2923481 00:28:40.944 10:14:46 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:28:40.944 10:14:46 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:28:40.944 10:14:46 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2923481' 00:28:40.944 killing process with pid 2923481 00:28:40.944 10:14:46 -- common/autotest_common.sh@945 -- # kill 2923481 00:28:40.944 10:14:46 -- common/autotest_common.sh@950 -- # wait 2923481 00:28:41.203 10:14:46 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:41.203 10:14:46 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:41.203 10:14:46 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:41.203 10:14:46 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:41.203 10:14:46 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:41.203 10:14:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:41.203 10:14:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:41.203 10:14:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:43.107 10:14:48 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:43.108 00:28:43.108 real 0m17.293s 00:28:43.108 user 0m26.793s 00:28:43.108 sys 0m2.944s 00:28:43.108 10:14:48 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:28:43.108 10:14:48 -- common/autotest_common.sh@10 -- # set +x 00:28:43.108 ************************************ 00:28:43.108 END TEST nvmf_discovery 00:28:43.108 ************************************ 00:28:43.108 10:14:48 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:28:43.108 10:14:48 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:28:43.108 10:14:48 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:28:43.108 10:14:48 -- common/autotest_common.sh@10 -- # set +x 00:28:43.108 ************************************ 00:28:43.108 START TEST nvmf_discovery_remove_ifc 00:28:43.108 ************************************ 00:28:43.108 10:14:48 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:28:43.366 * Looking for test storage... 00:28:43.366 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:43.366 10:14:48 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:43.366 10:14:48 -- nvmf/common.sh@7 -- # uname -s 00:28:43.366 10:14:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:43.366 10:14:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:43.366 10:14:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:43.366 10:14:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:43.366 10:14:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:43.366 10:14:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:43.366 10:14:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:43.366 10:14:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:43.366 10:14:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:43.366 10:14:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:43.366 10:14:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:43.366 10:14:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:43.366 10:14:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:43.366 10:14:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:43.366 10:14:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:43.366 10:14:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:43.366 10:14:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:43.366 10:14:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:43.366 10:14:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:43.367 10:14:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:43.367 10:14:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:43.367 10:14:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:43.367 10:14:48 -- paths/export.sh@5 -- # export PATH 00:28:43.367 10:14:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:43.367 10:14:48 -- nvmf/common.sh@46 -- # : 0 00:28:43.367 10:14:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:43.367 10:14:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:43.367 10:14:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:43.367 10:14:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:43.367 10:14:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:43.367 10:14:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:43.367 10:14:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:43.367 10:14:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:43.367 10:14:48 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:28:43.367 10:14:48 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:28:43.367 10:14:48 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:28:43.367 10:14:48 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:28:43.367 10:14:48 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:28:43.367 10:14:48 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:28:43.367 10:14:48 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:28:43.367 10:14:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:43.367 10:14:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:43.367 10:14:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:43.367 10:14:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:43.367 10:14:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:43.367 10:14:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:43.367 10:14:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:43.367 10:14:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:43.367 10:14:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:43.367 10:14:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:43.367 10:14:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:43.367 10:14:48 -- common/autotest_common.sh@10 -- # set +x 00:28:45.269 10:14:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:45.269 10:14:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:45.269 10:14:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:45.269 10:14:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:45.269 10:14:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:45.269 10:14:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:45.269 10:14:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:45.269 10:14:50 -- nvmf/common.sh@294 -- # net_devs=() 00:28:45.269 10:14:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:45.269 10:14:50 -- nvmf/common.sh@295 -- # e810=() 00:28:45.269 10:14:50 -- nvmf/common.sh@295 -- # local -ga e810 00:28:45.269 10:14:50 -- nvmf/common.sh@296 -- # x722=() 00:28:45.269 10:14:50 -- nvmf/common.sh@296 -- # local -ga x722 00:28:45.269 10:14:50 -- nvmf/common.sh@297 -- # mlx=() 00:28:45.269 10:14:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:45.269 10:14:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:45.269 10:14:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:45.269 10:14:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:45.269 10:14:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:45.269 10:14:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:45.269 10:14:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:45.269 10:14:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:45.269 10:14:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:45.269 10:14:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:45.269 10:14:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:45.269 10:14:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:45.269 10:14:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:45.269 10:14:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:45.269 10:14:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:45.269 10:14:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:45.269 10:14:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:45.269 10:14:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:45.269 10:14:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:45.269 10:14:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:45.269 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:45.269 10:14:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:45.269 10:14:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:45.269 10:14:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:45.269 10:14:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:45.269 10:14:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:45.269 10:14:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:45.269 10:14:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:45.269 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:45.269 10:14:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:45.269 10:14:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:45.269 10:14:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:45.269 10:14:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:45.269 10:14:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:45.269 10:14:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:45.269 10:14:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:45.269 10:14:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:45.269 10:14:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:45.269 10:14:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:45.269 10:14:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:45.269 10:14:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:45.269 10:14:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:45.269 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:45.269 10:14:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:45.269 10:14:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:45.270 10:14:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:45.270 10:14:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:45.270 10:14:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:45.270 10:14:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:45.270 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:45.270 10:14:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:45.270 10:14:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:45.270 10:14:50 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:45.270 10:14:50 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:45.270 10:14:50 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:45.270 10:14:50 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:45.270 10:14:50 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:45.270 10:14:50 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:45.270 10:14:50 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:45.270 10:14:50 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:45.270 10:14:50 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:45.270 10:14:50 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:45.270 10:14:50 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:45.270 10:14:50 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:45.270 10:14:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:45.270 10:14:50 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:45.270 10:14:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:45.270 10:14:50 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:45.270 10:14:50 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:45.270 10:14:51 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:45.270 10:14:51 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:45.270 10:14:51 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:45.270 10:14:51 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:45.528 10:14:51 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:45.528 10:14:51 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:45.528 10:14:51 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:45.528 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:45.528 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.136 ms 00:28:45.528 00:28:45.528 --- 10.0.0.2 ping statistics --- 00:28:45.528 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:45.528 rtt min/avg/max/mdev = 0.136/0.136/0.136/0.000 ms 00:28:45.528 10:14:51 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:45.528 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:45.528 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.096 ms 00:28:45.528 00:28:45.528 --- 10.0.0.1 ping statistics --- 00:28:45.528 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:45.528 rtt min/avg/max/mdev = 0.096/0.096/0.096/0.000 ms 00:28:45.528 10:14:51 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:45.528 10:14:51 -- nvmf/common.sh@410 -- # return 0 00:28:45.528 10:14:51 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:45.528 10:14:51 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:45.528 10:14:51 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:45.528 10:14:51 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:45.528 10:14:51 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:45.528 10:14:51 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:45.528 10:14:51 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:45.528 10:14:51 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:28:45.528 10:14:51 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:45.528 10:14:51 -- common/autotest_common.sh@712 -- # xtrace_disable 00:28:45.528 10:14:51 -- common/autotest_common.sh@10 -- # set +x 00:28:45.528 10:14:51 -- nvmf/common.sh@469 -- # nvmfpid=2927108 00:28:45.528 10:14:51 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:28:45.528 10:14:51 -- nvmf/common.sh@470 -- # waitforlisten 2927108 00:28:45.528 10:14:51 -- common/autotest_common.sh@819 -- # '[' -z 2927108 ']' 00:28:45.528 10:14:51 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:45.528 10:14:51 -- common/autotest_common.sh@824 -- # local max_retries=100 00:28:45.528 10:14:51 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:45.528 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:45.528 10:14:51 -- common/autotest_common.sh@828 -- # xtrace_disable 00:28:45.528 10:14:51 -- common/autotest_common.sh@10 -- # set +x 00:28:45.528 [2024-07-13 10:14:51.182360] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:28:45.528 [2024-07-13 10:14:51.182445] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:45.528 EAL: No free 2048 kB hugepages reported on node 1 00:28:45.528 [2024-07-13 10:14:51.245088] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:45.528 [2024-07-13 10:14:51.327133] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:45.528 [2024-07-13 10:14:51.327308] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:45.528 [2024-07-13 10:14:51.327326] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:45.528 [2024-07-13 10:14:51.327338] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:45.528 [2024-07-13 10:14:51.327365] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:46.465 10:14:52 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:28:46.465 10:14:52 -- common/autotest_common.sh@852 -- # return 0 00:28:46.465 10:14:52 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:46.465 10:14:52 -- common/autotest_common.sh@718 -- # xtrace_disable 00:28:46.465 10:14:52 -- common/autotest_common.sh@10 -- # set +x 00:28:46.465 10:14:52 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:46.465 10:14:52 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:28:46.465 10:14:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:46.465 10:14:52 -- common/autotest_common.sh@10 -- # set +x 00:28:46.465 [2024-07-13 10:14:52.155011] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:46.465 [2024-07-13 10:14:52.163185] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:28:46.465 null0 00:28:46.465 [2024-07-13 10:14:52.195096] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:46.465 10:14:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:46.465 10:14:52 -- host/discovery_remove_ifc.sh@59 -- # hostpid=2927263 00:28:46.465 10:14:52 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:28:46.465 10:14:52 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 2927263 /tmp/host.sock 00:28:46.465 10:14:52 -- common/autotest_common.sh@819 -- # '[' -z 2927263 ']' 00:28:46.465 10:14:52 -- common/autotest_common.sh@823 -- # local rpc_addr=/tmp/host.sock 00:28:46.465 10:14:52 -- common/autotest_common.sh@824 -- # local max_retries=100 00:28:46.465 10:14:52 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:28:46.465 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:28:46.465 10:14:52 -- common/autotest_common.sh@828 -- # xtrace_disable 00:28:46.465 10:14:52 -- common/autotest_common.sh@10 -- # set +x 00:28:46.465 [2024-07-13 10:14:52.256613] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:28:46.465 [2024-07-13 10:14:52.256679] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2927263 ] 00:28:46.723 EAL: No free 2048 kB hugepages reported on node 1 00:28:46.723 [2024-07-13 10:14:52.317144] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:46.723 [2024-07-13 10:14:52.405774] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:46.723 [2024-07-13 10:14:52.405963] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:46.723 10:14:52 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:28:46.723 10:14:52 -- common/autotest_common.sh@852 -- # return 0 00:28:46.723 10:14:52 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:46.723 10:14:52 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:28:46.723 10:14:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:46.723 10:14:52 -- common/autotest_common.sh@10 -- # set +x 00:28:46.723 10:14:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:46.723 10:14:52 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:28:46.723 10:14:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:46.723 10:14:52 -- common/autotest_common.sh@10 -- # set +x 00:28:46.981 10:14:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:46.981 10:14:52 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:28:46.981 10:14:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:46.981 10:14:52 -- common/autotest_common.sh@10 -- # set +x 00:28:47.925 [2024-07-13 10:14:53.623138] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:28:47.925 [2024-07-13 10:14:53.623195] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:28:47.925 [2024-07-13 10:14:53.623217] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:47.925 [2024-07-13 10:14:53.709488] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:28:48.214 [2024-07-13 10:14:53.773332] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:28:48.214 [2024-07-13 10:14:53.773393] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:28:48.214 [2024-07-13 10:14:53.773437] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:28:48.214 [2024-07-13 10:14:53.773462] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:28:48.214 [2024-07-13 10:14:53.773504] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:28:48.214 10:14:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:48.214 10:14:53 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:28:48.214 10:14:53 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:48.214 10:14:53 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:48.214 10:14:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:48.214 10:14:53 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:48.214 10:14:53 -- common/autotest_common.sh@10 -- # set +x 00:28:48.214 10:14:53 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:48.214 10:14:53 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:48.214 [2024-07-13 10:14:53.781120] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x1557f00 was disconnected and freed. delete nvme_qpair. 00:28:48.214 10:14:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:48.214 10:14:53 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:28:48.214 10:14:53 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:28:48.214 10:14:53 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:28:48.214 10:14:53 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:28:48.214 10:14:53 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:48.214 10:14:53 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:48.214 10:14:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:48.214 10:14:53 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:48.214 10:14:53 -- common/autotest_common.sh@10 -- # set +x 00:28:48.214 10:14:53 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:48.214 10:14:53 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:48.214 10:14:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:48.214 10:14:53 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:48.214 10:14:53 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:49.150 10:14:54 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:49.150 10:14:54 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:49.150 10:14:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:49.150 10:14:54 -- common/autotest_common.sh@10 -- # set +x 00:28:49.150 10:14:54 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:49.150 10:14:54 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:49.150 10:14:54 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:49.150 10:14:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:49.150 10:14:54 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:49.150 10:14:54 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:50.529 10:14:55 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:50.529 10:14:55 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:50.529 10:14:55 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:50.529 10:14:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:50.529 10:14:55 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:50.529 10:14:55 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:50.529 10:14:55 -- common/autotest_common.sh@10 -- # set +x 00:28:50.529 10:14:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:50.529 10:14:56 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:50.529 10:14:56 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:51.461 10:14:57 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:51.462 10:14:57 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:51.462 10:14:57 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:51.462 10:14:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:51.462 10:14:57 -- common/autotest_common.sh@10 -- # set +x 00:28:51.462 10:14:57 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:51.462 10:14:57 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:51.462 10:14:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:51.462 10:14:57 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:51.462 10:14:57 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:52.397 10:14:58 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:52.397 10:14:58 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:52.397 10:14:58 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:52.397 10:14:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:52.397 10:14:58 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:52.397 10:14:58 -- common/autotest_common.sh@10 -- # set +x 00:28:52.397 10:14:58 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:52.397 10:14:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:52.397 10:14:58 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:52.397 10:14:58 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:53.329 10:14:59 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:53.329 10:14:59 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:53.329 10:14:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:53.329 10:14:59 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:53.329 10:14:59 -- common/autotest_common.sh@10 -- # set +x 00:28:53.329 10:14:59 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:53.329 10:14:59 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:53.329 10:14:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:53.329 10:14:59 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:53.329 10:14:59 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:53.588 [2024-07-13 10:14:59.214222] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:28:53.588 [2024-07-13 10:14:59.214286] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:53.588 [2024-07-13 10:14:59.214312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:53.588 [2024-07-13 10:14:59.214331] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:53.588 [2024-07-13 10:14:59.214347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:53.588 [2024-07-13 10:14:59.214363] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:53.588 [2024-07-13 10:14:59.214378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:53.588 [2024-07-13 10:14:59.214394] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:53.588 [2024-07-13 10:14:59.214409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:53.588 [2024-07-13 10:14:59.214425] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:28:53.588 [2024-07-13 10:14:59.214440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:53.588 [2024-07-13 10:14:59.214455] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x151f150 is same with the state(5) to be set 00:28:53.588 [2024-07-13 10:14:59.224243] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x151f150 (9): Bad file descriptor 00:28:53.588 [2024-07-13 10:14:59.234292] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:54.525 10:15:00 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:54.525 10:15:00 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:54.525 10:15:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:54.525 10:15:00 -- common/autotest_common.sh@10 -- # set +x 00:28:54.525 10:15:00 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:54.525 10:15:00 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:54.525 10:15:00 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:54.525 [2024-07-13 10:15:00.253913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:28:55.898 [2024-07-13 10:15:01.277935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:28:55.898 [2024-07-13 10:15:01.278029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x151f150 with addr=10.0.0.2, port=4420 00:28:55.898 [2024-07-13 10:15:01.278059] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x151f150 is same with the state(5) to be set 00:28:55.898 [2024-07-13 10:15:01.278098] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:55.898 [2024-07-13 10:15:01.278117] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:55.898 [2024-07-13 10:15:01.278153] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:55.898 [2024-07-13 10:15:01.278185] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:28:55.898 [2024-07-13 10:15:01.278657] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x151f150 (9): Bad file descriptor 00:28:55.898 [2024-07-13 10:15:01.278702] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:55.898 [2024-07-13 10:15:01.278746] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:28:55.898 [2024-07-13 10:15:01.278799] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:55.898 [2024-07-13 10:15:01.278824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:55.898 [2024-07-13 10:15:01.278845] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:55.898 [2024-07-13 10:15:01.278862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:55.898 [2024-07-13 10:15:01.278897] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:55.898 [2024-07-13 10:15:01.278928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:55.898 [2024-07-13 10:15:01.278943] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:55.898 [2024-07-13 10:15:01.278956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:55.898 [2024-07-13 10:15:01.278971] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:28:55.898 [2024-07-13 10:15:01.278985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:55.898 [2024-07-13 10:15:01.278999] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:28:55.898 [2024-07-13 10:15:01.279103] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x151e680 (9): Bad file descriptor 00:28:55.898 [2024-07-13 10:15:01.280124] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:28:55.898 [2024-07-13 10:15:01.280147] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:28:55.898 10:15:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:55.898 10:15:01 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:55.898 10:15:01 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:56.833 10:15:02 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:56.833 10:15:02 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:56.833 10:15:02 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:56.833 10:15:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:56.833 10:15:02 -- common/autotest_common.sh@10 -- # set +x 00:28:56.833 10:15:02 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:56.833 10:15:02 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:56.833 10:15:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:56.833 10:15:02 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:28:56.833 10:15:02 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:56.833 10:15:02 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:56.833 10:15:02 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:28:56.833 10:15:02 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:56.833 10:15:02 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:56.833 10:15:02 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:56.833 10:15:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:56.833 10:15:02 -- common/autotest_common.sh@10 -- # set +x 00:28:56.833 10:15:02 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:56.833 10:15:02 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:56.833 10:15:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:56.833 10:15:02 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:28:56.833 10:15:02 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:57.767 [2024-07-13 10:15:03.339701] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:28:57.767 [2024-07-13 10:15:03.339734] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:28:57.767 [2024-07-13 10:15:03.339768] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:57.767 10:15:03 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:57.767 10:15:03 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:57.767 10:15:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:57.767 10:15:03 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:57.767 10:15:03 -- common/autotest_common.sh@10 -- # set +x 00:28:57.767 10:15:03 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:57.767 10:15:03 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:57.767 10:15:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:57.767 10:15:03 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:28:57.767 10:15:03 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:57.767 [2024-07-13 10:15:03.468173] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:28:57.767 [2024-07-13 10:15:03.528095] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:28:57.767 [2024-07-13 10:15:03.528157] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:28:57.767 [2024-07-13 10:15:03.528192] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:28:57.767 [2024-07-13 10:15:03.528213] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:28:57.767 [2024-07-13 10:15:03.528239] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:28:57.767 [2024-07-13 10:15:03.537037] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x152c4c0 was disconnected and freed. delete nvme_qpair. 00:28:58.700 10:15:04 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:58.700 10:15:04 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:58.700 10:15:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:58.700 10:15:04 -- common/autotest_common.sh@10 -- # set +x 00:28:58.700 10:15:04 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:58.700 10:15:04 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:58.700 10:15:04 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:58.700 10:15:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:58.700 10:15:04 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:28:58.700 10:15:04 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:28:58.700 10:15:04 -- host/discovery_remove_ifc.sh@90 -- # killprocess 2927263 00:28:58.700 10:15:04 -- common/autotest_common.sh@926 -- # '[' -z 2927263 ']' 00:28:58.700 10:15:04 -- common/autotest_common.sh@930 -- # kill -0 2927263 00:28:58.700 10:15:04 -- common/autotest_common.sh@931 -- # uname 00:28:58.700 10:15:04 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:28:58.700 10:15:04 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2927263 00:28:58.959 10:15:04 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:28:58.959 10:15:04 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:28:58.959 10:15:04 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2927263' 00:28:58.959 killing process with pid 2927263 00:28:58.959 10:15:04 -- common/autotest_common.sh@945 -- # kill 2927263 00:28:58.959 10:15:04 -- common/autotest_common.sh@950 -- # wait 2927263 00:28:58.959 10:15:04 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:28:58.959 10:15:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:58.959 10:15:04 -- nvmf/common.sh@116 -- # sync 00:28:58.959 10:15:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:58.959 10:15:04 -- nvmf/common.sh@119 -- # set +e 00:28:58.959 10:15:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:58.959 10:15:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:58.959 rmmod nvme_tcp 00:28:58.959 rmmod nvme_fabrics 00:28:59.218 rmmod nvme_keyring 00:28:59.218 10:15:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:59.218 10:15:04 -- nvmf/common.sh@123 -- # set -e 00:28:59.218 10:15:04 -- nvmf/common.sh@124 -- # return 0 00:28:59.218 10:15:04 -- nvmf/common.sh@477 -- # '[' -n 2927108 ']' 00:28:59.218 10:15:04 -- nvmf/common.sh@478 -- # killprocess 2927108 00:28:59.218 10:15:04 -- common/autotest_common.sh@926 -- # '[' -z 2927108 ']' 00:28:59.218 10:15:04 -- common/autotest_common.sh@930 -- # kill -0 2927108 00:28:59.218 10:15:04 -- common/autotest_common.sh@931 -- # uname 00:28:59.218 10:15:04 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:28:59.218 10:15:04 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2927108 00:28:59.218 10:15:04 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:28:59.218 10:15:04 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:28:59.218 10:15:04 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2927108' 00:28:59.218 killing process with pid 2927108 00:28:59.218 10:15:04 -- common/autotest_common.sh@945 -- # kill 2927108 00:28:59.218 10:15:04 -- common/autotest_common.sh@950 -- # wait 2927108 00:28:59.476 10:15:05 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:59.476 10:15:05 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:59.476 10:15:05 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:59.476 10:15:05 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:59.476 10:15:05 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:59.476 10:15:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:59.476 10:15:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:59.476 10:15:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:01.379 10:15:07 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:01.379 00:29:01.379 real 0m18.205s 00:29:01.379 user 0m25.151s 00:29:01.379 sys 0m3.018s 00:29:01.379 10:15:07 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:29:01.379 10:15:07 -- common/autotest_common.sh@10 -- # set +x 00:29:01.379 ************************************ 00:29:01.379 END TEST nvmf_discovery_remove_ifc 00:29:01.379 ************************************ 00:29:01.379 10:15:07 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:29:01.379 10:15:07 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:29:01.379 10:15:07 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:29:01.379 10:15:07 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:29:01.379 10:15:07 -- common/autotest_common.sh@10 -- # set +x 00:29:01.379 ************************************ 00:29:01.379 START TEST nvmf_digest 00:29:01.379 ************************************ 00:29:01.379 10:15:07 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:29:01.379 * Looking for test storage... 00:29:01.636 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:01.636 10:15:07 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:01.636 10:15:07 -- nvmf/common.sh@7 -- # uname -s 00:29:01.636 10:15:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:01.636 10:15:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:01.636 10:15:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:01.636 10:15:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:01.636 10:15:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:01.636 10:15:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:01.636 10:15:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:01.636 10:15:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:01.636 10:15:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:01.636 10:15:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:01.636 10:15:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:01.636 10:15:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:01.636 10:15:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:01.636 10:15:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:01.636 10:15:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:01.636 10:15:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:01.636 10:15:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:01.636 10:15:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:01.636 10:15:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:01.636 10:15:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:01.636 10:15:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:01.636 10:15:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:01.636 10:15:07 -- paths/export.sh@5 -- # export PATH 00:29:01.637 10:15:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:01.637 10:15:07 -- nvmf/common.sh@46 -- # : 0 00:29:01.637 10:15:07 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:01.637 10:15:07 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:01.637 10:15:07 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:01.637 10:15:07 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:01.637 10:15:07 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:01.637 10:15:07 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:01.637 10:15:07 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:01.637 10:15:07 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:01.637 10:15:07 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:29:01.637 10:15:07 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:29:01.637 10:15:07 -- host/digest.sh@16 -- # runtime=2 00:29:01.637 10:15:07 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:29:01.637 10:15:07 -- host/digest.sh@132 -- # nvmftestinit 00:29:01.637 10:15:07 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:01.637 10:15:07 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:01.637 10:15:07 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:01.637 10:15:07 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:01.637 10:15:07 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:01.637 10:15:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:01.637 10:15:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:01.637 10:15:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:01.637 10:15:07 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:01.637 10:15:07 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:01.637 10:15:07 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:01.637 10:15:07 -- common/autotest_common.sh@10 -- # set +x 00:29:03.588 10:15:09 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:03.588 10:15:09 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:03.588 10:15:09 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:03.588 10:15:09 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:03.588 10:15:09 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:03.588 10:15:09 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:03.588 10:15:09 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:03.588 10:15:09 -- nvmf/common.sh@294 -- # net_devs=() 00:29:03.588 10:15:09 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:03.588 10:15:09 -- nvmf/common.sh@295 -- # e810=() 00:29:03.588 10:15:09 -- nvmf/common.sh@295 -- # local -ga e810 00:29:03.588 10:15:09 -- nvmf/common.sh@296 -- # x722=() 00:29:03.588 10:15:09 -- nvmf/common.sh@296 -- # local -ga x722 00:29:03.588 10:15:09 -- nvmf/common.sh@297 -- # mlx=() 00:29:03.588 10:15:09 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:03.588 10:15:09 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:03.588 10:15:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:03.588 10:15:09 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:03.588 10:15:09 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:03.588 10:15:09 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:03.588 10:15:09 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:03.588 10:15:09 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:03.588 10:15:09 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:03.588 10:15:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:03.588 10:15:09 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:03.588 10:15:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:03.588 10:15:09 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:03.588 10:15:09 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:03.588 10:15:09 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:03.588 10:15:09 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:03.588 10:15:09 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:03.588 10:15:09 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:03.588 10:15:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:03.588 10:15:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:03.588 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:03.588 10:15:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:03.588 10:15:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:03.588 10:15:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:03.588 10:15:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:03.588 10:15:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:03.588 10:15:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:03.588 10:15:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:03.588 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:03.588 10:15:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:03.588 10:15:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:03.588 10:15:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:03.588 10:15:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:03.588 10:15:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:03.588 10:15:09 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:03.588 10:15:09 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:03.588 10:15:09 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:03.588 10:15:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:03.588 10:15:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:03.588 10:15:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:03.588 10:15:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:03.588 10:15:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:03.588 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:03.588 10:15:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:03.588 10:15:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:03.588 10:15:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:03.588 10:15:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:03.588 10:15:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:03.588 10:15:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:03.588 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:03.588 10:15:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:03.588 10:15:09 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:03.588 10:15:09 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:03.588 10:15:09 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:03.588 10:15:09 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:03.588 10:15:09 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:03.588 10:15:09 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:03.588 10:15:09 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:03.588 10:15:09 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:03.588 10:15:09 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:03.588 10:15:09 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:03.588 10:15:09 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:03.588 10:15:09 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:03.588 10:15:09 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:03.588 10:15:09 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:03.588 10:15:09 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:03.588 10:15:09 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:03.588 10:15:09 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:03.588 10:15:09 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:03.588 10:15:09 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:03.588 10:15:09 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:03.588 10:15:09 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:03.588 10:15:09 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:03.588 10:15:09 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:03.588 10:15:09 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:03.588 10:15:09 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:03.588 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:03.588 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.163 ms 00:29:03.588 00:29:03.588 --- 10.0.0.2 ping statistics --- 00:29:03.588 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:03.588 rtt min/avg/max/mdev = 0.163/0.163/0.163/0.000 ms 00:29:03.588 10:15:09 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:03.588 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:03.588 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.114 ms 00:29:03.588 00:29:03.588 --- 10.0.0.1 ping statistics --- 00:29:03.588 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:03.588 rtt min/avg/max/mdev = 0.114/0.114/0.114/0.000 ms 00:29:03.588 10:15:09 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:03.588 10:15:09 -- nvmf/common.sh@410 -- # return 0 00:29:03.588 10:15:09 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:03.588 10:15:09 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:03.588 10:15:09 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:03.588 10:15:09 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:03.588 10:15:09 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:03.588 10:15:09 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:03.588 10:15:09 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:03.588 10:15:09 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:29:03.588 10:15:09 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:29:03.588 10:15:09 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:29:03.588 10:15:09 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:29:03.588 10:15:09 -- common/autotest_common.sh@10 -- # set +x 00:29:03.588 ************************************ 00:29:03.588 START TEST nvmf_digest_clean 00:29:03.588 ************************************ 00:29:03.588 10:15:09 -- common/autotest_common.sh@1104 -- # run_digest 00:29:03.588 10:15:09 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:29:03.588 10:15:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:03.588 10:15:09 -- common/autotest_common.sh@712 -- # xtrace_disable 00:29:03.588 10:15:09 -- common/autotest_common.sh@10 -- # set +x 00:29:03.588 10:15:09 -- nvmf/common.sh@469 -- # nvmfpid=2931395 00:29:03.589 10:15:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:29:03.589 10:15:09 -- nvmf/common.sh@470 -- # waitforlisten 2931395 00:29:03.589 10:15:09 -- common/autotest_common.sh@819 -- # '[' -z 2931395 ']' 00:29:03.589 10:15:09 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:03.589 10:15:09 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:03.589 10:15:09 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:03.589 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:03.589 10:15:09 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:03.589 10:15:09 -- common/autotest_common.sh@10 -- # set +x 00:29:03.589 [2024-07-13 10:15:09.277507] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:29:03.589 [2024-07-13 10:15:09.277577] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:03.589 EAL: No free 2048 kB hugepages reported on node 1 00:29:03.589 [2024-07-13 10:15:09.347024] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:03.847 [2024-07-13 10:15:09.439785] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:03.847 [2024-07-13 10:15:09.439977] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:03.847 [2024-07-13 10:15:09.439997] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:03.847 [2024-07-13 10:15:09.440009] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:03.847 [2024-07-13 10:15:09.440048] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:03.847 10:15:09 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:03.847 10:15:09 -- common/autotest_common.sh@852 -- # return 0 00:29:03.847 10:15:09 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:03.847 10:15:09 -- common/autotest_common.sh@718 -- # xtrace_disable 00:29:03.847 10:15:09 -- common/autotest_common.sh@10 -- # set +x 00:29:03.847 10:15:09 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:03.847 10:15:09 -- host/digest.sh@120 -- # common_target_config 00:29:03.847 10:15:09 -- host/digest.sh@43 -- # rpc_cmd 00:29:03.847 10:15:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:03.847 10:15:09 -- common/autotest_common.sh@10 -- # set +x 00:29:03.847 null0 00:29:03.847 [2024-07-13 10:15:09.648669] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:04.165 [2024-07-13 10:15:09.672883] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:04.165 10:15:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:04.165 10:15:09 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:29:04.165 10:15:09 -- host/digest.sh@77 -- # local rw bs qd 00:29:04.165 10:15:09 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:04.165 10:15:09 -- host/digest.sh@80 -- # rw=randread 00:29:04.165 10:15:09 -- host/digest.sh@80 -- # bs=4096 00:29:04.165 10:15:09 -- host/digest.sh@80 -- # qd=128 00:29:04.165 10:15:09 -- host/digest.sh@82 -- # bperfpid=2931427 00:29:04.165 10:15:09 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:29:04.165 10:15:09 -- host/digest.sh@83 -- # waitforlisten 2931427 /var/tmp/bperf.sock 00:29:04.165 10:15:09 -- common/autotest_common.sh@819 -- # '[' -z 2931427 ']' 00:29:04.165 10:15:09 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:04.165 10:15:09 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:04.165 10:15:09 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:04.165 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:04.165 10:15:09 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:04.165 10:15:09 -- common/autotest_common.sh@10 -- # set +x 00:29:04.165 [2024-07-13 10:15:09.712049] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:29:04.165 [2024-07-13 10:15:09.712121] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2931427 ] 00:29:04.165 EAL: No free 2048 kB hugepages reported on node 1 00:29:04.165 [2024-07-13 10:15:09.772651] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:04.165 [2024-07-13 10:15:09.860115] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:04.165 10:15:09 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:04.165 10:15:09 -- common/autotest_common.sh@852 -- # return 0 00:29:04.165 10:15:09 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:04.165 10:15:09 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:04.165 10:15:09 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:04.746 10:15:10 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:04.747 10:15:10 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:05.004 nvme0n1 00:29:05.004 10:15:10 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:05.004 10:15:10 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:05.004 Running I/O for 2 seconds... 00:29:07.530 00:29:07.530 Latency(us) 00:29:07.530 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:07.530 Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:29:07.530 nvme0n1 : 2.00 14989.72 58.55 0.00 0.00 8531.59 3034.07 16893.72 00:29:07.530 =================================================================================================================== 00:29:07.530 Total : 14989.72 58.55 0.00 0.00 8531.59 3034.07 16893.72 00:29:07.530 0 00:29:07.530 10:15:12 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:07.530 10:15:12 -- host/digest.sh@92 -- # get_accel_stats 00:29:07.530 10:15:12 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:07.530 10:15:12 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:07.530 10:15:12 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:07.530 | select(.opcode=="crc32c") 00:29:07.530 | "\(.module_name) \(.executed)"' 00:29:07.530 10:15:13 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:07.530 10:15:13 -- host/digest.sh@93 -- # exp_module=software 00:29:07.530 10:15:13 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:07.530 10:15:13 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:07.530 10:15:13 -- host/digest.sh@97 -- # killprocess 2931427 00:29:07.530 10:15:13 -- common/autotest_common.sh@926 -- # '[' -z 2931427 ']' 00:29:07.530 10:15:13 -- common/autotest_common.sh@930 -- # kill -0 2931427 00:29:07.530 10:15:13 -- common/autotest_common.sh@931 -- # uname 00:29:07.530 10:15:13 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:07.530 10:15:13 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2931427 00:29:07.530 10:15:13 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:29:07.530 10:15:13 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:29:07.530 10:15:13 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2931427' 00:29:07.530 killing process with pid 2931427 00:29:07.530 10:15:13 -- common/autotest_common.sh@945 -- # kill 2931427 00:29:07.530 Received shutdown signal, test time was about 2.000000 seconds 00:29:07.530 00:29:07.530 Latency(us) 00:29:07.530 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:07.530 =================================================================================================================== 00:29:07.530 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:07.530 10:15:13 -- common/autotest_common.sh@950 -- # wait 2931427 00:29:07.530 10:15:13 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:29:07.531 10:15:13 -- host/digest.sh@77 -- # local rw bs qd 00:29:07.531 10:15:13 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:07.531 10:15:13 -- host/digest.sh@80 -- # rw=randread 00:29:07.531 10:15:13 -- host/digest.sh@80 -- # bs=131072 00:29:07.531 10:15:13 -- host/digest.sh@80 -- # qd=16 00:29:07.531 10:15:13 -- host/digest.sh@82 -- # bperfpid=2931966 00:29:07.531 10:15:13 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:29:07.531 10:15:13 -- host/digest.sh@83 -- # waitforlisten 2931966 /var/tmp/bperf.sock 00:29:07.531 10:15:13 -- common/autotest_common.sh@819 -- # '[' -z 2931966 ']' 00:29:07.531 10:15:13 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:07.531 10:15:13 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:07.531 10:15:13 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:07.531 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:07.531 10:15:13 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:07.531 10:15:13 -- common/autotest_common.sh@10 -- # set +x 00:29:07.531 [2024-07-13 10:15:13.322102] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:29:07.531 [2024-07-13 10:15:13.322192] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2931966 ] 00:29:07.531 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:07.531 Zero copy mechanism will not be used. 00:29:07.788 EAL: No free 2048 kB hugepages reported on node 1 00:29:07.788 [2024-07-13 10:15:13.380007] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:07.788 [2024-07-13 10:15:13.463438] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:07.788 10:15:13 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:07.788 10:15:13 -- common/autotest_common.sh@852 -- # return 0 00:29:07.788 10:15:13 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:07.788 10:15:13 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:07.788 10:15:13 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:08.045 10:15:13 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:08.045 10:15:13 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:08.610 nvme0n1 00:29:08.610 10:15:14 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:08.610 10:15:14 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:08.610 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:08.610 Zero copy mechanism will not be used. 00:29:08.610 Running I/O for 2 seconds... 00:29:11.138 00:29:11.138 Latency(us) 00:29:11.138 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:11.138 Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:29:11.138 nvme0n1 : 2.00 3085.84 385.73 0.00 0.00 5180.81 1468.49 8058.50 00:29:11.138 =================================================================================================================== 00:29:11.138 Total : 3085.84 385.73 0.00 0.00 5180.81 1468.49 8058.50 00:29:11.138 0 00:29:11.138 10:15:16 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:11.138 10:15:16 -- host/digest.sh@92 -- # get_accel_stats 00:29:11.138 10:15:16 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:11.138 10:15:16 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:11.138 | select(.opcode=="crc32c") 00:29:11.138 | "\(.module_name) \(.executed)"' 00:29:11.138 10:15:16 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:11.138 10:15:16 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:11.138 10:15:16 -- host/digest.sh@93 -- # exp_module=software 00:29:11.138 10:15:16 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:11.138 10:15:16 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:11.138 10:15:16 -- host/digest.sh@97 -- # killprocess 2931966 00:29:11.138 10:15:16 -- common/autotest_common.sh@926 -- # '[' -z 2931966 ']' 00:29:11.138 10:15:16 -- common/autotest_common.sh@930 -- # kill -0 2931966 00:29:11.138 10:15:16 -- common/autotest_common.sh@931 -- # uname 00:29:11.138 10:15:16 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:11.138 10:15:16 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2931966 00:29:11.138 10:15:16 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:29:11.138 10:15:16 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:29:11.138 10:15:16 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2931966' 00:29:11.138 killing process with pid 2931966 00:29:11.138 10:15:16 -- common/autotest_common.sh@945 -- # kill 2931966 00:29:11.138 Received shutdown signal, test time was about 2.000000 seconds 00:29:11.138 00:29:11.138 Latency(us) 00:29:11.138 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:11.138 =================================================================================================================== 00:29:11.138 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:11.138 10:15:16 -- common/autotest_common.sh@950 -- # wait 2931966 00:29:11.138 10:15:16 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:29:11.138 10:15:16 -- host/digest.sh@77 -- # local rw bs qd 00:29:11.138 10:15:16 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:11.138 10:15:16 -- host/digest.sh@80 -- # rw=randwrite 00:29:11.138 10:15:16 -- host/digest.sh@80 -- # bs=4096 00:29:11.138 10:15:16 -- host/digest.sh@80 -- # qd=128 00:29:11.138 10:15:16 -- host/digest.sh@82 -- # bperfpid=2932390 00:29:11.138 10:15:16 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:29:11.138 10:15:16 -- host/digest.sh@83 -- # waitforlisten 2932390 /var/tmp/bperf.sock 00:29:11.138 10:15:16 -- common/autotest_common.sh@819 -- # '[' -z 2932390 ']' 00:29:11.138 10:15:16 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:11.138 10:15:16 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:11.138 10:15:16 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:11.138 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:11.138 10:15:16 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:11.138 10:15:16 -- common/autotest_common.sh@10 -- # set +x 00:29:11.396 [2024-07-13 10:15:16.989986] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:29:11.396 [2024-07-13 10:15:16.990071] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2932390 ] 00:29:11.396 EAL: No free 2048 kB hugepages reported on node 1 00:29:11.396 [2024-07-13 10:15:17.052975] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:11.396 [2024-07-13 10:15:17.141389] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:11.396 10:15:17 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:11.396 10:15:17 -- common/autotest_common.sh@852 -- # return 0 00:29:11.396 10:15:17 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:11.396 10:15:17 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:11.396 10:15:17 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:11.959 10:15:17 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:11.959 10:15:17 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:12.216 nvme0n1 00:29:12.216 10:15:17 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:12.216 10:15:17 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:12.473 Running I/O for 2 seconds... 00:29:14.372 00:29:14.372 Latency(us) 00:29:14.372 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:14.372 Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:29:14.372 nvme0n1 : 2.01 19344.19 75.56 0.00 0.00 6603.22 4223.43 18544.26 00:29:14.372 =================================================================================================================== 00:29:14.372 Total : 19344.19 75.56 0.00 0.00 6603.22 4223.43 18544.26 00:29:14.372 0 00:29:14.372 10:15:20 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:14.372 10:15:20 -- host/digest.sh@92 -- # get_accel_stats 00:29:14.372 10:15:20 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:14.372 10:15:20 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:14.372 10:15:20 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:14.372 | select(.opcode=="crc32c") 00:29:14.372 | "\(.module_name) \(.executed)"' 00:29:14.630 10:15:20 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:14.630 10:15:20 -- host/digest.sh@93 -- # exp_module=software 00:29:14.630 10:15:20 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:14.630 10:15:20 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:14.630 10:15:20 -- host/digest.sh@97 -- # killprocess 2932390 00:29:14.630 10:15:20 -- common/autotest_common.sh@926 -- # '[' -z 2932390 ']' 00:29:14.630 10:15:20 -- common/autotest_common.sh@930 -- # kill -0 2932390 00:29:14.630 10:15:20 -- common/autotest_common.sh@931 -- # uname 00:29:14.630 10:15:20 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:14.630 10:15:20 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2932390 00:29:14.630 10:15:20 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:29:14.630 10:15:20 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:29:14.630 10:15:20 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2932390' 00:29:14.630 killing process with pid 2932390 00:29:14.630 10:15:20 -- common/autotest_common.sh@945 -- # kill 2932390 00:29:14.630 Received shutdown signal, test time was about 2.000000 seconds 00:29:14.630 00:29:14.630 Latency(us) 00:29:14.630 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:14.630 =================================================================================================================== 00:29:14.630 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:14.630 10:15:20 -- common/autotest_common.sh@950 -- # wait 2932390 00:29:14.888 10:15:20 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:29:14.888 10:15:20 -- host/digest.sh@77 -- # local rw bs qd 00:29:14.888 10:15:20 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:14.888 10:15:20 -- host/digest.sh@80 -- # rw=randwrite 00:29:14.888 10:15:20 -- host/digest.sh@80 -- # bs=131072 00:29:14.888 10:15:20 -- host/digest.sh@80 -- # qd=16 00:29:14.888 10:15:20 -- host/digest.sh@82 -- # bperfpid=2932809 00:29:14.888 10:15:20 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:29:14.888 10:15:20 -- host/digest.sh@83 -- # waitforlisten 2932809 /var/tmp/bperf.sock 00:29:14.888 10:15:20 -- common/autotest_common.sh@819 -- # '[' -z 2932809 ']' 00:29:14.888 10:15:20 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:14.888 10:15:20 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:14.888 10:15:20 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:14.888 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:14.888 10:15:20 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:14.888 10:15:20 -- common/autotest_common.sh@10 -- # set +x 00:29:14.888 [2024-07-13 10:15:20.625088] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:29:14.888 [2024-07-13 10:15:20.625180] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2932809 ] 00:29:14.888 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:14.888 Zero copy mechanism will not be used. 00:29:14.888 EAL: No free 2048 kB hugepages reported on node 1 00:29:14.888 [2024-07-13 10:15:20.690091] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:15.146 [2024-07-13 10:15:20.779967] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:15.146 10:15:20 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:15.146 10:15:20 -- common/autotest_common.sh@852 -- # return 0 00:29:15.146 10:15:20 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:15.146 10:15:20 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:15.146 10:15:20 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:15.403 10:15:21 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:15.403 10:15:21 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:15.968 nvme0n1 00:29:15.968 10:15:21 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:15.968 10:15:21 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:15.968 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:15.968 Zero copy mechanism will not be used. 00:29:15.968 Running I/O for 2 seconds... 00:29:17.863 00:29:17.863 Latency(us) 00:29:17.863 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:17.863 Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:29:17.864 nvme0n1 : 2.01 2494.79 311.85 0.00 0.00 6362.32 4029.25 14951.92 00:29:17.864 =================================================================================================================== 00:29:17.864 Total : 2494.79 311.85 0.00 0.00 6362.32 4029.25 14951.92 00:29:17.864 0 00:29:18.121 10:15:23 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:18.121 10:15:23 -- host/digest.sh@92 -- # get_accel_stats 00:29:18.121 10:15:23 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:18.121 10:15:23 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:18.121 | select(.opcode=="crc32c") 00:29:18.121 | "\(.module_name) \(.executed)"' 00:29:18.121 10:15:23 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:18.121 10:15:23 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:18.121 10:15:23 -- host/digest.sh@93 -- # exp_module=software 00:29:18.121 10:15:23 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:18.121 10:15:23 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:18.121 10:15:23 -- host/digest.sh@97 -- # killprocess 2932809 00:29:18.121 10:15:23 -- common/autotest_common.sh@926 -- # '[' -z 2932809 ']' 00:29:18.121 10:15:23 -- common/autotest_common.sh@930 -- # kill -0 2932809 00:29:18.121 10:15:23 -- common/autotest_common.sh@931 -- # uname 00:29:18.121 10:15:23 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:18.121 10:15:23 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2932809 00:29:18.379 10:15:23 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:29:18.379 10:15:23 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:29:18.379 10:15:23 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2932809' 00:29:18.379 killing process with pid 2932809 00:29:18.379 10:15:23 -- common/autotest_common.sh@945 -- # kill 2932809 00:29:18.379 Received shutdown signal, test time was about 2.000000 seconds 00:29:18.379 00:29:18.379 Latency(us) 00:29:18.379 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:18.379 =================================================================================================================== 00:29:18.379 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:18.379 10:15:23 -- common/autotest_common.sh@950 -- # wait 2932809 00:29:18.379 10:15:24 -- host/digest.sh@126 -- # killprocess 2931395 00:29:18.379 10:15:24 -- common/autotest_common.sh@926 -- # '[' -z 2931395 ']' 00:29:18.379 10:15:24 -- common/autotest_common.sh@930 -- # kill -0 2931395 00:29:18.379 10:15:24 -- common/autotest_common.sh@931 -- # uname 00:29:18.379 10:15:24 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:18.379 10:15:24 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2931395 00:29:18.638 10:15:24 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:29:18.638 10:15:24 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:29:18.638 10:15:24 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2931395' 00:29:18.638 killing process with pid 2931395 00:29:18.638 10:15:24 -- common/autotest_common.sh@945 -- # kill 2931395 00:29:18.638 10:15:24 -- common/autotest_common.sh@950 -- # wait 2931395 00:29:18.638 00:29:18.638 real 0m15.189s 00:29:18.638 user 0m27.802s 00:29:18.638 sys 0m4.210s 00:29:18.638 10:15:24 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:29:18.638 10:15:24 -- common/autotest_common.sh@10 -- # set +x 00:29:18.638 ************************************ 00:29:18.638 END TEST nvmf_digest_clean 00:29:18.638 ************************************ 00:29:18.638 10:15:24 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:29:18.638 10:15:24 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:29:18.638 10:15:24 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:29:18.638 10:15:24 -- common/autotest_common.sh@10 -- # set +x 00:29:18.638 ************************************ 00:29:18.638 START TEST nvmf_digest_error 00:29:18.638 ************************************ 00:29:18.638 10:15:24 -- common/autotest_common.sh@1104 -- # run_digest_error 00:29:18.638 10:15:24 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:29:18.638 10:15:24 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:18.638 10:15:24 -- common/autotest_common.sh@712 -- # xtrace_disable 00:29:18.638 10:15:24 -- common/autotest_common.sh@10 -- # set +x 00:29:18.638 10:15:24 -- nvmf/common.sh@469 -- # nvmfpid=2933267 00:29:18.638 10:15:24 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:29:18.638 10:15:24 -- nvmf/common.sh@470 -- # waitforlisten 2933267 00:29:18.638 10:15:24 -- common/autotest_common.sh@819 -- # '[' -z 2933267 ']' 00:29:18.638 10:15:24 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:18.638 10:15:24 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:18.638 10:15:24 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:18.638 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:18.638 10:15:24 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:18.638 10:15:24 -- common/autotest_common.sh@10 -- # set +x 00:29:18.896 [2024-07-13 10:15:24.491299] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:29:18.896 [2024-07-13 10:15:24.491376] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:18.896 EAL: No free 2048 kB hugepages reported on node 1 00:29:18.896 [2024-07-13 10:15:24.557172] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:18.896 [2024-07-13 10:15:24.638986] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:18.896 [2024-07-13 10:15:24.639150] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:18.896 [2024-07-13 10:15:24.639182] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:18.896 [2024-07-13 10:15:24.639195] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:18.896 [2024-07-13 10:15:24.639228] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:18.896 10:15:24 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:18.896 10:15:24 -- common/autotest_common.sh@852 -- # return 0 00:29:18.896 10:15:24 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:18.896 10:15:24 -- common/autotest_common.sh@718 -- # xtrace_disable 00:29:18.896 10:15:24 -- common/autotest_common.sh@10 -- # set +x 00:29:19.154 10:15:24 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:19.154 10:15:24 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:29:19.154 10:15:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:19.154 10:15:24 -- common/autotest_common.sh@10 -- # set +x 00:29:19.155 [2024-07-13 10:15:24.723823] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:29:19.155 10:15:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:19.155 10:15:24 -- host/digest.sh@104 -- # common_target_config 00:29:19.155 10:15:24 -- host/digest.sh@43 -- # rpc_cmd 00:29:19.155 10:15:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:19.155 10:15:24 -- common/autotest_common.sh@10 -- # set +x 00:29:19.155 null0 00:29:19.155 [2024-07-13 10:15:24.834670] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:19.155 [2024-07-13 10:15:24.858885] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:19.155 10:15:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:19.155 10:15:24 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:29:19.155 10:15:24 -- host/digest.sh@54 -- # local rw bs qd 00:29:19.155 10:15:24 -- host/digest.sh@56 -- # rw=randread 00:29:19.155 10:15:24 -- host/digest.sh@56 -- # bs=4096 00:29:19.155 10:15:24 -- host/digest.sh@56 -- # qd=128 00:29:19.155 10:15:24 -- host/digest.sh@58 -- # bperfpid=2933398 00:29:19.155 10:15:24 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:29:19.155 10:15:24 -- host/digest.sh@60 -- # waitforlisten 2933398 /var/tmp/bperf.sock 00:29:19.155 10:15:24 -- common/autotest_common.sh@819 -- # '[' -z 2933398 ']' 00:29:19.155 10:15:24 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:19.155 10:15:24 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:19.155 10:15:24 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:19.155 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:19.155 10:15:24 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:19.155 10:15:24 -- common/autotest_common.sh@10 -- # set +x 00:29:19.155 [2024-07-13 10:15:24.905520] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:29:19.155 [2024-07-13 10:15:24.905592] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2933398 ] 00:29:19.155 EAL: No free 2048 kB hugepages reported on node 1 00:29:19.413 [2024-07-13 10:15:24.971799] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:19.413 [2024-07-13 10:15:25.060797] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:20.374 10:15:25 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:20.374 10:15:25 -- common/autotest_common.sh@852 -- # return 0 00:29:20.374 10:15:25 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:20.374 10:15:25 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:20.374 10:15:26 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:20.374 10:15:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:20.374 10:15:26 -- common/autotest_common.sh@10 -- # set +x 00:29:20.374 10:15:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:20.374 10:15:26 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:20.374 10:15:26 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:20.950 nvme0n1 00:29:20.950 10:15:26 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:29:20.950 10:15:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:20.950 10:15:26 -- common/autotest_common.sh@10 -- # set +x 00:29:20.950 10:15:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:20.950 10:15:26 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:20.950 10:15:26 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:20.950 Running I/O for 2 seconds... 00:29:20.950 [2024-07-13 10:15:26.702603] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:20.950 [2024-07-13 10:15:26.702657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:3712 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.950 [2024-07-13 10:15:26.702679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.950 [2024-07-13 10:15:26.717984] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:20.950 [2024-07-13 10:15:26.718018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:8059 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.950 [2024-07-13 10:15:26.718036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.950 [2024-07-13 10:15:26.731698] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:20.950 [2024-07-13 10:15:26.731731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:17537 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.950 [2024-07-13 10:15:26.731748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.950 [2024-07-13 10:15:26.742553] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:20.950 [2024-07-13 10:15:26.742583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:19652 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.950 [2024-07-13 10:15:26.742614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.950 [2024-07-13 10:15:26.757454] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:20.950 [2024-07-13 10:15:26.757483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:22825 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.950 [2024-07-13 10:15:26.757514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.209 [2024-07-13 10:15:26.778978] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.209 [2024-07-13 10:15:26.779012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:10548 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.209 [2024-07-13 10:15:26.779030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.209 [2024-07-13 10:15:26.793967] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.209 [2024-07-13 10:15:26.794013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:13323 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.209 [2024-07-13 10:15:26.794030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.209 [2024-07-13 10:15:26.809079] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.209 [2024-07-13 10:15:26.809109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:9583 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.209 [2024-07-13 10:15:26.809142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.209 [2024-07-13 10:15:26.823799] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.209 [2024-07-13 10:15:26.823830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:11681 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.209 [2024-07-13 10:15:26.823847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.209 [2024-07-13 10:15:26.838881] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.209 [2024-07-13 10:15:26.838912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20981 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.209 [2024-07-13 10:15:26.838939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.209 [2024-07-13 10:15:26.853875] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.209 [2024-07-13 10:15:26.853905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:20224 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.209 [2024-07-13 10:15:26.853921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.209 [2024-07-13 10:15:26.867789] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.209 [2024-07-13 10:15:26.867820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:13396 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.209 [2024-07-13 10:15:26.867837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.209 [2024-07-13 10:15:26.878111] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.209 [2024-07-13 10:15:26.878138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:5248 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.209 [2024-07-13 10:15:26.878169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.209 [2024-07-13 10:15:26.893813] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.209 [2024-07-13 10:15:26.893848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14173 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.209 [2024-07-13 10:15:26.893877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.209 [2024-07-13 10:15:26.910344] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.209 [2024-07-13 10:15:26.910378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:17265 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.209 [2024-07-13 10:15:26.910397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.209 [2024-07-13 10:15:26.933431] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.209 [2024-07-13 10:15:26.933466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:5708 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.209 [2024-07-13 10:15:26.933484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.209 [2024-07-13 10:15:26.944546] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.209 [2024-07-13 10:15:26.944579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6857 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.209 [2024-07-13 10:15:26.944598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.209 [2024-07-13 10:15:26.960948] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.209 [2024-07-13 10:15:26.960976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:7935 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.209 [2024-07-13 10:15:26.961007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.209 [2024-07-13 10:15:26.983968] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.209 [2024-07-13 10:15:26.983996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:6872 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.209 [2024-07-13 10:15:26.984026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.209 [2024-07-13 10:15:27.000740] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.209 [2024-07-13 10:15:27.000773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:17185 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.209 [2024-07-13 10:15:27.000792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.209 [2024-07-13 10:15:27.016933] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.209 [2024-07-13 10:15:27.016963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:23538 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.209 [2024-07-13 10:15:27.016980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.467 [2024-07-13 10:15:27.034401] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.467 [2024-07-13 10:15:27.034438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:1116 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.467 [2024-07-13 10:15:27.034457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.467 [2024-07-13 10:15:27.050086] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.467 [2024-07-13 10:15:27.050118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:20517 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.467 [2024-07-13 10:15:27.050135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.467 [2024-07-13 10:15:27.061403] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.467 [2024-07-13 10:15:27.061436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:8075 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.468 [2024-07-13 10:15:27.061455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.468 [2024-07-13 10:15:27.078477] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.468 [2024-07-13 10:15:27.078511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:6114 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.468 [2024-07-13 10:15:27.078530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.468 [2024-07-13 10:15:27.095160] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.468 [2024-07-13 10:15:27.095189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:13031 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.468 [2024-07-13 10:15:27.095220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.468 [2024-07-13 10:15:27.111756] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.468 [2024-07-13 10:15:27.111790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:13749 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.468 [2024-07-13 10:15:27.111815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.468 [2024-07-13 10:15:27.128879] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.468 [2024-07-13 10:15:27.128924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:14134 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.468 [2024-07-13 10:15:27.128940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.468 [2024-07-13 10:15:27.151707] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.468 [2024-07-13 10:15:27.151742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:9453 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.468 [2024-07-13 10:15:27.151762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.468 [2024-07-13 10:15:27.167969] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.468 [2024-07-13 10:15:27.167998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:17407 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.468 [2024-07-13 10:15:27.168031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.468 [2024-07-13 10:15:27.185067] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.468 [2024-07-13 10:15:27.185097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:2901 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.468 [2024-07-13 10:15:27.185113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.468 [2024-07-13 10:15:27.201691] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.468 [2024-07-13 10:15:27.201725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:5817 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.468 [2024-07-13 10:15:27.201743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.468 [2024-07-13 10:15:27.218667] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.468 [2024-07-13 10:15:27.218701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24026 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.468 [2024-07-13 10:15:27.218720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.468 [2024-07-13 10:15:27.235853] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.468 [2024-07-13 10:15:27.235895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:22776 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.468 [2024-07-13 10:15:27.235915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.468 [2024-07-13 10:15:27.253017] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.468 [2024-07-13 10:15:27.253047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:13378 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.468 [2024-07-13 10:15:27.253064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.468 [2024-07-13 10:15:27.270074] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.468 [2024-07-13 10:15:27.270109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:23967 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.468 [2024-07-13 10:15:27.270127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.727 [2024-07-13 10:15:27.287131] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.727 [2024-07-13 10:15:27.287194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:13276 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.727 [2024-07-13 10:15:27.287227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.727 [2024-07-13 10:15:27.304427] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.727 [2024-07-13 10:15:27.304464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:1298 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.727 [2024-07-13 10:15:27.304483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.727 [2024-07-13 10:15:27.321078] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.727 [2024-07-13 10:15:27.321110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17707 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.727 [2024-07-13 10:15:27.321127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.727 [2024-07-13 10:15:27.337620] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.727 [2024-07-13 10:15:27.337654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:7265 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.727 [2024-07-13 10:15:27.337673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.727 [2024-07-13 10:15:27.354768] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.727 [2024-07-13 10:15:27.354803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:17562 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.727 [2024-07-13 10:15:27.354822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.727 [2024-07-13 10:15:27.372154] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.727 [2024-07-13 10:15:27.372200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:24446 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.727 [2024-07-13 10:15:27.372216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.727 [2024-07-13 10:15:27.388494] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.727 [2024-07-13 10:15:27.388528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:8748 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.727 [2024-07-13 10:15:27.388548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.727 [2024-07-13 10:15:27.405752] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.727 [2024-07-13 10:15:27.405786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:15977 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.727 [2024-07-13 10:15:27.405805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.727 [2024-07-13 10:15:27.422367] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.727 [2024-07-13 10:15:27.422401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:14379 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.727 [2024-07-13 10:15:27.422420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.727 [2024-07-13 10:15:27.438799] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.727 [2024-07-13 10:15:27.438833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:10592 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.727 [2024-07-13 10:15:27.438851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.727 [2024-07-13 10:15:27.455841] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.727 [2024-07-13 10:15:27.455883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:15572 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.727 [2024-07-13 10:15:27.455918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.727 [2024-07-13 10:15:27.473384] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.727 [2024-07-13 10:15:27.473416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:22544 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.727 [2024-07-13 10:15:27.473435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.727 [2024-07-13 10:15:27.489724] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.727 [2024-07-13 10:15:27.489757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:20241 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.727 [2024-07-13 10:15:27.489775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.727 [2024-07-13 10:15:27.506805] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.727 [2024-07-13 10:15:27.506839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:5062 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.727 [2024-07-13 10:15:27.506858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.727 [2024-07-13 10:15:27.523235] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.727 [2024-07-13 10:15:27.523269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:25119 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.727 [2024-07-13 10:15:27.523288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.727 [2024-07-13 10:15:27.539783] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.727 [2024-07-13 10:15:27.539820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:9375 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.727 [2024-07-13 10:15:27.539840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.985 [2024-07-13 10:15:27.557442] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.985 [2024-07-13 10:15:27.557479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:1093 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.985 [2024-07-13 10:15:27.557506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.985 [2024-07-13 10:15:27.573779] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.986 [2024-07-13 10:15:27.573813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:11701 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.986 [2024-07-13 10:15:27.573833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.986 [2024-07-13 10:15:27.590414] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.986 [2024-07-13 10:15:27.590449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:20605 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.986 [2024-07-13 10:15:27.590467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.986 [2024-07-13 10:15:27.607064] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.986 [2024-07-13 10:15:27.607091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:24657 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.986 [2024-07-13 10:15:27.607122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.986 [2024-07-13 10:15:27.623601] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.986 [2024-07-13 10:15:27.623634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:1835 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.986 [2024-07-13 10:15:27.623653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.986 [2024-07-13 10:15:27.640059] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.986 [2024-07-13 10:15:27.640087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:14876 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.986 [2024-07-13 10:15:27.640117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.986 [2024-07-13 10:15:27.656451] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.986 [2024-07-13 10:15:27.656485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:11720 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.986 [2024-07-13 10:15:27.656505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.986 [2024-07-13 10:15:27.674133] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.986 [2024-07-13 10:15:27.674177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:591 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.986 [2024-07-13 10:15:27.674196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.986 [2024-07-13 10:15:27.690258] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.986 [2024-07-13 10:15:27.690293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:24983 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.986 [2024-07-13 10:15:27.690311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.986 [2024-07-13 10:15:27.707253] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.986 [2024-07-13 10:15:27.707293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:477 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.986 [2024-07-13 10:15:27.707313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.986 [2024-07-13 10:15:27.723618] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.986 [2024-07-13 10:15:27.723652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:8528 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.986 [2024-07-13 10:15:27.723671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.986 [2024-07-13 10:15:27.740760] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.986 [2024-07-13 10:15:27.740793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:19121 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.986 [2024-07-13 10:15:27.740811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.986 [2024-07-13 10:15:27.757191] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.986 [2024-07-13 10:15:27.757225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:16849 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.986 [2024-07-13 10:15:27.757243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.986 [2024-07-13 10:15:27.773839] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.986 [2024-07-13 10:15:27.773886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:25035 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.986 [2024-07-13 10:15:27.773920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.986 [2024-07-13 10:15:27.790294] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:21.986 [2024-07-13 10:15:27.790328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:22993 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.986 [2024-07-13 10:15:27.790347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.245 [2024-07-13 10:15:27.807502] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.245 [2024-07-13 10:15:27.807538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:9345 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.245 [2024-07-13 10:15:27.807558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.245 [2024-07-13 10:15:27.824912] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.245 [2024-07-13 10:15:27.824944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:6286 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.245 [2024-07-13 10:15:27.824961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.245 [2024-07-13 10:15:27.841401] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.245 [2024-07-13 10:15:27.841436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:9381 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.245 [2024-07-13 10:15:27.841455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.245 [2024-07-13 10:15:27.858631] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.245 [2024-07-13 10:15:27.858666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:2938 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.245 [2024-07-13 10:15:27.858685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.245 [2024-07-13 10:15:27.874549] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.245 [2024-07-13 10:15:27.874584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19386 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.245 [2024-07-13 10:15:27.874603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.245 [2024-07-13 10:15:27.891414] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.245 [2024-07-13 10:15:27.891450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:25330 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.245 [2024-07-13 10:15:27.891468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.245 [2024-07-13 10:15:27.907833] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.245 [2024-07-13 10:15:27.907875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24864 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.245 [2024-07-13 10:15:27.907896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.245 [2024-07-13 10:15:27.924994] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.245 [2024-07-13 10:15:27.925024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:17896 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.245 [2024-07-13 10:15:27.925040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.245 [2024-07-13 10:15:27.941633] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.245 [2024-07-13 10:15:27.941666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:9029 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.245 [2024-07-13 10:15:27.941685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.245 [2024-07-13 10:15:27.958812] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.245 [2024-07-13 10:15:27.958847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:7316 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.245 [2024-07-13 10:15:27.958874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.245 [2024-07-13 10:15:27.975201] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.245 [2024-07-13 10:15:27.975235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:3034 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.245 [2024-07-13 10:15:27.975253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.245 [2024-07-13 10:15:27.992244] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.245 [2024-07-13 10:15:27.992277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:6695 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.245 [2024-07-13 10:15:27.992301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.245 [2024-07-13 10:15:28.009137] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.245 [2024-07-13 10:15:28.009165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:13051 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.245 [2024-07-13 10:15:28.009196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.245 [2024-07-13 10:15:28.026220] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.245 [2024-07-13 10:15:28.026266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:22904 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.245 [2024-07-13 10:15:28.026285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.245 [2024-07-13 10:15:28.042175] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.245 [2024-07-13 10:15:28.042219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:11622 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.245 [2024-07-13 10:15:28.042238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.245 [2024-07-13 10:15:28.058713] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.245 [2024-07-13 10:15:28.058749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:7351 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.245 [2024-07-13 10:15:28.058769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.505 [2024-07-13 10:15:28.075436] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.505 [2024-07-13 10:15:28.075473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6565 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.505 [2024-07-13 10:15:28.075493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.505 [2024-07-13 10:15:28.092702] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.505 [2024-07-13 10:15:28.092737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:14358 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.505 [2024-07-13 10:15:28.092756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.505 [2024-07-13 10:15:28.109530] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.505 [2024-07-13 10:15:28.109565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:18500 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.505 [2024-07-13 10:15:28.109583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.505 [2024-07-13 10:15:28.126123] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.505 [2024-07-13 10:15:28.126151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:17284 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.505 [2024-07-13 10:15:28.126183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.505 [2024-07-13 10:15:28.143461] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.505 [2024-07-13 10:15:28.143495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:19198 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.505 [2024-07-13 10:15:28.143514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.505 [2024-07-13 10:15:28.160548] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.505 [2024-07-13 10:15:28.160583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:849 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.505 [2024-07-13 10:15:28.160602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.505 [2024-07-13 10:15:28.177609] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.505 [2024-07-13 10:15:28.177642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:3817 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.505 [2024-07-13 10:15:28.177660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.505 [2024-07-13 10:15:28.193882] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.505 [2024-07-13 10:15:28.193929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:4075 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.505 [2024-07-13 10:15:28.193944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.505 [2024-07-13 10:15:28.210557] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.505 [2024-07-13 10:15:28.210591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:13742 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.505 [2024-07-13 10:15:28.210609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.505 [2024-07-13 10:15:28.227268] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.505 [2024-07-13 10:15:28.227302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2177 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.505 [2024-07-13 10:15:28.227320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.505 [2024-07-13 10:15:28.243877] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.505 [2024-07-13 10:15:28.243923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:17843 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.505 [2024-07-13 10:15:28.243938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.505 [2024-07-13 10:15:28.260554] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.505 [2024-07-13 10:15:28.260588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:7355 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.505 [2024-07-13 10:15:28.260608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.505 [2024-07-13 10:15:28.277126] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.505 [2024-07-13 10:15:28.277173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:9550 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.505 [2024-07-13 10:15:28.277197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.505 [2024-07-13 10:15:28.294494] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.505 [2024-07-13 10:15:28.294528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:22889 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.505 [2024-07-13 10:15:28.294548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.505 [2024-07-13 10:15:28.311016] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.505 [2024-07-13 10:15:28.311048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:21749 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.505 [2024-07-13 10:15:28.311065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.765 [2024-07-13 10:15:28.327825] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.765 [2024-07-13 10:15:28.327861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:13359 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.765 [2024-07-13 10:15:28.327894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.765 [2024-07-13 10:15:28.344215] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.765 [2024-07-13 10:15:28.344250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:18538 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.765 [2024-07-13 10:15:28.344269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.765 [2024-07-13 10:15:28.361137] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.765 [2024-07-13 10:15:28.361185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:14911 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.765 [2024-07-13 10:15:28.361204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.765 [2024-07-13 10:15:28.378089] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.765 [2024-07-13 10:15:28.378117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:9970 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.765 [2024-07-13 10:15:28.378147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.765 [2024-07-13 10:15:28.395439] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.765 [2024-07-13 10:15:28.395472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:6649 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.765 [2024-07-13 10:15:28.395491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.765 [2024-07-13 10:15:28.411892] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.765 [2024-07-13 10:15:28.411934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:22139 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.765 [2024-07-13 10:15:28.411950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.765 [2024-07-13 10:15:28.428997] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.765 [2024-07-13 10:15:28.429029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:11177 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.765 [2024-07-13 10:15:28.429061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.765 [2024-07-13 10:15:28.445491] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.765 [2024-07-13 10:15:28.445526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:25048 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.765 [2024-07-13 10:15:28.445544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.765 [2024-07-13 10:15:28.462935] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.765 [2024-07-13 10:15:28.462965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:24882 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.765 [2024-07-13 10:15:28.462982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.765 [2024-07-13 10:15:28.479555] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.765 [2024-07-13 10:15:28.479588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:25064 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.765 [2024-07-13 10:15:28.479607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.765 [2024-07-13 10:15:28.496109] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.765 [2024-07-13 10:15:28.496155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:6333 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.765 [2024-07-13 10:15:28.496174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.765 [2024-07-13 10:15:28.512687] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.765 [2024-07-13 10:15:28.512720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25035 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.765 [2024-07-13 10:15:28.512738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.765 [2024-07-13 10:15:28.529304] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.765 [2024-07-13 10:15:28.529337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:22121 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.765 [2024-07-13 10:15:28.529355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.765 [2024-07-13 10:15:28.545438] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.765 [2024-07-13 10:15:28.545472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:25100 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.765 [2024-07-13 10:15:28.545491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.765 [2024-07-13 10:15:28.562103] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.765 [2024-07-13 10:15:28.562132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:6399 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.765 [2024-07-13 10:15:28.562176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:22.765 [2024-07-13 10:15:28.578831] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:22.765 [2024-07-13 10:15:28.578875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:1756 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:22.765 [2024-07-13 10:15:28.578911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:23.024 [2024-07-13 10:15:28.595370] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:23.024 [2024-07-13 10:15:28.595407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:23965 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.024 [2024-07-13 10:15:28.595427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:23.024 [2024-07-13 10:15:28.613057] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:23.024 [2024-07-13 10:15:28.613087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:17714 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.024 [2024-07-13 10:15:28.613119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:23.024 [2024-07-13 10:15:28.630368] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:23.024 [2024-07-13 10:15:28.630402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:12903 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.024 [2024-07-13 10:15:28.630422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:23.024 [2024-07-13 10:15:28.647285] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:23.024 [2024-07-13 10:15:28.647319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:23307 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.024 [2024-07-13 10:15:28.647338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:23.024 [2024-07-13 10:15:28.663088] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:23.024 [2024-07-13 10:15:28.663116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:17465 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.024 [2024-07-13 10:15:28.663147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:23.024 [2024-07-13 10:15:28.679979] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x848e80) 00:29:23.024 [2024-07-13 10:15:28.680007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:5778 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:23.024 [2024-07-13 10:15:28.680038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:23.024 00:29:23.024 Latency(us) 00:29:23.024 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:23.024 Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:29:23.024 nvme0n1 : 2.00 15315.45 59.83 0.00 0.00 8348.67 2682.12 24855.13 00:29:23.024 =================================================================================================================== 00:29:23.024 Total : 15315.45 59.83 0.00 0.00 8348.67 2682.12 24855.13 00:29:23.024 0 00:29:23.024 10:15:28 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:23.024 10:15:28 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:23.024 10:15:28 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:23.024 10:15:28 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:23.024 | .driver_specific 00:29:23.024 | .nvme_error 00:29:23.024 | .status_code 00:29:23.024 | .command_transient_transport_error' 00:29:23.283 10:15:28 -- host/digest.sh@71 -- # (( 120 > 0 )) 00:29:23.283 10:15:28 -- host/digest.sh@73 -- # killprocess 2933398 00:29:23.283 10:15:28 -- common/autotest_common.sh@926 -- # '[' -z 2933398 ']' 00:29:23.283 10:15:28 -- common/autotest_common.sh@930 -- # kill -0 2933398 00:29:23.283 10:15:28 -- common/autotest_common.sh@931 -- # uname 00:29:23.283 10:15:28 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:23.283 10:15:28 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2933398 00:29:23.283 10:15:28 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:29:23.283 10:15:28 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:29:23.283 10:15:28 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2933398' 00:29:23.283 killing process with pid 2933398 00:29:23.283 10:15:28 -- common/autotest_common.sh@945 -- # kill 2933398 00:29:23.283 Received shutdown signal, test time was about 2.000000 seconds 00:29:23.283 00:29:23.283 Latency(us) 00:29:23.283 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:23.283 =================================================================================================================== 00:29:23.283 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:23.283 10:15:28 -- common/autotest_common.sh@950 -- # wait 2933398 00:29:23.541 10:15:29 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:29:23.541 10:15:29 -- host/digest.sh@54 -- # local rw bs qd 00:29:23.541 10:15:29 -- host/digest.sh@56 -- # rw=randread 00:29:23.541 10:15:29 -- host/digest.sh@56 -- # bs=131072 00:29:23.541 10:15:29 -- host/digest.sh@56 -- # qd=16 00:29:23.541 10:15:29 -- host/digest.sh@58 -- # bperfpid=2933952 00:29:23.541 10:15:29 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:29:23.541 10:15:29 -- host/digest.sh@60 -- # waitforlisten 2933952 /var/tmp/bperf.sock 00:29:23.541 10:15:29 -- common/autotest_common.sh@819 -- # '[' -z 2933952 ']' 00:29:23.541 10:15:29 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:23.541 10:15:29 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:23.541 10:15:29 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:23.541 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:23.541 10:15:29 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:23.541 10:15:29 -- common/autotest_common.sh@10 -- # set +x 00:29:23.541 [2024-07-13 10:15:29.223102] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:29:23.541 [2024-07-13 10:15:29.223183] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2933952 ] 00:29:23.541 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:23.541 Zero copy mechanism will not be used. 00:29:23.541 EAL: No free 2048 kB hugepages reported on node 1 00:29:23.541 [2024-07-13 10:15:29.284890] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:23.799 [2024-07-13 10:15:29.372070] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:24.366 10:15:30 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:24.366 10:15:30 -- common/autotest_common.sh@852 -- # return 0 00:29:24.366 10:15:30 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:24.366 10:15:30 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:24.624 10:15:30 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:24.624 10:15:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:24.624 10:15:30 -- common/autotest_common.sh@10 -- # set +x 00:29:24.624 10:15:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:24.624 10:15:30 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:24.624 10:15:30 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:24.882 nvme0n1 00:29:25.140 10:15:30 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:29:25.141 10:15:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:25.141 10:15:30 -- common/autotest_common.sh@10 -- # set +x 00:29:25.141 10:15:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:25.141 10:15:30 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:25.141 10:15:30 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:25.141 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:25.141 Zero copy mechanism will not be used. 00:29:25.141 Running I/O for 2 seconds... 00:29:25.141 [2024-07-13 10:15:30.821445] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.141 [2024-07-13 10:15:30.821503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.141 [2024-07-13 10:15:30.821528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:25.141 [2024-07-13 10:15:30.831461] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.141 [2024-07-13 10:15:30.831497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.141 [2024-07-13 10:15:30.831516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:25.141 [2024-07-13 10:15:30.841297] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.141 [2024-07-13 10:15:30.841330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.141 [2024-07-13 10:15:30.841349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:25.141 [2024-07-13 10:15:30.851152] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.141 [2024-07-13 10:15:30.851202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.141 [2024-07-13 10:15:30.851219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:25.141 [2024-07-13 10:15:30.860753] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.141 [2024-07-13 10:15:30.860787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.141 [2024-07-13 10:15:30.860806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:25.141 [2024-07-13 10:15:30.870758] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.141 [2024-07-13 10:15:30.870790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.141 [2024-07-13 10:15:30.870810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:25.141 [2024-07-13 10:15:30.880401] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.141 [2024-07-13 10:15:30.880446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.141 [2024-07-13 10:15:30.880466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:25.141 [2024-07-13 10:15:30.890226] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.141 [2024-07-13 10:15:30.890272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.141 [2024-07-13 10:15:30.890291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:25.141 [2024-07-13 10:15:30.900151] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.141 [2024-07-13 10:15:30.900196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.141 [2024-07-13 10:15:30.900214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:25.141 [2024-07-13 10:15:30.910590] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.141 [2024-07-13 10:15:30.910623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.141 [2024-07-13 10:15:30.910643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:25.141 [2024-07-13 10:15:30.920355] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.141 [2024-07-13 10:15:30.920387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.141 [2024-07-13 10:15:30.920405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:25.141 [2024-07-13 10:15:30.929985] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.141 [2024-07-13 10:15:30.930014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.141 [2024-07-13 10:15:30.930045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:25.141 [2024-07-13 10:15:30.939932] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.141 [2024-07-13 10:15:30.939961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.141 [2024-07-13 10:15:30.939978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:25.141 [2024-07-13 10:15:30.949482] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.141 [2024-07-13 10:15:30.949515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.141 [2024-07-13 10:15:30.949533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:25.400 [2024-07-13 10:15:30.959183] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.400 [2024-07-13 10:15:30.959230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.400 [2024-07-13 10:15:30.959248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:25.400 [2024-07-13 10:15:30.968957] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.400 [2024-07-13 10:15:30.968987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.400 [2024-07-13 10:15:30.969019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:25.400 [2024-07-13 10:15:30.978465] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.400 [2024-07-13 10:15:30.978498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.400 [2024-07-13 10:15:30.978517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:25.400 [2024-07-13 10:15:30.988709] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.400 [2024-07-13 10:15:30.988743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.401 [2024-07-13 10:15:30.988762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:25.401 [2024-07-13 10:15:30.998344] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.401 [2024-07-13 10:15:30.998377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.401 [2024-07-13 10:15:30.998396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:25.401 [2024-07-13 10:15:31.008043] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.401 [2024-07-13 10:15:31.008072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.401 [2024-07-13 10:15:31.008088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:25.401 [2024-07-13 10:15:31.018417] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.401 [2024-07-13 10:15:31.018451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.401 [2024-07-13 10:15:31.018470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:25.401 [2024-07-13 10:15:31.028313] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.401 [2024-07-13 10:15:31.028347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.401 [2024-07-13 10:15:31.028365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:25.401 [2024-07-13 10:15:31.038049] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.401 [2024-07-13 10:15:31.038077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.401 [2024-07-13 10:15:31.038108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:25.401 [2024-07-13 10:15:31.047658] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.401 [2024-07-13 10:15:31.047695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.401 [2024-07-13 10:15:31.047715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:25.401 [2024-07-13 10:15:31.057344] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.401 [2024-07-13 10:15:31.057376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.401 [2024-07-13 10:15:31.057394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:25.401 [2024-07-13 10:15:31.067017] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.401 [2024-07-13 10:15:31.067044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.401 [2024-07-13 10:15:31.067075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:25.401 [2024-07-13 10:15:31.076501] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.401 [2024-07-13 10:15:31.076532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.401 [2024-07-13 10:15:31.076551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:25.401 [2024-07-13 10:15:31.086311] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.401 [2024-07-13 10:15:31.086343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.401 [2024-07-13 10:15:31.086361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:25.401 [2024-07-13 10:15:31.096002] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.401 [2024-07-13 10:15:31.096032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.401 [2024-07-13 10:15:31.096049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:25.401 [2024-07-13 10:15:31.105936] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.401 [2024-07-13 10:15:31.105963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.401 [2024-07-13 10:15:31.105994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:25.401 [2024-07-13 10:15:31.115608] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.401 [2024-07-13 10:15:31.115639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.401 [2024-07-13 10:15:31.115657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:25.401 [2024-07-13 10:15:31.125248] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.401 [2024-07-13 10:15:31.125279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.401 [2024-07-13 10:15:31.125298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:25.401 [2024-07-13 10:15:31.135266] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.401 [2024-07-13 10:15:31.135298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.401 [2024-07-13 10:15:31.135316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:25.401 [2024-07-13 10:15:31.144854] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.401 [2024-07-13 10:15:31.144911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.401 [2024-07-13 10:15:31.144929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:25.401 [2024-07-13 10:15:31.154533] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.401 [2024-07-13 10:15:31.154566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.401 [2024-07-13 10:15:31.154584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:25.401 [2024-07-13 10:15:31.164255] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.401 [2024-07-13 10:15:31.164286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.401 [2024-07-13 10:15:31.164304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:25.401 [2024-07-13 10:15:31.174376] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.401 [2024-07-13 10:15:31.174409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.401 [2024-07-13 10:15:31.174427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:25.401 [2024-07-13 10:15:31.184133] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.401 [2024-07-13 10:15:31.184178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.401 [2024-07-13 10:15:31.184197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:25.401 [2024-07-13 10:15:31.193844] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.401 [2024-07-13 10:15:31.193887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.401 [2024-07-13 10:15:31.193921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:25.401 [2024-07-13 10:15:31.203488] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.401 [2024-07-13 10:15:31.203520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.401 [2024-07-13 10:15:31.203539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:25.401 [2024-07-13 10:15:31.213274] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.401 [2024-07-13 10:15:31.213310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.401 [2024-07-13 10:15:31.213339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:25.660 [2024-07-13 10:15:31.223107] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.660 [2024-07-13 10:15:31.223138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.660 [2024-07-13 10:15:31.223175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:25.660 [2024-07-13 10:15:31.233556] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.660 [2024-07-13 10:15:31.233591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.660 [2024-07-13 10:15:31.233610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:25.660 [2024-07-13 10:15:31.243368] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.660 [2024-07-13 10:15:31.243401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.660 [2024-07-13 10:15:31.243420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:25.660 [2024-07-13 10:15:31.253056] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.661 [2024-07-13 10:15:31.253085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.661 [2024-07-13 10:15:31.253117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:25.661 [2024-07-13 10:15:31.262611] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.661 [2024-07-13 10:15:31.262644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.661 [2024-07-13 10:15:31.262671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:25.661 [2024-07-13 10:15:31.272361] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.661 [2024-07-13 10:15:31.272394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.661 [2024-07-13 10:15:31.272413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:25.661 [2024-07-13 10:15:31.282050] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.661 [2024-07-13 10:15:31.282077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.661 [2024-07-13 10:15:31.282108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:25.661 [2024-07-13 10:15:31.291722] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.661 [2024-07-13 10:15:31.291754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.661 [2024-07-13 10:15:31.291772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:25.661 [2024-07-13 10:15:31.301472] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.661 [2024-07-13 10:15:31.301509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.661 [2024-07-13 10:15:31.301528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:25.661 [2024-07-13 10:15:31.311126] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.661 [2024-07-13 10:15:31.311155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.661 [2024-07-13 10:15:31.311170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:25.661 [2024-07-13 10:15:31.321325] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.661 [2024-07-13 10:15:31.321359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.661 [2024-07-13 10:15:31.321378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:25.661 [2024-07-13 10:15:31.331172] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.661 [2024-07-13 10:15:31.331213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.661 [2024-07-13 10:15:31.331229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:25.661 [2024-07-13 10:15:31.340788] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.661 [2024-07-13 10:15:31.340820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.661 [2024-07-13 10:15:31.340839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:25.661 [2024-07-13 10:15:31.350594] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.661 [2024-07-13 10:15:31.350626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.661 [2024-07-13 10:15:31.350653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:25.661 [2024-07-13 10:15:31.360337] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.661 [2024-07-13 10:15:31.360369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.661 [2024-07-13 10:15:31.360386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:25.661 [2024-07-13 10:15:31.370053] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.661 [2024-07-13 10:15:31.370080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.661 [2024-07-13 10:15:31.370110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:25.661 [2024-07-13 10:15:31.379584] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.661 [2024-07-13 10:15:31.379616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.661 [2024-07-13 10:15:31.379634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:25.661 [2024-07-13 10:15:31.389820] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.661 [2024-07-13 10:15:31.389854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.661 [2024-07-13 10:15:31.389883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:25.661 [2024-07-13 10:15:31.399410] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.661 [2024-07-13 10:15:31.399443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.661 [2024-07-13 10:15:31.399462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:25.661 [2024-07-13 10:15:31.408957] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.661 [2024-07-13 10:15:31.408984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.661 [2024-07-13 10:15:31.409016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:25.661 [2024-07-13 10:15:31.418522] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.661 [2024-07-13 10:15:31.418553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.661 [2024-07-13 10:15:31.418571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:25.661 [2024-07-13 10:15:31.428108] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.661 [2024-07-13 10:15:31.428135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.661 [2024-07-13 10:15:31.428150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:25.661 [2024-07-13 10:15:31.437840] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.661 [2024-07-13 10:15:31.437880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.661 [2024-07-13 10:15:31.437901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:25.661 [2024-07-13 10:15:31.447504] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.661 [2024-07-13 10:15:31.447536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.661 [2024-07-13 10:15:31.447554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:25.661 [2024-07-13 10:15:31.457283] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.661 [2024-07-13 10:15:31.457315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.661 [2024-07-13 10:15:31.457333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:25.661 [2024-07-13 10:15:31.466921] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.661 [2024-07-13 10:15:31.466968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.661 [2024-07-13 10:15:31.466984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:25.661 [2024-07-13 10:15:31.476779] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.661 [2024-07-13 10:15:31.476825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.661 [2024-07-13 10:15:31.476853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:25.920 [2024-07-13 10:15:31.486468] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.920 [2024-07-13 10:15:31.486503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.921 [2024-07-13 10:15:31.486523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:25.921 [2024-07-13 10:15:31.496116] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.921 [2024-07-13 10:15:31.496144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.921 [2024-07-13 10:15:31.496175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:25.921 [2024-07-13 10:15:31.505946] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.921 [2024-07-13 10:15:31.505974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.921 [2024-07-13 10:15:31.506006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:25.921 [2024-07-13 10:15:31.515534] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.921 [2024-07-13 10:15:31.515565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.921 [2024-07-13 10:15:31.515583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:25.921 [2024-07-13 10:15:31.525251] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.921 [2024-07-13 10:15:31.525284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.921 [2024-07-13 10:15:31.525303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:25.921 [2024-07-13 10:15:31.535083] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.921 [2024-07-13 10:15:31.535110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.921 [2024-07-13 10:15:31.535141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:25.921 [2024-07-13 10:15:31.545432] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.921 [2024-07-13 10:15:31.545464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.921 [2024-07-13 10:15:31.545483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:25.921 [2024-07-13 10:15:31.555205] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.921 [2024-07-13 10:15:31.555237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.921 [2024-07-13 10:15:31.555256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:25.921 [2024-07-13 10:15:31.565368] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.921 [2024-07-13 10:15:31.565400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.921 [2024-07-13 10:15:31.565419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:25.921 [2024-07-13 10:15:31.574917] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.921 [2024-07-13 10:15:31.574945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.921 [2024-07-13 10:15:31.574961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:25.921 [2024-07-13 10:15:31.584501] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.921 [2024-07-13 10:15:31.584532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.921 [2024-07-13 10:15:31.584550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:25.921 [2024-07-13 10:15:31.594046] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.921 [2024-07-13 10:15:31.594073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.921 [2024-07-13 10:15:31.594103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:25.921 [2024-07-13 10:15:31.604211] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.921 [2024-07-13 10:15:31.604243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.921 [2024-07-13 10:15:31.604261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:25.921 [2024-07-13 10:15:31.613978] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.921 [2024-07-13 10:15:31.614005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.921 [2024-07-13 10:15:31.614036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:25.921 [2024-07-13 10:15:31.623469] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.921 [2024-07-13 10:15:31.623501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.921 [2024-07-13 10:15:31.623520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:25.921 [2024-07-13 10:15:31.633244] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.921 [2024-07-13 10:15:31.633277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.921 [2024-07-13 10:15:31.633300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:25.921 [2024-07-13 10:15:31.643631] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.921 [2024-07-13 10:15:31.643664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.921 [2024-07-13 10:15:31.643683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:25.921 [2024-07-13 10:15:31.653406] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.921 [2024-07-13 10:15:31.653438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.921 [2024-07-13 10:15:31.653456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:25.921 [2024-07-13 10:15:31.662711] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.921 [2024-07-13 10:15:31.662744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.921 [2024-07-13 10:15:31.662764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:25.921 [2024-07-13 10:15:31.672495] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.921 [2024-07-13 10:15:31.672527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.921 [2024-07-13 10:15:31.672545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:25.921 [2024-07-13 10:15:31.682065] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.921 [2024-07-13 10:15:31.682093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.921 [2024-07-13 10:15:31.682126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:25.921 [2024-07-13 10:15:31.691562] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.921 [2024-07-13 10:15:31.691593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.921 [2024-07-13 10:15:31.691611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:25.921 [2024-07-13 10:15:31.701319] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.921 [2024-07-13 10:15:31.701351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.921 [2024-07-13 10:15:31.701369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:25.921 [2024-07-13 10:15:31.711129] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.921 [2024-07-13 10:15:31.711169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.921 [2024-07-13 10:15:31.711185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:25.921 [2024-07-13 10:15:31.721087] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.921 [2024-07-13 10:15:31.721120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.921 [2024-07-13 10:15:31.721152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:25.921 [2024-07-13 10:15:31.730938] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:25.921 [2024-07-13 10:15:31.730965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:25.921 [2024-07-13 10:15:31.730996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.181 [2024-07-13 10:15:31.740636] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.181 [2024-07-13 10:15:31.740682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.181 [2024-07-13 10:15:31.740714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.181 [2024-07-13 10:15:31.750489] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.181 [2024-07-13 10:15:31.750524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.181 [2024-07-13 10:15:31.750543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.181 [2024-07-13 10:15:31.760155] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.181 [2024-07-13 10:15:31.760184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.181 [2024-07-13 10:15:31.760217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.181 [2024-07-13 10:15:31.770121] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.181 [2024-07-13 10:15:31.770148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.181 [2024-07-13 10:15:31.770179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.181 [2024-07-13 10:15:31.780298] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.181 [2024-07-13 10:15:31.780331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.181 [2024-07-13 10:15:31.780350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.181 [2024-07-13 10:15:31.790002] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.181 [2024-07-13 10:15:31.790030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.181 [2024-07-13 10:15:31.790063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.181 [2024-07-13 10:15:31.799506] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.181 [2024-07-13 10:15:31.799538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.181 [2024-07-13 10:15:31.799561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.181 [2024-07-13 10:15:31.809180] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.181 [2024-07-13 10:15:31.809212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.181 [2024-07-13 10:15:31.809230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.181 [2024-07-13 10:15:31.819397] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.181 [2024-07-13 10:15:31.819430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.181 [2024-07-13 10:15:31.819449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.181 [2024-07-13 10:15:31.828990] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.181 [2024-07-13 10:15:31.829019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.181 [2024-07-13 10:15:31.829051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.181 [2024-07-13 10:15:31.838727] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.181 [2024-07-13 10:15:31.838760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.181 [2024-07-13 10:15:31.838778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.181 [2024-07-13 10:15:31.848270] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.181 [2024-07-13 10:15:31.848302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.181 [2024-07-13 10:15:31.848320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.181 [2024-07-13 10:15:31.858025] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.181 [2024-07-13 10:15:31.858053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.181 [2024-07-13 10:15:31.858085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.181 [2024-07-13 10:15:31.867734] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.181 [2024-07-13 10:15:31.867765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.181 [2024-07-13 10:15:31.867783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.181 [2024-07-13 10:15:31.877489] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.181 [2024-07-13 10:15:31.877520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.181 [2024-07-13 10:15:31.877539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.181 [2024-07-13 10:15:31.887376] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.181 [2024-07-13 10:15:31.887415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.181 [2024-07-13 10:15:31.887434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.181 [2024-07-13 10:15:31.897049] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.181 [2024-07-13 10:15:31.897090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.181 [2024-07-13 10:15:31.897106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.181 [2024-07-13 10:15:31.907070] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.181 [2024-07-13 10:15:31.907098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.181 [2024-07-13 10:15:31.907129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.181 [2024-07-13 10:15:31.916661] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.181 [2024-07-13 10:15:31.916694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.181 [2024-07-13 10:15:31.916712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.181 [2024-07-13 10:15:31.926931] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.181 [2024-07-13 10:15:31.926959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.181 [2024-07-13 10:15:31.926990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.181 [2024-07-13 10:15:31.936404] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.181 [2024-07-13 10:15:31.936437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.181 [2024-07-13 10:15:31.936456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.181 [2024-07-13 10:15:31.946710] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.181 [2024-07-13 10:15:31.946742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.181 [2024-07-13 10:15:31.946760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.181 [2024-07-13 10:15:31.956454] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.181 [2024-07-13 10:15:31.956487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.181 [2024-07-13 10:15:31.956505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.181 [2024-07-13 10:15:31.966129] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.181 [2024-07-13 10:15:31.966173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.182 [2024-07-13 10:15:31.966189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.182 [2024-07-13 10:15:31.975813] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.182 [2024-07-13 10:15:31.975845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.182 [2024-07-13 10:15:31.975863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.182 [2024-07-13 10:15:31.985386] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.182 [2024-07-13 10:15:31.985417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.182 [2024-07-13 10:15:31.985435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.182 [2024-07-13 10:15:31.995229] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.182 [2024-07-13 10:15:31.995264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.182 [2024-07-13 10:15:31.995284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.441 [2024-07-13 10:15:32.005271] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.441 [2024-07-13 10:15:32.005307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.441 [2024-07-13 10:15:32.005337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.441 [2024-07-13 10:15:32.015105] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.441 [2024-07-13 10:15:32.015134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.441 [2024-07-13 10:15:32.015165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.441 [2024-07-13 10:15:32.024701] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.441 [2024-07-13 10:15:32.024734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.441 [2024-07-13 10:15:32.024753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.441 [2024-07-13 10:15:32.034587] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.441 [2024-07-13 10:15:32.034619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.441 [2024-07-13 10:15:32.034637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.441 [2024-07-13 10:15:32.044275] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.441 [2024-07-13 10:15:32.044307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.441 [2024-07-13 10:15:32.044325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.441 [2024-07-13 10:15:32.054307] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.441 [2024-07-13 10:15:32.054340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.441 [2024-07-13 10:15:32.054364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.441 [2024-07-13 10:15:32.064193] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.441 [2024-07-13 10:15:32.064237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.441 [2024-07-13 10:15:32.064256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.441 [2024-07-13 10:15:32.074064] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.441 [2024-07-13 10:15:32.074092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.441 [2024-07-13 10:15:32.074123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.441 [2024-07-13 10:15:32.084256] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.441 [2024-07-13 10:15:32.084289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.441 [2024-07-13 10:15:32.084307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.441 [2024-07-13 10:15:32.094120] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.441 [2024-07-13 10:15:32.094147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.441 [2024-07-13 10:15:32.094179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.441 [2024-07-13 10:15:32.103552] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.441 [2024-07-13 10:15:32.103584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.441 [2024-07-13 10:15:32.103602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.441 [2024-07-13 10:15:32.113562] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.441 [2024-07-13 10:15:32.113595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.441 [2024-07-13 10:15:32.113614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.441 [2024-07-13 10:15:32.123307] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.441 [2024-07-13 10:15:32.123339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.441 [2024-07-13 10:15:32.123357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.441 [2024-07-13 10:15:32.132914] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.441 [2024-07-13 10:15:32.132941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.441 [2024-07-13 10:15:32.132971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.441 [2024-07-13 10:15:32.142406] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.441 [2024-07-13 10:15:32.142438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.441 [2024-07-13 10:15:32.142456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.441 [2024-07-13 10:15:32.152425] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.441 [2024-07-13 10:15:32.152458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.441 [2024-07-13 10:15:32.152477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.441 [2024-07-13 10:15:32.162088] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.441 [2024-07-13 10:15:32.162129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.442 [2024-07-13 10:15:32.162145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.442 [2024-07-13 10:15:32.172345] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.442 [2024-07-13 10:15:32.172379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.442 [2024-07-13 10:15:32.172397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.442 [2024-07-13 10:15:32.182003] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.442 [2024-07-13 10:15:32.182030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.442 [2024-07-13 10:15:32.182062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.442 [2024-07-13 10:15:32.191804] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.442 [2024-07-13 10:15:32.191836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.442 [2024-07-13 10:15:32.191855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.442 [2024-07-13 10:15:32.201614] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.442 [2024-07-13 10:15:32.201646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.442 [2024-07-13 10:15:32.201664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.442 [2024-07-13 10:15:32.211390] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.442 [2024-07-13 10:15:32.211422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.442 [2024-07-13 10:15:32.211441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.442 [2024-07-13 10:15:32.221258] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.442 [2024-07-13 10:15:32.221291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.442 [2024-07-13 10:15:32.221315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.442 [2024-07-13 10:15:32.231453] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.442 [2024-07-13 10:15:32.231486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.442 [2024-07-13 10:15:32.231505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.442 [2024-07-13 10:15:32.241731] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.442 [2024-07-13 10:15:32.241764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.442 [2024-07-13 10:15:32.241783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.442 [2024-07-13 10:15:32.251420] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.442 [2024-07-13 10:15:32.251452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.442 [2024-07-13 10:15:32.251471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.701 [2024-07-13 10:15:32.261183] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.701 [2024-07-13 10:15:32.261228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.701 [2024-07-13 10:15:32.261263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.701 [2024-07-13 10:15:32.271324] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.701 [2024-07-13 10:15:32.271358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.701 [2024-07-13 10:15:32.271377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.701 [2024-07-13 10:15:32.281119] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.701 [2024-07-13 10:15:32.281162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.701 [2024-07-13 10:15:32.281178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.701 [2024-07-13 10:15:32.291274] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.701 [2024-07-13 10:15:32.291307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.701 [2024-07-13 10:15:32.291327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.701 [2024-07-13 10:15:32.301573] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.701 [2024-07-13 10:15:32.301607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.701 [2024-07-13 10:15:32.301625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.701 [2024-07-13 10:15:32.311238] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.701 [2024-07-13 10:15:32.311277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.701 [2024-07-13 10:15:32.311296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.701 [2024-07-13 10:15:32.321467] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.701 [2024-07-13 10:15:32.321500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.701 [2024-07-13 10:15:32.321518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.701 [2024-07-13 10:15:32.331093] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.701 [2024-07-13 10:15:32.331121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.701 [2024-07-13 10:15:32.331153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.701 [2024-07-13 10:15:32.340673] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.701 [2024-07-13 10:15:32.340706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.701 [2024-07-13 10:15:32.340724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.701 [2024-07-13 10:15:32.350342] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.701 [2024-07-13 10:15:32.350374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.701 [2024-07-13 10:15:32.350392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.701 [2024-07-13 10:15:32.359732] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.701 [2024-07-13 10:15:32.359764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.701 [2024-07-13 10:15:32.359782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.701 [2024-07-13 10:15:32.369343] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.701 [2024-07-13 10:15:32.369375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.701 [2024-07-13 10:15:32.369393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.701 [2024-07-13 10:15:32.379095] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.701 [2024-07-13 10:15:32.379122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.701 [2024-07-13 10:15:32.379155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.701 [2024-07-13 10:15:32.389317] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.701 [2024-07-13 10:15:32.389351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.701 [2024-07-13 10:15:32.389370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.701 [2024-07-13 10:15:32.398706] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.702 [2024-07-13 10:15:32.398735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.702 [2024-07-13 10:15:32.398767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.702 [2024-07-13 10:15:32.408154] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.702 [2024-07-13 10:15:32.408203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.702 [2024-07-13 10:15:32.408219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.702 [2024-07-13 10:15:32.417462] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.702 [2024-07-13 10:15:32.417495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.702 [2024-07-13 10:15:32.417514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.702 [2024-07-13 10:15:32.427102] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.702 [2024-07-13 10:15:32.427131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.702 [2024-07-13 10:15:32.427164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.702 [2024-07-13 10:15:32.436759] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.702 [2024-07-13 10:15:32.436792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.702 [2024-07-13 10:15:32.436810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.702 [2024-07-13 10:15:32.446447] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.702 [2024-07-13 10:15:32.446479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.702 [2024-07-13 10:15:32.446497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.702 [2024-07-13 10:15:32.456168] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.702 [2024-07-13 10:15:32.456213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.702 [2024-07-13 10:15:32.456232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.702 [2024-07-13 10:15:32.466492] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.702 [2024-07-13 10:15:32.466527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.702 [2024-07-13 10:15:32.466546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.702 [2024-07-13 10:15:32.476370] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.702 [2024-07-13 10:15:32.476402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.702 [2024-07-13 10:15:32.476430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.702 [2024-07-13 10:15:32.486059] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.702 [2024-07-13 10:15:32.486086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.702 [2024-07-13 10:15:32.486118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.702 [2024-07-13 10:15:32.496362] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.702 [2024-07-13 10:15:32.496394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.702 [2024-07-13 10:15:32.496413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.702 [2024-07-13 10:15:32.506112] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.702 [2024-07-13 10:15:32.506141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.702 [2024-07-13 10:15:32.506165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.702 [2024-07-13 10:15:32.516066] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.702 [2024-07-13 10:15:32.516096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.702 [2024-07-13 10:15:32.516129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.961 [2024-07-13 10:15:32.526002] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.961 [2024-07-13 10:15:32.526047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.961 [2024-07-13 10:15:32.526067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.961 [2024-07-13 10:15:32.535529] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.961 [2024-07-13 10:15:32.535561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.961 [2024-07-13 10:15:32.535580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.961 [2024-07-13 10:15:32.545113] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.961 [2024-07-13 10:15:32.545140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.961 [2024-07-13 10:15:32.545171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.961 [2024-07-13 10:15:32.554662] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.961 [2024-07-13 10:15:32.554694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.961 [2024-07-13 10:15:32.554712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.961 [2024-07-13 10:15:32.564277] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.961 [2024-07-13 10:15:32.564309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.961 [2024-07-13 10:15:32.564328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.961 [2024-07-13 10:15:32.573880] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.961 [2024-07-13 10:15:32.573924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.961 [2024-07-13 10:15:32.573939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.961 [2024-07-13 10:15:32.583475] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.961 [2024-07-13 10:15:32.583507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.961 [2024-07-13 10:15:32.583525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.961 [2024-07-13 10:15:32.593125] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.961 [2024-07-13 10:15:32.593152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.961 [2024-07-13 10:15:32.593186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.961 [2024-07-13 10:15:32.603087] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.961 [2024-07-13 10:15:32.603114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.961 [2024-07-13 10:15:32.603145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.961 [2024-07-13 10:15:32.613377] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.961 [2024-07-13 10:15:32.613411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.961 [2024-07-13 10:15:32.613430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.961 [2024-07-13 10:15:32.623083] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.961 [2024-07-13 10:15:32.623110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.961 [2024-07-13 10:15:32.623142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.961 [2024-07-13 10:15:32.633406] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.961 [2024-07-13 10:15:32.633438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.961 [2024-07-13 10:15:32.633457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.961 [2024-07-13 10:15:32.643069] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.961 [2024-07-13 10:15:32.643095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.961 [2024-07-13 10:15:32.643132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.961 [2024-07-13 10:15:32.652924] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.962 [2024-07-13 10:15:32.652951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.962 [2024-07-13 10:15:32.652967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.962 [2024-07-13 10:15:32.662433] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.962 [2024-07-13 10:15:32.662465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.962 [2024-07-13 10:15:32.662484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.962 [2024-07-13 10:15:32.672090] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.962 [2024-07-13 10:15:32.672116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.962 [2024-07-13 10:15:32.672148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.962 [2024-07-13 10:15:32.681680] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.962 [2024-07-13 10:15:32.681711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.962 [2024-07-13 10:15:32.681730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.962 [2024-07-13 10:15:32.691333] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.962 [2024-07-13 10:15:32.691364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.962 [2024-07-13 10:15:32.691382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.962 [2024-07-13 10:15:32.701750] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.962 [2024-07-13 10:15:32.701784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.962 [2024-07-13 10:15:32.701803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.962 [2024-07-13 10:15:32.711389] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.962 [2024-07-13 10:15:32.711421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.962 [2024-07-13 10:15:32.711440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.962 [2024-07-13 10:15:32.721410] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.962 [2024-07-13 10:15:32.721442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.962 [2024-07-13 10:15:32.721461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.962 [2024-07-13 10:15:32.731093] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.962 [2024-07-13 10:15:32.731140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.962 [2024-07-13 10:15:32.731157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:26.962 [2024-07-13 10:15:32.740787] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.962 [2024-07-13 10:15:32.740819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.962 [2024-07-13 10:15:32.740837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:26.962 [2024-07-13 10:15:32.750346] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.962 [2024-07-13 10:15:32.750377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.962 [2024-07-13 10:15:32.750396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:26.962 [2024-07-13 10:15:32.760503] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.962 [2024-07-13 10:15:32.760536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.962 [2024-07-13 10:15:32.760554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:26.962 [2024-07-13 10:15:32.770132] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:26.962 [2024-07-13 10:15:32.770159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:26.962 [2024-07-13 10:15:32.770175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.219 [2024-07-13 10:15:32.780517] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:27.219 [2024-07-13 10:15:32.780553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.219 [2024-07-13 10:15:32.780573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:27.219 [2024-07-13 10:15:32.790393] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:27.219 [2024-07-13 10:15:32.790428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.219 [2024-07-13 10:15:32.790447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:27.219 [2024-07-13 10:15:32.799926] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:27.219 [2024-07-13 10:15:32.799953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.219 [2024-07-13 10:15:32.799985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:27.219 [2024-07-13 10:15:32.809558] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x21bbd30) 00:29:27.219 [2024-07-13 10:15:32.809590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:27.219 [2024-07-13 10:15:32.809609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:27.219 00:29:27.219 Latency(us) 00:29:27.219 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:27.220 Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:29:27.220 nvme0n1 : 2.00 3167.41 395.93 0.00 0.00 5047.39 4441.88 10631.40 00:29:27.220 =================================================================================================================== 00:29:27.220 Total : 3167.41 395.93 0.00 0.00 5047.39 4441.88 10631.40 00:29:27.220 0 00:29:27.220 10:15:32 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:27.220 10:15:32 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:27.220 10:15:32 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:27.220 | .driver_specific 00:29:27.220 | .nvme_error 00:29:27.220 | .status_code 00:29:27.220 | .command_transient_transport_error' 00:29:27.220 10:15:32 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:27.477 10:15:33 -- host/digest.sh@71 -- # (( 204 > 0 )) 00:29:27.477 10:15:33 -- host/digest.sh@73 -- # killprocess 2933952 00:29:27.477 10:15:33 -- common/autotest_common.sh@926 -- # '[' -z 2933952 ']' 00:29:27.477 10:15:33 -- common/autotest_common.sh@930 -- # kill -0 2933952 00:29:27.477 10:15:33 -- common/autotest_common.sh@931 -- # uname 00:29:27.477 10:15:33 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:27.477 10:15:33 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2933952 00:29:27.477 10:15:33 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:29:27.477 10:15:33 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:29:27.477 10:15:33 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2933952' 00:29:27.477 killing process with pid 2933952 00:29:27.477 10:15:33 -- common/autotest_common.sh@945 -- # kill 2933952 00:29:27.477 Received shutdown signal, test time was about 2.000000 seconds 00:29:27.477 00:29:27.477 Latency(us) 00:29:27.477 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:27.477 =================================================================================================================== 00:29:27.477 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:27.477 10:15:33 -- common/autotest_common.sh@950 -- # wait 2933952 00:29:27.733 10:15:33 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:29:27.733 10:15:33 -- host/digest.sh@54 -- # local rw bs qd 00:29:27.733 10:15:33 -- host/digest.sh@56 -- # rw=randwrite 00:29:27.733 10:15:33 -- host/digest.sh@56 -- # bs=4096 00:29:27.733 10:15:33 -- host/digest.sh@56 -- # qd=128 00:29:27.733 10:15:33 -- host/digest.sh@58 -- # bperfpid=2934382 00:29:27.733 10:15:33 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:29:27.733 10:15:33 -- host/digest.sh@60 -- # waitforlisten 2934382 /var/tmp/bperf.sock 00:29:27.733 10:15:33 -- common/autotest_common.sh@819 -- # '[' -z 2934382 ']' 00:29:27.733 10:15:33 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:27.733 10:15:33 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:27.733 10:15:33 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:27.733 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:27.733 10:15:33 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:27.733 10:15:33 -- common/autotest_common.sh@10 -- # set +x 00:29:27.733 [2024-07-13 10:15:33.369934] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:29:27.733 [2024-07-13 10:15:33.370011] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2934382 ] 00:29:27.733 EAL: No free 2048 kB hugepages reported on node 1 00:29:27.733 [2024-07-13 10:15:33.431838] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:27.733 [2024-07-13 10:15:33.518895] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:28.664 10:15:34 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:28.664 10:15:34 -- common/autotest_common.sh@852 -- # return 0 00:29:28.664 10:15:34 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:28.664 10:15:34 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:28.921 10:15:34 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:28.921 10:15:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:28.921 10:15:34 -- common/autotest_common.sh@10 -- # set +x 00:29:28.921 10:15:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:28.921 10:15:34 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:28.921 10:15:34 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:29.483 nvme0n1 00:29:29.483 10:15:35 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:29:29.483 10:15:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:29.483 10:15:35 -- common/autotest_common.sh@10 -- # set +x 00:29:29.483 10:15:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:29.483 10:15:35 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:29.483 10:15:35 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:29.483 Running I/O for 2 seconds... 00:29:29.483 [2024-07-13 10:15:35.198346] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190ee5c8 00:29:29.483 [2024-07-13 10:15:35.199660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:3739 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:29.483 [2024-07-13 10:15:35.199708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0049 p:0 m:0 dnr:0 00:29:29.483 [2024-07-13 10:15:35.211122] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190ea248 00:29:29.483 [2024-07-13 10:15:35.212026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:17067 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:29.483 [2024-07-13 10:15:35.212071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:29:29.483 [2024-07-13 10:15:35.223562] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190f2d80 00:29:29.483 [2024-07-13 10:15:35.224144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:21357 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:29.483 [2024-07-13 10:15:35.224188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:29:29.483 [2024-07-13 10:15:35.235876] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e88f8 00:29:29.484 [2024-07-13 10:15:35.236510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:13277 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:29.484 [2024-07-13 10:15:35.236542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:29:29.484 [2024-07-13 10:15:35.248387] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190eee38 00:29:29.484 [2024-07-13 10:15:35.248885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:10692 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:29.484 [2024-07-13 10:15:35.248929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:29:29.484 [2024-07-13 10:15:35.260703] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190f2948 00:29:29.484 [2024-07-13 10:15:35.261159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:8837 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:29.484 [2024-07-13 10:15:35.261204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:29:29.484 [2024-07-13 10:15:35.272945] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190f3e60 00:29:29.484 [2024-07-13 10:15:35.273356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:8374 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:29.484 [2024-07-13 10:15:35.273388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:29:29.484 [2024-07-13 10:15:35.285343] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190f3a28 00:29:29.484 [2024-07-13 10:15:35.285728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16360 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:29.484 [2024-07-13 10:15:35.285759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:29:29.484 [2024-07-13 10:15:35.297620] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190ecc78 00:29:29.484 [2024-07-13 10:15:35.298086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:6899 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:29.484 [2024-07-13 10:15:35.298118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0052 p:0 m:0 dnr:0 00:29:29.742 [2024-07-13 10:15:35.310365] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190f0350 00:29:29.742 [2024-07-13 10:15:35.310783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:17465 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:29.742 [2024-07-13 10:15:35.310818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:29:29.742 [2024-07-13 10:15:35.322830] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:29.742 [2024-07-13 10:15:35.323185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:1577 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:29.742 [2024-07-13 10:15:35.323219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0050 p:0 m:0 dnr:0 00:29:29.742 [2024-07-13 10:15:35.335198] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190f31b8 00:29:29.742 [2024-07-13 10:15:35.335532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:24960 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:29.742 [2024-07-13 10:15:35.335564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:004f p:0 m:0 dnr:0 00:29:29.742 [2024-07-13 10:15:35.347464] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190ea680 00:29:29.742 [2024-07-13 10:15:35.347805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:13692 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:29.742 [2024-07-13 10:15:35.347837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:004e p:0 m:0 dnr:0 00:29:29.742 [2024-07-13 10:15:35.361990] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190ed0b0 00:29:29.742 [2024-07-13 10:15:35.363842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:12694 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:29.742 [2024-07-13 10:15:35.363890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:29.742 [2024-07-13 10:15:35.373011] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190eaab8 00:29:29.742 [2024-07-13 10:15:35.374270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:13042 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:29.742 [2024-07-13 10:15:35.374302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:29.742 [2024-07-13 10:15:35.385190] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190eaab8 00:29:29.742 [2024-07-13 10:15:35.386680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:20235 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:29.742 [2024-07-13 10:15:35.386712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:29.742 [2024-07-13 10:15:35.397435] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190eaab8 00:29:29.742 [2024-07-13 10:15:35.399018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:3043 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:29.742 [2024-07-13 10:15:35.399045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:29.742 [2024-07-13 10:15:35.408735] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e49b0 00:29:29.742 [2024-07-13 10:15:35.409801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:17693 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:29.742 [2024-07-13 10:15:35.409829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0047 p:0 m:0 dnr:0 00:29:29.742 [2024-07-13 10:15:35.419682] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190fac10 00:29:29.742 [2024-07-13 10:15:35.420083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:12395 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:29.742 [2024-07-13 10:15:35.420111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:001a p:0 m:0 dnr:0 00:29:29.742 [2024-07-13 10:15:35.432278] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190f4f40 00:29:29.742 [2024-07-13 10:15:35.433220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:24226 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:29.742 [2024-07-13 10:15:35.433252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:002a p:0 m:0 dnr:0 00:29:29.742 [2024-07-13 10:15:35.444620] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190fb048 00:29:29.742 [2024-07-13 10:15:35.444830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:2522 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:29.742 [2024-07-13 10:15:35.444861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0029 p:0 m:0 dnr:0 00:29:29.742 [2024-07-13 10:15:35.457428] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190f96f8 00:29:29.742 [2024-07-13 10:15:35.458377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:25597 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:29.742 [2024-07-13 10:15:35.458409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:004a p:0 m:0 dnr:0 00:29:29.742 [2024-07-13 10:15:35.469807] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190f96f8 00:29:29.742 [2024-07-13 10:15:35.470743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:15393 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:29.742 [2024-07-13 10:15:35.470774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:004b p:0 m:0 dnr:0 00:29:29.742 [2024-07-13 10:15:35.482311] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190f92c0 00:29:29.742 [2024-07-13 10:15:35.483272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:12 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:29.742 [2024-07-13 10:15:35.483304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:004c p:0 m:0 dnr:0 00:29:29.742 [2024-07-13 10:15:35.494812] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190f8a50 00:29:29.742 [2024-07-13 10:15:35.495771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:7749 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:29.742 [2024-07-13 10:15:35.495803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:004d p:0 m:0 dnr:0 00:29:29.742 [2024-07-13 10:15:35.508104] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190f35f0 00:29:29.742 [2024-07-13 10:15:35.508683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:6166 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:29.742 [2024-07-13 10:15:35.508717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:004d p:0 m:0 dnr:0 00:29:29.742 [2024-07-13 10:15:35.520880] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e73e0 00:29:29.742 [2024-07-13 10:15:35.522165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:5583 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:29.742 [2024-07-13 10:15:35.522200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:29:29.742 [2024-07-13 10:15:35.533560] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e9e10 00:29:29.742 [2024-07-13 10:15:35.534860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:703 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:29.742 [2024-07-13 10:15:35.534914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:29:29.742 [2024-07-13 10:15:35.546030] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190fac10 00:29:29.742 [2024-07-13 10:15:35.547371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:10552 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:29.742 [2024-07-13 10:15:35.547403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:29:30.000 [2024-07-13 10:15:35.558815] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190fa7d8 00:29:30.000 [2024-07-13 10:15:35.560208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:18934 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.000 [2024-07-13 10:15:35.560243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:29:30.000 [2024-07-13 10:15:35.571609] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190fa7d8 00:29:30.000 [2024-07-13 10:15:35.572953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:1376 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.000 [2024-07-13 10:15:35.572984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:29:30.000 [2024-07-13 10:15:35.584067] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190fac10 00:29:30.000 [2024-07-13 10:15:35.585435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:10213 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.000 [2024-07-13 10:15:35.585468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:29:30.000 [2024-07-13 10:15:35.596675] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e9e10 00:29:30.000 [2024-07-13 10:15:35.598017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:17911 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.000 [2024-07-13 10:15:35.598046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:29:30.000 [2024-07-13 10:15:35.609208] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e73e0 00:29:30.000 [2024-07-13 10:15:35.610571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:11999 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.000 [2024-07-13 10:15:35.610603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:29:30.000 [2024-07-13 10:15:35.621827] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e2c28 00:29:30.001 [2024-07-13 10:15:35.623192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:2287 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.001 [2024-07-13 10:15:35.623224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:29:30.001 [2024-07-13 10:15:35.634274] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190ee190 00:29:30.001 [2024-07-13 10:15:35.635667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:18516 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.001 [2024-07-13 10:15:35.635699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:29:30.001 [2024-07-13 10:15:35.646828] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190fb048 00:29:30.001 [2024-07-13 10:15:35.648212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:17651 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.001 [2024-07-13 10:15:35.648244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:29:30.001 [2024-07-13 10:15:35.659310] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190ed0b0 00:29:30.001 [2024-07-13 10:15:35.660715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:24254 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.001 [2024-07-13 10:15:35.660746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:29:30.001 [2024-07-13 10:15:35.671883] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e2c28 00:29:30.001 [2024-07-13 10:15:35.673335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:9930 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.001 [2024-07-13 10:15:35.673367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:30.001 [2024-07-13 10:15:35.684442] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190ed0b0 00:29:30.001 [2024-07-13 10:15:35.685922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:12948 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.001 [2024-07-13 10:15:35.685949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:30.001 [2024-07-13 10:15:35.696920] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190f2510 00:29:30.001 [2024-07-13 10:15:35.698378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:7634 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.001 [2024-07-13 10:15:35.698410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:30.001 [2024-07-13 10:15:35.709513] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190f4b08 00:29:30.001 [2024-07-13 10:15:35.711061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:5684 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.001 [2024-07-13 10:15:35.711104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:30.001 [2024-07-13 10:15:35.721949] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e2c28 00:29:30.001 [2024-07-13 10:15:35.723429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:25450 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.001 [2024-07-13 10:15:35.723461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:30.001 [2024-07-13 10:15:35.734422] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e73e0 00:29:30.001 [2024-07-13 10:15:35.735991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:14555 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.001 [2024-07-13 10:15:35.736017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:30.001 [2024-07-13 10:15:35.746863] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e9e10 00:29:30.001 [2024-07-13 10:15:35.748326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:358 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.001 [2024-07-13 10:15:35.748368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:30.001 [2024-07-13 10:15:35.759278] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e3d08 00:29:30.001 [2024-07-13 10:15:35.760788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:24720 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.001 [2024-07-13 10:15:35.760819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.001 [2024-07-13 10:15:35.770183] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190f9f68 00:29:30.001 [2024-07-13 10:15:35.771096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:8060 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.001 [2024-07-13 10:15:35.771124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:004d p:0 m:0 dnr:0 00:29:30.001 [2024-07-13 10:15:35.782644] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190f9f68 00:29:30.001 [2024-07-13 10:15:35.783579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:7955 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.001 [2024-07-13 10:15:35.783610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:004e p:0 m:0 dnr:0 00:29:30.001 [2024-07-13 10:15:35.795242] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190fa3a0 00:29:30.001 [2024-07-13 10:15:35.796161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:14260 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.001 [2024-07-13 10:15:35.796221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:004f p:0 m:0 dnr:0 00:29:30.001 [2024-07-13 10:15:35.807667] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e3d08 00:29:30.001 [2024-07-13 10:15:35.808618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:24017 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.001 [2024-07-13 10:15:35.808649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0050 p:0 m:0 dnr:0 00:29:30.259 [2024-07-13 10:15:35.820633] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190ea248 00:29:30.259 [2024-07-13 10:15:35.821632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:1499 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.259 [2024-07-13 10:15:35.821667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:29:30.259 [2024-07-13 10:15:35.833248] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190f1868 00:29:30.259 [2024-07-13 10:15:35.834236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:18642 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.259 [2024-07-13 10:15:35.834269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0052 p:0 m:0 dnr:0 00:29:30.259 [2024-07-13 10:15:35.845877] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190f46d0 00:29:30.259 [2024-07-13 10:15:35.846886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:1518 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.259 [2024-07-13 10:15:35.846933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:29:30.259 [2024-07-13 10:15:35.858422] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e73e0 00:29:30.259 [2024-07-13 10:15:35.859475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:17576 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.259 [2024-07-13 10:15:35.859506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:29:30.259 [2024-07-13 10:15:35.870910] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e73e0 00:29:30.259 [2024-07-13 10:15:35.871923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:402 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.259 [2024-07-13 10:15:35.871951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:29:30.259 [2024-07-13 10:15:35.883261] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e73e0 00:29:30.259 [2024-07-13 10:15:35.884288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:21344 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.259 [2024-07-13 10:15:35.884319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:29:30.259 [2024-07-13 10:15:35.895598] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e73e0 00:29:30.259 [2024-07-13 10:15:35.896638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:121 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.259 [2024-07-13 10:15:35.896669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:29:30.259 [2024-07-13 10:15:35.908027] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e73e0 00:29:30.259 [2024-07-13 10:15:35.909116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:8307 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.259 [2024-07-13 10:15:35.909144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:29:30.259 [2024-07-13 10:15:35.920457] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e73e0 00:29:30.259 [2024-07-13 10:15:35.921559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:7132 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.259 [2024-07-13 10:15:35.921591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:29:30.259 [2024-07-13 10:15:35.932976] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e73e0 00:29:30.259 [2024-07-13 10:15:35.934090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:10164 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.259 [2024-07-13 10:15:35.934132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:29:30.259 [2024-07-13 10:15:35.945353] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e73e0 00:29:30.259 [2024-07-13 10:15:35.946462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:1255 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.259 [2024-07-13 10:15:35.946493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:29:30.259 [2024-07-13 10:15:35.957887] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e73e0 00:29:30.259 [2024-07-13 10:15:35.959060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:17218 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.259 [2024-07-13 10:15:35.959088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:29:30.259 [2024-07-13 10:15:35.970371] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e73e0 00:29:30.259 [2024-07-13 10:15:35.971514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:8743 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.259 [2024-07-13 10:15:35.971544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:29:30.259 [2024-07-13 10:15:35.982852] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e73e0 00:29:30.259 [2024-07-13 10:15:35.984036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:118 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.259 [2024-07-13 10:15:35.984062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:29:30.259 [2024-07-13 10:15:35.995209] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e73e0 00:29:30.260 [2024-07-13 10:15:35.996349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:9213 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.260 [2024-07-13 10:15:35.996380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:29:30.260 [2024-07-13 10:15:36.007751] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e73e0 00:29:30.260 [2024-07-13 10:15:36.008943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:17364 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.260 [2024-07-13 10:15:36.008985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:29:30.260 [2024-07-13 10:15:36.021765] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190eea00 00:29:30.260 [2024-07-13 10:15:36.023057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:3084 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.260 [2024-07-13 10:15:36.023085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.260 [2024-07-13 10:15:36.032177] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190ef6a8 00:29:30.260 [2024-07-13 10:15:36.032809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:20477 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.260 [2024-07-13 10:15:36.032839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0037 p:0 m:0 dnr:0 00:29:30.260 [2024-07-13 10:15:36.044744] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190fb8b8 00:29:30.260 [2024-07-13 10:15:36.045610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:7085 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.260 [2024-07-13 10:15:36.045642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0048 p:0 m:0 dnr:0 00:29:30.260 [2024-07-13 10:15:36.057223] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190fbcf0 00:29:30.260 [2024-07-13 10:15:36.058071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:17306 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.260 [2024-07-13 10:15:36.058099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0049 p:0 m:0 dnr:0 00:29:30.260 [2024-07-13 10:15:36.069588] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190fbcf0 00:29:30.260 [2024-07-13 10:15:36.070499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:16728 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.260 [2024-07-13 10:15:36.070530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:004a p:0 m:0 dnr:0 00:29:30.518 [2024-07-13 10:15:36.082565] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190fb8b8 00:29:30.518 [2024-07-13 10:15:36.083491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:20050 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.518 [2024-07-13 10:15:36.083525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:004b p:0 m:0 dnr:0 00:29:30.518 [2024-07-13 10:15:36.095188] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190ef6a8 00:29:30.518 [2024-07-13 10:15:36.096094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:20763 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.519 [2024-07-13 10:15:36.096123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:004c p:0 m:0 dnr:0 00:29:30.519 [2024-07-13 10:15:36.107676] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e9168 00:29:30.519 [2024-07-13 10:15:36.108590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:4275 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.519 [2024-07-13 10:15:36.108622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:004d p:0 m:0 dnr:0 00:29:30.519 [2024-07-13 10:15:36.120287] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e1b48 00:29:30.519 [2024-07-13 10:15:36.121240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:4101 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.519 [2024-07-13 10:15:36.121277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:004e p:0 m:0 dnr:0 00:29:30.519 [2024-07-13 10:15:36.132793] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190ed920 00:29:30.519 [2024-07-13 10:15:36.133747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:16170 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.519 [2024-07-13 10:15:36.133778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:004f p:0 m:0 dnr:0 00:29:30.519 [2024-07-13 10:15:36.145306] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e84c0 00:29:30.519 [2024-07-13 10:15:36.146289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:6812 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.519 [2024-07-13 10:15:36.146321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0050 p:0 m:0 dnr:0 00:29:30.519 [2024-07-13 10:15:36.157789] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190ef6a8 00:29:30.519 [2024-07-13 10:15:36.158746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:2029 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.519 [2024-07-13 10:15:36.158778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:29:30.519 [2024-07-13 10:15:36.170319] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e49b0 00:29:30.519 [2024-07-13 10:15:36.171323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:24129 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.519 [2024-07-13 10:15:36.171354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0052 p:0 m:0 dnr:0 00:29:30.519 [2024-07-13 10:15:36.182790] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190ef270 00:29:30.519 [2024-07-13 10:15:36.183791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:7150 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.519 [2024-07-13 10:15:36.183823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:29:30.519 [2024-07-13 10:15:36.195229] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190ef270 00:29:30.519 [2024-07-13 10:15:36.196253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:1456 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.519 [2024-07-13 10:15:36.196284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:29:30.519 [2024-07-13 10:15:36.207672] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190ef270 00:29:30.519 [2024-07-13 10:15:36.208688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:23241 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.519 [2024-07-13 10:15:36.208719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:29:30.519 [2024-07-13 10:15:36.220157] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190ef270 00:29:30.519 [2024-07-13 10:15:36.221221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:4197 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.519 [2024-07-13 10:15:36.221252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:29:30.519 [2024-07-13 10:15:36.232569] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190ef270 00:29:30.519 [2024-07-13 10:15:36.233642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:22966 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.519 [2024-07-13 10:15:36.233673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:29:30.519 [2024-07-13 10:15:36.245063] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190ef270 00:29:30.519 [2024-07-13 10:15:36.246166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:3343 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.519 [2024-07-13 10:15:36.246197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:29:30.519 [2024-07-13 10:15:36.257416] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190ef270 00:29:30.519 [2024-07-13 10:15:36.258534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:7541 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.519 [2024-07-13 10:15:36.258565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:29:30.519 [2024-07-13 10:15:36.269997] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190ef270 00:29:30.519 [2024-07-13 10:15:36.271125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:18173 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.519 [2024-07-13 10:15:36.271167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:29:30.519 [2024-07-13 10:15:36.282343] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190ef270 00:29:30.519 [2024-07-13 10:15:36.283480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:9032 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.519 [2024-07-13 10:15:36.283512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:29:30.519 [2024-07-13 10:15:36.294880] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190ef270 00:29:30.519 [2024-07-13 10:15:36.296020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:3736 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.519 [2024-07-13 10:15:36.296046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:29:30.519 [2024-07-13 10:15:36.307315] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190ef270 00:29:30.519 [2024-07-13 10:15:36.308469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:6355 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.519 [2024-07-13 10:15:36.308500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:29:30.519 [2024-07-13 10:15:36.319836] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190ef270 00:29:30.519 [2024-07-13 10:15:36.321078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:21702 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.519 [2024-07-13 10:15:36.321105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:29:30.519 [2024-07-13 10:15:36.332454] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190ef270 00:29:30.519 [2024-07-13 10:15:36.333731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:22300 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.519 [2024-07-13 10:15:36.333766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:29:30.778 [2024-07-13 10:15:36.345384] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190ef270 00:29:30.778 [2024-07-13 10:15:36.346756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:8546 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.778 [2024-07-13 10:15:36.346791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:29:30.778 [2024-07-13 10:15:36.357823] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190ef270 00:29:30.778 [2024-07-13 10:15:36.359013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:113 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.778 [2024-07-13 10:15:36.359042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:30.778 [2024-07-13 10:15:36.370252] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190ef270 00:29:30.778 [2024-07-13 10:15:36.371459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:21674 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.778 [2024-07-13 10:15:36.371490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:29:30.778 [2024-07-13 10:15:36.382756] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190ef270 00:29:30.778 [2024-07-13 10:15:36.383962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:5466 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.778 [2024-07-13 10:15:36.383988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:29:30.778 [2024-07-13 10:15:36.395117] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190ef270 00:29:30.778 [2024-07-13 10:15:36.396357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:10158 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.778 [2024-07-13 10:15:36.396390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:29:30.778 [2024-07-13 10:15:36.407533] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190ef270 00:29:30.778 [2024-07-13 10:15:36.408787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:17550 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.778 [2024-07-13 10:15:36.408819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:29:30.778 [2024-07-13 10:15:36.419953] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190fa7d8 00:29:30.778 [2024-07-13 10:15:36.421017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:6084 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.778 [2024-07-13 10:15:36.421046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:29:30.778 [2024-07-13 10:15:36.432445] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190f4298 00:29:30.778 [2024-07-13 10:15:36.433614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:19930 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.778 [2024-07-13 10:15:36.433645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:29:30.778 [2024-07-13 10:15:36.446547] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190f6cc8 00:29:30.778 [2024-07-13 10:15:36.447845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:23794 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.778 [2024-07-13 10:15:36.447890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.778 [2024-07-13 10:15:36.457334] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190f8e88 00:29:30.778 [2024-07-13 10:15:36.458549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:26 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.778 [2024-07-13 10:15:36.458581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:29:30.778 [2024-07-13 10:15:36.469751] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190f8e88 00:29:30.778 [2024-07-13 10:15:36.470823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:25442 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.778 [2024-07-13 10:15:36.470855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:29:30.778 [2024-07-13 10:15:36.482176] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190f8e88 00:29:30.778 [2024-07-13 10:15:36.483325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:5666 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.778 [2024-07-13 10:15:36.483359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:29:30.778 [2024-07-13 10:15:36.495943] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:30.778 [2024-07-13 10:15:36.496312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:17360 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.778 [2024-07-13 10:15:36.496345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:30.778 [2024-07-13 10:15:36.509525] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:30.778 [2024-07-13 10:15:36.509855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:7860 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.778 [2024-07-13 10:15:36.509910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:30.778 [2024-07-13 10:15:36.523137] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:30.778 [2024-07-13 10:15:36.523480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:20220 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.778 [2024-07-13 10:15:36.523511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:30.778 [2024-07-13 10:15:36.536755] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:30.778 [2024-07-13 10:15:36.537095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:23404 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.778 [2024-07-13 10:15:36.537123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:30.778 [2024-07-13 10:15:36.550545] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:30.778 [2024-07-13 10:15:36.550882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:23579 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.778 [2024-07-13 10:15:36.550926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:30.778 [2024-07-13 10:15:36.564268] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:30.778 [2024-07-13 10:15:36.564605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:23213 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.778 [2024-07-13 10:15:36.564636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:30.778 [2024-07-13 10:15:36.577889] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:30.778 [2024-07-13 10:15:36.578211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:16961 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.778 [2024-07-13 10:15:36.578242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:30.778 [2024-07-13 10:15:36.591731] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:30.778 [2024-07-13 10:15:36.592071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:15515 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:30.778 [2024-07-13 10:15:36.592102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.037 [2024-07-13 10:15:36.605914] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.037 [2024-07-13 10:15:36.606223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:17624 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.037 [2024-07-13 10:15:36.606257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.037 [2024-07-13 10:15:36.619556] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.037 [2024-07-13 10:15:36.619859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:13059 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.037 [2024-07-13 10:15:36.619914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.037 [2024-07-13 10:15:36.633161] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.037 [2024-07-13 10:15:36.633478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:12042 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.037 [2024-07-13 10:15:36.633510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.037 [2024-07-13 10:15:36.646847] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.037 [2024-07-13 10:15:36.647209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:12363 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.038 [2024-07-13 10:15:36.647240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.038 [2024-07-13 10:15:36.660436] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.038 [2024-07-13 10:15:36.660772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:23097 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.038 [2024-07-13 10:15:36.660802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.038 [2024-07-13 10:15:36.674103] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.038 [2024-07-13 10:15:36.674442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:13670 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.038 [2024-07-13 10:15:36.674474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.038 [2024-07-13 10:15:36.687730] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.038 [2024-07-13 10:15:36.688075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:24420 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.038 [2024-07-13 10:15:36.688104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.038 [2024-07-13 10:15:36.701384] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.038 [2024-07-13 10:15:36.701715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:9922 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.038 [2024-07-13 10:15:36.701745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.038 [2024-07-13 10:15:36.715111] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.038 [2024-07-13 10:15:36.715445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4002 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.038 [2024-07-13 10:15:36.715476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.038 [2024-07-13 10:15:36.728768] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.038 [2024-07-13 10:15:36.729177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:15414 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.038 [2024-07-13 10:15:36.729204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.038 [2024-07-13 10:15:36.742450] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.038 [2024-07-13 10:15:36.742785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:18314 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.038 [2024-07-13 10:15:36.742817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.038 [2024-07-13 10:15:36.756079] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.038 [2024-07-13 10:15:36.756425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:3063 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.038 [2024-07-13 10:15:36.756456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.038 [2024-07-13 10:15:36.769698] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.038 [2024-07-13 10:15:36.770045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:9639 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.038 [2024-07-13 10:15:36.770073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.038 [2024-07-13 10:15:36.783385] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.038 [2024-07-13 10:15:36.783713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:6274 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.038 [2024-07-13 10:15:36.783744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.038 [2024-07-13 10:15:36.796990] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.038 [2024-07-13 10:15:36.797358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:5095 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.038 [2024-07-13 10:15:36.797388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.038 [2024-07-13 10:15:36.810627] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.038 [2024-07-13 10:15:36.810988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:16786 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.038 [2024-07-13 10:15:36.811016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.038 [2024-07-13 10:15:36.824264] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.038 [2024-07-13 10:15:36.824593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:4107 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.038 [2024-07-13 10:15:36.824624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.038 [2024-07-13 10:15:36.837805] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.038 [2024-07-13 10:15:36.838169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:12297 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.038 [2024-07-13 10:15:36.838214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.038 [2024-07-13 10:15:36.851606] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.038 [2024-07-13 10:15:36.852024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:17175 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.038 [2024-07-13 10:15:36.852064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.297 [2024-07-13 10:15:36.865533] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.297 [2024-07-13 10:15:36.865837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:13546 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.297 [2024-07-13 10:15:36.865878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.297 [2024-07-13 10:15:36.879023] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.297 [2024-07-13 10:15:36.879352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:4034 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.297 [2024-07-13 10:15:36.879381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.297 [2024-07-13 10:15:36.892419] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.297 [2024-07-13 10:15:36.892749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:11068 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.297 [2024-07-13 10:15:36.892781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.297 [2024-07-13 10:15:36.905923] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.297 [2024-07-13 10:15:36.906258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:6117 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.297 [2024-07-13 10:15:36.906290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.297 [2024-07-13 10:15:36.919403] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.297 [2024-07-13 10:15:36.919744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:9478 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.297 [2024-07-13 10:15:36.919781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.297 [2024-07-13 10:15:36.932950] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.297 [2024-07-13 10:15:36.933271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:239 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.297 [2024-07-13 10:15:36.933303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.297 [2024-07-13 10:15:36.946489] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.297 [2024-07-13 10:15:36.946818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:14136 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.297 [2024-07-13 10:15:36.946849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.297 [2024-07-13 10:15:36.960155] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.297 [2024-07-13 10:15:36.960502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:12110 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.297 [2024-07-13 10:15:36.960533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.297 [2024-07-13 10:15:36.973778] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.297 [2024-07-13 10:15:36.974124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:15519 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.297 [2024-07-13 10:15:36.974170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.297 [2024-07-13 10:15:36.987432] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.297 [2024-07-13 10:15:36.987762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:5350 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.297 [2024-07-13 10:15:36.987793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.297 [2024-07-13 10:15:37.001059] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.297 [2024-07-13 10:15:37.001445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:23504 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.297 [2024-07-13 10:15:37.001477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.297 [2024-07-13 10:15:37.014658] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.297 [2024-07-13 10:15:37.014997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:22140 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.297 [2024-07-13 10:15:37.015024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.297 [2024-07-13 10:15:37.028289] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.297 [2024-07-13 10:15:37.028624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:15388 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.297 [2024-07-13 10:15:37.028655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.297 [2024-07-13 10:15:37.041945] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.297 [2024-07-13 10:15:37.042346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:14377 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.297 [2024-07-13 10:15:37.042377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.297 [2024-07-13 10:15:37.055541] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.297 [2024-07-13 10:15:37.055890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:3456 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.297 [2024-07-13 10:15:37.055921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.297 [2024-07-13 10:15:37.069135] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.297 [2024-07-13 10:15:37.069477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:23755 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.297 [2024-07-13 10:15:37.069507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.297 [2024-07-13 10:15:37.082761] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.297 [2024-07-13 10:15:37.083113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:13205 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.297 [2024-07-13 10:15:37.083141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.297 [2024-07-13 10:15:37.096342] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.297 [2024-07-13 10:15:37.096669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:1135 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.297 [2024-07-13 10:15:37.096700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.297 [2024-07-13 10:15:37.110047] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.297 [2024-07-13 10:15:37.110393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:7034 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.297 [2024-07-13 10:15:37.110426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.555 [2024-07-13 10:15:37.124195] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.555 [2024-07-13 10:15:37.124546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:17862 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.555 [2024-07-13 10:15:37.124580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.555 [2024-07-13 10:15:37.137739] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.555 [2024-07-13 10:15:37.138079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:10448 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.555 [2024-07-13 10:15:37.138108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.555 [2024-07-13 10:15:37.151327] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.555 [2024-07-13 10:15:37.151663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:10903 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.555 [2024-07-13 10:15:37.151694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.555 [2024-07-13 10:15:37.164929] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.555 [2024-07-13 10:15:37.165340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:16796 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.555 [2024-07-13 10:15:37.165371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.555 [2024-07-13 10:15:37.178562] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.555 [2024-07-13 10:15:37.178918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:2857 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.555 [2024-07-13 10:15:37.178946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.555 [2024-07-13 10:15:37.192185] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12780) with pdu=0x2000190e7818 00:29:31.555 [2024-07-13 10:15:37.192488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:11589 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:31.555 [2024-07-13 10:15:37.192518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:31.555 00:29:31.555 Latency(us) 00:29:31.555 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:31.555 Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:29:31.555 nvme0n1 : 2.01 19853.86 77.55 0.00 0.00 6433.41 2864.17 15728.64 00:29:31.555 =================================================================================================================== 00:29:31.555 Total : 19853.86 77.55 0.00 0.00 6433.41 2864.17 15728.64 00:29:31.555 0 00:29:31.555 10:15:37 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:31.555 10:15:37 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:31.555 10:15:37 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:31.555 10:15:37 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:31.555 | .driver_specific 00:29:31.555 | .nvme_error 00:29:31.555 | .status_code 00:29:31.555 | .command_transient_transport_error' 00:29:31.814 10:15:37 -- host/digest.sh@71 -- # (( 156 > 0 )) 00:29:31.814 10:15:37 -- host/digest.sh@73 -- # killprocess 2934382 00:29:31.814 10:15:37 -- common/autotest_common.sh@926 -- # '[' -z 2934382 ']' 00:29:31.814 10:15:37 -- common/autotest_common.sh@930 -- # kill -0 2934382 00:29:31.814 10:15:37 -- common/autotest_common.sh@931 -- # uname 00:29:31.814 10:15:37 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:31.814 10:15:37 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2934382 00:29:31.814 10:15:37 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:29:31.814 10:15:37 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:29:31.814 10:15:37 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2934382' 00:29:31.814 killing process with pid 2934382 00:29:31.814 10:15:37 -- common/autotest_common.sh@945 -- # kill 2934382 00:29:31.814 Received shutdown signal, test time was about 2.000000 seconds 00:29:31.814 00:29:31.814 Latency(us) 00:29:31.814 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:31.814 =================================================================================================================== 00:29:31.814 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:31.814 10:15:37 -- common/autotest_common.sh@950 -- # wait 2934382 00:29:32.072 10:15:37 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:29:32.072 10:15:37 -- host/digest.sh@54 -- # local rw bs qd 00:29:32.072 10:15:37 -- host/digest.sh@56 -- # rw=randwrite 00:29:32.072 10:15:37 -- host/digest.sh@56 -- # bs=131072 00:29:32.072 10:15:37 -- host/digest.sh@56 -- # qd=16 00:29:32.072 10:15:37 -- host/digest.sh@58 -- # bperfpid=2934933 00:29:32.072 10:15:37 -- host/digest.sh@60 -- # waitforlisten 2934933 /var/tmp/bperf.sock 00:29:32.072 10:15:37 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:29:32.072 10:15:37 -- common/autotest_common.sh@819 -- # '[' -z 2934933 ']' 00:29:32.072 10:15:37 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:32.072 10:15:37 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:32.072 10:15:37 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:32.072 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:32.072 10:15:37 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:32.072 10:15:37 -- common/autotest_common.sh@10 -- # set +x 00:29:32.072 [2024-07-13 10:15:37.726050] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:29:32.072 [2024-07-13 10:15:37.726137] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2934933 ] 00:29:32.072 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:32.072 Zero copy mechanism will not be used. 00:29:32.072 EAL: No free 2048 kB hugepages reported on node 1 00:29:32.072 [2024-07-13 10:15:37.784750] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:32.072 [2024-07-13 10:15:37.868963] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:33.008 10:15:38 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:33.008 10:15:38 -- common/autotest_common.sh@852 -- # return 0 00:29:33.008 10:15:38 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:33.008 10:15:38 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:33.266 10:15:38 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:33.266 10:15:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:33.266 10:15:38 -- common/autotest_common.sh@10 -- # set +x 00:29:33.266 10:15:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:33.266 10:15:38 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:33.266 10:15:38 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:33.840 nvme0n1 00:29:33.840 10:15:39 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:29:33.840 10:15:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:33.840 10:15:39 -- common/autotest_common.sh@10 -- # set +x 00:29:33.840 10:15:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:33.840 10:15:39 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:33.840 10:15:39 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:33.840 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:33.840 Zero copy mechanism will not be used. 00:29:33.840 Running I/O for 2 seconds... 00:29:33.840 [2024-07-13 10:15:39.643885] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:33.840 [2024-07-13 10:15:39.644210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:33.840 [2024-07-13 10:15:39.644249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.099 [2024-07-13 10:15:39.658291] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.099 [2024-07-13 10:15:39.658642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.099 [2024-07-13 10:15:39.658681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.099 [2024-07-13 10:15:39.671833] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.099 [2024-07-13 10:15:39.672166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.099 [2024-07-13 10:15:39.672197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.099 [2024-07-13 10:15:39.684969] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.099 [2024-07-13 10:15:39.685245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.099 [2024-07-13 10:15:39.685275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.099 [2024-07-13 10:15:39.698505] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.099 [2024-07-13 10:15:39.698947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.099 [2024-07-13 10:15:39.698977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.099 [2024-07-13 10:15:39.712723] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.099 [2024-07-13 10:15:39.713025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.099 [2024-07-13 10:15:39.713054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.099 [2024-07-13 10:15:39.727139] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.099 [2024-07-13 10:15:39.727543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.099 [2024-07-13 10:15:39.727571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.099 [2024-07-13 10:15:39.741989] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.099 [2024-07-13 10:15:39.742429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.099 [2024-07-13 10:15:39.742459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.099 [2024-07-13 10:15:39.754984] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.099 [2024-07-13 10:15:39.755379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.099 [2024-07-13 10:15:39.755407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.099 [2024-07-13 10:15:39.768346] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.099 [2024-07-13 10:15:39.768755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.099 [2024-07-13 10:15:39.768783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.099 [2024-07-13 10:15:39.781891] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.099 [2024-07-13 10:15:39.782275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.099 [2024-07-13 10:15:39.782303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.099 [2024-07-13 10:15:39.794368] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.099 [2024-07-13 10:15:39.794633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.099 [2024-07-13 10:15:39.794661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.099 [2024-07-13 10:15:39.807681] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.100 [2024-07-13 10:15:39.807955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.100 [2024-07-13 10:15:39.807984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.100 [2024-07-13 10:15:39.822271] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.100 [2024-07-13 10:15:39.822603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.100 [2024-07-13 10:15:39.822630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.100 [2024-07-13 10:15:39.834707] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.100 [2024-07-13 10:15:39.835041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.100 [2024-07-13 10:15:39.835069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.100 [2024-07-13 10:15:39.847965] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.100 [2024-07-13 10:15:39.848471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.100 [2024-07-13 10:15:39.848499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.100 [2024-07-13 10:15:39.862926] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.100 [2024-07-13 10:15:39.863402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.100 [2024-07-13 10:15:39.863429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.100 [2024-07-13 10:15:39.877013] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.100 [2024-07-13 10:15:39.877404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.100 [2024-07-13 10:15:39.877433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.100 [2024-07-13 10:15:39.890391] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.100 [2024-07-13 10:15:39.890911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.100 [2024-07-13 10:15:39.890939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.100 [2024-07-13 10:15:39.904825] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.100 [2024-07-13 10:15:39.905192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.100 [2024-07-13 10:15:39.905221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.360 [2024-07-13 10:15:39.917574] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.360 [2024-07-13 10:15:39.917897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.360 [2024-07-13 10:15:39.917939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.360 [2024-07-13 10:15:39.930929] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.360 [2024-07-13 10:15:39.931175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.360 [2024-07-13 10:15:39.931204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.360 [2024-07-13 10:15:39.946485] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.360 [2024-07-13 10:15:39.946928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.360 [2024-07-13 10:15:39.946957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.360 [2024-07-13 10:15:39.960517] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.360 [2024-07-13 10:15:39.961175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.360 [2024-07-13 10:15:39.961204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.360 [2024-07-13 10:15:39.974940] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.360 [2024-07-13 10:15:39.975467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.360 [2024-07-13 10:15:39.975495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.360 [2024-07-13 10:15:39.988192] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.360 [2024-07-13 10:15:39.988418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.360 [2024-07-13 10:15:39.988445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.360 [2024-07-13 10:15:40.001484] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.360 [2024-07-13 10:15:40.001875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.360 [2024-07-13 10:15:40.001903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.360 [2024-07-13 10:15:40.013801] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.360 [2024-07-13 10:15:40.014086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.360 [2024-07-13 10:15:40.014129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.360 [2024-07-13 10:15:40.027033] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.360 [2024-07-13 10:15:40.027250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.360 [2024-07-13 10:15:40.027278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.360 [2024-07-13 10:15:40.040153] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.360 [2024-07-13 10:15:40.040319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.360 [2024-07-13 10:15:40.040348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.360 [2024-07-13 10:15:40.052218] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.360 [2024-07-13 10:15:40.052585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.360 [2024-07-13 10:15:40.052613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.360 [2024-07-13 10:15:40.066020] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.360 [2024-07-13 10:15:40.066438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.360 [2024-07-13 10:15:40.066467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.360 [2024-07-13 10:15:40.079088] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.360 [2024-07-13 10:15:40.079483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.360 [2024-07-13 10:15:40.079511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.360 [2024-07-13 10:15:40.092319] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.360 [2024-07-13 10:15:40.092705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.360 [2024-07-13 10:15:40.092748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.360 [2024-07-13 10:15:40.105825] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.360 [2024-07-13 10:15:40.106352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.360 [2024-07-13 10:15:40.106379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.360 [2024-07-13 10:15:40.120556] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.360 [2024-07-13 10:15:40.121055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.360 [2024-07-13 10:15:40.121084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.360 [2024-07-13 10:15:40.134543] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.360 [2024-07-13 10:15:40.134936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.360 [2024-07-13 10:15:40.134964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.360 [2024-07-13 10:15:40.147103] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.360 [2024-07-13 10:15:40.147385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.360 [2024-07-13 10:15:40.147413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.360 [2024-07-13 10:15:40.159207] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.360 [2024-07-13 10:15:40.159673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.360 [2024-07-13 10:15:40.159701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.360 [2024-07-13 10:15:40.174456] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.360 [2024-07-13 10:15:40.175045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.360 [2024-07-13 10:15:40.175076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.619 [2024-07-13 10:15:40.189103] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.619 [2024-07-13 10:15:40.189533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.619 [2024-07-13 10:15:40.189563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.619 [2024-07-13 10:15:40.203475] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.619 [2024-07-13 10:15:40.203965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.619 [2024-07-13 10:15:40.203993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.619 [2024-07-13 10:15:40.217303] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.619 [2024-07-13 10:15:40.217682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.619 [2024-07-13 10:15:40.217709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.619 [2024-07-13 10:15:40.231367] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.619 [2024-07-13 10:15:40.231686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.619 [2024-07-13 10:15:40.231713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.619 [2024-07-13 10:15:40.245400] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.619 [2024-07-13 10:15:40.245644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.619 [2024-07-13 10:15:40.245670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.619 [2024-07-13 10:15:40.257875] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.619 [2024-07-13 10:15:40.258261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.619 [2024-07-13 10:15:40.258301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.619 [2024-07-13 10:15:40.271012] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.619 [2024-07-13 10:15:40.271259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.619 [2024-07-13 10:15:40.271287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.619 [2024-07-13 10:15:40.283757] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.619 [2024-07-13 10:15:40.284019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.619 [2024-07-13 10:15:40.284047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.619 [2024-07-13 10:15:40.298180] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.619 [2024-07-13 10:15:40.298538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.619 [2024-07-13 10:15:40.298565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.619 [2024-07-13 10:15:40.312450] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.619 [2024-07-13 10:15:40.312855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.619 [2024-07-13 10:15:40.312892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.619 [2024-07-13 10:15:40.326743] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.619 [2024-07-13 10:15:40.327077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.619 [2024-07-13 10:15:40.327105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.619 [2024-07-13 10:15:40.339010] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.619 [2024-07-13 10:15:40.339302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.619 [2024-07-13 10:15:40.339329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.619 [2024-07-13 10:15:40.351942] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.619 [2024-07-13 10:15:40.352209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.619 [2024-07-13 10:15:40.352235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.619 [2024-07-13 10:15:40.365963] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.620 [2024-07-13 10:15:40.366195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.620 [2024-07-13 10:15:40.366227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.620 [2024-07-13 10:15:40.377807] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.620 [2024-07-13 10:15:40.378402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.620 [2024-07-13 10:15:40.378429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.620 [2024-07-13 10:15:40.391334] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.620 [2024-07-13 10:15:40.391636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.620 [2024-07-13 10:15:40.391663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.620 [2024-07-13 10:15:40.404978] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.620 [2024-07-13 10:15:40.405353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.620 [2024-07-13 10:15:40.405380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.620 [2024-07-13 10:15:40.420171] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.620 [2024-07-13 10:15:40.420489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.620 [2024-07-13 10:15:40.420516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.620 [2024-07-13 10:15:40.435258] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.620 [2024-07-13 10:15:40.435784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.620 [2024-07-13 10:15:40.435816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.879 [2024-07-13 10:15:40.452713] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.879 [2024-07-13 10:15:40.453135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.879 [2024-07-13 10:15:40.453179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.879 [2024-07-13 10:15:40.467346] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.879 [2024-07-13 10:15:40.467778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.879 [2024-07-13 10:15:40.467805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.879 [2024-07-13 10:15:40.482062] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.879 [2024-07-13 10:15:40.482461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.879 [2024-07-13 10:15:40.482489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.879 [2024-07-13 10:15:40.495924] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.879 [2024-07-13 10:15:40.496425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.879 [2024-07-13 10:15:40.496452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.879 [2024-07-13 10:15:40.509617] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.879 [2024-07-13 10:15:40.510059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.879 [2024-07-13 10:15:40.510087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.879 [2024-07-13 10:15:40.521509] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.879 [2024-07-13 10:15:40.521930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.879 [2024-07-13 10:15:40.521959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.879 [2024-07-13 10:15:40.534563] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.879 [2024-07-13 10:15:40.534752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.879 [2024-07-13 10:15:40.534779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.879 [2024-07-13 10:15:40.547247] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.879 [2024-07-13 10:15:40.547581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.879 [2024-07-13 10:15:40.547608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.879 [2024-07-13 10:15:40.561554] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.879 [2024-07-13 10:15:40.561963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.879 [2024-07-13 10:15:40.561991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.879 [2024-07-13 10:15:40.573939] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.879 [2024-07-13 10:15:40.574311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.879 [2024-07-13 10:15:40.574339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.879 [2024-07-13 10:15:40.587544] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.879 [2024-07-13 10:15:40.587745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.879 [2024-07-13 10:15:40.587774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.879 [2024-07-13 10:15:40.600715] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.879 [2024-07-13 10:15:40.601091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.879 [2024-07-13 10:15:40.601124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.879 [2024-07-13 10:15:40.614207] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.879 [2024-07-13 10:15:40.614588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.879 [2024-07-13 10:15:40.614617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.879 [2024-07-13 10:15:40.628123] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.879 [2024-07-13 10:15:40.628483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.879 [2024-07-13 10:15:40.628510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.879 [2024-07-13 10:15:40.642561] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.879 [2024-07-13 10:15:40.643012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.879 [2024-07-13 10:15:40.643040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.879 [2024-07-13 10:15:40.657120] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.879 [2024-07-13 10:15:40.657586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.879 [2024-07-13 10:15:40.657613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.879 [2024-07-13 10:15:40.671057] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.879 [2024-07-13 10:15:40.671524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.879 [2024-07-13 10:15:40.671551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.880 [2024-07-13 10:15:40.685632] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:34.880 [2024-07-13 10:15:40.685910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.880 [2024-07-13 10:15:40.685938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.138 [2024-07-13 10:15:40.699403] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.138 [2024-07-13 10:15:40.699916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.138 [2024-07-13 10:15:40.699946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.138 [2024-07-13 10:15:40.712056] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.138 [2024-07-13 10:15:40.712516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.138 [2024-07-13 10:15:40.712544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.138 [2024-07-13 10:15:40.724828] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.138 [2024-07-13 10:15:40.725152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.139 [2024-07-13 10:15:40.725186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.139 [2024-07-13 10:15:40.738769] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.139 [2024-07-13 10:15:40.739131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.139 [2024-07-13 10:15:40.739159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.139 [2024-07-13 10:15:40.750920] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.139 [2024-07-13 10:15:40.751236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.139 [2024-07-13 10:15:40.751262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.139 [2024-07-13 10:15:40.765369] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.139 [2024-07-13 10:15:40.765693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.139 [2024-07-13 10:15:40.765721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.139 [2024-07-13 10:15:40.779756] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.139 [2024-07-13 10:15:40.780153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.139 [2024-07-13 10:15:40.780196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.139 [2024-07-13 10:15:40.793910] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.139 [2024-07-13 10:15:40.794228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.139 [2024-07-13 10:15:40.794255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.139 [2024-07-13 10:15:40.806796] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.139 [2024-07-13 10:15:40.807217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.139 [2024-07-13 10:15:40.807244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.139 [2024-07-13 10:15:40.819930] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.139 [2024-07-13 10:15:40.820227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.139 [2024-07-13 10:15:40.820254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.139 [2024-07-13 10:15:40.832722] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.139 [2024-07-13 10:15:40.832995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.139 [2024-07-13 10:15:40.833023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.139 [2024-07-13 10:15:40.845756] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.139 [2024-07-13 10:15:40.846078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.139 [2024-07-13 10:15:40.846106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.139 [2024-07-13 10:15:40.857534] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.139 [2024-07-13 10:15:40.857788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.139 [2024-07-13 10:15:40.857815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.139 [2024-07-13 10:15:40.870155] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.139 [2024-07-13 10:15:40.870480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.139 [2024-07-13 10:15:40.870506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.139 [2024-07-13 10:15:40.883662] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.139 [2024-07-13 10:15:40.884062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.139 [2024-07-13 10:15:40.884089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.139 [2024-07-13 10:15:40.896020] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.139 [2024-07-13 10:15:40.896447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.139 [2024-07-13 10:15:40.896473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.139 [2024-07-13 10:15:40.910497] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.139 [2024-07-13 10:15:40.910759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.139 [2024-07-13 10:15:40.910786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.139 [2024-07-13 10:15:40.925170] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.139 [2024-07-13 10:15:40.925475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.139 [2024-07-13 10:15:40.925503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.139 [2024-07-13 10:15:40.938490] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.139 [2024-07-13 10:15:40.938901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.139 [2024-07-13 10:15:40.938929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.139 [2024-07-13 10:15:40.950450] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.139 [2024-07-13 10:15:40.950886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.139 [2024-07-13 10:15:40.950931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.398 [2024-07-13 10:15:40.964363] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.398 [2024-07-13 10:15:40.964683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.398 [2024-07-13 10:15:40.964714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.398 [2024-07-13 10:15:40.976402] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.398 [2024-07-13 10:15:40.976892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.398 [2024-07-13 10:15:40.976921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.398 [2024-07-13 10:15:40.989246] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.398 [2024-07-13 10:15:40.989465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.398 [2024-07-13 10:15:40.989492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.398 [2024-07-13 10:15:41.002190] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.398 [2024-07-13 10:15:41.002555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.398 [2024-07-13 10:15:41.002583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.398 [2024-07-13 10:15:41.015148] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.398 [2024-07-13 10:15:41.015487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.398 [2024-07-13 10:15:41.015513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.398 [2024-07-13 10:15:41.029135] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.398 [2024-07-13 10:15:41.029578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.398 [2024-07-13 10:15:41.029605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.399 [2024-07-13 10:15:41.042583] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.399 [2024-07-13 10:15:41.042975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.399 [2024-07-13 10:15:41.043003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.399 [2024-07-13 10:15:41.055312] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.399 [2024-07-13 10:15:41.055806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.399 [2024-07-13 10:15:41.055833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.399 [2024-07-13 10:15:41.067605] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.399 [2024-07-13 10:15:41.067950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.399 [2024-07-13 10:15:41.067978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.399 [2024-07-13 10:15:41.081836] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.399 [2024-07-13 10:15:41.082147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.399 [2024-07-13 10:15:41.082175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.399 [2024-07-13 10:15:41.094825] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.399 [2024-07-13 10:15:41.095252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.399 [2024-07-13 10:15:41.095279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.399 [2024-07-13 10:15:41.109619] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.399 [2024-07-13 10:15:41.110008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.399 [2024-07-13 10:15:41.110036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.399 [2024-07-13 10:15:41.123623] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.399 [2024-07-13 10:15:41.124135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.399 [2024-07-13 10:15:41.124163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.399 [2024-07-13 10:15:41.137901] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.399 [2024-07-13 10:15:41.138413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.399 [2024-07-13 10:15:41.138441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.399 [2024-07-13 10:15:41.152581] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.399 [2024-07-13 10:15:41.152970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.399 [2024-07-13 10:15:41.152998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.399 [2024-07-13 10:15:41.166223] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.399 [2024-07-13 10:15:41.166741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.399 [2024-07-13 10:15:41.166768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.399 [2024-07-13 10:15:41.180231] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.399 [2024-07-13 10:15:41.180563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.399 [2024-07-13 10:15:41.180590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.399 [2024-07-13 10:15:41.195325] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.399 [2024-07-13 10:15:41.195827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.399 [2024-07-13 10:15:41.195854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.399 [2024-07-13 10:15:41.209800] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.399 [2024-07-13 10:15:41.210104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.399 [2024-07-13 10:15:41.210131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.658 [2024-07-13 10:15:41.224668] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.658 [2024-07-13 10:15:41.225147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.658 [2024-07-13 10:15:41.225193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.658 [2024-07-13 10:15:41.238725] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.658 [2024-07-13 10:15:41.238974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.658 [2024-07-13 10:15:41.239003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.658 [2024-07-13 10:15:41.251366] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.658 [2024-07-13 10:15:41.251821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.658 [2024-07-13 10:15:41.251863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.658 [2024-07-13 10:15:41.263558] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.658 [2024-07-13 10:15:41.264096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.658 [2024-07-13 10:15:41.264126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.658 [2024-07-13 10:15:41.277620] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.658 [2024-07-13 10:15:41.278042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.658 [2024-07-13 10:15:41.278071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.658 [2024-07-13 10:15:41.289990] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.658 [2024-07-13 10:15:41.290330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.658 [2024-07-13 10:15:41.290358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.658 [2024-07-13 10:15:41.304341] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.658 [2024-07-13 10:15:41.304633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.658 [2024-07-13 10:15:41.304664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.658 [2024-07-13 10:15:41.319090] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.658 [2024-07-13 10:15:41.319484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.658 [2024-07-13 10:15:41.319510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.658 [2024-07-13 10:15:41.333262] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.658 [2024-07-13 10:15:41.333568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.658 [2024-07-13 10:15:41.333596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.658 [2024-07-13 10:15:41.346451] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.658 [2024-07-13 10:15:41.346963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.658 [2024-07-13 10:15:41.347005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.658 [2024-07-13 10:15:41.361516] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.658 [2024-07-13 10:15:41.361959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.658 [2024-07-13 10:15:41.361987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.658 [2024-07-13 10:15:41.374216] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.658 [2024-07-13 10:15:41.374525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.658 [2024-07-13 10:15:41.374553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.658 [2024-07-13 10:15:41.387614] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.658 [2024-07-13 10:15:41.387955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.658 [2024-07-13 10:15:41.387983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.658 [2024-07-13 10:15:41.401627] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.658 [2024-07-13 10:15:41.402027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.659 [2024-07-13 10:15:41.402054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.659 [2024-07-13 10:15:41.414914] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.659 [2024-07-13 10:15:41.415186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.659 [2024-07-13 10:15:41.415213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.659 [2024-07-13 10:15:41.427217] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.659 [2024-07-13 10:15:41.427497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.659 [2024-07-13 10:15:41.427525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.659 [2024-07-13 10:15:41.439955] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.659 [2024-07-13 10:15:41.440349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.659 [2024-07-13 10:15:41.440376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.659 [2024-07-13 10:15:41.453230] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.659 [2024-07-13 10:15:41.453678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.659 [2024-07-13 10:15:41.453705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.659 [2024-07-13 10:15:41.468106] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.659 [2024-07-13 10:15:41.468533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.659 [2024-07-13 10:15:41.468561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.917 [2024-07-13 10:15:41.482632] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.917 [2024-07-13 10:15:41.483082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.917 [2024-07-13 10:15:41.483113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.917 [2024-07-13 10:15:41.495689] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.917 [2024-07-13 10:15:41.496107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.917 [2024-07-13 10:15:41.496136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.917 [2024-07-13 10:15:41.509808] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.917 [2024-07-13 10:15:41.510298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.917 [2024-07-13 10:15:41.510326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.917 [2024-07-13 10:15:41.524248] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.917 [2024-07-13 10:15:41.524642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.917 [2024-07-13 10:15:41.524669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.917 [2024-07-13 10:15:41.537762] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.917 [2024-07-13 10:15:41.538045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.917 [2024-07-13 10:15:41.538073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.917 [2024-07-13 10:15:41.551640] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.917 [2024-07-13 10:15:41.552103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.917 [2024-07-13 10:15:41.552131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.917 [2024-07-13 10:15:41.565260] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.917 [2024-07-13 10:15:41.565756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.917 [2024-07-13 10:15:41.565783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.917 [2024-07-13 10:15:41.579789] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.917 [2024-07-13 10:15:41.580137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.917 [2024-07-13 10:15:41.580166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.917 [2024-07-13 10:15:41.598999] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.917 [2024-07-13 10:15:41.599500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.917 [2024-07-13 10:15:41.599527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.917 [2024-07-13 10:15:41.613103] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.918 [2024-07-13 10:15:41.613369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.918 [2024-07-13 10:15:41.613395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.918 [2024-07-13 10:15:41.626628] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe12a50) with pdu=0x2000190fef90 00:29:35.918 [2024-07-13 10:15:41.627032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.918 [2024-07-13 10:15:41.627060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.918 00:29:35.918 Latency(us) 00:29:35.918 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:35.918 Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:29:35.918 nvme0n1 : 2.01 2258.75 282.34 0.00 0.00 7064.82 4975.88 17961.72 00:29:35.918 =================================================================================================================== 00:29:35.918 Total : 2258.75 282.34 0.00 0.00 7064.82 4975.88 17961.72 00:29:35.918 0 00:29:35.918 10:15:41 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:35.918 10:15:41 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:35.918 10:15:41 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:35.918 10:15:41 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:35.918 | .driver_specific 00:29:35.918 | .nvme_error 00:29:35.918 | .status_code 00:29:35.918 | .command_transient_transport_error' 00:29:36.176 10:15:41 -- host/digest.sh@71 -- # (( 146 > 0 )) 00:29:36.176 10:15:41 -- host/digest.sh@73 -- # killprocess 2934933 00:29:36.176 10:15:41 -- common/autotest_common.sh@926 -- # '[' -z 2934933 ']' 00:29:36.176 10:15:41 -- common/autotest_common.sh@930 -- # kill -0 2934933 00:29:36.176 10:15:41 -- common/autotest_common.sh@931 -- # uname 00:29:36.176 10:15:41 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:36.176 10:15:41 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2934933 00:29:36.176 10:15:41 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:29:36.176 10:15:41 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:29:36.176 10:15:41 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2934933' 00:29:36.176 killing process with pid 2934933 00:29:36.176 10:15:41 -- common/autotest_common.sh@945 -- # kill 2934933 00:29:36.176 Received shutdown signal, test time was about 2.000000 seconds 00:29:36.176 00:29:36.176 Latency(us) 00:29:36.176 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:36.176 =================================================================================================================== 00:29:36.176 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:36.176 10:15:41 -- common/autotest_common.sh@950 -- # wait 2934933 00:29:36.434 10:15:42 -- host/digest.sh@115 -- # killprocess 2933267 00:29:36.434 10:15:42 -- common/autotest_common.sh@926 -- # '[' -z 2933267 ']' 00:29:36.434 10:15:42 -- common/autotest_common.sh@930 -- # kill -0 2933267 00:29:36.434 10:15:42 -- common/autotest_common.sh@931 -- # uname 00:29:36.434 10:15:42 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:36.434 10:15:42 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2933267 00:29:36.434 10:15:42 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:29:36.434 10:15:42 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:29:36.434 10:15:42 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2933267' 00:29:36.434 killing process with pid 2933267 00:29:36.434 10:15:42 -- common/autotest_common.sh@945 -- # kill 2933267 00:29:36.434 10:15:42 -- common/autotest_common.sh@950 -- # wait 2933267 00:29:36.692 00:29:36.692 real 0m17.928s 00:29:36.692 user 0m36.289s 00:29:36.692 sys 0m4.351s 00:29:36.692 10:15:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:29:36.692 10:15:42 -- common/autotest_common.sh@10 -- # set +x 00:29:36.692 ************************************ 00:29:36.692 END TEST nvmf_digest_error 00:29:36.692 ************************************ 00:29:36.692 10:15:42 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:29:36.692 10:15:42 -- host/digest.sh@139 -- # nvmftestfini 00:29:36.692 10:15:42 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:36.692 10:15:42 -- nvmf/common.sh@116 -- # sync 00:29:36.692 10:15:42 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:36.692 10:15:42 -- nvmf/common.sh@119 -- # set +e 00:29:36.692 10:15:42 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:36.692 10:15:42 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:36.692 rmmod nvme_tcp 00:29:36.692 rmmod nvme_fabrics 00:29:36.692 rmmod nvme_keyring 00:29:36.692 10:15:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:36.692 10:15:42 -- nvmf/common.sh@123 -- # set -e 00:29:36.692 10:15:42 -- nvmf/common.sh@124 -- # return 0 00:29:36.692 10:15:42 -- nvmf/common.sh@477 -- # '[' -n 2933267 ']' 00:29:36.692 10:15:42 -- nvmf/common.sh@478 -- # killprocess 2933267 00:29:36.692 10:15:42 -- common/autotest_common.sh@926 -- # '[' -z 2933267 ']' 00:29:36.692 10:15:42 -- common/autotest_common.sh@930 -- # kill -0 2933267 00:29:36.692 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (2933267) - No such process 00:29:36.692 10:15:42 -- common/autotest_common.sh@953 -- # echo 'Process with pid 2933267 is not found' 00:29:36.692 Process with pid 2933267 is not found 00:29:36.692 10:15:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:36.692 10:15:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:36.693 10:15:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:36.693 10:15:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:36.693 10:15:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:36.693 10:15:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:36.693 10:15:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:36.693 10:15:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:39.224 10:15:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:39.224 00:29:39.224 real 0m37.346s 00:29:39.224 user 1m4.839s 00:29:39.224 sys 0m10.037s 00:29:39.224 10:15:44 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:29:39.224 10:15:44 -- common/autotest_common.sh@10 -- # set +x 00:29:39.224 ************************************ 00:29:39.224 END TEST nvmf_digest 00:29:39.224 ************************************ 00:29:39.224 10:15:44 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:29:39.224 10:15:44 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:29:39.224 10:15:44 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:29:39.224 10:15:44 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:29:39.224 10:15:44 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:29:39.224 10:15:44 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:29:39.224 10:15:44 -- common/autotest_common.sh@10 -- # set +x 00:29:39.224 ************************************ 00:29:39.224 START TEST nvmf_bdevperf 00:29:39.224 ************************************ 00:29:39.224 10:15:44 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:29:39.224 * Looking for test storage... 00:29:39.224 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:39.224 10:15:44 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:39.224 10:15:44 -- nvmf/common.sh@7 -- # uname -s 00:29:39.224 10:15:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:39.224 10:15:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:39.224 10:15:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:39.225 10:15:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:39.225 10:15:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:39.225 10:15:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:39.225 10:15:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:39.225 10:15:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:39.225 10:15:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:39.225 10:15:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:39.225 10:15:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:39.225 10:15:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:39.225 10:15:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:39.225 10:15:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:39.225 10:15:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:39.225 10:15:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:39.225 10:15:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:39.225 10:15:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:39.225 10:15:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:39.225 10:15:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:39.225 10:15:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:39.225 10:15:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:39.225 10:15:44 -- paths/export.sh@5 -- # export PATH 00:29:39.225 10:15:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:39.225 10:15:44 -- nvmf/common.sh@46 -- # : 0 00:29:39.225 10:15:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:39.225 10:15:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:39.225 10:15:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:39.225 10:15:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:39.225 10:15:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:39.225 10:15:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:39.225 10:15:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:39.225 10:15:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:39.225 10:15:44 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:29:39.225 10:15:44 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:29:39.225 10:15:44 -- host/bdevperf.sh@24 -- # nvmftestinit 00:29:39.225 10:15:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:39.225 10:15:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:39.225 10:15:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:39.225 10:15:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:39.225 10:15:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:39.225 10:15:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:39.225 10:15:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:39.225 10:15:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:39.225 10:15:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:39.225 10:15:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:39.225 10:15:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:39.225 10:15:44 -- common/autotest_common.sh@10 -- # set +x 00:29:41.127 10:15:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:41.127 10:15:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:41.127 10:15:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:41.127 10:15:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:41.127 10:15:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:41.127 10:15:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:41.127 10:15:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:41.127 10:15:46 -- nvmf/common.sh@294 -- # net_devs=() 00:29:41.127 10:15:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:41.127 10:15:46 -- nvmf/common.sh@295 -- # e810=() 00:29:41.127 10:15:46 -- nvmf/common.sh@295 -- # local -ga e810 00:29:41.127 10:15:46 -- nvmf/common.sh@296 -- # x722=() 00:29:41.127 10:15:46 -- nvmf/common.sh@296 -- # local -ga x722 00:29:41.127 10:15:46 -- nvmf/common.sh@297 -- # mlx=() 00:29:41.127 10:15:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:41.127 10:15:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:41.127 10:15:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:41.127 10:15:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:41.127 10:15:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:41.127 10:15:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:41.127 10:15:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:41.127 10:15:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:41.127 10:15:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:41.127 10:15:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:41.127 10:15:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:41.127 10:15:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:41.127 10:15:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:41.127 10:15:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:41.127 10:15:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:41.127 10:15:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:41.127 10:15:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:41.127 10:15:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:41.127 10:15:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:41.127 10:15:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:41.127 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:41.127 10:15:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:41.127 10:15:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:41.127 10:15:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:41.127 10:15:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:41.127 10:15:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:41.127 10:15:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:41.127 10:15:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:41.127 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:41.127 10:15:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:41.127 10:15:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:41.127 10:15:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:41.127 10:15:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:41.127 10:15:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:41.127 10:15:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:41.127 10:15:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:41.127 10:15:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:41.127 10:15:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:41.127 10:15:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:41.127 10:15:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:41.127 10:15:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:41.127 10:15:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:41.127 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:41.127 10:15:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:41.127 10:15:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:41.127 10:15:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:41.127 10:15:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:41.127 10:15:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:41.127 10:15:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:41.127 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:41.127 10:15:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:41.127 10:15:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:41.127 10:15:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:41.127 10:15:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:41.127 10:15:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:41.127 10:15:46 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:41.127 10:15:46 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:41.127 10:15:46 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:41.127 10:15:46 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:41.127 10:15:46 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:41.127 10:15:46 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:41.127 10:15:46 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:41.127 10:15:46 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:41.127 10:15:46 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:41.127 10:15:46 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:41.127 10:15:46 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:41.127 10:15:46 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:41.127 10:15:46 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:41.127 10:15:46 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:41.127 10:15:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:41.127 10:15:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:41.127 10:15:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:41.127 10:15:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:41.127 10:15:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:41.127 10:15:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:41.127 10:15:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:41.127 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:41.127 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.227 ms 00:29:41.127 00:29:41.127 --- 10.0.0.2 ping statistics --- 00:29:41.127 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:41.127 rtt min/avg/max/mdev = 0.227/0.227/0.227/0.000 ms 00:29:41.127 10:15:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:41.127 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:41.127 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.154 ms 00:29:41.127 00:29:41.127 --- 10.0.0.1 ping statistics --- 00:29:41.127 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:41.127 rtt min/avg/max/mdev = 0.154/0.154/0.154/0.000 ms 00:29:41.127 10:15:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:41.127 10:15:46 -- nvmf/common.sh@410 -- # return 0 00:29:41.127 10:15:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:41.127 10:15:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:41.127 10:15:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:41.127 10:15:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:41.127 10:15:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:41.127 10:15:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:41.127 10:15:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:41.127 10:15:46 -- host/bdevperf.sh@25 -- # tgt_init 00:29:41.127 10:15:46 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:29:41.127 10:15:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:41.127 10:15:46 -- common/autotest_common.sh@712 -- # xtrace_disable 00:29:41.127 10:15:46 -- common/autotest_common.sh@10 -- # set +x 00:29:41.127 10:15:46 -- nvmf/common.sh@469 -- # nvmfpid=2937443 00:29:41.127 10:15:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:29:41.127 10:15:46 -- nvmf/common.sh@470 -- # waitforlisten 2937443 00:29:41.127 10:15:46 -- common/autotest_common.sh@819 -- # '[' -z 2937443 ']' 00:29:41.127 10:15:46 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:41.127 10:15:46 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:41.127 10:15:46 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:41.127 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:41.127 10:15:46 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:41.127 10:15:46 -- common/autotest_common.sh@10 -- # set +x 00:29:41.127 [2024-07-13 10:15:46.825944] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:29:41.127 [2024-07-13 10:15:46.826026] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:41.127 EAL: No free 2048 kB hugepages reported on node 1 00:29:41.127 [2024-07-13 10:15:46.888638] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:29:41.386 [2024-07-13 10:15:46.974194] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:41.386 [2024-07-13 10:15:46.974356] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:41.386 [2024-07-13 10:15:46.974384] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:41.386 [2024-07-13 10:15:46.974396] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:41.386 [2024-07-13 10:15:46.974479] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:29:41.386 [2024-07-13 10:15:46.974550] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:29:41.386 [2024-07-13 10:15:46.974553] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:42.320 10:15:47 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:42.320 10:15:47 -- common/autotest_common.sh@852 -- # return 0 00:29:42.320 10:15:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:42.320 10:15:47 -- common/autotest_common.sh@718 -- # xtrace_disable 00:29:42.320 10:15:47 -- common/autotest_common.sh@10 -- # set +x 00:29:42.320 10:15:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:42.320 10:15:47 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:29:42.320 10:15:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:42.320 10:15:47 -- common/autotest_common.sh@10 -- # set +x 00:29:42.320 [2024-07-13 10:15:47.833793] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:42.320 10:15:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:42.320 10:15:47 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:29:42.320 10:15:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:42.320 10:15:47 -- common/autotest_common.sh@10 -- # set +x 00:29:42.320 Malloc0 00:29:42.320 10:15:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:42.320 10:15:47 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:29:42.320 10:15:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:42.320 10:15:47 -- common/autotest_common.sh@10 -- # set +x 00:29:42.320 10:15:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:42.320 10:15:47 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:29:42.320 10:15:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:42.320 10:15:47 -- common/autotest_common.sh@10 -- # set +x 00:29:42.320 10:15:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:42.320 10:15:47 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:42.320 10:15:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:42.320 10:15:47 -- common/autotest_common.sh@10 -- # set +x 00:29:42.320 [2024-07-13 10:15:47.890237] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:42.320 10:15:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:42.320 10:15:47 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:29:42.320 10:15:47 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:29:42.320 10:15:47 -- nvmf/common.sh@520 -- # config=() 00:29:42.320 10:15:47 -- nvmf/common.sh@520 -- # local subsystem config 00:29:42.320 10:15:47 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:42.321 10:15:47 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:42.321 { 00:29:42.321 "params": { 00:29:42.321 "name": "Nvme$subsystem", 00:29:42.321 "trtype": "$TEST_TRANSPORT", 00:29:42.321 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:42.321 "adrfam": "ipv4", 00:29:42.321 "trsvcid": "$NVMF_PORT", 00:29:42.321 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:42.321 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:42.321 "hdgst": ${hdgst:-false}, 00:29:42.321 "ddgst": ${ddgst:-false} 00:29:42.321 }, 00:29:42.321 "method": "bdev_nvme_attach_controller" 00:29:42.321 } 00:29:42.321 EOF 00:29:42.321 )") 00:29:42.321 10:15:47 -- nvmf/common.sh@542 -- # cat 00:29:42.321 10:15:47 -- nvmf/common.sh@544 -- # jq . 00:29:42.321 10:15:47 -- nvmf/common.sh@545 -- # IFS=, 00:29:42.321 10:15:47 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:42.321 "params": { 00:29:42.321 "name": "Nvme1", 00:29:42.321 "trtype": "tcp", 00:29:42.321 "traddr": "10.0.0.2", 00:29:42.321 "adrfam": "ipv4", 00:29:42.321 "trsvcid": "4420", 00:29:42.321 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:42.321 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:42.321 "hdgst": false, 00:29:42.321 "ddgst": false 00:29:42.321 }, 00:29:42.321 "method": "bdev_nvme_attach_controller" 00:29:42.321 }' 00:29:42.321 [2024-07-13 10:15:47.936057] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:29:42.321 [2024-07-13 10:15:47.936122] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2937598 ] 00:29:42.321 EAL: No free 2048 kB hugepages reported on node 1 00:29:42.321 [2024-07-13 10:15:47.995223] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:42.321 [2024-07-13 10:15:48.080475] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:42.580 Running I/O for 1 seconds... 00:29:43.513 00:29:43.513 Latency(us) 00:29:43.513 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:43.513 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:29:43.513 Verification LBA range: start 0x0 length 0x4000 00:29:43.513 Nvme1n1 : 1.01 12899.51 50.39 0.00 0.00 9880.12 1347.13 17087.91 00:29:43.513 =================================================================================================================== 00:29:43.513 Total : 12899.51 50.39 0.00 0.00 9880.12 1347.13 17087.91 00:29:43.770 10:15:49 -- host/bdevperf.sh@30 -- # bdevperfpid=2937832 00:29:43.771 10:15:49 -- host/bdevperf.sh@32 -- # sleep 3 00:29:43.771 10:15:49 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:29:43.771 10:15:49 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:29:43.771 10:15:49 -- nvmf/common.sh@520 -- # config=() 00:29:43.771 10:15:49 -- nvmf/common.sh@520 -- # local subsystem config 00:29:43.771 10:15:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:43.771 10:15:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:43.771 { 00:29:43.771 "params": { 00:29:43.771 "name": "Nvme$subsystem", 00:29:43.771 "trtype": "$TEST_TRANSPORT", 00:29:43.771 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:43.771 "adrfam": "ipv4", 00:29:43.771 "trsvcid": "$NVMF_PORT", 00:29:43.771 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:43.771 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:43.771 "hdgst": ${hdgst:-false}, 00:29:43.771 "ddgst": ${ddgst:-false} 00:29:43.771 }, 00:29:43.771 "method": "bdev_nvme_attach_controller" 00:29:43.771 } 00:29:43.771 EOF 00:29:43.771 )") 00:29:43.771 10:15:49 -- nvmf/common.sh@542 -- # cat 00:29:43.771 10:15:49 -- nvmf/common.sh@544 -- # jq . 00:29:43.771 10:15:49 -- nvmf/common.sh@545 -- # IFS=, 00:29:43.771 10:15:49 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:43.771 "params": { 00:29:43.771 "name": "Nvme1", 00:29:43.771 "trtype": "tcp", 00:29:43.771 "traddr": "10.0.0.2", 00:29:43.771 "adrfam": "ipv4", 00:29:43.771 "trsvcid": "4420", 00:29:43.771 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:43.771 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:43.771 "hdgst": false, 00:29:43.771 "ddgst": false 00:29:43.771 }, 00:29:43.771 "method": "bdev_nvme_attach_controller" 00:29:43.771 }' 00:29:43.771 [2024-07-13 10:15:49.511208] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:29:43.771 [2024-07-13 10:15:49.511302] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2937832 ] 00:29:43.771 EAL: No free 2048 kB hugepages reported on node 1 00:29:43.771 [2024-07-13 10:15:49.571466] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:44.028 [2024-07-13 10:15:49.658531] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:44.286 Running I/O for 15 seconds... 00:29:46.816 10:15:52 -- host/bdevperf.sh@33 -- # kill -9 2937443 00:29:46.816 10:15:52 -- host/bdevperf.sh@35 -- # sleep 3 00:29:46.816 [2024-07-13 10:15:52.483254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:125104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.816 [2024-07-13 10:15:52.483304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.816 [2024-07-13 10:15:52.483333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:124472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.816 [2024-07-13 10:15:52.483349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.816 [2024-07-13 10:15:52.483365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:124488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.816 [2024-07-13 10:15:52.483379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.816 [2024-07-13 10:15:52.483395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:124512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.816 [2024-07-13 10:15:52.483408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.816 [2024-07-13 10:15:52.483424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:124528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.816 [2024-07-13 10:15:52.483437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.816 [2024-07-13 10:15:52.483452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:124536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.816 [2024-07-13 10:15:52.483466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.816 [2024-07-13 10:15:52.483481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:124560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.816 [2024-07-13 10:15:52.483501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.816 [2024-07-13 10:15:52.483516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:124568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.816 [2024-07-13 10:15:52.483544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.816 [2024-07-13 10:15:52.483563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:124576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.816 [2024-07-13 10:15:52.483579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.816 [2024-07-13 10:15:52.483596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:125128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.816 [2024-07-13 10:15:52.483612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.816 [2024-07-13 10:15:52.483629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:125136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.816 [2024-07-13 10:15:52.483645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.817 [2024-07-13 10:15:52.483662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:125184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.817 [2024-07-13 10:15:52.483678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.817 [2024-07-13 10:15:52.483694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:125208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.817 [2024-07-13 10:15:52.483709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.817 [2024-07-13 10:15:52.483726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:125224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.817 [2024-07-13 10:15:52.483741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.817 [2024-07-13 10:15:52.483757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:124584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.817 [2024-07-13 10:15:52.483773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.817 [2024-07-13 10:15:52.483789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:124592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.817 [2024-07-13 10:15:52.483804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.817 [2024-07-13 10:15:52.483821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:124600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.817 [2024-07-13 10:15:52.483837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.817 [2024-07-13 10:15:52.483854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:124648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.817 [2024-07-13 10:15:52.483878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.817 [2024-07-13 10:15:52.483896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:124656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.817 [2024-07-13 10:15:52.483933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.817 [2024-07-13 10:15:52.483953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:124672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.817 [2024-07-13 10:15:52.483968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.817 [2024-07-13 10:15:52.483984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:124680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.817 [2024-07-13 10:15:52.483997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.817 [2024-07-13 10:15:52.484012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:124688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.817 [2024-07-13 10:15:52.484026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.817 [2024-07-13 10:15:52.484042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:125240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.817 [2024-07-13 10:15:52.484056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.817 [2024-07-13 10:15:52.484071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:125256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.817 [2024-07-13 10:15:52.484084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.817 [2024-07-13 10:15:52.484099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:125264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.817 [2024-07-13 10:15:52.484113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.817 [2024-07-13 10:15:52.484128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:125272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.817 [2024-07-13 10:15:52.484156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.817 [2024-07-13 10:15:52.484171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:125288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.817 [2024-07-13 10:15:52.484184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.817 [2024-07-13 10:15:52.484199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:125296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.817 [2024-07-13 10:15:52.484228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.817 [2024-07-13 10:15:52.484246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:125304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.817 [2024-07-13 10:15:52.484261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.817 [2024-07-13 10:15:52.484277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:125320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.817 [2024-07-13 10:15:52.484292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.817 [2024-07-13 10:15:52.484308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:125328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.817 [2024-07-13 10:15:52.484324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.817 [2024-07-13 10:15:52.484341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:125344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:46.817 [2024-07-13 10:15:52.484360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.817 [2024-07-13 10:15:52.484377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:125352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:46.817 [2024-07-13 10:15:52.484392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.817 [2024-07-13 10:15:52.484409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:125360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.817 [2024-07-13 10:15:52.484424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.817 [2024-07-13 10:15:52.484441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:125368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.817 [2024-07-13 10:15:52.484456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.817 [2024-07-13 10:15:52.484474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:125376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:46.817 [2024-07-13 10:15:52.484490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.817 [2024-07-13 10:15:52.484506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:125384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:46.817 [2024-07-13 10:15:52.484521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.817 [2024-07-13 10:15:52.484538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:125392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:46.817 [2024-07-13 10:15:52.484553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.817 [2024-07-13 10:15:52.484569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:125400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.817 [2024-07-13 10:15:52.484584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.817 [2024-07-13 10:15:52.484601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:125408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.817 [2024-07-13 10:15:52.484615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.817 [2024-07-13 10:15:52.484632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:125416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.817 [2024-07-13 10:15:52.484646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.817 [2024-07-13 10:15:52.484663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:125424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.817 [2024-07-13 10:15:52.484678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.817 [2024-07-13 10:15:52.484695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:125432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:46.817 [2024-07-13 10:15:52.484709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.817 [2024-07-13 10:15:52.484726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:125440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.817 [2024-07-13 10:15:52.484742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.817 [2024-07-13 10:15:52.484763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:125448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.817 [2024-07-13 10:15:52.484779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.817 [2024-07-13 10:15:52.484795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:125456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:46.817 [2024-07-13 10:15:52.484810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.817 [2024-07-13 10:15:52.484827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:125464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.817 [2024-07-13 10:15:52.484841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.817 [2024-07-13 10:15:52.484858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:125472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:46.817 [2024-07-13 10:15:52.484880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.817 [2024-07-13 10:15:52.484897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:125480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.817 [2024-07-13 10:15:52.484913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.817 [2024-07-13 10:15:52.484945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:125488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.817 [2024-07-13 10:15:52.484958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.817 [2024-07-13 10:15:52.484973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:125496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:46.817 [2024-07-13 10:15:52.484986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.817 [2024-07-13 10:15:52.485002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:124736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.817 [2024-07-13 10:15:52.485016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.818 [2024-07-13 10:15:52.485031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:124752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.818 [2024-07-13 10:15:52.485045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.818 [2024-07-13 10:15:52.485060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:124760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.818 [2024-07-13 10:15:52.485073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.818 [2024-07-13 10:15:52.485088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:124768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.818 [2024-07-13 10:15:52.485102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.818 [2024-07-13 10:15:52.485117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:124776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.818 [2024-07-13 10:15:52.485130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.818 [2024-07-13 10:15:52.485160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:124784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.818 [2024-07-13 10:15:52.485181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.818 [2024-07-13 10:15:52.485197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:124800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.818 [2024-07-13 10:15:52.485225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.818 [2024-07-13 10:15:52.485243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:124808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.818 [2024-07-13 10:15:52.485258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.818 [2024-07-13 10:15:52.485275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:124824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.818 [2024-07-13 10:15:52.485289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.818 [2024-07-13 10:15:52.485306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:124840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.818 [2024-07-13 10:15:52.485321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.818 [2024-07-13 10:15:52.485337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:124872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.818 [2024-07-13 10:15:52.485353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.818 [2024-07-13 10:15:52.485369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:124880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.818 [2024-07-13 10:15:52.485384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.818 [2024-07-13 10:15:52.485400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:124888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.818 [2024-07-13 10:15:52.485415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.818 [2024-07-13 10:15:52.485431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:124896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.818 [2024-07-13 10:15:52.485446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.818 [2024-07-13 10:15:52.485463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:124904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.818 [2024-07-13 10:15:52.485477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.818 [2024-07-13 10:15:52.485494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:124920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.818 [2024-07-13 10:15:52.485509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.818 [2024-07-13 10:15:52.485525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:125504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:46.818 [2024-07-13 10:15:52.485540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.818 [2024-07-13 10:15:52.485557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:125512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.818 [2024-07-13 10:15:52.485572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.818 [2024-07-13 10:15:52.485592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:125520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.818 [2024-07-13 10:15:52.485608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.818 [2024-07-13 10:15:52.485625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:124944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.818 [2024-07-13 10:15:52.485640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.818 [2024-07-13 10:15:52.485656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:124952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.818 [2024-07-13 10:15:52.485671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.818 [2024-07-13 10:15:52.485688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:124976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.818 [2024-07-13 10:15:52.485702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.818 [2024-07-13 10:15:52.485719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:124992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.818 [2024-07-13 10:15:52.485733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.818 [2024-07-13 10:15:52.485750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:125008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.818 [2024-07-13 10:15:52.485765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.818 [2024-07-13 10:15:52.485781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:125040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.818 [2024-07-13 10:15:52.485796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.818 [2024-07-13 10:15:52.485813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:125072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.818 [2024-07-13 10:15:52.485827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.818 [2024-07-13 10:15:52.485844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:125088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.818 [2024-07-13 10:15:52.485859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.818 [2024-07-13 10:15:52.485885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:125528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:46.818 [2024-07-13 10:15:52.485901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.818 [2024-07-13 10:15:52.485933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:125536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:46.818 [2024-07-13 10:15:52.485946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.818 [2024-07-13 10:15:52.485961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:125544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.818 [2024-07-13 10:15:52.485974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.818 [2024-07-13 10:15:52.485989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:125552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.818 [2024-07-13 10:15:52.486006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.818 [2024-07-13 10:15:52.486021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:125560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:46.818 [2024-07-13 10:15:52.486035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.818 [2024-07-13 10:15:52.486050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:125568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.818 [2024-07-13 10:15:52.486064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.818 [2024-07-13 10:15:52.486079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:125576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.818 [2024-07-13 10:15:52.486092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.818 [2024-07-13 10:15:52.486107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:125584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.818 [2024-07-13 10:15:52.486121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.818 [2024-07-13 10:15:52.486136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:125592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.818 [2024-07-13 10:15:52.486164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.818 [2024-07-13 10:15:52.486182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:125600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.818 [2024-07-13 10:15:52.486197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.818 [2024-07-13 10:15:52.486214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:125608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:46.818 [2024-07-13 10:15:52.486229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.818 [2024-07-13 10:15:52.486245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:125616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.818 [2024-07-13 10:15:52.486260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.818 [2024-07-13 10:15:52.486276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:125624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.818 [2024-07-13 10:15:52.486291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.818 [2024-07-13 10:15:52.486307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:125632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.818 [2024-07-13 10:15:52.486322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.818 [2024-07-13 10:15:52.486338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:125640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.819 [2024-07-13 10:15:52.486353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.819 [2024-07-13 10:15:52.486370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:125648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.819 [2024-07-13 10:15:52.486385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.819 [2024-07-13 10:15:52.486401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:125656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.819 [2024-07-13 10:15:52.486420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.819 [2024-07-13 10:15:52.486437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:125664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:46.819 [2024-07-13 10:15:52.486452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.819 [2024-07-13 10:15:52.486469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:125672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.819 [2024-07-13 10:15:52.486484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.819 [2024-07-13 10:15:52.486500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:125680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.819 [2024-07-13 10:15:52.486515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.819 [2024-07-13 10:15:52.486531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:125688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:46.819 [2024-07-13 10:15:52.486546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.819 [2024-07-13 10:15:52.486562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:125696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:46.819 [2024-07-13 10:15:52.486584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.819 [2024-07-13 10:15:52.486601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:125704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:46.819 [2024-07-13 10:15:52.486616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.819 [2024-07-13 10:15:52.486633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:125096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.819 [2024-07-13 10:15:52.486647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.819 [2024-07-13 10:15:52.486664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:125112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.819 [2024-07-13 10:15:52.486679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.819 [2024-07-13 10:15:52.486695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:125120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.819 [2024-07-13 10:15:52.486710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.819 [2024-07-13 10:15:52.486727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:125144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.819 [2024-07-13 10:15:52.486741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.819 [2024-07-13 10:15:52.486758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:125152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.819 [2024-07-13 10:15:52.486773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.819 [2024-07-13 10:15:52.486789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:125160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.819 [2024-07-13 10:15:52.486804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.819 [2024-07-13 10:15:52.486824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:125168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.819 [2024-07-13 10:15:52.486840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.819 [2024-07-13 10:15:52.486856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:125176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.819 [2024-07-13 10:15:52.486878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.819 [2024-07-13 10:15:52.486896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:125712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.819 [2024-07-13 10:15:52.486927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.819 [2024-07-13 10:15:52.486943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:125720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.819 [2024-07-13 10:15:52.486956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.819 [2024-07-13 10:15:52.486971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:125728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:46.819 [2024-07-13 10:15:52.486984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.819 [2024-07-13 10:15:52.486999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:125736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.819 [2024-07-13 10:15:52.487012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.819 [2024-07-13 10:15:52.487028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:125744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:46.819 [2024-07-13 10:15:52.487041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.819 [2024-07-13 10:15:52.487056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:125752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:46.819 [2024-07-13 10:15:52.487070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.819 [2024-07-13 10:15:52.487084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:125760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:46.819 [2024-07-13 10:15:52.487103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.819 [2024-07-13 10:15:52.487118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:125768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.819 [2024-07-13 10:15:52.487132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.819 [2024-07-13 10:15:52.487161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:125776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:46.819 [2024-07-13 10:15:52.487177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.819 [2024-07-13 10:15:52.487194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:125784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:46.819 [2024-07-13 10:15:52.487209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.819 [2024-07-13 10:15:52.487226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:125792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:46.819 [2024-07-13 10:15:52.487245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.819 [2024-07-13 10:15:52.487261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:125192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.819 [2024-07-13 10:15:52.487276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.819 [2024-07-13 10:15:52.487293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:125200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.819 [2024-07-13 10:15:52.487308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.819 [2024-07-13 10:15:52.487325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:125216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.819 [2024-07-13 10:15:52.487339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.819 [2024-07-13 10:15:52.487356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:125232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.819 [2024-07-13 10:15:52.487371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.819 [2024-07-13 10:15:52.487388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:125248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.819 [2024-07-13 10:15:52.487403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.819 [2024-07-13 10:15:52.487419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:125280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.819 [2024-07-13 10:15:52.487434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.819 [2024-07-13 10:15:52.487451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:125312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.819 [2024-07-13 10:15:52.487466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.819 [2024-07-13 10:15:52.487482] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x158c450 is same with the state(5) to be set 00:29:46.819 [2024-07-13 10:15:52.487501] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:29:46.819 [2024-07-13 10:15:52.487513] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:29:46.819 [2024-07-13 10:15:52.487525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:125336 len:8 PRP1 0x0 PRP2 0x0 00:29:46.819 [2024-07-13 10:15:52.487539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.819 [2024-07-13 10:15:52.487608] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x158c450 was disconnected and freed. reset controller. 00:29:46.819 [2024-07-13 10:15:52.487681] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:46.819 [2024-07-13 10:15:52.487705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.819 [2024-07-13 10:15:52.487722] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:46.819 [2024-07-13 10:15:52.487737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.819 [2024-07-13 10:15:52.487752] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:46.819 [2024-07-13 10:15:52.487785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.819 [2024-07-13 10:15:52.487799] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:46.819 [2024-07-13 10:15:52.487811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:46.819 [2024-07-13 10:15:52.487823] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:46.820 [2024-07-13 10:15:52.490214] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:46.820 [2024-07-13 10:15:52.490256] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:46.820 [2024-07-13 10:15:52.490885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:46.820 [2024-07-13 10:15:52.491018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:46.820 [2024-07-13 10:15:52.491044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:46.820 [2024-07-13 10:15:52.491060] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:46.820 [2024-07-13 10:15:52.491215] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:46.820 [2024-07-13 10:15:52.491458] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:46.820 [2024-07-13 10:15:52.491481] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:46.820 [2024-07-13 10:15:52.491502] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:46.820 [2024-07-13 10:15:52.493951] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:46.820 [2024-07-13 10:15:52.503033] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:46.820 [2024-07-13 10:15:52.503360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:46.820 [2024-07-13 10:15:52.503575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:46.820 [2024-07-13 10:15:52.503603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:46.820 [2024-07-13 10:15:52.503621] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:46.820 [2024-07-13 10:15:52.503751] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:46.820 [2024-07-13 10:15:52.503910] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:46.820 [2024-07-13 10:15:52.503934] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:46.820 [2024-07-13 10:15:52.503950] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:46.820 [2024-07-13 10:15:52.506345] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:46.820 [2024-07-13 10:15:52.515707] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:46.820 [2024-07-13 10:15:52.516126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:46.820 [2024-07-13 10:15:52.516307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:46.820 [2024-07-13 10:15:52.516335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:46.820 [2024-07-13 10:15:52.516353] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:46.820 [2024-07-13 10:15:52.516507] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:46.820 [2024-07-13 10:15:52.516677] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:46.820 [2024-07-13 10:15:52.516701] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:46.820 [2024-07-13 10:15:52.516716] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:46.820 [2024-07-13 10:15:52.518920] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:46.820 [2024-07-13 10:15:52.528283] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:46.820 [2024-07-13 10:15:52.528607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:46.820 [2024-07-13 10:15:52.528765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:46.820 [2024-07-13 10:15:52.528807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:46.820 [2024-07-13 10:15:52.528825] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:46.820 [2024-07-13 10:15:52.528966] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:46.820 [2024-07-13 10:15:52.529172] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:46.820 [2024-07-13 10:15:52.529195] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:46.820 [2024-07-13 10:15:52.529210] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:46.820 [2024-07-13 10:15:52.531510] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:46.820 [2024-07-13 10:15:52.540825] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:46.820 [2024-07-13 10:15:52.541170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:46.820 [2024-07-13 10:15:52.541365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:46.820 [2024-07-13 10:15:52.541408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:46.820 [2024-07-13 10:15:52.541424] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:46.820 [2024-07-13 10:15:52.541582] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:46.820 [2024-07-13 10:15:52.541758] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:46.820 [2024-07-13 10:15:52.541781] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:46.820 [2024-07-13 10:15:52.541796] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:46.820 [2024-07-13 10:15:52.544102] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:46.820 [2024-07-13 10:15:52.553361] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:46.820 [2024-07-13 10:15:52.553712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:46.820 [2024-07-13 10:15:52.553921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:46.820 [2024-07-13 10:15:52.553948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:46.820 [2024-07-13 10:15:52.553964] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:46.820 [2024-07-13 10:15:52.554147] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:46.820 [2024-07-13 10:15:52.554359] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:46.820 [2024-07-13 10:15:52.554382] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:46.820 [2024-07-13 10:15:52.554397] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:46.820 [2024-07-13 10:15:52.556772] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:46.820 [2024-07-13 10:15:52.565812] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:46.820 [2024-07-13 10:15:52.566138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:46.820 [2024-07-13 10:15:52.566318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:46.820 [2024-07-13 10:15:52.566347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:46.820 [2024-07-13 10:15:52.566364] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:46.820 [2024-07-13 10:15:52.566529] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:46.820 [2024-07-13 10:15:52.566699] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:46.820 [2024-07-13 10:15:52.566723] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:46.820 [2024-07-13 10:15:52.566738] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:46.820 [2024-07-13 10:15:52.569177] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:46.820 [2024-07-13 10:15:52.578702] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:46.820 [2024-07-13 10:15:52.579098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:46.820 [2024-07-13 10:15:52.579340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:46.820 [2024-07-13 10:15:52.579394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:46.820 [2024-07-13 10:15:52.579411] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:46.820 [2024-07-13 10:15:52.579576] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:46.820 [2024-07-13 10:15:52.579764] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:46.820 [2024-07-13 10:15:52.579787] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:46.820 [2024-07-13 10:15:52.579802] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:46.820 [2024-07-13 10:15:52.582116] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:46.820 [2024-07-13 10:15:52.591411] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:46.820 [2024-07-13 10:15:52.591727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:46.820 [2024-07-13 10:15:52.591930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:46.820 [2024-07-13 10:15:52.591960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:46.820 [2024-07-13 10:15:52.591978] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:46.820 [2024-07-13 10:15:52.592161] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:46.820 [2024-07-13 10:15:52.592331] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:46.820 [2024-07-13 10:15:52.592360] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:46.820 [2024-07-13 10:15:52.592375] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:46.820 [2024-07-13 10:15:52.594569] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:46.821 [2024-07-13 10:15:52.603892] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:46.821 [2024-07-13 10:15:52.604232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:46.821 [2024-07-13 10:15:52.604439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:46.821 [2024-07-13 10:15:52.604464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:46.821 [2024-07-13 10:15:52.604480] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:46.821 [2024-07-13 10:15:52.604680] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:46.821 [2024-07-13 10:15:52.604877] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:46.821 [2024-07-13 10:15:52.604901] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:46.821 [2024-07-13 10:15:52.604917] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:46.821 [2024-07-13 10:15:52.607110] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:46.821 [2024-07-13 10:15:52.616694] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:46.821 [2024-07-13 10:15:52.617085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:46.821 [2024-07-13 10:15:52.617284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:46.821 [2024-07-13 10:15:52.617310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:46.821 [2024-07-13 10:15:52.617326] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:46.821 [2024-07-13 10:15:52.617525] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:46.821 [2024-07-13 10:15:52.617659] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:46.821 [2024-07-13 10:15:52.617683] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:46.821 [2024-07-13 10:15:52.617698] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:46.821 [2024-07-13 10:15:52.619961] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:46.821 [2024-07-13 10:15:52.629369] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:46.821 [2024-07-13 10:15:52.629670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:46.821 [2024-07-13 10:15:52.629851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:46.821 [2024-07-13 10:15:52.629889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:46.821 [2024-07-13 10:15:52.629908] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:46.821 [2024-07-13 10:15:52.630064] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:46.821 [2024-07-13 10:15:52.630277] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:46.821 [2024-07-13 10:15:52.630310] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:46.821 [2024-07-13 10:15:52.630334] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.083 [2024-07-13 10:15:52.632792] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.083 [2024-07-13 10:15:52.642020] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.083 [2024-07-13 10:15:52.642439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.083 [2024-07-13 10:15:52.642611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.083 [2024-07-13 10:15:52.642640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.083 [2024-07-13 10:15:52.642657] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.083 [2024-07-13 10:15:52.642805] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.083 [2024-07-13 10:15:52.642965] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.083 [2024-07-13 10:15:52.642990] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.083 [2024-07-13 10:15:52.643005] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.083 [2024-07-13 10:15:52.645415] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.083 [2024-07-13 10:15:52.654410] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.083 [2024-07-13 10:15:52.654789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.083 [2024-07-13 10:15:52.654962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.083 [2024-07-13 10:15:52.654991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.083 [2024-07-13 10:15:52.655009] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.083 [2024-07-13 10:15:52.655192] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.083 [2024-07-13 10:15:52.655398] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.083 [2024-07-13 10:15:52.655422] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.083 [2024-07-13 10:15:52.655436] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.083 [2024-07-13 10:15:52.657718] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.083 [2024-07-13 10:15:52.667142] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.083 [2024-07-13 10:15:52.667634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.083 [2024-07-13 10:15:52.667841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.083 [2024-07-13 10:15:52.667966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.083 [2024-07-13 10:15:52.667992] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.083 [2024-07-13 10:15:52.668151] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.083 [2024-07-13 10:15:52.668358] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.083 [2024-07-13 10:15:52.668381] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.083 [2024-07-13 10:15:52.668397] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.083 [2024-07-13 10:15:52.670663] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.083 [2024-07-13 10:15:52.679879] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.083 [2024-07-13 10:15:52.680204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.083 [2024-07-13 10:15:52.680470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.083 [2024-07-13 10:15:52.680501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.083 [2024-07-13 10:15:52.680519] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.083 [2024-07-13 10:15:52.680703] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.083 [2024-07-13 10:15:52.680902] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.084 [2024-07-13 10:15:52.680926] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.084 [2024-07-13 10:15:52.680942] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.084 [2024-07-13 10:15:52.683422] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.084 [2024-07-13 10:15:52.692651] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.084 [2024-07-13 10:15:52.693038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.084 [2024-07-13 10:15:52.693232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.084 [2024-07-13 10:15:52.693286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.084 [2024-07-13 10:15:52.693304] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.084 [2024-07-13 10:15:52.693487] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.084 [2024-07-13 10:15:52.693693] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.084 [2024-07-13 10:15:52.693716] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.084 [2024-07-13 10:15:52.693732] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.084 [2024-07-13 10:15:52.696197] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.084 [2024-07-13 10:15:52.705275] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.084 [2024-07-13 10:15:52.705604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.084 [2024-07-13 10:15:52.705800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.084 [2024-07-13 10:15:52.705829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.084 [2024-07-13 10:15:52.705846] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.084 [2024-07-13 10:15:52.706003] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.084 [2024-07-13 10:15:52.706210] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.084 [2024-07-13 10:15:52.706233] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.084 [2024-07-13 10:15:52.706249] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.084 [2024-07-13 10:15:52.708536] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.084 [2024-07-13 10:15:52.718021] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.084 [2024-07-13 10:15:52.718397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.084 [2024-07-13 10:15:52.718736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.084 [2024-07-13 10:15:52.718782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.084 [2024-07-13 10:15:52.718800] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.084 [2024-07-13 10:15:52.718993] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.084 [2024-07-13 10:15:52.719217] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.084 [2024-07-13 10:15:52.719241] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.084 [2024-07-13 10:15:52.719256] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.084 [2024-07-13 10:15:52.721600] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.084 [2024-07-13 10:15:52.730840] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.084 [2024-07-13 10:15:52.731160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.084 [2024-07-13 10:15:52.731452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.084 [2024-07-13 10:15:52.731501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.084 [2024-07-13 10:15:52.731519] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.084 [2024-07-13 10:15:52.731665] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.084 [2024-07-13 10:15:52.731853] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.084 [2024-07-13 10:15:52.731887] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.084 [2024-07-13 10:15:52.731904] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.084 [2024-07-13 10:15:52.734334] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.084 [2024-07-13 10:15:52.743275] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.084 [2024-07-13 10:15:52.743595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.084 [2024-07-13 10:15:52.743770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.084 [2024-07-13 10:15:52.743794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.084 [2024-07-13 10:15:52.743810] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.084 [2024-07-13 10:15:52.744054] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.084 [2024-07-13 10:15:52.744227] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.084 [2024-07-13 10:15:52.744246] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.084 [2024-07-13 10:15:52.744259] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.084 [2024-07-13 10:15:52.746126] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.084 [2024-07-13 10:15:52.755888] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.084 [2024-07-13 10:15:52.756218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.084 [2024-07-13 10:15:52.756397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.084 [2024-07-13 10:15:52.756426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.084 [2024-07-13 10:15:52.756443] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.084 [2024-07-13 10:15:52.756572] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.084 [2024-07-13 10:15:52.756742] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.084 [2024-07-13 10:15:52.756766] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.084 [2024-07-13 10:15:52.756781] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.084 [2024-07-13 10:15:52.759151] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.084 [2024-07-13 10:15:52.768476] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.084 [2024-07-13 10:15:52.768855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.084 [2024-07-13 10:15:52.769036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.084 [2024-07-13 10:15:52.769064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.084 [2024-07-13 10:15:52.769081] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.084 [2024-07-13 10:15:52.769229] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.084 [2024-07-13 10:15:52.769397] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.084 [2024-07-13 10:15:52.769421] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.084 [2024-07-13 10:15:52.769437] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.084 [2024-07-13 10:15:52.771759] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.084 [2024-07-13 10:15:52.781094] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.084 [2024-07-13 10:15:52.781543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.084 [2024-07-13 10:15:52.781741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.084 [2024-07-13 10:15:52.781769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.084 [2024-07-13 10:15:52.781786] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.084 [2024-07-13 10:15:52.781940] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.084 [2024-07-13 10:15:52.782091] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.084 [2024-07-13 10:15:52.782115] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.084 [2024-07-13 10:15:52.782130] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.084 [2024-07-13 10:15:52.784413] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.084 [2024-07-13 10:15:52.793750] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.084 [2024-07-13 10:15:52.794100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.084 [2024-07-13 10:15:52.794308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.084 [2024-07-13 10:15:52.794358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.084 [2024-07-13 10:15:52.794377] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.084 [2024-07-13 10:15:52.794488] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.084 [2024-07-13 10:15:52.794658] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.084 [2024-07-13 10:15:52.794682] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.084 [2024-07-13 10:15:52.794697] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.084 [2024-07-13 10:15:52.796920] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.084 [2024-07-13 10:15:52.806376] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.084 [2024-07-13 10:15:52.806713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.084 [2024-07-13 10:15:52.806906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.084 [2024-07-13 10:15:52.806957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.084 [2024-07-13 10:15:52.806975] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.084 [2024-07-13 10:15:52.807157] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.084 [2024-07-13 10:15:52.807363] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.085 [2024-07-13 10:15:52.807387] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.085 [2024-07-13 10:15:52.807402] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.085 [2024-07-13 10:15:52.809702] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.085 [2024-07-13 10:15:52.819042] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.085 [2024-07-13 10:15:52.819462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.085 [2024-07-13 10:15:52.819747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.085 [2024-07-13 10:15:52.819773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.085 [2024-07-13 10:15:52.819789] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.085 [2024-07-13 10:15:52.819982] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.085 [2024-07-13 10:15:52.820153] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.085 [2024-07-13 10:15:52.820180] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.085 [2024-07-13 10:15:52.820195] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.085 [2024-07-13 10:15:52.822569] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.085 [2024-07-13 10:15:52.831776] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.085 [2024-07-13 10:15:52.832117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.085 [2024-07-13 10:15:52.832347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.085 [2024-07-13 10:15:52.832403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.085 [2024-07-13 10:15:52.832426] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.085 [2024-07-13 10:15:52.832574] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.085 [2024-07-13 10:15:52.832707] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.085 [2024-07-13 10:15:52.832731] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.085 [2024-07-13 10:15:52.832746] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.085 [2024-07-13 10:15:52.835013] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.085 [2024-07-13 10:15:52.844326] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.085 [2024-07-13 10:15:52.844754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.085 [2024-07-13 10:15:52.844924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.085 [2024-07-13 10:15:52.844953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.085 [2024-07-13 10:15:52.844971] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.085 [2024-07-13 10:15:52.845117] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.085 [2024-07-13 10:15:52.845269] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.085 [2024-07-13 10:15:52.845292] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.085 [2024-07-13 10:15:52.845307] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.085 [2024-07-13 10:15:52.847615] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.085 [2024-07-13 10:15:52.857089] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.085 [2024-07-13 10:15:52.857562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.085 [2024-07-13 10:15:52.857749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.085 [2024-07-13 10:15:52.857778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.085 [2024-07-13 10:15:52.857795] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.085 [2024-07-13 10:15:52.857969] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.085 [2024-07-13 10:15:52.858157] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.085 [2024-07-13 10:15:52.858180] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.085 [2024-07-13 10:15:52.858196] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.085 [2024-07-13 10:15:52.860533] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.085 [2024-07-13 10:15:52.869647] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.085 [2024-07-13 10:15:52.870005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.085 [2024-07-13 10:15:52.870208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.085 [2024-07-13 10:15:52.870234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.085 [2024-07-13 10:15:52.870250] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.085 [2024-07-13 10:15:52.870371] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.085 [2024-07-13 10:15:52.870548] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.085 [2024-07-13 10:15:52.870568] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.085 [2024-07-13 10:15:52.870581] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.085 [2024-07-13 10:15:52.872965] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.085 [2024-07-13 10:15:52.882254] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.085 [2024-07-13 10:15:52.882598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.085 [2024-07-13 10:15:52.882757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.085 [2024-07-13 10:15:52.882799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.085 [2024-07-13 10:15:52.882817] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.085 [2024-07-13 10:15:52.883048] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.085 [2024-07-13 10:15:52.883261] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.085 [2024-07-13 10:15:52.883285] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.085 [2024-07-13 10:15:52.883300] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.085 [2024-07-13 10:15:52.885707] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.085 [2024-07-13 10:15:52.894839] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.085 [2024-07-13 10:15:52.895200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.085 [2024-07-13 10:15:52.895388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.085 [2024-07-13 10:15:52.895436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.085 [2024-07-13 10:15:52.895465] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.085 [2024-07-13 10:15:52.895686] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.085 [2024-07-13 10:15:52.895887] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.085 [2024-07-13 10:15:52.895924] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.085 [2024-07-13 10:15:52.895938] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.085 [2024-07-13 10:15:52.898247] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.344 [2024-07-13 10:15:52.907435] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.344 [2024-07-13 10:15:52.907771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.344 [2024-07-13 10:15:52.907984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.344 [2024-07-13 10:15:52.908011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.344 [2024-07-13 10:15:52.908027] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.344 [2024-07-13 10:15:52.908255] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.344 [2024-07-13 10:15:52.908412] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.344 [2024-07-13 10:15:52.908436] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.344 [2024-07-13 10:15:52.908451] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.344 [2024-07-13 10:15:52.910759] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.344 [2024-07-13 10:15:52.920079] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.344 [2024-07-13 10:15:52.920496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.344 [2024-07-13 10:15:52.920688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.344 [2024-07-13 10:15:52.920717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.344 [2024-07-13 10:15:52.920734] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.344 [2024-07-13 10:15:52.920923] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.344 [2024-07-13 10:15:52.921072] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.344 [2024-07-13 10:15:52.921093] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.344 [2024-07-13 10:15:52.921106] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.344 [2024-07-13 10:15:52.923556] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.344 [2024-07-13 10:15:52.932724] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.344 [2024-07-13 10:15:52.933057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.344 [2024-07-13 10:15:52.933234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.344 [2024-07-13 10:15:52.933263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.344 [2024-07-13 10:15:52.933280] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.344 [2024-07-13 10:15:52.933428] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.344 [2024-07-13 10:15:52.933579] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.344 [2024-07-13 10:15:52.933603] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.344 [2024-07-13 10:15:52.933618] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.344 [2024-07-13 10:15:52.936092] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.344 [2024-07-13 10:15:52.945211] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.344 [2024-07-13 10:15:52.945559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.344 [2024-07-13 10:15:52.945754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.344 [2024-07-13 10:15:52.945782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.344 [2024-07-13 10:15:52.945800] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.344 [2024-07-13 10:15:52.946029] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.344 [2024-07-13 10:15:52.946181] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.344 [2024-07-13 10:15:52.946210] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.344 [2024-07-13 10:15:52.946226] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.344 [2024-07-13 10:15:52.948548] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.344 [2024-07-13 10:15:52.957708] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.344 [2024-07-13 10:15:52.958031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.344 [2024-07-13 10:15:52.958226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.344 [2024-07-13 10:15:52.958274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.344 [2024-07-13 10:15:52.958291] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.344 [2024-07-13 10:15:52.958474] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.344 [2024-07-13 10:15:52.958661] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.344 [2024-07-13 10:15:52.958685] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.344 [2024-07-13 10:15:52.958700] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.344 [2024-07-13 10:15:52.960977] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.344 [2024-07-13 10:15:52.970447] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.344 [2024-07-13 10:15:52.970849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.344 [2024-07-13 10:15:52.971062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.344 [2024-07-13 10:15:52.971088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.344 [2024-07-13 10:15:52.971104] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.344 [2024-07-13 10:15:52.971266] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.344 [2024-07-13 10:15:52.971382] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.344 [2024-07-13 10:15:52.971405] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.344 [2024-07-13 10:15:52.971420] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.344 [2024-07-13 10:15:52.973741] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.344 [2024-07-13 10:15:52.982793] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.344 [2024-07-13 10:15:52.983174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.344 [2024-07-13 10:15:52.983314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.344 [2024-07-13 10:15:52.983343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.344 [2024-07-13 10:15:52.983360] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.344 [2024-07-13 10:15:52.983543] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.344 [2024-07-13 10:15:52.983749] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.344 [2024-07-13 10:15:52.983773] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.344 [2024-07-13 10:15:52.983794] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.344 [2024-07-13 10:15:52.986089] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.344 [2024-07-13 10:15:52.995512] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.344 [2024-07-13 10:15:52.995843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.344 [2024-07-13 10:15:52.996030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.344 [2024-07-13 10:15:52.996059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.344 [2024-07-13 10:15:52.996076] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.344 [2024-07-13 10:15:52.996241] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.344 [2024-07-13 10:15:52.996393] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.344 [2024-07-13 10:15:52.996416] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.344 [2024-07-13 10:15:52.996431] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.344 [2024-07-13 10:15:52.998660] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.344 [2024-07-13 10:15:53.007912] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.344 [2024-07-13 10:15:53.008240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.344 [2024-07-13 10:15:53.008434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.344 [2024-07-13 10:15:53.008482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.344 [2024-07-13 10:15:53.008500] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.344 [2024-07-13 10:15:53.008647] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.344 [2024-07-13 10:15:53.008798] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.344 [2024-07-13 10:15:53.008821] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.344 [2024-07-13 10:15:53.008836] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.345 [2024-07-13 10:15:53.011167] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.345 [2024-07-13 10:15:53.020504] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.345 [2024-07-13 10:15:53.020877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.345 [2024-07-13 10:15:53.021041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.345 [2024-07-13 10:15:53.021066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.345 [2024-07-13 10:15:53.021082] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.345 [2024-07-13 10:15:53.021230] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.345 [2024-07-13 10:15:53.021429] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.345 [2024-07-13 10:15:53.021452] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.345 [2024-07-13 10:15:53.021467] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.345 [2024-07-13 10:15:53.023741] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.345 [2024-07-13 10:15:53.033030] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.345 [2024-07-13 10:15:53.033505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.345 [2024-07-13 10:15:53.033681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.345 [2024-07-13 10:15:53.033722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.345 [2024-07-13 10:15:53.033737] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.345 [2024-07-13 10:15:53.033892] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.345 [2024-07-13 10:15:53.034008] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.345 [2024-07-13 10:15:53.034031] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.345 [2024-07-13 10:15:53.034046] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.345 [2024-07-13 10:15:53.036148] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.345 [2024-07-13 10:15:53.045565] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.345 [2024-07-13 10:15:53.045966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.345 [2024-07-13 10:15:53.046184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.345 [2024-07-13 10:15:53.046231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.345 [2024-07-13 10:15:53.046249] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.345 [2024-07-13 10:15:53.046413] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.345 [2024-07-13 10:15:53.046583] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.345 [2024-07-13 10:15:53.046607] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.345 [2024-07-13 10:15:53.046622] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.345 [2024-07-13 10:15:53.049003] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.345 [2024-07-13 10:15:53.058214] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.345 [2024-07-13 10:15:53.058580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.345 [2024-07-13 10:15:53.058753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.345 [2024-07-13 10:15:53.058782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.345 [2024-07-13 10:15:53.058800] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.345 [2024-07-13 10:15:53.058976] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.345 [2024-07-13 10:15:53.059165] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.345 [2024-07-13 10:15:53.059189] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.345 [2024-07-13 10:15:53.059205] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.345 [2024-07-13 10:15:53.061582] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.345 [2024-07-13 10:15:53.070788] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.345 [2024-07-13 10:15:53.071150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.345 [2024-07-13 10:15:53.071309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.345 [2024-07-13 10:15:53.071334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.345 [2024-07-13 10:15:53.071350] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.345 [2024-07-13 10:15:53.071562] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.345 [2024-07-13 10:15:53.071769] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.345 [2024-07-13 10:15:53.071792] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.345 [2024-07-13 10:15:53.071807] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.345 [2024-07-13 10:15:53.074089] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.345 [2024-07-13 10:15:53.083424] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.345 [2024-07-13 10:15:53.083789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.345 [2024-07-13 10:15:53.083986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.345 [2024-07-13 10:15:53.084013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.345 [2024-07-13 10:15:53.084029] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.345 [2024-07-13 10:15:53.084160] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.345 [2024-07-13 10:15:53.084312] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.345 [2024-07-13 10:15:53.084336] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.345 [2024-07-13 10:15:53.084351] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.345 [2024-07-13 10:15:53.086687] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.345 [2024-07-13 10:15:53.095981] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.345 [2024-07-13 10:15:53.096455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.345 [2024-07-13 10:15:53.096706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.345 [2024-07-13 10:15:53.096752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.345 [2024-07-13 10:15:53.096770] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.345 [2024-07-13 10:15:53.097000] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.345 [2024-07-13 10:15:53.097177] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.345 [2024-07-13 10:15:53.097201] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.345 [2024-07-13 10:15:53.097216] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.345 [2024-07-13 10:15:53.099556] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.345 [2024-07-13 10:15:53.108480] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.345 [2024-07-13 10:15:53.108891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.345 [2024-07-13 10:15:53.109121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.345 [2024-07-13 10:15:53.109170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.345 [2024-07-13 10:15:53.109187] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.345 [2024-07-13 10:15:53.109335] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.345 [2024-07-13 10:15:53.109505] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.345 [2024-07-13 10:15:53.109529] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.345 [2024-07-13 10:15:53.109544] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.345 [2024-07-13 10:15:53.111683] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.345 [2024-07-13 10:15:53.121120] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.345 [2024-07-13 10:15:53.121474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.345 [2024-07-13 10:15:53.121647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.345 [2024-07-13 10:15:53.121675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.345 [2024-07-13 10:15:53.121692] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.345 [2024-07-13 10:15:53.121857] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.345 [2024-07-13 10:15:53.122026] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.345 [2024-07-13 10:15:53.122050] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.345 [2024-07-13 10:15:53.122065] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.345 [2024-07-13 10:15:53.124436] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.345 [2024-07-13 10:15:53.133754] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.345 [2024-07-13 10:15:53.134087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.345 [2024-07-13 10:15:53.134286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.345 [2024-07-13 10:15:53.134335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.345 [2024-07-13 10:15:53.134352] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.345 [2024-07-13 10:15:53.134573] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.345 [2024-07-13 10:15:53.134725] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.345 [2024-07-13 10:15:53.134748] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.346 [2024-07-13 10:15:53.134763] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.346 [2024-07-13 10:15:53.137185] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.346 [2024-07-13 10:15:53.146277] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.346 [2024-07-13 10:15:53.146574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.346 [2024-07-13 10:15:53.146751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.346 [2024-07-13 10:15:53.146785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.346 [2024-07-13 10:15:53.146803] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.346 [2024-07-13 10:15:53.147016] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.346 [2024-07-13 10:15:53.147187] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.346 [2024-07-13 10:15:53.147210] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.346 [2024-07-13 10:15:53.147225] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.346 [2024-07-13 10:15:53.149491] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.346 [2024-07-13 10:15:53.159087] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.606 [2024-07-13 10:15:53.159664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.606 [2024-07-13 10:15:53.159860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.606 [2024-07-13 10:15:53.159917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.606 [2024-07-13 10:15:53.159935] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.606 [2024-07-13 10:15:53.160090] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.606 [2024-07-13 10:15:53.160275] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.606 [2024-07-13 10:15:53.160300] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.606 [2024-07-13 10:15:53.160316] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.606 [2024-07-13 10:15:53.162691] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.606 [2024-07-13 10:15:53.171974] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.606 [2024-07-13 10:15:53.172476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.606 [2024-07-13 10:15:53.172769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.606 [2024-07-13 10:15:53.172816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.606 [2024-07-13 10:15:53.172834] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.606 [2024-07-13 10:15:53.172990] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.606 [2024-07-13 10:15:53.173179] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.606 [2024-07-13 10:15:53.173202] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.606 [2024-07-13 10:15:53.173217] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.606 [2024-07-13 10:15:53.175625] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.606 [2024-07-13 10:15:53.184854] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.606 [2024-07-13 10:15:53.185233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.606 [2024-07-13 10:15:53.185444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.606 [2024-07-13 10:15:53.185485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.606 [2024-07-13 10:15:53.185505] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.606 [2024-07-13 10:15:53.185663] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.606 [2024-07-13 10:15:53.185839] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.606 [2024-07-13 10:15:53.185863] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.606 [2024-07-13 10:15:53.185891] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.606 [2024-07-13 10:15:53.188302] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.606 [2024-07-13 10:15:53.197463] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.606 [2024-07-13 10:15:53.197830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.606 [2024-07-13 10:15:53.198018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.606 [2024-07-13 10:15:53.198047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.606 [2024-07-13 10:15:53.198065] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.606 [2024-07-13 10:15:53.198212] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.606 [2024-07-13 10:15:53.198381] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.606 [2024-07-13 10:15:53.198404] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.606 [2024-07-13 10:15:53.198420] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.606 [2024-07-13 10:15:53.200743] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.606 [2024-07-13 10:15:53.210086] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.606 [2024-07-13 10:15:53.210483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.606 [2024-07-13 10:15:53.210648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.606 [2024-07-13 10:15:53.210674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.606 [2024-07-13 10:15:53.210689] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.606 [2024-07-13 10:15:53.210916] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.606 [2024-07-13 10:15:53.211087] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.606 [2024-07-13 10:15:53.211110] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.606 [2024-07-13 10:15:53.211125] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.606 [2024-07-13 10:15:53.213337] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.606 [2024-07-13 10:15:53.222947] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.606 [2024-07-13 10:15:53.223249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.606 [2024-07-13 10:15:53.223399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.606 [2024-07-13 10:15:53.223429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.606 [2024-07-13 10:15:53.223446] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.606 [2024-07-13 10:15:53.223618] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.606 [2024-07-13 10:15:53.223806] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.606 [2024-07-13 10:15:53.223830] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.606 [2024-07-13 10:15:53.223845] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.606 [2024-07-13 10:15:53.226423] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.606 [2024-07-13 10:15:53.235632] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.606 [2024-07-13 10:15:53.235973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.606 [2024-07-13 10:15:53.236132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.606 [2024-07-13 10:15:53.236162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.606 [2024-07-13 10:15:53.236179] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.606 [2024-07-13 10:15:53.236327] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.606 [2024-07-13 10:15:53.236538] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.606 [2024-07-13 10:15:53.236561] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.606 [2024-07-13 10:15:53.236576] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.606 [2024-07-13 10:15:53.238826] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.606 [2024-07-13 10:15:53.248325] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.606 [2024-07-13 10:15:53.248702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.606 [2024-07-13 10:15:53.248898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.606 [2024-07-13 10:15:53.248928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.606 [2024-07-13 10:15:53.248945] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.606 [2024-07-13 10:15:53.249165] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.606 [2024-07-13 10:15:53.249334] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.606 [2024-07-13 10:15:53.249357] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.606 [2024-07-13 10:15:53.249372] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.606 [2024-07-13 10:15:53.251693] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.606 [2024-07-13 10:15:53.261080] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.606 [2024-07-13 10:15:53.261518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.606 [2024-07-13 10:15:53.261758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.606 [2024-07-13 10:15:53.261797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.606 [2024-07-13 10:15:53.261812] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.606 [2024-07-13 10:15:53.262011] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.606 [2024-07-13 10:15:53.262202] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.606 [2024-07-13 10:15:53.262226] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.606 [2024-07-13 10:15:53.262241] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.606 [2024-07-13 10:15:53.264398] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.607 [2024-07-13 10:15:53.273806] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.607 [2024-07-13 10:15:53.274185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.607 [2024-07-13 10:15:53.274337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.607 [2024-07-13 10:15:53.274366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.607 [2024-07-13 10:15:53.274384] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.607 [2024-07-13 10:15:53.274512] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.607 [2024-07-13 10:15:53.274718] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.607 [2024-07-13 10:15:53.274741] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.607 [2024-07-13 10:15:53.274756] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.607 [2024-07-13 10:15:53.277121] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.607 [2024-07-13 10:15:53.286433] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.607 [2024-07-13 10:15:53.286881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.607 [2024-07-13 10:15:53.287077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.607 [2024-07-13 10:15:53.287124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.607 [2024-07-13 10:15:53.287142] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.607 [2024-07-13 10:15:53.287289] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.607 [2024-07-13 10:15:53.287458] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.607 [2024-07-13 10:15:53.287482] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.607 [2024-07-13 10:15:53.287496] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.607 [2024-07-13 10:15:53.289921] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.607 [2024-07-13 10:15:53.299134] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.607 [2024-07-13 10:15:53.299490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.607 [2024-07-13 10:15:53.299688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.607 [2024-07-13 10:15:53.299734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.607 [2024-07-13 10:15:53.299752] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.607 [2024-07-13 10:15:53.299891] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.607 [2024-07-13 10:15:53.300065] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.607 [2024-07-13 10:15:53.300093] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.607 [2024-07-13 10:15:53.300109] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.607 [2024-07-13 10:15:53.302429] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.607 [2024-07-13 10:15:53.311823] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.607 [2024-07-13 10:15:53.312209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.607 [2024-07-13 10:15:53.312511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.607 [2024-07-13 10:15:53.312570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.607 [2024-07-13 10:15:53.312587] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.607 [2024-07-13 10:15:53.312734] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.607 [2024-07-13 10:15:53.312877] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.607 [2024-07-13 10:15:53.312901] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.607 [2024-07-13 10:15:53.312916] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.607 [2024-07-13 10:15:53.315219] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.607 [2024-07-13 10:15:53.324608] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.607 [2024-07-13 10:15:53.324949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.607 [2024-07-13 10:15:53.325123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.607 [2024-07-13 10:15:53.325152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.607 [2024-07-13 10:15:53.325169] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.607 [2024-07-13 10:15:53.325353] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.607 [2024-07-13 10:15:53.325558] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.607 [2024-07-13 10:15:53.325582] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.607 [2024-07-13 10:15:53.325597] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.607 [2024-07-13 10:15:53.327912] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.607 [2024-07-13 10:15:53.337296] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.607 [2024-07-13 10:15:53.337683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.607 [2024-07-13 10:15:53.337852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.607 [2024-07-13 10:15:53.337890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.607 [2024-07-13 10:15:53.337909] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.607 [2024-07-13 10:15:53.338147] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.607 [2024-07-13 10:15:53.338298] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.607 [2024-07-13 10:15:53.338322] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.607 [2024-07-13 10:15:53.338346] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.607 [2024-07-13 10:15:53.340678] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.607 [2024-07-13 10:15:53.349913] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.607 [2024-07-13 10:15:53.350228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.607 [2024-07-13 10:15:53.350500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.607 [2024-07-13 10:15:53.350551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.607 [2024-07-13 10:15:53.350569] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.607 [2024-07-13 10:15:53.350716] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.607 [2024-07-13 10:15:53.350849] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.607 [2024-07-13 10:15:53.350885] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.607 [2024-07-13 10:15:53.350902] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.607 [2024-07-13 10:15:53.353131] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.607 [2024-07-13 10:15:53.362525] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.607 [2024-07-13 10:15:53.362823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.607 [2024-07-13 10:15:53.362978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.607 [2024-07-13 10:15:53.363008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.607 [2024-07-13 10:15:53.363025] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.607 [2024-07-13 10:15:53.363208] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.607 [2024-07-13 10:15:53.363378] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.607 [2024-07-13 10:15:53.363402] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.607 [2024-07-13 10:15:53.363417] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.607 [2024-07-13 10:15:53.365874] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.607 [2024-07-13 10:15:53.374850] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.607 [2024-07-13 10:15:53.375281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.607 [2024-07-13 10:15:53.375430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.607 [2024-07-13 10:15:53.375455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.607 [2024-07-13 10:15:53.375470] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.607 [2024-07-13 10:15:53.375659] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.607 [2024-07-13 10:15:53.375829] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.607 [2024-07-13 10:15:53.375852] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.607 [2024-07-13 10:15:53.375878] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.607 [2024-07-13 10:15:53.378191] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.607 [2024-07-13 10:15:53.387290] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.607 [2024-07-13 10:15:53.387653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.607 [2024-07-13 10:15:53.387823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.607 [2024-07-13 10:15:53.387852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.607 [2024-07-13 10:15:53.387881] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.607 [2024-07-13 10:15:53.388031] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.608 [2024-07-13 10:15:53.388218] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.608 [2024-07-13 10:15:53.388242] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.608 [2024-07-13 10:15:53.388257] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.608 [2024-07-13 10:15:53.390707] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.608 [2024-07-13 10:15:53.399996] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.608 [2024-07-13 10:15:53.400277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.608 [2024-07-13 10:15:53.400491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.608 [2024-07-13 10:15:53.400537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.608 [2024-07-13 10:15:53.400555] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.608 [2024-07-13 10:15:53.400738] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.608 [2024-07-13 10:15:53.400919] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.608 [2024-07-13 10:15:53.400943] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.608 [2024-07-13 10:15:53.400959] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.608 [2024-07-13 10:15:53.403191] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.608 [2024-07-13 10:15:53.412620] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.608 [2024-07-13 10:15:53.412962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.608 [2024-07-13 10:15:53.413179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.608 [2024-07-13 10:15:53.413227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.608 [2024-07-13 10:15:53.413245] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.608 [2024-07-13 10:15:53.413428] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.608 [2024-07-13 10:15:53.413579] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.608 [2024-07-13 10:15:53.413603] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.608 [2024-07-13 10:15:53.413618] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.608 [2024-07-13 10:15:53.416038] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.879 [2024-07-13 10:15:53.425145] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.879 [2024-07-13 10:15:53.425622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.879 [2024-07-13 10:15:53.425855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.879 [2024-07-13 10:15:53.425895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.879 [2024-07-13 10:15:53.425917] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.879 [2024-07-13 10:15:53.426114] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.879 [2024-07-13 10:15:53.426285] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.879 [2024-07-13 10:15:53.426309] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.879 [2024-07-13 10:15:53.426324] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.879 [2024-07-13 10:15:53.428520] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.879 [2024-07-13 10:15:53.437811] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.879 [2024-07-13 10:15:53.438154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.879 [2024-07-13 10:15:53.438442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.879 [2024-07-13 10:15:53.438491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.879 [2024-07-13 10:15:53.438508] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.879 [2024-07-13 10:15:53.438692] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.879 [2024-07-13 10:15:53.438862] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.879 [2024-07-13 10:15:53.438898] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.879 [2024-07-13 10:15:53.438913] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.879 [2024-07-13 10:15:53.441071] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.879 [2024-07-13 10:15:53.450485] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.879 [2024-07-13 10:15:53.450852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.879 [2024-07-13 10:15:53.451058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.879 [2024-07-13 10:15:53.451087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.879 [2024-07-13 10:15:53.451104] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.879 [2024-07-13 10:15:53.451288] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.879 [2024-07-13 10:15:53.451457] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.879 [2024-07-13 10:15:53.451481] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.879 [2024-07-13 10:15:53.451496] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.879 [2024-07-13 10:15:53.453899] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.879 [2024-07-13 10:15:53.463108] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.879 [2024-07-13 10:15:53.463465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.879 [2024-07-13 10:15:53.463665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.879 [2024-07-13 10:15:53.463690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.879 [2024-07-13 10:15:53.463706] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.879 [2024-07-13 10:15:53.463852] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.879 [2024-07-13 10:15:53.464084] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.879 [2024-07-13 10:15:53.464108] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.879 [2024-07-13 10:15:53.464123] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.879 [2024-07-13 10:15:53.466498] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.879 [2024-07-13 10:15:53.475597] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.879 [2024-07-13 10:15:53.475965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.879 [2024-07-13 10:15:53.476105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.879 [2024-07-13 10:15:53.476130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.879 [2024-07-13 10:15:53.476145] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.879 [2024-07-13 10:15:53.476292] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.879 [2024-07-13 10:15:53.476475] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.879 [2024-07-13 10:15:53.476499] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.879 [2024-07-13 10:15:53.476514] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.879 [2024-07-13 10:15:53.478730] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.879 [2024-07-13 10:15:53.488057] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.879 [2024-07-13 10:15:53.488473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.879 [2024-07-13 10:15:53.488646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.879 [2024-07-13 10:15:53.488675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.879 [2024-07-13 10:15:53.488692] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.879 [2024-07-13 10:15:53.488857] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.879 [2024-07-13 10:15:53.489021] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.879 [2024-07-13 10:15:53.489044] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.879 [2024-07-13 10:15:53.489060] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.879 [2024-07-13 10:15:53.491382] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.879 [2024-07-13 10:15:53.500688] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.879 [2024-07-13 10:15:53.501001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.879 [2024-07-13 10:15:53.501190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.879 [2024-07-13 10:15:53.501221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.879 [2024-07-13 10:15:53.501237] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.879 [2024-07-13 10:15:53.501387] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.879 [2024-07-13 10:15:53.501535] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.879 [2024-07-13 10:15:53.501558] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.879 [2024-07-13 10:15:53.501574] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.879 [2024-07-13 10:15:53.504144] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.879 [2024-07-13 10:15:53.513192] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.879 [2024-07-13 10:15:53.513600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.879 [2024-07-13 10:15:53.513788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.879 [2024-07-13 10:15:53.513816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.879 [2024-07-13 10:15:53.513834] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.879 [2024-07-13 10:15:53.514029] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.879 [2024-07-13 10:15:53.514198] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.879 [2024-07-13 10:15:53.514222] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.879 [2024-07-13 10:15:53.514238] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.879 [2024-07-13 10:15:53.516559] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.879 [2024-07-13 10:15:53.525967] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.879 [2024-07-13 10:15:53.526355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.879 [2024-07-13 10:15:53.526536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.879 [2024-07-13 10:15:53.526574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.879 [2024-07-13 10:15:53.526589] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.879 [2024-07-13 10:15:53.526766] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.880 [2024-07-13 10:15:53.526966] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.880 [2024-07-13 10:15:53.526991] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.880 [2024-07-13 10:15:53.527006] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.880 [2024-07-13 10:15:53.529327] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.880 [2024-07-13 10:15:53.538596] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.880 [2024-07-13 10:15:53.538996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.880 [2024-07-13 10:15:53.539206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.880 [2024-07-13 10:15:53.539235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.880 [2024-07-13 10:15:53.539258] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.880 [2024-07-13 10:15:53.539442] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.880 [2024-07-13 10:15:53.539647] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.880 [2024-07-13 10:15:53.539671] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.880 [2024-07-13 10:15:53.539686] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.880 [2024-07-13 10:15:53.542072] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.880 [2024-07-13 10:15:53.551143] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.880 [2024-07-13 10:15:53.551606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.880 [2024-07-13 10:15:53.551835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.880 [2024-07-13 10:15:53.551864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.880 [2024-07-13 10:15:53.551893] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.880 [2024-07-13 10:15:53.552078] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.880 [2024-07-13 10:15:53.552193] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.880 [2024-07-13 10:15:53.552216] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.880 [2024-07-13 10:15:53.552232] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.880 [2024-07-13 10:15:53.554606] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.880 [2024-07-13 10:15:53.563927] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.880 [2024-07-13 10:15:53.564239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.880 [2024-07-13 10:15:53.564443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.880 [2024-07-13 10:15:53.564468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.880 [2024-07-13 10:15:53.564482] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.880 [2024-07-13 10:15:53.564644] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.880 [2024-07-13 10:15:53.564831] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.880 [2024-07-13 10:15:53.564854] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.880 [2024-07-13 10:15:53.564880] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.880 [2024-07-13 10:15:53.567149] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.880 [2024-07-13 10:15:53.576562] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.880 [2024-07-13 10:15:53.576895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.880 [2024-07-13 10:15:53.577081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.880 [2024-07-13 10:15:53.577107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.880 [2024-07-13 10:15:53.577122] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.880 [2024-07-13 10:15:53.577304] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.880 [2024-07-13 10:15:53.577420] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.880 [2024-07-13 10:15:53.577442] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.880 [2024-07-13 10:15:53.577458] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.880 [2024-07-13 10:15:53.579693] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.880 [2024-07-13 10:15:53.588974] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.880 [2024-07-13 10:15:53.589339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.880 [2024-07-13 10:15:53.589667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.880 [2024-07-13 10:15:53.589720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.880 [2024-07-13 10:15:53.589737] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.880 [2024-07-13 10:15:53.589915] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.880 [2024-07-13 10:15:53.590067] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.880 [2024-07-13 10:15:53.590090] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.880 [2024-07-13 10:15:53.590106] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.880 [2024-07-13 10:15:53.592535] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.880 [2024-07-13 10:15:53.601527] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.880 [2024-07-13 10:15:53.601841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.880 [2024-07-13 10:15:53.602019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.880 [2024-07-13 10:15:53.602048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.880 [2024-07-13 10:15:53.602065] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.880 [2024-07-13 10:15:53.602176] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.880 [2024-07-13 10:15:53.602381] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.880 [2024-07-13 10:15:53.602405] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.880 [2024-07-13 10:15:53.602420] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.880 [2024-07-13 10:15:53.604761] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.880 [2024-07-13 10:15:53.614257] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.880 [2024-07-13 10:15:53.614623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.880 [2024-07-13 10:15:53.614754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.880 [2024-07-13 10:15:53.614780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.880 [2024-07-13 10:15:53.614795] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.880 [2024-07-13 10:15:53.614985] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.880 [2024-07-13 10:15:53.615154] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.880 [2024-07-13 10:15:53.615179] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.880 [2024-07-13 10:15:53.615194] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.880 [2024-07-13 10:15:53.617424] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.880 [2024-07-13 10:15:53.626904] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.880 [2024-07-13 10:15:53.627264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.880 [2024-07-13 10:15:53.627479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.880 [2024-07-13 10:15:53.627526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.880 [2024-07-13 10:15:53.627544] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.880 [2024-07-13 10:15:53.627708] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.880 [2024-07-13 10:15:53.627888] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.880 [2024-07-13 10:15:53.627913] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.880 [2024-07-13 10:15:53.627928] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.880 [2024-07-13 10:15:53.630121] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.880 [2024-07-13 10:15:53.639523] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.880 [2024-07-13 10:15:53.639879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.880 [2024-07-13 10:15:53.640168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.880 [2024-07-13 10:15:53.640220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.880 [2024-07-13 10:15:53.640238] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.880 [2024-07-13 10:15:53.640384] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.880 [2024-07-13 10:15:53.640571] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.880 [2024-07-13 10:15:53.640595] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.880 [2024-07-13 10:15:53.640611] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.880 [2024-07-13 10:15:53.642980] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.880 [2024-07-13 10:15:53.652232] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.880 [2024-07-13 10:15:53.652544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.880 [2024-07-13 10:15:53.652739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.880 [2024-07-13 10:15:53.652767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.880 [2024-07-13 10:15:53.652784] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.880 [2024-07-13 10:15:53.652979] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.880 [2024-07-13 10:15:53.653130] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.880 [2024-07-13 10:15:53.653159] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.880 [2024-07-13 10:15:53.653175] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.880 [2024-07-13 10:15:53.655494] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.880 [2024-07-13 10:15:53.664815] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.880 [2024-07-13 10:15:53.665184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.880 [2024-07-13 10:15:53.665382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.880 [2024-07-13 10:15:53.665410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.880 [2024-07-13 10:15:53.665427] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.880 [2024-07-13 10:15:53.665627] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.880 [2024-07-13 10:15:53.665779] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.880 [2024-07-13 10:15:53.665802] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.880 [2024-07-13 10:15:53.665817] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.880 [2024-07-13 10:15:53.668111] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:47.880 [2024-07-13 10:15:53.677248] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:47.880 [2024-07-13 10:15:53.677602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.880 [2024-07-13 10:15:53.677802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:47.880 [2024-07-13 10:15:53.677830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:47.880 [2024-07-13 10:15:53.677847] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:47.880 [2024-07-13 10:15:53.678076] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:47.880 [2024-07-13 10:15:53.678246] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:47.880 [2024-07-13 10:15:53.678269] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:47.880 [2024-07-13 10:15:53.678285] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:47.880 [2024-07-13 10:15:53.680634] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.195 [2024-07-13 10:15:53.689810] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.195 [2024-07-13 10:15:53.690114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.195 [2024-07-13 10:15:53.690343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.195 [2024-07-13 10:15:53.690373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.195 [2024-07-13 10:15:53.690392] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.195 [2024-07-13 10:15:53.690573] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.195 [2024-07-13 10:15:53.690726] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.195 [2024-07-13 10:15:53.690750] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.195 [2024-07-13 10:15:53.690771] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.195 [2024-07-13 10:15:53.693313] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.195 [2024-07-13 10:15:53.703094] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.195 [2024-07-13 10:15:53.703553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.195 [2024-07-13 10:15:53.703713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.195 [2024-07-13 10:15:53.703750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.195 [2024-07-13 10:15:53.703779] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.195 [2024-07-13 10:15:53.703932] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.195 [2024-07-13 10:15:53.704161] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.195 [2024-07-13 10:15:53.704194] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.195 [2024-07-13 10:15:53.704219] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.195 [2024-07-13 10:15:53.706929] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.195 [2024-07-13 10:15:53.715883] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.195 [2024-07-13 10:15:53.716201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.195 [2024-07-13 10:15:53.716457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.195 [2024-07-13 10:15:53.716512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.195 [2024-07-13 10:15:53.716530] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.195 [2024-07-13 10:15:53.716714] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.195 [2024-07-13 10:15:53.716877] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.195 [2024-07-13 10:15:53.716902] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.195 [2024-07-13 10:15:53.716917] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.195 [2024-07-13 10:15:53.719419] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.195 [2024-07-13 10:15:53.728590] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.195 [2024-07-13 10:15:53.728999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.195 [2024-07-13 10:15:53.729158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.195 [2024-07-13 10:15:53.729202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.195 [2024-07-13 10:15:53.729220] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.195 [2024-07-13 10:15:53.729403] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.195 [2024-07-13 10:15:53.729554] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.195 [2024-07-13 10:15:53.729578] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.195 [2024-07-13 10:15:53.729593] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.195 [2024-07-13 10:15:53.731878] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.195 [2024-07-13 10:15:53.741315] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.195 [2024-07-13 10:15:53.741654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.195 [2024-07-13 10:15:53.741849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.195 [2024-07-13 10:15:53.741888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.195 [2024-07-13 10:15:53.741919] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.195 [2024-07-13 10:15:53.742066] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.195 [2024-07-13 10:15:53.742200] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.195 [2024-07-13 10:15:53.742223] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.195 [2024-07-13 10:15:53.742239] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.195 [2024-07-13 10:15:53.744376] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.195 [2024-07-13 10:15:53.754008] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.195 [2024-07-13 10:15:53.754489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.195 [2024-07-13 10:15:53.754799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.195 [2024-07-13 10:15:53.754848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.195 [2024-07-13 10:15:53.754873] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.195 [2024-07-13 10:15:53.755023] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.195 [2024-07-13 10:15:53.755156] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.195 [2024-07-13 10:15:53.755179] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.195 [2024-07-13 10:15:53.755195] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.195 [2024-07-13 10:15:53.757739] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.195 [2024-07-13 10:15:53.766477] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.195 [2024-07-13 10:15:53.766877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.195 [2024-07-13 10:15:53.767092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.195 [2024-07-13 10:15:53.767121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.195 [2024-07-13 10:15:53.767139] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.195 [2024-07-13 10:15:53.767287] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.195 [2024-07-13 10:15:53.767456] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.195 [2024-07-13 10:15:53.767480] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.196 [2024-07-13 10:15:53.767496] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.196 [2024-07-13 10:15:53.769835] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.196 [2024-07-13 10:15:53.779020] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.196 [2024-07-13 10:15:53.779509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.196 [2024-07-13 10:15:53.779796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.196 [2024-07-13 10:15:53.779822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.196 [2024-07-13 10:15:53.779837] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.196 [2024-07-13 10:15:53.779983] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.196 [2024-07-13 10:15:53.780154] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.196 [2024-07-13 10:15:53.780178] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.196 [2024-07-13 10:15:53.780193] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.196 [2024-07-13 10:15:53.782547] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.196 [2024-07-13 10:15:53.791549] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.196 [2024-07-13 10:15:53.791874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.196 [2024-07-13 10:15:53.792022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.196 [2024-07-13 10:15:53.792051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.196 [2024-07-13 10:15:53.792068] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.196 [2024-07-13 10:15:53.792251] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.196 [2024-07-13 10:15:53.792439] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.196 [2024-07-13 10:15:53.792463] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.196 [2024-07-13 10:15:53.792478] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.196 [2024-07-13 10:15:53.794836] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.196 [2024-07-13 10:15:53.804258] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.196 [2024-07-13 10:15:53.804626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.196 [2024-07-13 10:15:53.804795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.196 [2024-07-13 10:15:53.804821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.196 [2024-07-13 10:15:53.804837] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.196 [2024-07-13 10:15:53.805007] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.196 [2024-07-13 10:15:53.805221] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.196 [2024-07-13 10:15:53.805245] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.196 [2024-07-13 10:15:53.805260] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.196 [2024-07-13 10:15:53.807616] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.196 [2024-07-13 10:15:53.816858] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.196 [2024-07-13 10:15:53.817232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.196 [2024-07-13 10:15:53.817403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.196 [2024-07-13 10:15:53.817432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.196 [2024-07-13 10:15:53.817449] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.196 [2024-07-13 10:15:53.817632] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.196 [2024-07-13 10:15:53.817801] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.196 [2024-07-13 10:15:53.817826] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.196 [2024-07-13 10:15:53.817841] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.196 [2024-07-13 10:15:53.820135] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.196 [2024-07-13 10:15:53.829381] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.196 [2024-07-13 10:15:53.829671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.196 [2024-07-13 10:15:53.829871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.196 [2024-07-13 10:15:53.829901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.196 [2024-07-13 10:15:53.829919] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.196 [2024-07-13 10:15:53.830102] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.196 [2024-07-13 10:15:53.830271] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.196 [2024-07-13 10:15:53.830295] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.196 [2024-07-13 10:15:53.830311] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.196 [2024-07-13 10:15:53.832663] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.196 [2024-07-13 10:15:53.841957] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.196 [2024-07-13 10:15:53.842270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.196 [2024-07-13 10:15:53.842440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.196 [2024-07-13 10:15:53.842469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.196 [2024-07-13 10:15:53.842486] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.196 [2024-07-13 10:15:53.842634] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.196 [2024-07-13 10:15:53.842804] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.196 [2024-07-13 10:15:53.842827] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.196 [2024-07-13 10:15:53.842843] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.196 [2024-07-13 10:15:53.845186] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.196 [2024-07-13 10:15:53.854552] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.196 [2024-07-13 10:15:53.854894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.196 [2024-07-13 10:15:53.855109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.196 [2024-07-13 10:15:53.855139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.196 [2024-07-13 10:15:53.855155] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.196 [2024-07-13 10:15:53.855331] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.196 [2024-07-13 10:15:53.855514] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.196 [2024-07-13 10:15:53.855538] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.196 [2024-07-13 10:15:53.855553] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.196 [2024-07-13 10:15:53.857759] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.196 [2024-07-13 10:15:53.867111] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.196 [2024-07-13 10:15:53.867477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.196 [2024-07-13 10:15:53.867806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.196 [2024-07-13 10:15:53.867856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.196 [2024-07-13 10:15:53.867887] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.196 [2024-07-13 10:15:53.868017] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.196 [2024-07-13 10:15:53.868205] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.196 [2024-07-13 10:15:53.868229] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.196 [2024-07-13 10:15:53.868244] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.196 [2024-07-13 10:15:53.870620] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.196 [2024-07-13 10:15:53.879608] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.196 [2024-07-13 10:15:53.879947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.196 [2024-07-13 10:15:53.880150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.196 [2024-07-13 10:15:53.880178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.196 [2024-07-13 10:15:53.880196] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.196 [2024-07-13 10:15:53.880360] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.196 [2024-07-13 10:15:53.880494] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.196 [2024-07-13 10:15:53.880517] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.196 [2024-07-13 10:15:53.880532] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.196 [2024-07-13 10:15:53.882672] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.196 [2024-07-13 10:15:53.892048] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.196 [2024-07-13 10:15:53.892416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.196 [2024-07-13 10:15:53.892574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.196 [2024-07-13 10:15:53.892601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.196 [2024-07-13 10:15:53.892640] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.196 [2024-07-13 10:15:53.892842] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.196 [2024-07-13 10:15:53.893027] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.196 [2024-07-13 10:15:53.893050] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.196 [2024-07-13 10:15:53.893064] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.196 [2024-07-13 10:15:53.895420] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.196 [2024-07-13 10:15:53.904722] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.196 [2024-07-13 10:15:53.905030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.196 [2024-07-13 10:15:53.905169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.196 [2024-07-13 10:15:53.905195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.196 [2024-07-13 10:15:53.905210] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.196 [2024-07-13 10:15:53.905373] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.196 [2024-07-13 10:15:53.905526] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.196 [2024-07-13 10:15:53.905549] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.196 [2024-07-13 10:15:53.905564] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.196 [2024-07-13 10:15:53.907846] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.196 [2024-07-13 10:15:53.917213] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.196 [2024-07-13 10:15:53.917554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.196 [2024-07-13 10:15:53.917759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.196 [2024-07-13 10:15:53.917787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.196 [2024-07-13 10:15:53.917805] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.196 [2024-07-13 10:15:53.917988] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.196 [2024-07-13 10:15:53.918125] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.196 [2024-07-13 10:15:53.918160] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.196 [2024-07-13 10:15:53.918174] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.196 [2024-07-13 10:15:53.920431] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.196 [2024-07-13 10:15:53.929809] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.196 [2024-07-13 10:15:53.930108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.196 [2024-07-13 10:15:53.930294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.196 [2024-07-13 10:15:53.930322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.196 [2024-07-13 10:15:53.930339] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.196 [2024-07-13 10:15:53.930531] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.196 [2024-07-13 10:15:53.930700] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.196 [2024-07-13 10:15:53.930724] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.196 [2024-07-13 10:15:53.930739] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.196 [2024-07-13 10:15:53.933195] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.196 [2024-07-13 10:15:53.942364] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.196 [2024-07-13 10:15:53.942698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.196 [2024-07-13 10:15:53.942878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.196 [2024-07-13 10:15:53.942931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.196 [2024-07-13 10:15:53.942947] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.196 [2024-07-13 10:15:53.943095] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.196 [2024-07-13 10:15:53.943311] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.196 [2024-07-13 10:15:53.943335] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.196 [2024-07-13 10:15:53.943351] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.196 [2024-07-13 10:15:53.945679] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.196 [2024-07-13 10:15:53.955103] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.196 [2024-07-13 10:15:53.955571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.196 [2024-07-13 10:15:53.955828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.196 [2024-07-13 10:15:53.955853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.196 [2024-07-13 10:15:53.955877] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.196 [2024-07-13 10:15:53.956049] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.196 [2024-07-13 10:15:53.956273] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.196 [2024-07-13 10:15:53.956297] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.196 [2024-07-13 10:15:53.956314] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.196 [2024-07-13 10:15:53.958655] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.196 [2024-07-13 10:15:53.967861] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.196 [2024-07-13 10:15:53.968325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.196 [2024-07-13 10:15:53.968607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.196 [2024-07-13 10:15:53.968657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.196 [2024-07-13 10:15:53.968674] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.196 [2024-07-13 10:15:53.968902] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.196 [2024-07-13 10:15:53.969051] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.196 [2024-07-13 10:15:53.969075] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.196 [2024-07-13 10:15:53.969091] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.196 [2024-07-13 10:15:53.971249] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.196 [2024-07-13 10:15:53.980514] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.196 [2024-07-13 10:15:53.980852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.196 [2024-07-13 10:15:53.981013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.196 [2024-07-13 10:15:53.981041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.196 [2024-07-13 10:15:53.981059] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.196 [2024-07-13 10:15:53.981188] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.196 [2024-07-13 10:15:53.981375] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.196 [2024-07-13 10:15:53.981399] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.196 [2024-07-13 10:15:53.981416] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.196 [2024-07-13 10:15:53.983805] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.456 [2024-07-13 10:15:53.993398] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.456 [2024-07-13 10:15:53.993723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.456 [2024-07-13 10:15:53.993902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.456 [2024-07-13 10:15:53.993949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.456 [2024-07-13 10:15:53.993966] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.456 [2024-07-13 10:15:53.994132] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.456 [2024-07-13 10:15:53.994285] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.456 [2024-07-13 10:15:53.994307] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.456 [2024-07-13 10:15:53.994321] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.456 [2024-07-13 10:15:53.996547] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.456 [2024-07-13 10:15:54.006042] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.456 [2024-07-13 10:15:54.006401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.456 [2024-07-13 10:15:54.006699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.456 [2024-07-13 10:15:54.006750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.456 [2024-07-13 10:15:54.006767] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.456 [2024-07-13 10:15:54.006976] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.456 [2024-07-13 10:15:54.007130] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.456 [2024-07-13 10:15:54.007183] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.456 [2024-07-13 10:15:54.007197] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.456 [2024-07-13 10:15:54.009581] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.456 [2024-07-13 10:15:54.018649] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.456 [2024-07-13 10:15:54.019001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.456 [2024-07-13 10:15:54.019140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.456 [2024-07-13 10:15:54.019166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.456 [2024-07-13 10:15:54.019182] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.457 [2024-07-13 10:15:54.019373] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.457 [2024-07-13 10:15:54.019579] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.457 [2024-07-13 10:15:54.019603] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.457 [2024-07-13 10:15:54.019618] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.457 [2024-07-13 10:15:54.021970] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.457 [2024-07-13 10:15:54.031288] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.457 [2024-07-13 10:15:54.031651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.457 [2024-07-13 10:15:54.031784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.457 [2024-07-13 10:15:54.031810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.457 [2024-07-13 10:15:54.031826] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.457 [2024-07-13 10:15:54.031952] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.457 [2024-07-13 10:15:54.032105] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.457 [2024-07-13 10:15:54.032126] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.457 [2024-07-13 10:15:54.032140] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.457 [2024-07-13 10:15:54.034412] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.457 [2024-07-13 10:15:54.043821] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.457 [2024-07-13 10:15:54.044143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.457 [2024-07-13 10:15:54.044356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.457 [2024-07-13 10:15:54.044385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.457 [2024-07-13 10:15:54.044402] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.457 [2024-07-13 10:15:54.044567] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.457 [2024-07-13 10:15:54.044755] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.457 [2024-07-13 10:15:54.044779] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.457 [2024-07-13 10:15:54.044800] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.457 [2024-07-13 10:15:54.047225] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.457 [2024-07-13 10:15:54.056179] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.457 [2024-07-13 10:15:54.056599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.457 [2024-07-13 10:15:54.056811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.457 [2024-07-13 10:15:54.056839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.457 [2024-07-13 10:15:54.056856] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.457 [2024-07-13 10:15:54.057013] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.457 [2024-07-13 10:15:54.057147] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.457 [2024-07-13 10:15:54.057170] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.457 [2024-07-13 10:15:54.057185] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.457 [2024-07-13 10:15:54.059472] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.457 [2024-07-13 10:15:54.068811] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.457 [2024-07-13 10:15:54.069164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.457 [2024-07-13 10:15:54.069399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.457 [2024-07-13 10:15:54.069459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.457 [2024-07-13 10:15:54.069477] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.457 [2024-07-13 10:15:54.069643] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.457 [2024-07-13 10:15:54.069777] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.457 [2024-07-13 10:15:54.069800] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.457 [2024-07-13 10:15:54.069815] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.457 [2024-07-13 10:15:54.071967] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.457 [2024-07-13 10:15:54.081128] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.457 [2024-07-13 10:15:54.081476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.457 [2024-07-13 10:15:54.081708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.457 [2024-07-13 10:15:54.081755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.457 [2024-07-13 10:15:54.081773] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.457 [2024-07-13 10:15:54.081949] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.457 [2024-07-13 10:15:54.082136] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.457 [2024-07-13 10:15:54.082159] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.457 [2024-07-13 10:15:54.082186] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.457 [2024-07-13 10:15:54.084464] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.457 [2024-07-13 10:15:54.093681] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.457 [2024-07-13 10:15:54.094059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.457 [2024-07-13 10:15:54.094212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.457 [2024-07-13 10:15:54.094240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.457 [2024-07-13 10:15:54.094258] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.457 [2024-07-13 10:15:54.094478] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.457 [2024-07-13 10:15:54.094611] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.457 [2024-07-13 10:15:54.094636] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.457 [2024-07-13 10:15:54.094653] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.457 [2024-07-13 10:15:54.097010] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.457 [2024-07-13 10:15:54.106175] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.457 [2024-07-13 10:15:54.106532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.457 [2024-07-13 10:15:54.106725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.457 [2024-07-13 10:15:54.106772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.457 [2024-07-13 10:15:54.106790] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.457 [2024-07-13 10:15:54.106969] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.457 [2024-07-13 10:15:54.107121] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.457 [2024-07-13 10:15:54.107146] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.457 [2024-07-13 10:15:54.107162] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.457 [2024-07-13 10:15:54.109378] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.457 [2024-07-13 10:15:54.118761] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.457 [2024-07-13 10:15:54.119131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.457 [2024-07-13 10:15:54.119306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.457 [2024-07-13 10:15:54.119335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.457 [2024-07-13 10:15:54.119352] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.457 [2024-07-13 10:15:54.119554] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.457 [2024-07-13 10:15:54.119698] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.457 [2024-07-13 10:15:54.119723] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.457 [2024-07-13 10:15:54.119738] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.457 [2024-07-13 10:15:54.122080] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.457 [2024-07-13 10:15:54.131594] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.457 [2024-07-13 10:15:54.131948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.457 [2024-07-13 10:15:54.132125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.457 [2024-07-13 10:15:54.132155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.457 [2024-07-13 10:15:54.132173] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.457 [2024-07-13 10:15:54.132323] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.457 [2024-07-13 10:15:54.132528] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.457 [2024-07-13 10:15:54.132554] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.457 [2024-07-13 10:15:54.132571] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.457 [2024-07-13 10:15:54.134806] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.457 [2024-07-13 10:15:54.144191] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.457 [2024-07-13 10:15:54.144559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.457 [2024-07-13 10:15:54.144724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.457 [2024-07-13 10:15:54.144753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.457 [2024-07-13 10:15:54.144770] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.457 [2024-07-13 10:15:54.144967] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.457 [2024-07-13 10:15:54.145155] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.458 [2024-07-13 10:15:54.145181] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.458 [2024-07-13 10:15:54.145197] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.458 [2024-07-13 10:15:54.147626] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.458 [2024-07-13 10:15:54.156670] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.458 [2024-07-13 10:15:54.156992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.458 [2024-07-13 10:15:54.157269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.458 [2024-07-13 10:15:54.157325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.458 [2024-07-13 10:15:54.157343] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.458 [2024-07-13 10:15:54.157491] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.458 [2024-07-13 10:15:54.157696] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.458 [2024-07-13 10:15:54.157720] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.458 [2024-07-13 10:15:54.157735] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.458 [2024-07-13 10:15:54.160176] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.458 [2024-07-13 10:15:54.169241] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.458 [2024-07-13 10:15:54.169590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.458 [2024-07-13 10:15:54.169786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.458 [2024-07-13 10:15:54.169816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.458 [2024-07-13 10:15:54.169835] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.458 [2024-07-13 10:15:54.169995] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.458 [2024-07-13 10:15:54.170148] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.458 [2024-07-13 10:15:54.170173] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.458 [2024-07-13 10:15:54.170189] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.458 [2024-07-13 10:15:54.172388] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.458 [2024-07-13 10:15:54.181986] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.458 [2024-07-13 10:15:54.182329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.458 [2024-07-13 10:15:54.182529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.458 [2024-07-13 10:15:54.182557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.458 [2024-07-13 10:15:54.182576] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.458 [2024-07-13 10:15:54.182778] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.458 [2024-07-13 10:15:54.182998] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.458 [2024-07-13 10:15:54.183024] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.458 [2024-07-13 10:15:54.183040] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.458 [2024-07-13 10:15:54.185453] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.458 [2024-07-13 10:15:54.194551] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.458 [2024-07-13 10:15:54.194984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.458 [2024-07-13 10:15:54.195137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.458 [2024-07-13 10:15:54.195166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.458 [2024-07-13 10:15:54.195184] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.458 [2024-07-13 10:15:54.195385] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.458 [2024-07-13 10:15:54.195555] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.458 [2024-07-13 10:15:54.195580] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.458 [2024-07-13 10:15:54.195597] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.458 [2024-07-13 10:15:54.197965] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.458 [2024-07-13 10:15:54.207249] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.458 [2024-07-13 10:15:54.207654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.458 [2024-07-13 10:15:54.207872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.458 [2024-07-13 10:15:54.207908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.458 [2024-07-13 10:15:54.207943] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.458 [2024-07-13 10:15:54.208120] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.458 [2024-07-13 10:15:54.208293] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.458 [2024-07-13 10:15:54.208319] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.458 [2024-07-13 10:15:54.208335] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.458 [2024-07-13 10:15:54.210604] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.458 [2024-07-13 10:15:54.219760] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.458 [2024-07-13 10:15:54.220135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.458 [2024-07-13 10:15:54.220425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.458 [2024-07-13 10:15:54.220476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.458 [2024-07-13 10:15:54.220494] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.458 [2024-07-13 10:15:54.220642] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.458 [2024-07-13 10:15:54.220758] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.458 [2024-07-13 10:15:54.220781] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.458 [2024-07-13 10:15:54.220798] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.458 [2024-07-13 10:15:54.223103] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.458 [2024-07-13 10:15:54.232381] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.458 [2024-07-13 10:15:54.232749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.458 [2024-07-13 10:15:54.232930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.458 [2024-07-13 10:15:54.232958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.458 [2024-07-13 10:15:54.232974] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.458 [2024-07-13 10:15:54.233156] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.458 [2024-07-13 10:15:54.233368] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.458 [2024-07-13 10:15:54.233405] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.458 [2024-07-13 10:15:54.233421] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.458 [2024-07-13 10:15:54.235914] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.458 [2024-07-13 10:15:54.244733] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.458 [2024-07-13 10:15:54.245067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.458 [2024-07-13 10:15:54.245312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.458 [2024-07-13 10:15:54.245342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.458 [2024-07-13 10:15:54.245366] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.458 [2024-07-13 10:15:54.245550] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.458 [2024-07-13 10:15:54.245684] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.458 [2024-07-13 10:15:54.245707] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.458 [2024-07-13 10:15:54.245723] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.458 [2024-07-13 10:15:54.247764] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.458 [2024-07-13 10:15:54.257315] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.458 [2024-07-13 10:15:54.257669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.458 [2024-07-13 10:15:54.257857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.458 [2024-07-13 10:15:54.257891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.458 [2024-07-13 10:15:54.257909] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.458 [2024-07-13 10:15:54.258056] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.458 [2024-07-13 10:15:54.258246] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.458 [2024-07-13 10:15:54.258267] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.458 [2024-07-13 10:15:54.258281] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.458 [2024-07-13 10:15:54.260622] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.458 [2024-07-13 10:15:54.269908] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.458 [2024-07-13 10:15:54.270311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.458 [2024-07-13 10:15:54.270503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.458 [2024-07-13 10:15:54.270551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.458 [2024-07-13 10:15:54.270569] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.458 [2024-07-13 10:15:54.270718] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.458 [2024-07-13 10:15:54.270883] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.458 [2024-07-13 10:15:54.270917] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.459 [2024-07-13 10:15:54.270933] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.718 [2024-07-13 10:15:54.273366] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.718 [2024-07-13 10:15:54.282434] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.718 [2024-07-13 10:15:54.282796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.718 [2024-07-13 10:15:54.282967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.718 [2024-07-13 10:15:54.282995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.718 [2024-07-13 10:15:54.283012] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.718 [2024-07-13 10:15:54.283208] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.718 [2024-07-13 10:15:54.283361] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.718 [2024-07-13 10:15:54.283386] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.718 [2024-07-13 10:15:54.283403] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.718 [2024-07-13 10:15:54.285726] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.718 [2024-07-13 10:15:54.295109] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.718 [2024-07-13 10:15:54.295432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.718 [2024-07-13 10:15:54.295593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.718 [2024-07-13 10:15:54.295619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.718 [2024-07-13 10:15:54.295651] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.718 [2024-07-13 10:15:54.295792] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.718 [2024-07-13 10:15:54.295960] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.718 [2024-07-13 10:15:54.295986] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.718 [2024-07-13 10:15:54.296002] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.718 [2024-07-13 10:15:54.298344] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.718 [2024-07-13 10:15:54.307617] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.718 [2024-07-13 10:15:54.307965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.718 [2024-07-13 10:15:54.308145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.718 [2024-07-13 10:15:54.308174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.718 [2024-07-13 10:15:54.308192] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.718 [2024-07-13 10:15:54.308357] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.718 [2024-07-13 10:15:54.308517] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.718 [2024-07-13 10:15:54.308541] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.718 [2024-07-13 10:15:54.308557] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.718 [2024-07-13 10:15:54.310997] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.718 [2024-07-13 10:15:54.320185] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.718 [2024-07-13 10:15:54.320529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.718 [2024-07-13 10:15:54.320688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.718 [2024-07-13 10:15:54.320717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.718 [2024-07-13 10:15:54.320735] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.718 [2024-07-13 10:15:54.320916] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.718 [2024-07-13 10:15:54.321111] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.718 [2024-07-13 10:15:54.321136] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.718 [2024-07-13 10:15:54.321152] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.718 [2024-07-13 10:15:54.323346] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.718 [2024-07-13 10:15:54.332991] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.718 [2024-07-13 10:15:54.333287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.718 [2024-07-13 10:15:54.333488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.718 [2024-07-13 10:15:54.333517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.718 [2024-07-13 10:15:54.333535] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.718 [2024-07-13 10:15:54.333737] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.718 [2024-07-13 10:15:54.333919] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.718 [2024-07-13 10:15:54.333944] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.718 [2024-07-13 10:15:54.333960] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.718 [2024-07-13 10:15:54.336352] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.718 [2024-07-13 10:15:54.345418] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.718 [2024-07-13 10:15:54.345793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.718 [2024-07-13 10:15:54.345990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.718 [2024-07-13 10:15:54.346022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.718 [2024-07-13 10:15:54.346040] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.718 [2024-07-13 10:15:54.346224] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.718 [2024-07-13 10:15:54.346393] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.718 [2024-07-13 10:15:54.346418] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.718 [2024-07-13 10:15:54.346434] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.718 [2024-07-13 10:15:54.348845] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.718 [2024-07-13 10:15:54.357967] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.718 [2024-07-13 10:15:54.358291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.718 [2024-07-13 10:15:54.358615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.718 [2024-07-13 10:15:54.358666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.718 [2024-07-13 10:15:54.358684] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.718 [2024-07-13 10:15:54.358877] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.718 [2024-07-13 10:15:54.359030] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.718 [2024-07-13 10:15:54.359059] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.718 [2024-07-13 10:15:54.359077] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.718 [2024-07-13 10:15:54.361488] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.718 [2024-07-13 10:15:54.370465] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.718 [2024-07-13 10:15:54.370833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.718 [2024-07-13 10:15:54.371006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.718 [2024-07-13 10:15:54.371036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.718 [2024-07-13 10:15:54.371053] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.718 [2024-07-13 10:15:54.371165] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.718 [2024-07-13 10:15:54.371371] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.718 [2024-07-13 10:15:54.371395] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.719 [2024-07-13 10:15:54.371411] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.719 [2024-07-13 10:15:54.373804] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.719 [2024-07-13 10:15:54.383037] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.719 [2024-07-13 10:15:54.383546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.719 [2024-07-13 10:15:54.383721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.719 [2024-07-13 10:15:54.383753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.719 [2024-07-13 10:15:54.383771] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.719 [2024-07-13 10:15:54.383932] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.719 [2024-07-13 10:15:54.384085] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.719 [2024-07-13 10:15:54.384109] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.719 [2024-07-13 10:15:54.384126] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.719 [2024-07-13 10:15:54.386464] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.719 [2024-07-13 10:15:54.395690] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.719 [2024-07-13 10:15:54.396043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.719 [2024-07-13 10:15:54.396208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.719 [2024-07-13 10:15:54.396234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.719 [2024-07-13 10:15:54.396266] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.719 [2024-07-13 10:15:54.396442] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.719 [2024-07-13 10:15:54.396632] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.719 [2024-07-13 10:15:54.396656] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.719 [2024-07-13 10:15:54.396678] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.719 [2024-07-13 10:15:54.399082] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.719 [2024-07-13 10:15:54.407977] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.719 [2024-07-13 10:15:54.408289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.719 [2024-07-13 10:15:54.408549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.719 [2024-07-13 10:15:54.408575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.719 [2024-07-13 10:15:54.408590] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.719 [2024-07-13 10:15:54.408812] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.719 [2024-07-13 10:15:54.408995] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.719 [2024-07-13 10:15:54.409021] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.719 [2024-07-13 10:15:54.409037] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.719 [2024-07-13 10:15:54.411158] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.719 [2024-07-13 10:15:54.420539] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.719 [2024-07-13 10:15:54.420928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.719 [2024-07-13 10:15:54.421220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.719 [2024-07-13 10:15:54.421272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.719 [2024-07-13 10:15:54.421290] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.719 [2024-07-13 10:15:54.421438] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.719 [2024-07-13 10:15:54.421572] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.719 [2024-07-13 10:15:54.421597] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.719 [2024-07-13 10:15:54.421612] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.719 [2024-07-13 10:15:54.424092] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.719 [2024-07-13 10:15:54.433107] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.719 [2024-07-13 10:15:54.433503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.719 [2024-07-13 10:15:54.433791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.719 [2024-07-13 10:15:54.433861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.719 [2024-07-13 10:15:54.433890] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.719 [2024-07-13 10:15:54.434111] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.719 [2024-07-13 10:15:54.434264] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.719 [2024-07-13 10:15:54.434289] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.719 [2024-07-13 10:15:54.434305] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.719 [2024-07-13 10:15:54.436910] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.719 [2024-07-13 10:15:54.445696] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.719 [2024-07-13 10:15:54.446098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.719 [2024-07-13 10:15:54.446383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.719 [2024-07-13 10:15:54.446432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.719 [2024-07-13 10:15:54.446450] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.719 [2024-07-13 10:15:54.446652] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.719 [2024-07-13 10:15:54.446888] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.719 [2024-07-13 10:15:54.446913] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.719 [2024-07-13 10:15:54.446929] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.719 [2024-07-13 10:15:54.449106] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.719 [2024-07-13 10:15:54.458325] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.719 [2024-07-13 10:15:54.458645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.719 [2024-07-13 10:15:54.458824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.719 [2024-07-13 10:15:54.458850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.719 [2024-07-13 10:15:54.458875] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.719 [2024-07-13 10:15:54.458992] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.719 [2024-07-13 10:15:54.459140] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.719 [2024-07-13 10:15:54.459165] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.719 [2024-07-13 10:15:54.459181] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.719 [2024-07-13 10:15:54.461520] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.719 [2024-07-13 10:15:54.470885] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.719 [2024-07-13 10:15:54.471212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.719 [2024-07-13 10:15:54.471440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.719 [2024-07-13 10:15:54.471487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.719 [2024-07-13 10:15:54.471506] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.719 [2024-07-13 10:15:54.471725] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.719 [2024-07-13 10:15:54.471909] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.719 [2024-07-13 10:15:54.471935] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.719 [2024-07-13 10:15:54.471951] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.719 [2024-07-13 10:15:54.474342] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.719 [2024-07-13 10:15:54.483580] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.719 [2024-07-13 10:15:54.483966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.719 [2024-07-13 10:15:54.484242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.719 [2024-07-13 10:15:54.484290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.719 [2024-07-13 10:15:54.484308] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.719 [2024-07-13 10:15:54.484474] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.719 [2024-07-13 10:15:54.484645] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.719 [2024-07-13 10:15:54.484669] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.719 [2024-07-13 10:15:54.484685] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.719 [2024-07-13 10:15:54.487088] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.719 [2024-07-13 10:15:54.496134] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.719 [2024-07-13 10:15:54.496519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.719 [2024-07-13 10:15:54.496697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.719 [2024-07-13 10:15:54.496723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.719 [2024-07-13 10:15:54.496739] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.719 [2024-07-13 10:15:54.496947] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.719 [2024-07-13 10:15:54.497100] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.720 [2024-07-13 10:15:54.497124] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.720 [2024-07-13 10:15:54.497140] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.720 [2024-07-13 10:15:54.499460] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.720 [2024-07-13 10:15:54.508922] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.720 [2024-07-13 10:15:54.509286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.720 [2024-07-13 10:15:54.509477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.720 [2024-07-13 10:15:54.509503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.720 [2024-07-13 10:15:54.509519] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.720 [2024-07-13 10:15:54.509643] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.720 [2024-07-13 10:15:54.509824] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.720 [2024-07-13 10:15:54.509849] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.720 [2024-07-13 10:15:54.509874] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.720 [2024-07-13 10:15:54.512249] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.720 [2024-07-13 10:15:54.521639] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.720 [2024-07-13 10:15:54.521997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.720 [2024-07-13 10:15:54.522175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.720 [2024-07-13 10:15:54.522204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.720 [2024-07-13 10:15:54.522222] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.720 [2024-07-13 10:15:54.522388] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.720 [2024-07-13 10:15:54.522558] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.720 [2024-07-13 10:15:54.522583] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.720 [2024-07-13 10:15:54.522599] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.720 [2024-07-13 10:15:54.525127] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.979 [2024-07-13 10:15:54.534450] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.979 [2024-07-13 10:15:54.534943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.979 [2024-07-13 10:15:54.535119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.979 [2024-07-13 10:15:54.535151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.979 [2024-07-13 10:15:54.535169] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.979 [2024-07-13 10:15:54.535336] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.979 [2024-07-13 10:15:54.535488] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.979 [2024-07-13 10:15:54.535514] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.979 [2024-07-13 10:15:54.535530] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.979 [2024-07-13 10:15:54.537852] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.979 [2024-07-13 10:15:54.547216] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.979 [2024-07-13 10:15:54.547551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.979 [2024-07-13 10:15:54.547698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.979 [2024-07-13 10:15:54.547728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.979 [2024-07-13 10:15:54.547746] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.979 [2024-07-13 10:15:54.547888] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.979 [2024-07-13 10:15:54.548060] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.979 [2024-07-13 10:15:54.548085] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.979 [2024-07-13 10:15:54.548101] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.979 [2024-07-13 10:15:54.550314] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.979 [2024-07-13 10:15:54.559633] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.979 [2024-07-13 10:15:54.560010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.979 [2024-07-13 10:15:54.560229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.979 [2024-07-13 10:15:54.560271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.979 [2024-07-13 10:15:54.560287] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.979 [2024-07-13 10:15:54.560470] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.979 [2024-07-13 10:15:54.560688] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.979 [2024-07-13 10:15:54.560713] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.979 [2024-07-13 10:15:54.560729] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.979 [2024-07-13 10:15:54.562968] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.979 [2024-07-13 10:15:54.572260] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.979 [2024-07-13 10:15:54.572661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.979 [2024-07-13 10:15:54.572830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.979 [2024-07-13 10:15:54.572860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.979 [2024-07-13 10:15:54.572889] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.980 [2024-07-13 10:15:54.573091] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.980 [2024-07-13 10:15:54.573225] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.980 [2024-07-13 10:15:54.573250] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.980 [2024-07-13 10:15:54.573266] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.980 [2024-07-13 10:15:54.575515] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.980 [2024-07-13 10:15:54.584807] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.980 [2024-07-13 10:15:54.585162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.980 [2024-07-13 10:15:54.585442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.980 [2024-07-13 10:15:54.585468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.980 [2024-07-13 10:15:54.585498] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.980 [2024-07-13 10:15:54.585690] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.980 [2024-07-13 10:15:54.585908] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.980 [2024-07-13 10:15:54.585934] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.980 [2024-07-13 10:15:54.585949] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.980 [2024-07-13 10:15:54.588202] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.980 [2024-07-13 10:15:54.597416] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.980 [2024-07-13 10:15:54.597753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.980 [2024-07-13 10:15:54.597945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.980 [2024-07-13 10:15:54.597972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.980 [2024-07-13 10:15:54.597993] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.980 [2024-07-13 10:15:54.598198] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.980 [2024-07-13 10:15:54.598362] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.980 [2024-07-13 10:15:54.598386] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.980 [2024-07-13 10:15:54.598402] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.980 [2024-07-13 10:15:54.600814] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.980 [2024-07-13 10:15:54.609841] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.980 [2024-07-13 10:15:54.610197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.980 [2024-07-13 10:15:54.610367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.980 [2024-07-13 10:15:54.610397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.980 [2024-07-13 10:15:54.610415] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.980 [2024-07-13 10:15:54.610544] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.980 [2024-07-13 10:15:54.610733] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.980 [2024-07-13 10:15:54.610758] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.980 [2024-07-13 10:15:54.610773] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.980 [2024-07-13 10:15:54.613247] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.980 [2024-07-13 10:15:54.622377] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.980 [2024-07-13 10:15:54.622683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.980 [2024-07-13 10:15:54.622857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.980 [2024-07-13 10:15:54.622900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.980 [2024-07-13 10:15:54.622919] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.980 [2024-07-13 10:15:54.623048] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.980 [2024-07-13 10:15:54.623218] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.980 [2024-07-13 10:15:54.623242] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.980 [2024-07-13 10:15:54.623258] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.980 [2024-07-13 10:15:54.625634] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.980 [2024-07-13 10:15:54.634917] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.980 [2024-07-13 10:15:54.635422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.980 [2024-07-13 10:15:54.635792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.980 [2024-07-13 10:15:54.635844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.980 [2024-07-13 10:15:54.635861] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.980 [2024-07-13 10:15:54.636062] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.980 [2024-07-13 10:15:54.636233] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.980 [2024-07-13 10:15:54.636257] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.980 [2024-07-13 10:15:54.636273] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.980 [2024-07-13 10:15:54.638610] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.980 [2024-07-13 10:15:54.647528] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.980 [2024-07-13 10:15:54.647943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.980 [2024-07-13 10:15:54.648127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.980 [2024-07-13 10:15:54.648154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.980 [2024-07-13 10:15:54.648170] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.980 [2024-07-13 10:15:54.648283] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.980 [2024-07-13 10:15:54.648448] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.980 [2024-07-13 10:15:54.648472] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.980 [2024-07-13 10:15:54.648488] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.980 [2024-07-13 10:15:54.650647] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.980 [2024-07-13 10:15:54.660308] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.980 [2024-07-13 10:15:54.660656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.980 [2024-07-13 10:15:54.660873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.980 [2024-07-13 10:15:54.660901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.980 [2024-07-13 10:15:54.660932] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.980 [2024-07-13 10:15:54.661135] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.980 [2024-07-13 10:15:54.661343] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.980 [2024-07-13 10:15:54.661367] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.980 [2024-07-13 10:15:54.661383] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.980 [2024-07-13 10:15:54.663704] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.980 [2024-07-13 10:15:54.672922] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.980 [2024-07-13 10:15:54.673237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.980 [2024-07-13 10:15:54.673429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.980 [2024-07-13 10:15:54.673469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.980 [2024-07-13 10:15:54.673484] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.980 [2024-07-13 10:15:54.673594] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.980 [2024-07-13 10:15:54.673772] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.980 [2024-07-13 10:15:54.673797] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.980 [2024-07-13 10:15:54.673813] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.980 [2024-07-13 10:15:54.676216] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.980 [2024-07-13 10:15:54.685526] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.980 [2024-07-13 10:15:54.685980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.980 [2024-07-13 10:15:54.686148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.980 [2024-07-13 10:15:54.686178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.980 [2024-07-13 10:15:54.686195] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.980 [2024-07-13 10:15:54.686325] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.980 [2024-07-13 10:15:54.686495] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.980 [2024-07-13 10:15:54.686520] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.980 [2024-07-13 10:15:54.686536] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.980 [2024-07-13 10:15:54.688885] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.980 [2024-07-13 10:15:54.697937] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.980 [2024-07-13 10:15:54.698259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.980 [2024-07-13 10:15:54.698504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.981 [2024-07-13 10:15:54.698554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.981 [2024-07-13 10:15:54.698572] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.981 [2024-07-13 10:15:54.698702] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.981 [2024-07-13 10:15:54.698883] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.981 [2024-07-13 10:15:54.698908] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.981 [2024-07-13 10:15:54.698924] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.981 [2024-07-13 10:15:54.701279] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.981 [2024-07-13 10:15:54.710517] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.981 [2024-07-13 10:15:54.710938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.981 [2024-07-13 10:15:54.711263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.981 [2024-07-13 10:15:54.711323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.981 [2024-07-13 10:15:54.711340] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.981 [2024-07-13 10:15:54.711488] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.981 [2024-07-13 10:15:54.711676] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.981 [2024-07-13 10:15:54.711706] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.981 [2024-07-13 10:15:54.711723] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.981 [2024-07-13 10:15:54.714108] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.981 [2024-07-13 10:15:54.723256] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.981 [2024-07-13 10:15:54.723611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.981 [2024-07-13 10:15:54.723787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.981 [2024-07-13 10:15:54.723813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.981 [2024-07-13 10:15:54.723829] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.981 [2024-07-13 10:15:54.724037] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.981 [2024-07-13 10:15:54.724208] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.981 [2024-07-13 10:15:54.724233] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.981 [2024-07-13 10:15:54.724249] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.981 [2024-07-13 10:15:54.726588] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.981 [2024-07-13 10:15:54.735708] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.981 [2024-07-13 10:15:54.736090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.981 [2024-07-13 10:15:54.736246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.981 [2024-07-13 10:15:54.736273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.981 [2024-07-13 10:15:54.736290] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.981 [2024-07-13 10:15:54.736474] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.981 [2024-07-13 10:15:54.736662] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.981 [2024-07-13 10:15:54.736686] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.981 [2024-07-13 10:15:54.736702] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.981 [2024-07-13 10:15:54.738940] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.981 [2024-07-13 10:15:54.748212] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.981 [2024-07-13 10:15:54.748543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.981 [2024-07-13 10:15:54.748706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.981 [2024-07-13 10:15:54.748732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.981 [2024-07-13 10:15:54.748748] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.981 [2024-07-13 10:15:54.748927] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.981 [2024-07-13 10:15:54.749098] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.981 [2024-07-13 10:15:54.749123] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.981 [2024-07-13 10:15:54.749144] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.981 [2024-07-13 10:15:54.751430] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.981 [2024-07-13 10:15:54.760909] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.981 [2024-07-13 10:15:54.761328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.981 [2024-07-13 10:15:54.761630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.981 [2024-07-13 10:15:54.761680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.981 [2024-07-13 10:15:54.761698] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.981 [2024-07-13 10:15:54.761889] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.981 [2024-07-13 10:15:54.762023] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.981 [2024-07-13 10:15:54.762048] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.981 [2024-07-13 10:15:54.762063] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.981 [2024-07-13 10:15:54.764180] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.981 [2024-07-13 10:15:54.773642] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.981 [2024-07-13 10:15:54.774022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.981 [2024-07-13 10:15:54.774242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.981 [2024-07-13 10:15:54.774293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.981 [2024-07-13 10:15:54.774311] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.981 [2024-07-13 10:15:54.774442] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.981 [2024-07-13 10:15:54.774648] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.981 [2024-07-13 10:15:54.774672] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.981 [2024-07-13 10:15:54.774688] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.981 [2024-07-13 10:15:54.776974] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:48.981 [2024-07-13 10:15:54.786100] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:48.981 [2024-07-13 10:15:54.786464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.981 [2024-07-13 10:15:54.786574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:48.981 [2024-07-13 10:15:54.786599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:48.981 [2024-07-13 10:15:54.786614] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:48.981 [2024-07-13 10:15:54.786754] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:48.981 [2024-07-13 10:15:54.786928] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:48.981 [2024-07-13 10:15:54.786954] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:48.981 [2024-07-13 10:15:54.786970] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:48.981 [2024-07-13 10:15:54.789349] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.241 [2024-07-13 10:15:54.798607] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.241 [2024-07-13 10:15:54.798937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.241 [2024-07-13 10:15:54.799164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.241 [2024-07-13 10:15:54.799190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.241 [2024-07-13 10:15:54.799222] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.241 [2024-07-13 10:15:54.799389] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.241 [2024-07-13 10:15:54.799604] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.241 [2024-07-13 10:15:54.799631] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.241 [2024-07-13 10:15:54.799647] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.241 [2024-07-13 10:15:54.802196] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.241 [2024-07-13 10:15:54.811208] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.241 [2024-07-13 10:15:54.811677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.241 [2024-07-13 10:15:54.811884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.241 [2024-07-13 10:15:54.811912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.241 [2024-07-13 10:15:54.811929] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.241 [2024-07-13 10:15:54.812110] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.241 [2024-07-13 10:15:54.812226] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.241 [2024-07-13 10:15:54.812251] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.241 [2024-07-13 10:15:54.812267] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.241 [2024-07-13 10:15:54.814535] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.241 [2024-07-13 10:15:54.823813] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.241 [2024-07-13 10:15:54.824134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.241 [2024-07-13 10:15:54.824419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.242 [2024-07-13 10:15:54.824479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.242 [2024-07-13 10:15:54.824496] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.242 [2024-07-13 10:15:54.824680] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.242 [2024-07-13 10:15:54.824833] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.242 [2024-07-13 10:15:54.824857] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.242 [2024-07-13 10:15:54.824884] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.242 [2024-07-13 10:15:54.827314] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.242 [2024-07-13 10:15:54.836803] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.242 [2024-07-13 10:15:54.837137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.242 [2024-07-13 10:15:54.837472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.242 [2024-07-13 10:15:54.837522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.242 [2024-07-13 10:15:54.837539] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.242 [2024-07-13 10:15:54.837759] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.242 [2024-07-13 10:15:54.837904] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.242 [2024-07-13 10:15:54.837930] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.242 [2024-07-13 10:15:54.837946] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.242 [2024-07-13 10:15:54.840322] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.242 [2024-07-13 10:15:54.849516] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.242 [2024-07-13 10:15:54.849953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.242 [2024-07-13 10:15:54.850099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.242 [2024-07-13 10:15:54.850129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.242 [2024-07-13 10:15:54.850146] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.242 [2024-07-13 10:15:54.850330] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.242 [2024-07-13 10:15:54.850500] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.242 [2024-07-13 10:15:54.850525] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.242 [2024-07-13 10:15:54.850540] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.242 [2024-07-13 10:15:54.852806] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.242 [2024-07-13 10:15:54.862308] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.242 [2024-07-13 10:15:54.862655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.242 [2024-07-13 10:15:54.862821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.242 [2024-07-13 10:15:54.862864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.242 [2024-07-13 10:15:54.862894] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.242 [2024-07-13 10:15:54.863060] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.242 [2024-07-13 10:15:54.863213] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.242 [2024-07-13 10:15:54.863237] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.242 [2024-07-13 10:15:54.863253] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.242 [2024-07-13 10:15:54.865629] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.242 [2024-07-13 10:15:54.874831] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.242 [2024-07-13 10:15:54.875224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.242 [2024-07-13 10:15:54.875453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.242 [2024-07-13 10:15:54.875521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.242 [2024-07-13 10:15:54.875540] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.242 [2024-07-13 10:15:54.875706] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.242 [2024-07-13 10:15:54.875887] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.242 [2024-07-13 10:15:54.875912] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.242 [2024-07-13 10:15:54.875928] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.242 [2024-07-13 10:15:54.878498] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.242 [2024-07-13 10:15:54.887411] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.242 [2024-07-13 10:15:54.887731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.242 [2024-07-13 10:15:54.888416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.242 [2024-07-13 10:15:54.888450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.242 [2024-07-13 10:15:54.888469] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.242 [2024-07-13 10:15:54.888638] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.242 [2024-07-13 10:15:54.888809] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.242 [2024-07-13 10:15:54.888834] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.242 [2024-07-13 10:15:54.888851] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.242 [2024-07-13 10:15:54.891014] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.242 [2024-07-13 10:15:54.899879] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.242 [2024-07-13 10:15:54.900273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.242 [2024-07-13 10:15:54.900482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.242 [2024-07-13 10:15:54.900511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.242 [2024-07-13 10:15:54.900529] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.242 [2024-07-13 10:15:54.900677] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.242 [2024-07-13 10:15:54.900894] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.242 [2024-07-13 10:15:54.900930] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.242 [2024-07-13 10:15:54.900944] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.242 [2024-07-13 10:15:54.903210] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.242 [2024-07-13 10:15:54.912373] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.242 [2024-07-13 10:15:54.912775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.242 [2024-07-13 10:15:54.912972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.242 [2024-07-13 10:15:54.912999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.242 [2024-07-13 10:15:54.913016] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.242 [2024-07-13 10:15:54.913245] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.242 [2024-07-13 10:15:54.913434] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.242 [2024-07-13 10:15:54.913458] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.242 [2024-07-13 10:15:54.913474] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.242 [2024-07-13 10:15:54.915873] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.242 [2024-07-13 10:15:54.924852] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.242 [2024-07-13 10:15:54.925235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.242 [2024-07-13 10:15:54.925412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.242 [2024-07-13 10:15:54.925441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.242 [2024-07-13 10:15:54.925459] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.242 [2024-07-13 10:15:54.925607] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.242 [2024-07-13 10:15:54.925777] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.242 [2024-07-13 10:15:54.925802] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.242 [2024-07-13 10:15:54.925818] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.242 [2024-07-13 10:15:54.927746] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.242 [2024-07-13 10:15:54.937421] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.242 [2024-07-13 10:15:54.937788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.242 [2024-07-13 10:15:54.937974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.242 [2024-07-13 10:15:54.938002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.242 [2024-07-13 10:15:54.938019] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.242 [2024-07-13 10:15:54.938201] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.242 [2024-07-13 10:15:54.938390] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.242 [2024-07-13 10:15:54.938415] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.242 [2024-07-13 10:15:54.938431] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.242 [2024-07-13 10:15:54.940685] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.242 [2024-07-13 10:15:54.949963] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.242 [2024-07-13 10:15:54.950389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.242 [2024-07-13 10:15:54.950650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.243 [2024-07-13 10:15:54.950682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.243 [2024-07-13 10:15:54.950706] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.243 [2024-07-13 10:15:54.950901] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.243 [2024-07-13 10:15:54.951074] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.243 [2024-07-13 10:15:54.951094] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.243 [2024-07-13 10:15:54.951107] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.243 [2024-07-13 10:15:54.953535] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.243 [2024-07-13 10:15:54.962544] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.243 [2024-07-13 10:15:54.962857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.243 [2024-07-13 10:15:54.963008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.243 [2024-07-13 10:15:54.963034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.243 [2024-07-13 10:15:54.963051] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.243 [2024-07-13 10:15:54.963223] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.243 [2024-07-13 10:15:54.963358] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.243 [2024-07-13 10:15:54.963382] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.243 [2024-07-13 10:15:54.963398] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.243 [2024-07-13 10:15:54.965807] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.243 [2024-07-13 10:15:54.975049] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.243 [2024-07-13 10:15:54.975387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.243 [2024-07-13 10:15:54.975550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.243 [2024-07-13 10:15:54.975578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.243 [2024-07-13 10:15:54.975595] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.243 [2024-07-13 10:15:54.975720] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.243 [2024-07-13 10:15:54.975893] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.243 [2024-07-13 10:15:54.975931] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.243 [2024-07-13 10:15:54.975946] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.243 [2024-07-13 10:15:54.978095] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.243 [2024-07-13 10:15:54.987184] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.243 [2024-07-13 10:15:54.987488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.243 [2024-07-13 10:15:54.987680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.243 [2024-07-13 10:15:54.987707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.243 [2024-07-13 10:15:54.987723] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.243 [2024-07-13 10:15:54.987943] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.243 [2024-07-13 10:15:54.988104] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.243 [2024-07-13 10:15:54.988125] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.243 [2024-07-13 10:15:54.988139] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.243 [2024-07-13 10:15:54.990080] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.243 [2024-07-13 10:15:54.999737] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.243 [2024-07-13 10:15:55.000153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.243 [2024-07-13 10:15:55.000462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.243 [2024-07-13 10:15:55.000519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.243 [2024-07-13 10:15:55.000537] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.243 [2024-07-13 10:15:55.000703] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.243 [2024-07-13 10:15:55.000902] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.243 [2024-07-13 10:15:55.000941] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.243 [2024-07-13 10:15:55.000956] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.243 [2024-07-13 10:15:55.003323] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.243 [2024-07-13 10:15:55.012204] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.243 [2024-07-13 10:15:55.012730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.243 [2024-07-13 10:15:55.012960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.243 [2024-07-13 10:15:55.012987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.243 [2024-07-13 10:15:55.013018] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.243 [2024-07-13 10:15:55.013151] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.243 [2024-07-13 10:15:55.013322] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.243 [2024-07-13 10:15:55.013346] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.243 [2024-07-13 10:15:55.013363] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.243 [2024-07-13 10:15:55.015778] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.243 [2024-07-13 10:15:55.024792] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.243 [2024-07-13 10:15:55.025213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.243 [2024-07-13 10:15:55.025478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.243 [2024-07-13 10:15:55.025530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.243 [2024-07-13 10:15:55.025548] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.243 [2024-07-13 10:15:55.025695] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.243 [2024-07-13 10:15:55.025898] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.243 [2024-07-13 10:15:55.025924] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.243 [2024-07-13 10:15:55.025941] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.243 [2024-07-13 10:15:55.028440] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.243 [2024-07-13 10:15:55.037556] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.243 [2024-07-13 10:15:55.037854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.243 [2024-07-13 10:15:55.038035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.243 [2024-07-13 10:15:55.038065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.243 [2024-07-13 10:15:55.038083] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.243 [2024-07-13 10:15:55.038266] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.243 [2024-07-13 10:15:55.038436] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.243 [2024-07-13 10:15:55.038461] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.243 [2024-07-13 10:15:55.038477] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.243 [2024-07-13 10:15:55.040837] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.243 [2024-07-13 10:15:55.050193] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.243 [2024-07-13 10:15:55.050564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.243 [2024-07-13 10:15:55.050769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.243 [2024-07-13 10:15:55.050798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.243 [2024-07-13 10:15:55.050816] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.243 [2024-07-13 10:15:55.050974] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.243 [2024-07-13 10:15:55.051127] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.243 [2024-07-13 10:15:55.051151] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.243 [2024-07-13 10:15:55.051168] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.243 [2024-07-13 10:15:55.053533] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.505 [2024-07-13 10:15:55.062807] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.505 [2024-07-13 10:15:55.063134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.505 [2024-07-13 10:15:55.063349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.505 [2024-07-13 10:15:55.063377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.505 [2024-07-13 10:15:55.063394] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.505 [2024-07-13 10:15:55.063528] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.505 [2024-07-13 10:15:55.063696] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.505 [2024-07-13 10:15:55.063726] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.505 [2024-07-13 10:15:55.063743] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.505 [2024-07-13 10:15:55.066049] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.505 [2024-07-13 10:15:55.075684] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.505 [2024-07-13 10:15:55.076015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.505 [2024-07-13 10:15:55.076152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.505 [2024-07-13 10:15:55.076178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.505 [2024-07-13 10:15:55.076195] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.505 [2024-07-13 10:15:55.076344] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.505 [2024-07-13 10:15:55.076529] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.505 [2024-07-13 10:15:55.076553] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.505 [2024-07-13 10:15:55.076569] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.505 [2024-07-13 10:15:55.078910] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.505 [2024-07-13 10:15:55.088337] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.505 [2024-07-13 10:15:55.088861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.505 [2024-07-13 10:15:55.089644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.505 [2024-07-13 10:15:55.089679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.505 [2024-07-13 10:15:55.089697] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.505 [2024-07-13 10:15:55.089876] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.505 [2024-07-13 10:15:55.090066] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.505 [2024-07-13 10:15:55.090089] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.505 [2024-07-13 10:15:55.090104] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.505 [2024-07-13 10:15:55.092376] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.505 [2024-07-13 10:15:55.100879] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.505 [2024-07-13 10:15:55.101265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.505 [2024-07-13 10:15:55.101438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.505 [2024-07-13 10:15:55.101468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.505 [2024-07-13 10:15:55.101487] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.505 [2024-07-13 10:15:55.101652] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.505 [2024-07-13 10:15:55.101823] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.506 [2024-07-13 10:15:55.101848] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.506 [2024-07-13 10:15:55.101878] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.506 [2024-07-13 10:15:55.104441] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.506 [2024-07-13 10:15:55.113136] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.506 [2024-07-13 10:15:55.113467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.506 [2024-07-13 10:15:55.113625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.506 [2024-07-13 10:15:55.113652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.506 [2024-07-13 10:15:55.113668] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.506 [2024-07-13 10:15:55.113848] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.506 [2024-07-13 10:15:55.114010] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.506 [2024-07-13 10:15:55.114033] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.506 [2024-07-13 10:15:55.114047] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.506 [2024-07-13 10:15:55.116296] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.506 [2024-07-13 10:15:55.125716] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.506 [2024-07-13 10:15:55.126108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.506 [2024-07-13 10:15:55.126267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.506 [2024-07-13 10:15:55.126298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.506 [2024-07-13 10:15:55.126332] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.506 [2024-07-13 10:15:55.126480] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.506 [2024-07-13 10:15:55.126651] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.506 [2024-07-13 10:15:55.126675] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.506 [2024-07-13 10:15:55.126690] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.506 [2024-07-13 10:15:55.129249] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.506 [2024-07-13 10:15:55.138394] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.506 [2024-07-13 10:15:55.138765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.506 [2024-07-13 10:15:55.138942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.506 [2024-07-13 10:15:55.138969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.506 [2024-07-13 10:15:55.138986] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.506 [2024-07-13 10:15:55.139183] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.506 [2024-07-13 10:15:55.139372] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.506 [2024-07-13 10:15:55.139393] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.506 [2024-07-13 10:15:55.139406] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.506 [2024-07-13 10:15:55.141659] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.506 [2024-07-13 10:15:55.150966] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.506 [2024-07-13 10:15:55.151305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.506 [2024-07-13 10:15:55.151531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.506 [2024-07-13 10:15:55.151579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.506 [2024-07-13 10:15:55.151598] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.506 [2024-07-13 10:15:55.151831] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.506 [2024-07-13 10:15:55.152007] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.506 [2024-07-13 10:15:55.152030] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.506 [2024-07-13 10:15:55.152046] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.506 [2024-07-13 10:15:55.154437] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.506 [2024-07-13 10:15:55.163677] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.506 [2024-07-13 10:15:55.164041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.506 [2024-07-13 10:15:55.164180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.506 [2024-07-13 10:15:55.164206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.506 [2024-07-13 10:15:55.164223] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.506 [2024-07-13 10:15:55.164420] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.506 [2024-07-13 10:15:55.164572] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.506 [2024-07-13 10:15:55.164597] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.506 [2024-07-13 10:15:55.164612] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.506 [2024-07-13 10:15:55.167114] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.506 [2024-07-13 10:15:55.176303] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.506 [2024-07-13 10:15:55.176646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.506 [2024-07-13 10:15:55.176857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.506 [2024-07-13 10:15:55.176891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.506 [2024-07-13 10:15:55.176908] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.506 [2024-07-13 10:15:55.177073] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.506 [2024-07-13 10:15:55.177235] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.506 [2024-07-13 10:15:55.177260] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.506 [2024-07-13 10:15:55.177275] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.506 [2024-07-13 10:15:55.179646] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.506 [2024-07-13 10:15:55.189047] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.506 [2024-07-13 10:15:55.189408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.506 [2024-07-13 10:15:55.189622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.506 [2024-07-13 10:15:55.189651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.506 [2024-07-13 10:15:55.189669] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.506 [2024-07-13 10:15:55.189880] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.506 [2024-07-13 10:15:55.190061] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.506 [2024-07-13 10:15:55.190082] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.506 [2024-07-13 10:15:55.190096] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.506 [2024-07-13 10:15:55.192520] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.506 [2024-07-13 10:15:55.201507] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.506 [2024-07-13 10:15:55.201937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.506 [2024-07-13 10:15:55.202101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.506 [2024-07-13 10:15:55.202128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.506 [2024-07-13 10:15:55.202159] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.506 [2024-07-13 10:15:55.202377] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.506 [2024-07-13 10:15:55.202530] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.506 [2024-07-13 10:15:55.202555] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.506 [2024-07-13 10:15:55.202571] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.506 [2024-07-13 10:15:55.204696] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.506 [2024-07-13 10:15:55.214162] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.506 [2024-07-13 10:15:55.214554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.506 [2024-07-13 10:15:55.214775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.506 [2024-07-13 10:15:55.214820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.506 [2024-07-13 10:15:55.214839] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.506 [2024-07-13 10:15:55.214994] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.506 [2024-07-13 10:15:55.215106] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.506 [2024-07-13 10:15:55.215127] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.506 [2024-07-13 10:15:55.215154] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.506 [2024-07-13 10:15:55.217463] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.506 [2024-07-13 10:15:55.226663] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.506 [2024-07-13 10:15:55.227089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.506 [2024-07-13 10:15:55.227262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.506 [2024-07-13 10:15:55.227292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.506 [2024-07-13 10:15:55.227311] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.506 [2024-07-13 10:15:55.227494] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.506 [2024-07-13 10:15:55.227647] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.506 [2024-07-13 10:15:55.227672] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.507 [2024-07-13 10:15:55.227688] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.507 [2024-07-13 10:15:55.230134] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.507 [2024-07-13 10:15:55.239039] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.507 [2024-07-13 10:15:55.239425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.507 [2024-07-13 10:15:55.239604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.507 [2024-07-13 10:15:55.239630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.507 [2024-07-13 10:15:55.239645] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.507 [2024-07-13 10:15:55.239849] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.507 [2024-07-13 10:15:55.239976] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.507 [2024-07-13 10:15:55.240001] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.507 [2024-07-13 10:15:55.240017] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.507 [2024-07-13 10:15:55.242443] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.507 [2024-07-13 10:15:55.251696] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.507 [2024-07-13 10:15:55.252043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.507 [2024-07-13 10:15:55.252244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.507 [2024-07-13 10:15:55.252273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.507 [2024-07-13 10:15:55.252292] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.507 [2024-07-13 10:15:55.252476] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.507 [2024-07-13 10:15:55.252664] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.507 [2024-07-13 10:15:55.252689] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.507 [2024-07-13 10:15:55.252705] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.507 [2024-07-13 10:15:55.255091] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.507 [2024-07-13 10:15:55.264210] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.507 [2024-07-13 10:15:55.264560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.507 [2024-07-13 10:15:55.264767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.507 [2024-07-13 10:15:55.264797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.507 [2024-07-13 10:15:55.264816] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.507 [2024-07-13 10:15:55.265029] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.507 [2024-07-13 10:15:55.265154] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.507 [2024-07-13 10:15:55.265179] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.507 [2024-07-13 10:15:55.265196] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.507 [2024-07-13 10:15:55.267499] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.507 [2024-07-13 10:15:55.276663] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.507 [2024-07-13 10:15:55.277035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.507 [2024-07-13 10:15:55.277201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.507 [2024-07-13 10:15:55.277245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.507 [2024-07-13 10:15:55.277264] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.507 [2024-07-13 10:15:55.277430] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.507 [2024-07-13 10:15:55.277617] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.507 [2024-07-13 10:15:55.277643] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.507 [2024-07-13 10:15:55.277659] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.507 [2024-07-13 10:15:55.280086] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.507 [2024-07-13 10:15:55.289139] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.507 [2024-07-13 10:15:55.289550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.507 [2024-07-13 10:15:55.289740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.507 [2024-07-13 10:15:55.289766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.507 [2024-07-13 10:15:55.289782] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.507 [2024-07-13 10:15:55.289937] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.507 [2024-07-13 10:15:55.290101] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.507 [2024-07-13 10:15:55.290126] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.507 [2024-07-13 10:15:55.290141] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.507 [2024-07-13 10:15:55.292355] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.507 [2024-07-13 10:15:55.301783] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.507 [2024-07-13 10:15:55.302193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.507 [2024-07-13 10:15:55.302384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.507 [2024-07-13 10:15:55.302427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.507 [2024-07-13 10:15:55.302451] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.507 [2024-07-13 10:15:55.302618] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.507 [2024-07-13 10:15:55.302805] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.507 [2024-07-13 10:15:55.302830] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.507 [2024-07-13 10:15:55.302846] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.507 [2024-07-13 10:15:55.305145] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.507 [2024-07-13 10:15:55.314247] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.507 [2024-07-13 10:15:55.314633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.507 [2024-07-13 10:15:55.314790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.507 [2024-07-13 10:15:55.314820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.507 [2024-07-13 10:15:55.314838] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.507 [2024-07-13 10:15:55.315016] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.507 [2024-07-13 10:15:55.315205] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.507 [2024-07-13 10:15:55.315231] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.507 [2024-07-13 10:15:55.315247] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.507 [2024-07-13 10:15:55.317668] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.767 [2024-07-13 10:15:55.326825] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.768 [2024-07-13 10:15:55.327195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.768 [2024-07-13 10:15:55.327407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.768 [2024-07-13 10:15:55.327455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.768 [2024-07-13 10:15:55.327474] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.768 [2024-07-13 10:15:55.327623] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.768 [2024-07-13 10:15:55.327775] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.768 [2024-07-13 10:15:55.327801] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.768 [2024-07-13 10:15:55.327817] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.768 [2024-07-13 10:15:55.330349] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.768 [2024-07-13 10:15:55.339350] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.768 [2024-07-13 10:15:55.339702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.768 [2024-07-13 10:15:55.339902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.768 [2024-07-13 10:15:55.339930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.768 [2024-07-13 10:15:55.339946] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.768 [2024-07-13 10:15:55.340109] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.768 [2024-07-13 10:15:55.340281] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.768 [2024-07-13 10:15:55.340306] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.768 [2024-07-13 10:15:55.340322] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.768 [2024-07-13 10:15:55.342735] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.768 [2024-07-13 10:15:55.352039] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.768 [2024-07-13 10:15:55.352418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.768 [2024-07-13 10:15:55.352638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.768 [2024-07-13 10:15:55.352687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.768 [2024-07-13 10:15:55.352706] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.768 [2024-07-13 10:15:55.352885] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.768 [2024-07-13 10:15:55.353056] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.768 [2024-07-13 10:15:55.353082] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.768 [2024-07-13 10:15:55.353098] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.768 [2024-07-13 10:15:55.355349] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.768 [2024-07-13 10:15:55.364738] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.768 [2024-07-13 10:15:55.365128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.768 [2024-07-13 10:15:55.365270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.768 [2024-07-13 10:15:55.365296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.768 [2024-07-13 10:15:55.365312] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.768 [2024-07-13 10:15:55.365438] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.768 [2024-07-13 10:15:55.365589] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.768 [2024-07-13 10:15:55.365613] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.768 [2024-07-13 10:15:55.365629] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.768 [2024-07-13 10:15:55.367946] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.768 [2024-07-13 10:15:55.377487] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.768 [2024-07-13 10:15:55.377829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.768 [2024-07-13 10:15:55.378005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.768 [2024-07-13 10:15:55.378035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.768 [2024-07-13 10:15:55.378052] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.768 [2024-07-13 10:15:55.378225] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.768 [2024-07-13 10:15:55.378414] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.768 [2024-07-13 10:15:55.378440] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.768 [2024-07-13 10:15:55.378456] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.768 [2024-07-13 10:15:55.380796] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.768 [2024-07-13 10:15:55.390051] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.768 [2024-07-13 10:15:55.390432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.768 [2024-07-13 10:15:55.390704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.768 [2024-07-13 10:15:55.390746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.768 [2024-07-13 10:15:55.390762] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.768 [2024-07-13 10:15:55.390857] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.768 [2024-07-13 10:15:55.391059] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.768 [2024-07-13 10:15:55.391084] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.768 [2024-07-13 10:15:55.391099] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.768 [2024-07-13 10:15:55.393583] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.768 [2024-07-13 10:15:55.402389] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.768 [2024-07-13 10:15:55.402743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.768 [2024-07-13 10:15:55.402916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.768 [2024-07-13 10:15:55.402946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.768 [2024-07-13 10:15:55.402964] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.768 [2024-07-13 10:15:55.403111] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.768 [2024-07-13 10:15:55.403317] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.768 [2024-07-13 10:15:55.403343] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.768 [2024-07-13 10:15:55.403359] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.768 [2024-07-13 10:15:55.405808] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.768 [2024-07-13 10:15:55.415086] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.768 [2024-07-13 10:15:55.415427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.768 [2024-07-13 10:15:55.415599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.768 [2024-07-13 10:15:55.415629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.768 [2024-07-13 10:15:55.415648] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.768 [2024-07-13 10:15:55.415899] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.768 [2024-07-13 10:15:55.416131] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.768 [2024-07-13 10:15:55.416157] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.768 [2024-07-13 10:15:55.416173] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.768 [2024-07-13 10:15:55.418332] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.768 [2024-07-13 10:15:55.427599] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.768 [2024-07-13 10:15:55.427924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.768 [2024-07-13 10:15:55.428094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.768 [2024-07-13 10:15:55.428123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.768 [2024-07-13 10:15:55.428141] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.768 [2024-07-13 10:15:55.428307] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.768 [2024-07-13 10:15:55.428477] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.768 [2024-07-13 10:15:55.428503] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.768 [2024-07-13 10:15:55.428519] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.768 [2024-07-13 10:15:55.430806] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.768 [2024-07-13 10:15:55.440265] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.768 [2024-07-13 10:15:55.440658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.768 [2024-07-13 10:15:55.440837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.768 [2024-07-13 10:15:55.440877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.768 [2024-07-13 10:15:55.440898] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.768 [2024-07-13 10:15:55.441066] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.768 [2024-07-13 10:15:55.441219] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.768 [2024-07-13 10:15:55.441245] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.768 [2024-07-13 10:15:55.441261] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.768 [2024-07-13 10:15:55.443657] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.769 [2024-07-13 10:15:55.452630] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.769 [2024-07-13 10:15:55.453029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.769 [2024-07-13 10:15:55.453166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.769 [2024-07-13 10:15:55.453208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.769 [2024-07-13 10:15:55.453224] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.769 [2024-07-13 10:15:55.453351] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.769 [2024-07-13 10:15:55.453553] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.769 [2024-07-13 10:15:55.453579] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.769 [2024-07-13 10:15:55.453600] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.769 [2024-07-13 10:15:55.455910] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.769 [2024-07-13 10:15:55.465202] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.769 [2024-07-13 10:15:55.465593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.769 [2024-07-13 10:15:55.465762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.769 [2024-07-13 10:15:55.465791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.769 [2024-07-13 10:15:55.465808] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.769 [2024-07-13 10:15:55.465988] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.769 [2024-07-13 10:15:55.466122] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.769 [2024-07-13 10:15:55.466146] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.769 [2024-07-13 10:15:55.466162] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.769 [2024-07-13 10:15:55.468613] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.769 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 2937443 Killed "${NVMF_APP[@]}" "$@" 00:29:49.769 10:15:55 -- host/bdevperf.sh@36 -- # tgt_init 00:29:49.769 10:15:55 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:29:49.769 10:15:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:49.769 10:15:55 -- common/autotest_common.sh@712 -- # xtrace_disable 00:29:49.769 10:15:55 -- common/autotest_common.sh@10 -- # set +x 00:29:49.769 [2024-07-13 10:15:55.477850] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.769 [2024-07-13 10:15:55.478253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.769 [2024-07-13 10:15:55.478522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.769 [2024-07-13 10:15:55.478567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.769 [2024-07-13 10:15:55.478585] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.769 [2024-07-13 10:15:55.478770] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.769 [2024-07-13 10:15:55.478914] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.769 [2024-07-13 10:15:55.478939] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.769 [2024-07-13 10:15:55.478956] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.769 10:15:55 -- nvmf/common.sh@469 -- # nvmfpid=2938560 00:29:49.769 10:15:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:29:49.769 10:15:55 -- nvmf/common.sh@470 -- # waitforlisten 2938560 00:29:49.769 [2024-07-13 10:15:55.481352] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.769 10:15:55 -- common/autotest_common.sh@819 -- # '[' -z 2938560 ']' 00:29:49.769 10:15:55 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:49.769 10:15:55 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:49.769 10:15:55 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:49.769 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:49.769 10:15:55 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:49.769 10:15:55 -- common/autotest_common.sh@10 -- # set +x 00:29:49.769 [2024-07-13 10:15:55.490720] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.769 [2024-07-13 10:15:55.491085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.769 [2024-07-13 10:15:55.491257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.769 [2024-07-13 10:15:55.491286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.769 [2024-07-13 10:15:55.491305] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.769 [2024-07-13 10:15:55.491397] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.769 [2024-07-13 10:15:55.491604] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.769 [2024-07-13 10:15:55.491630] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.769 [2024-07-13 10:15:55.491646] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.769 [2024-07-13 10:15:55.493992] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.769 [2024-07-13 10:15:55.503125] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.769 [2024-07-13 10:15:55.503470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.769 [2024-07-13 10:15:55.503656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.769 [2024-07-13 10:15:55.503684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.769 [2024-07-13 10:15:55.503700] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.769 [2024-07-13 10:15:55.503854] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.769 [2024-07-13 10:15:55.504037] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.769 [2024-07-13 10:15:55.504060] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.769 [2024-07-13 10:15:55.504075] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.769 [2024-07-13 10:15:55.506146] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.769 [2024-07-13 10:15:55.515342] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.769 [2024-07-13 10:15:55.515635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.769 [2024-07-13 10:15:55.515805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.769 [2024-07-13 10:15:55.515831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.769 [2024-07-13 10:15:55.515847] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.769 [2024-07-13 10:15:55.516053] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.769 [2024-07-13 10:15:55.516216] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.769 [2024-07-13 10:15:55.516237] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.769 [2024-07-13 10:15:55.516251] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.769 [2024-07-13 10:15:55.518097] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.769 [2024-07-13 10:15:55.522689] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:29:49.769 [2024-07-13 10:15:55.522744] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:49.769 [2024-07-13 10:15:55.527441] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.769 [2024-07-13 10:15:55.527781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.769 [2024-07-13 10:15:55.527997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.769 [2024-07-13 10:15:55.528024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.769 [2024-07-13 10:15:55.528041] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.769 [2024-07-13 10:15:55.528188] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.769 [2024-07-13 10:15:55.528345] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.769 [2024-07-13 10:15:55.528365] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.769 [2024-07-13 10:15:55.528378] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.769 [2024-07-13 10:15:55.530508] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.769 [2024-07-13 10:15:55.539542] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.769 [2024-07-13 10:15:55.539857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.769 [2024-07-13 10:15:55.540064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.769 [2024-07-13 10:15:55.540090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.769 [2024-07-13 10:15:55.540106] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.769 [2024-07-13 10:15:55.540300] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.769 [2024-07-13 10:15:55.540438] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.769 [2024-07-13 10:15:55.540458] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.769 [2024-07-13 10:15:55.540470] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.769 [2024-07-13 10:15:55.542373] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.769 [2024-07-13 10:15:55.551668] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.769 [2024-07-13 10:15:55.552038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.769 [2024-07-13 10:15:55.552224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.769 [2024-07-13 10:15:55.552252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.769 [2024-07-13 10:15:55.552268] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.769 [2024-07-13 10:15:55.552416] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.770 [2024-07-13 10:15:55.552628] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.770 [2024-07-13 10:15:55.552648] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.770 [2024-07-13 10:15:55.552665] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.770 [2024-07-13 10:15:55.554702] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.770 EAL: No free 2048 kB hugepages reported on node 1 00:29:49.770 [2024-07-13 10:15:55.564077] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.770 [2024-07-13 10:15:55.564428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.770 [2024-07-13 10:15:55.564627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.770 [2024-07-13 10:15:55.564657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.770 [2024-07-13 10:15:55.564675] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.770 [2024-07-13 10:15:55.564857] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.770 [2024-07-13 10:15:55.565022] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.770 [2024-07-13 10:15:55.565044] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.770 [2024-07-13 10:15:55.565058] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.770 [2024-07-13 10:15:55.567302] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:49.770 [2024-07-13 10:15:55.576462] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:49.770 [2024-07-13 10:15:55.576796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.770 [2024-07-13 10:15:55.577001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:49.770 [2024-07-13 10:15:55.577028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:49.770 [2024-07-13 10:15:55.577044] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:49.770 [2024-07-13 10:15:55.577266] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:49.770 [2024-07-13 10:15:55.577455] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:49.770 [2024-07-13 10:15:55.577480] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:49.770 [2024-07-13 10:15:55.577496] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:49.770 [2024-07-13 10:15:55.579748] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.031 [2024-07-13 10:15:55.589157] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.031 [2024-07-13 10:15:55.589596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.031 [2024-07-13 10:15:55.589797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.031 [2024-07-13 10:15:55.589827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.031 [2024-07-13 10:15:55.589846] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.031 [2024-07-13 10:15:55.590005] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.031 [2024-07-13 10:15:55.590147] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.031 [2024-07-13 10:15:55.590167] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.031 [2024-07-13 10:15:55.590181] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.031 [2024-07-13 10:15:55.591059] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:29:50.031 [2024-07-13 10:15:55.592510] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.031 [2024-07-13 10:15:55.601617] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.032 [2024-07-13 10:15:55.602163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.032 [2024-07-13 10:15:55.602376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.032 [2024-07-13 10:15:55.602406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.032 [2024-07-13 10:15:55.602429] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.032 [2024-07-13 10:15:55.602590] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.032 [2024-07-13 10:15:55.602785] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.032 [2024-07-13 10:15:55.602810] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.032 [2024-07-13 10:15:55.602831] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.032 [2024-07-13 10:15:55.605117] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.032 [2024-07-13 10:15:55.614251] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.032 [2024-07-13 10:15:55.614705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.032 [2024-07-13 10:15:55.614848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.032 [2024-07-13 10:15:55.614881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.032 [2024-07-13 10:15:55.614901] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.032 [2024-07-13 10:15:55.615020] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.032 [2024-07-13 10:15:55.615239] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.032 [2024-07-13 10:15:55.615265] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.032 [2024-07-13 10:15:55.615283] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.032 [2024-07-13 10:15:55.617499] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.032 [2024-07-13 10:15:55.626875] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.032 [2024-07-13 10:15:55.627255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.032 [2024-07-13 10:15:55.627438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.032 [2024-07-13 10:15:55.627468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.032 [2024-07-13 10:15:55.627488] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.032 [2024-07-13 10:15:55.627708] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.032 [2024-07-13 10:15:55.627843] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.032 [2024-07-13 10:15:55.627957] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.032 [2024-07-13 10:15:55.627980] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.032 [2024-07-13 10:15:55.630300] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.032 [2024-07-13 10:15:55.639385] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.032 [2024-07-13 10:15:55.639795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.032 [2024-07-13 10:15:55.639967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.032 [2024-07-13 10:15:55.639995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.032 [2024-07-13 10:15:55.640014] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.032 [2024-07-13 10:15:55.640231] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.032 [2024-07-13 10:15:55.640367] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.032 [2024-07-13 10:15:55.640393] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.032 [2024-07-13 10:15:55.640410] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.032 [2024-07-13 10:15:55.642649] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.032 [2024-07-13 10:15:55.652031] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.032 [2024-07-13 10:15:55.652529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.032 [2024-07-13 10:15:55.652725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.032 [2024-07-13 10:15:55.652755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.032 [2024-07-13 10:15:55.652778] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.032 [2024-07-13 10:15:55.652995] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.032 [2024-07-13 10:15:55.653144] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.032 [2024-07-13 10:15:55.653181] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.032 [2024-07-13 10:15:55.653198] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.032 [2024-07-13 10:15:55.655542] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.032 [2024-07-13 10:15:55.664717] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.032 [2024-07-13 10:15:55.665087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.032 [2024-07-13 10:15:55.665303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.032 [2024-07-13 10:15:55.665333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.032 [2024-07-13 10:15:55.665351] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.032 [2024-07-13 10:15:55.665517] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.032 [2024-07-13 10:15:55.665651] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.032 [2024-07-13 10:15:55.665677] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.032 [2024-07-13 10:15:55.665693] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.032 [2024-07-13 10:15:55.668102] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.032 [2024-07-13 10:15:55.677250] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.032 [2024-07-13 10:15:55.677644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.032 [2024-07-13 10:15:55.677854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.032 [2024-07-13 10:15:55.677891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.032 [2024-07-13 10:15:55.677909] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.032 [2024-07-13 10:15:55.678087] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.032 [2024-07-13 10:15:55.678273] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.032 [2024-07-13 10:15:55.678299] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.032 [2024-07-13 10:15:55.678316] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.032 [2024-07-13 10:15:55.680729] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.032 [2024-07-13 10:15:55.681419] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:50.032 [2024-07-13 10:15:55.681535] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:50.032 [2024-07-13 10:15:55.681552] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:50.032 [2024-07-13 10:15:55.681564] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:50.033 [2024-07-13 10:15:55.681630] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:29:50.033 [2024-07-13 10:15:55.681677] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:29:50.033 [2024-07-13 10:15:55.681680] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:50.033 [2024-07-13 10:15:55.689645] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.033 [2024-07-13 10:15:55.690066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.033 [2024-07-13 10:15:55.690242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.033 [2024-07-13 10:15:55.690270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.033 [2024-07-13 10:15:55.690290] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.033 [2024-07-13 10:15:55.690448] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.033 [2024-07-13 10:15:55.690615] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.033 [2024-07-13 10:15:55.690637] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.033 [2024-07-13 10:15:55.690655] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.033 [2024-07-13 10:15:55.692773] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.033 [2024-07-13 10:15:55.702022] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.033 [2024-07-13 10:15:55.702537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.033 [2024-07-13 10:15:55.702736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.033 [2024-07-13 10:15:55.702765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.033 [2024-07-13 10:15:55.702786] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.033 [2024-07-13 10:15:55.702974] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.033 [2024-07-13 10:15:55.703123] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.033 [2024-07-13 10:15:55.703162] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.033 [2024-07-13 10:15:55.703180] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.033 [2024-07-13 10:15:55.705076] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.033 [2024-07-13 10:15:55.714401] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.033 [2024-07-13 10:15:55.714951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.033 [2024-07-13 10:15:55.715157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.033 [2024-07-13 10:15:55.715185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.033 [2024-07-13 10:15:55.715206] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.033 [2024-07-13 10:15:55.715400] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.033 [2024-07-13 10:15:55.715584] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.033 [2024-07-13 10:15:55.715606] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.033 [2024-07-13 10:15:55.715624] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.033 [2024-07-13 10:15:55.717637] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.033 [2024-07-13 10:15:55.726769] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.033 [2024-07-13 10:15:55.727241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.033 [2024-07-13 10:15:55.727458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.033 [2024-07-13 10:15:55.727486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.033 [2024-07-13 10:15:55.727508] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.033 [2024-07-13 10:15:55.727669] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.033 [2024-07-13 10:15:55.727838] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.033 [2024-07-13 10:15:55.727861] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.033 [2024-07-13 10:15:55.727902] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.033 [2024-07-13 10:15:55.730163] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.033 [2024-07-13 10:15:55.739016] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.033 [2024-07-13 10:15:55.739500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.033 [2024-07-13 10:15:55.739640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.033 [2024-07-13 10:15:55.739668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.033 [2024-07-13 10:15:55.739687] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.033 [2024-07-13 10:15:55.739845] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.033 [2024-07-13 10:15:55.740015] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.033 [2024-07-13 10:15:55.740048] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.033 [2024-07-13 10:15:55.740067] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.033 [2024-07-13 10:15:55.742053] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.033 [2024-07-13 10:15:55.751309] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.033 [2024-07-13 10:15:55.751872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.033 [2024-07-13 10:15:55.752012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.033 [2024-07-13 10:15:55.752041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.033 [2024-07-13 10:15:55.752062] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.033 [2024-07-13 10:15:55.752226] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.033 [2024-07-13 10:15:55.752410] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.033 [2024-07-13 10:15:55.752432] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.033 [2024-07-13 10:15:55.752450] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.033 [2024-07-13 10:15:55.754462] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.033 [2024-07-13 10:15:55.763674] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.033 [2024-07-13 10:15:55.764029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.033 [2024-07-13 10:15:55.764195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.033 [2024-07-13 10:15:55.764223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.033 [2024-07-13 10:15:55.764241] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.033 [2024-07-13 10:15:55.764411] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.033 [2024-07-13 10:15:55.764574] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.033 [2024-07-13 10:15:55.764597] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.033 [2024-07-13 10:15:55.764612] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.033 [2024-07-13 10:15:55.766681] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.033 [2024-07-13 10:15:55.776091] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.033 [2024-07-13 10:15:55.776426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.033 [2024-07-13 10:15:55.776571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.034 [2024-07-13 10:15:55.776599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.034 [2024-07-13 10:15:55.776615] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.034 [2024-07-13 10:15:55.776829] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.034 [2024-07-13 10:15:55.777026] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.034 [2024-07-13 10:15:55.777049] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.034 [2024-07-13 10:15:55.777071] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.034 [2024-07-13 10:15:55.779260] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.034 [2024-07-13 10:15:55.788445] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.034 [2024-07-13 10:15:55.788772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.034 [2024-07-13 10:15:55.788938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.034 [2024-07-13 10:15:55.788966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.034 [2024-07-13 10:15:55.788983] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.034 [2024-07-13 10:15:55.789151] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.034 [2024-07-13 10:15:55.789332] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.034 [2024-07-13 10:15:55.789355] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.034 [2024-07-13 10:15:55.789369] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.034 [2024-07-13 10:15:55.791297] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.034 [2024-07-13 10:15:55.800918] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.034 [2024-07-13 10:15:55.801263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.034 [2024-07-13 10:15:55.801398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.034 [2024-07-13 10:15:55.801423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.034 [2024-07-13 10:15:55.801439] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.034 [2024-07-13 10:15:55.801556] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.034 [2024-07-13 10:15:55.801739] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.034 [2024-07-13 10:15:55.801760] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.034 [2024-07-13 10:15:55.801774] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.034 [2024-07-13 10:15:55.803703] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.034 [2024-07-13 10:15:55.813282] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.034 [2024-07-13 10:15:55.813609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.034 [2024-07-13 10:15:55.813778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.034 [2024-07-13 10:15:55.813804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.034 [2024-07-13 10:15:55.813819] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.034 [2024-07-13 10:15:55.813979] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.034 [2024-07-13 10:15:55.814164] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.034 [2024-07-13 10:15:55.814185] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.034 [2024-07-13 10:15:55.814199] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.034 [2024-07-13 10:15:55.816303] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.034 [2024-07-13 10:15:55.825590] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.034 [2024-07-13 10:15:55.825911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.034 [2024-07-13 10:15:55.826050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.034 [2024-07-13 10:15:55.826075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.034 [2024-07-13 10:15:55.826091] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.034 [2024-07-13 10:15:55.826224] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.034 [2024-07-13 10:15:55.826434] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.034 [2024-07-13 10:15:55.826457] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.034 [2024-07-13 10:15:55.826471] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.034 [2024-07-13 10:15:55.828447] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.034 [2024-07-13 10:15:55.838005] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.034 [2024-07-13 10:15:55.838322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.034 [2024-07-13 10:15:55.838471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.034 [2024-07-13 10:15:55.838498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.034 [2024-07-13 10:15:55.838513] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.034 [2024-07-13 10:15:55.838706] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.034 [2024-07-13 10:15:55.838835] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.034 [2024-07-13 10:15:55.838857] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.034 [2024-07-13 10:15:55.838895] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.034 [2024-07-13 10:15:55.841013] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.294 [2024-07-13 10:15:55.850256] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.294 [2024-07-13 10:15:55.850589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.294 [2024-07-13 10:15:55.850752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.294 [2024-07-13 10:15:55.850781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.294 [2024-07-13 10:15:55.850798] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.294 [2024-07-13 10:15:55.850975] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.294 [2024-07-13 10:15:55.851109] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.294 [2024-07-13 10:15:55.851130] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.294 [2024-07-13 10:15:55.851144] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.294 [2024-07-13 10:15:55.853410] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.294 [2024-07-13 10:15:55.862604] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.294 [2024-07-13 10:15:55.862927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.294 [2024-07-13 10:15:55.863089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.294 [2024-07-13 10:15:55.863116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.294 [2024-07-13 10:15:55.863133] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.294 [2024-07-13 10:15:55.863267] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.294 [2024-07-13 10:15:55.863430] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.294 [2024-07-13 10:15:55.863452] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.294 [2024-07-13 10:15:55.863467] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.294 [2024-07-13 10:15:55.865445] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.294 [2024-07-13 10:15:55.874950] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.294 [2024-07-13 10:15:55.875317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.294 [2024-07-13 10:15:55.875499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.294 [2024-07-13 10:15:55.875525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.294 [2024-07-13 10:15:55.875542] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.294 [2024-07-13 10:15:55.875739] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.294 [2024-07-13 10:15:55.875926] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.294 [2024-07-13 10:15:55.875958] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.294 [2024-07-13 10:15:55.875974] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.294 [2024-07-13 10:15:55.877968] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.294 [2024-07-13 10:15:55.887287] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.294 [2024-07-13 10:15:55.887633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.294 [2024-07-13 10:15:55.887765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.294 [2024-07-13 10:15:55.887793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.294 [2024-07-13 10:15:55.887810] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.294 [2024-07-13 10:15:55.887985] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.294 [2024-07-13 10:15:55.888165] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.294 [2024-07-13 10:15:55.888187] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.294 [2024-07-13 10:15:55.888201] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.294 [2024-07-13 10:15:55.890133] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.294 [2024-07-13 10:15:55.899415] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.294 [2024-07-13 10:15:55.899792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.294 [2024-07-13 10:15:55.899952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.294 [2024-07-13 10:15:55.899980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.294 [2024-07-13 10:15:55.899997] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.294 [2024-07-13 10:15:55.900177] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.294 [2024-07-13 10:15:55.900322] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.294 [2024-07-13 10:15:55.900342] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.294 [2024-07-13 10:15:55.900356] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.294 [2024-07-13 10:15:55.902427] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.294 [2024-07-13 10:15:55.911745] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.294 [2024-07-13 10:15:55.912090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.294 [2024-07-13 10:15:55.912253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.294 [2024-07-13 10:15:55.912279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.294 [2024-07-13 10:15:55.912295] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.294 [2024-07-13 10:15:55.912445] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.294 [2024-07-13 10:15:55.912628] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.294 [2024-07-13 10:15:55.912651] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.294 [2024-07-13 10:15:55.912665] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.295 [2024-07-13 10:15:55.914578] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.295 [2024-07-13 10:15:55.923936] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.295 [2024-07-13 10:15:55.924255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.295 [2024-07-13 10:15:55.924381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.295 [2024-07-13 10:15:55.924406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.295 [2024-07-13 10:15:55.924422] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.295 [2024-07-13 10:15:55.924600] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.295 [2024-07-13 10:15:55.924730] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.295 [2024-07-13 10:15:55.924751] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.295 [2024-07-13 10:15:55.924765] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.295 [2024-07-13 10:15:55.926728] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.295 [2024-07-13 10:15:55.936276] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.295 [2024-07-13 10:15:55.936622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.295 [2024-07-13 10:15:55.936755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.295 [2024-07-13 10:15:55.936785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.295 [2024-07-13 10:15:55.936803] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.295 [2024-07-13 10:15:55.936927] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.295 [2024-07-13 10:15:55.937028] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.295 [2024-07-13 10:15:55.937049] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.295 [2024-07-13 10:15:55.937064] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.295 [2024-07-13 10:15:55.939133] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.295 [2024-07-13 10:15:55.948561] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.295 [2024-07-13 10:15:55.948950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.295 [2024-07-13 10:15:55.949113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.295 [2024-07-13 10:15:55.949140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.295 [2024-07-13 10:15:55.949156] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.295 [2024-07-13 10:15:55.949306] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.295 [2024-07-13 10:15:55.949484] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.295 [2024-07-13 10:15:55.949506] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.295 [2024-07-13 10:15:55.949521] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.295 [2024-07-13 10:15:55.951511] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.295 [2024-07-13 10:15:55.960861] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.295 [2024-07-13 10:15:55.961157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.295 [2024-07-13 10:15:55.961315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.295 [2024-07-13 10:15:55.961342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.295 [2024-07-13 10:15:55.961358] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.295 [2024-07-13 10:15:55.961523] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.295 [2024-07-13 10:15:55.961685] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.295 [2024-07-13 10:15:55.961707] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.295 [2024-07-13 10:15:55.961722] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.295 [2024-07-13 10:15:55.963808] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.295 [2024-07-13 10:15:55.973106] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.295 [2024-07-13 10:15:55.973527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.295 [2024-07-13 10:15:55.973690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.295 [2024-07-13 10:15:55.973716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.295 [2024-07-13 10:15:55.973737] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.295 [2024-07-13 10:15:55.973911] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.295 [2024-07-13 10:15:55.974092] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.295 [2024-07-13 10:15:55.974116] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.295 [2024-07-13 10:15:55.974130] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.295 [2024-07-13 10:15:55.976293] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.295 [2024-07-13 10:15:55.985414] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.295 [2024-07-13 10:15:55.985729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.295 [2024-07-13 10:15:55.985875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.295 [2024-07-13 10:15:55.985902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.295 [2024-07-13 10:15:55.985919] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.295 [2024-07-13 10:15:55.986020] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.295 [2024-07-13 10:15:55.986201] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.295 [2024-07-13 10:15:55.986222] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.295 [2024-07-13 10:15:55.986236] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.295 [2024-07-13 10:15:55.988241] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.295 [2024-07-13 10:15:55.997566] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.295 [2024-07-13 10:15:55.997886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.295 [2024-07-13 10:15:55.998050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.295 [2024-07-13 10:15:55.998077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.295 [2024-07-13 10:15:55.998094] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.295 [2024-07-13 10:15:55.998261] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.295 [2024-07-13 10:15:55.998485] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.295 [2024-07-13 10:15:55.998508] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.295 [2024-07-13 10:15:55.998522] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.295 [2024-07-13 10:15:56.000594] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.295 [2024-07-13 10:15:56.009752] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.295 [2024-07-13 10:15:56.010122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.295 [2024-07-13 10:15:56.010246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.295 [2024-07-13 10:15:56.010274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.295 [2024-07-13 10:15:56.010290] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.295 [2024-07-13 10:15:56.010492] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.295 [2024-07-13 10:15:56.010652] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.295 [2024-07-13 10:15:56.010674] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.295 [2024-07-13 10:15:56.010689] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.295 [2024-07-13 10:15:56.012872] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.295 [2024-07-13 10:15:56.021972] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.295 [2024-07-13 10:15:56.022371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.295 [2024-07-13 10:15:56.022498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.295 [2024-07-13 10:15:56.022526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.295 [2024-07-13 10:15:56.022542] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.295 [2024-07-13 10:15:56.022693] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.295 [2024-07-13 10:15:56.022897] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.295 [2024-07-13 10:15:56.022920] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.295 [2024-07-13 10:15:56.022935] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.295 [2024-07-13 10:15:56.025119] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.295 [2024-07-13 10:15:56.034324] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.295 [2024-07-13 10:15:56.034619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.295 [2024-07-13 10:15:56.034757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.295 [2024-07-13 10:15:56.034783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.295 [2024-07-13 10:15:56.034800] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.295 [2024-07-13 10:15:56.034959] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.295 [2024-07-13 10:15:56.035179] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.295 [2024-07-13 10:15:56.035201] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.295 [2024-07-13 10:15:56.035230] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.295 [2024-07-13 10:15:56.037289] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.296 [2024-07-13 10:15:56.046568] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.296 [2024-07-13 10:15:56.046927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.296 [2024-07-13 10:15:56.047089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.296 [2024-07-13 10:15:56.047116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.296 [2024-07-13 10:15:56.047133] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.296 [2024-07-13 10:15:56.047297] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.296 [2024-07-13 10:15:56.047449] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.296 [2024-07-13 10:15:56.047470] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.296 [2024-07-13 10:15:56.047484] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.296 [2024-07-13 10:15:56.049616] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.296 [2024-07-13 10:15:56.058730] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.296 [2024-07-13 10:15:56.059038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.296 [2024-07-13 10:15:56.059167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.296 [2024-07-13 10:15:56.059194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.296 [2024-07-13 10:15:56.059210] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.296 [2024-07-13 10:15:56.059390] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.296 [2024-07-13 10:15:56.059567] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.296 [2024-07-13 10:15:56.059588] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.296 [2024-07-13 10:15:56.059602] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.296 [2024-07-13 10:15:56.061791] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.296 [2024-07-13 10:15:56.071094] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.296 [2024-07-13 10:15:56.071486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.296 [2024-07-13 10:15:56.071644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.296 [2024-07-13 10:15:56.071671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.296 [2024-07-13 10:15:56.071687] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.296 [2024-07-13 10:15:56.071820] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.296 [2024-07-13 10:15:56.072011] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.296 [2024-07-13 10:15:56.072034] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.296 [2024-07-13 10:15:56.072048] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.296 [2024-07-13 10:15:56.074060] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.296 [2024-07-13 10:15:56.083325] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.296 [2024-07-13 10:15:56.083622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.296 [2024-07-13 10:15:56.083812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.296 [2024-07-13 10:15:56.083840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.296 [2024-07-13 10:15:56.083856] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.296 [2024-07-13 10:15:56.083980] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.296 [2024-07-13 10:15:56.084148] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.296 [2024-07-13 10:15:56.084174] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.296 [2024-07-13 10:15:56.084195] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.296 [2024-07-13 10:15:56.086109] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.296 [2024-07-13 10:15:56.095623] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.296 [2024-07-13 10:15:56.095950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.296 [2024-07-13 10:15:56.096114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.296 [2024-07-13 10:15:56.096141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.296 [2024-07-13 10:15:56.096158] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.296 [2024-07-13 10:15:56.096291] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.296 [2024-07-13 10:15:56.096486] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.296 [2024-07-13 10:15:56.096508] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.296 [2024-07-13 10:15:56.096522] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.296 [2024-07-13 10:15:56.098621] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.296 [2024-07-13 10:15:56.107826] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.296 [2024-07-13 10:15:56.108164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.296 [2024-07-13 10:15:56.108317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.296 [2024-07-13 10:15:56.108344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.296 [2024-07-13 10:15:56.108361] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.296 [2024-07-13 10:15:56.108495] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.296 [2024-07-13 10:15:56.108688] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.296 [2024-07-13 10:15:56.108710] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.296 [2024-07-13 10:15:56.108724] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.556 [2024-07-13 10:15:56.111006] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.556 [2024-07-13 10:15:56.120106] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.556 [2024-07-13 10:15:56.120434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.556 [2024-07-13 10:15:56.120605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.556 [2024-07-13 10:15:56.120633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.556 [2024-07-13 10:15:56.120649] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.556 [2024-07-13 10:15:56.120830] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.556 [2024-07-13 10:15:56.120957] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.556 [2024-07-13 10:15:56.120979] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.556 [2024-07-13 10:15:56.120999] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.556 [2024-07-13 10:15:56.123048] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.556 [2024-07-13 10:15:56.132429] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.556 [2024-07-13 10:15:56.132833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.556 [2024-07-13 10:15:56.133003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.556 [2024-07-13 10:15:56.133030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.556 [2024-07-13 10:15:56.133047] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.556 [2024-07-13 10:15:56.133197] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.556 [2024-07-13 10:15:56.133389] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.556 [2024-07-13 10:15:56.133410] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.556 [2024-07-13 10:15:56.133424] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.556 [2024-07-13 10:15:56.135542] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.556 [2024-07-13 10:15:56.144669] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.556 [2024-07-13 10:15:56.144994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.556 [2024-07-13 10:15:56.145152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.556 [2024-07-13 10:15:56.145178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.556 [2024-07-13 10:15:56.145194] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.556 [2024-07-13 10:15:56.145374] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.556 [2024-07-13 10:15:56.145520] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.556 [2024-07-13 10:15:56.145543] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.556 [2024-07-13 10:15:56.145556] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.556 [2024-07-13 10:15:56.147749] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.556 [2024-07-13 10:15:56.157041] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.556 [2024-07-13 10:15:56.157372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.556 [2024-07-13 10:15:56.157535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.556 [2024-07-13 10:15:56.157563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.556 [2024-07-13 10:15:56.157579] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.556 [2024-07-13 10:15:56.157713] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.556 [2024-07-13 10:15:56.157958] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.556 [2024-07-13 10:15:56.157981] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.556 [2024-07-13 10:15:56.157996] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.556 [2024-07-13 10:15:56.160065] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.556 [2024-07-13 10:15:56.169315] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.556 [2024-07-13 10:15:56.169731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.556 [2024-07-13 10:15:56.169884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.556 [2024-07-13 10:15:56.169921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.556 [2024-07-13 10:15:56.169937] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.556 [2024-07-13 10:15:56.170086] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.556 [2024-07-13 10:15:56.170268] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.556 [2024-07-13 10:15:56.170291] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.556 [2024-07-13 10:15:56.170304] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.556 [2024-07-13 10:15:56.172401] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.556 [2024-07-13 10:15:56.181623] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.556 [2024-07-13 10:15:56.182002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.556 [2024-07-13 10:15:56.182154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.556 [2024-07-13 10:15:56.182181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.556 [2024-07-13 10:15:56.182198] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.556 [2024-07-13 10:15:56.182363] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.556 [2024-07-13 10:15:56.182540] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.556 [2024-07-13 10:15:56.182562] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.556 [2024-07-13 10:15:56.182575] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.556 [2024-07-13 10:15:56.184662] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.556 [2024-07-13 10:15:56.194077] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.556 [2024-07-13 10:15:56.194438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.556 [2024-07-13 10:15:56.194592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.556 [2024-07-13 10:15:56.194619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.556 [2024-07-13 10:15:56.194635] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.556 [2024-07-13 10:15:56.194783] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.556 [2024-07-13 10:15:56.194946] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.556 [2024-07-13 10:15:56.194968] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.556 [2024-07-13 10:15:56.194982] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.556 [2024-07-13 10:15:56.196973] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.556 [2024-07-13 10:15:56.206235] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.556 [2024-07-13 10:15:56.206554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.556 [2024-07-13 10:15:56.206735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.556 [2024-07-13 10:15:56.206762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.556 [2024-07-13 10:15:56.206779] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.556 [2024-07-13 10:15:56.206862] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.556 [2024-07-13 10:15:56.207021] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.556 [2024-07-13 10:15:56.207043] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.556 [2024-07-13 10:15:56.207057] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.556 [2024-07-13 10:15:56.209125] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.556 [2024-07-13 10:15:56.218465] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.556 [2024-07-13 10:15:56.218808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.556 [2024-07-13 10:15:56.218994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.556 [2024-07-13 10:15:56.219023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.556 [2024-07-13 10:15:56.219039] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.556 [2024-07-13 10:15:56.219203] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.556 [2024-07-13 10:15:56.219334] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.556 [2024-07-13 10:15:56.219355] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.556 [2024-07-13 10:15:56.219369] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.556 [2024-07-13 10:15:56.221501] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.556 [2024-07-13 10:15:56.230616] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.556 [2024-07-13 10:15:56.230977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.556 [2024-07-13 10:15:56.231136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.556 [2024-07-13 10:15:56.231163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.557 [2024-07-13 10:15:56.231179] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.557 [2024-07-13 10:15:56.231329] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.557 [2024-07-13 10:15:56.231508] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.557 [2024-07-13 10:15:56.231529] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.557 [2024-07-13 10:15:56.231542] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.557 [2024-07-13 10:15:56.233684] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.557 [2024-07-13 10:15:56.242803] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.557 [2024-07-13 10:15:56.243141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.557 [2024-07-13 10:15:56.243262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.557 [2024-07-13 10:15:56.243289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.557 [2024-07-13 10:15:56.243305] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.557 [2024-07-13 10:15:56.243486] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.557 [2024-07-13 10:15:56.243692] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.557 [2024-07-13 10:15:56.243714] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.557 [2024-07-13 10:15:56.243727] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.557 [2024-07-13 10:15:56.245746] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.557 [2024-07-13 10:15:56.255070] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.557 [2024-07-13 10:15:56.255515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.557 [2024-07-13 10:15:56.255680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.557 [2024-07-13 10:15:56.255707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.557 [2024-07-13 10:15:56.255724] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.557 [2024-07-13 10:15:56.255882] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.557 [2024-07-13 10:15:56.256040] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.557 [2024-07-13 10:15:56.256062] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.557 [2024-07-13 10:15:56.256076] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.557 [2024-07-13 10:15:56.258299] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.557 [2024-07-13 10:15:56.267670] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.557 [2024-07-13 10:15:56.267943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.557 [2024-07-13 10:15:56.268129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.557 [2024-07-13 10:15:56.268156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.557 [2024-07-13 10:15:56.268174] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.557 [2024-07-13 10:15:56.268368] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.557 [2024-07-13 10:15:56.268554] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.557 [2024-07-13 10:15:56.268576] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.557 [2024-07-13 10:15:56.268590] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.557 [2024-07-13 10:15:56.270592] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.557 [2024-07-13 10:15:56.279740] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.557 [2024-07-13 10:15:56.280047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.557 [2024-07-13 10:15:56.280180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.557 [2024-07-13 10:15:56.280211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.557 [2024-07-13 10:15:56.280228] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.557 [2024-07-13 10:15:56.280377] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.557 [2024-07-13 10:15:56.280552] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.557 [2024-07-13 10:15:56.280573] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.557 [2024-07-13 10:15:56.280587] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.557 [2024-07-13 10:15:56.282658] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.557 [2024-07-13 10:15:56.292092] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.557 [2024-07-13 10:15:56.292416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.557 [2024-07-13 10:15:56.292567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.557 [2024-07-13 10:15:56.292593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.557 [2024-07-13 10:15:56.292610] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.557 [2024-07-13 10:15:56.292759] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.557 [2024-07-13 10:15:56.292970] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.557 [2024-07-13 10:15:56.292993] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.557 [2024-07-13 10:15:56.293008] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.557 [2024-07-13 10:15:56.294919] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.557 [2024-07-13 10:15:56.304454] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.557 [2024-07-13 10:15:56.304736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.557 [2024-07-13 10:15:56.304863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.557 [2024-07-13 10:15:56.304897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.557 [2024-07-13 10:15:56.304913] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.557 [2024-07-13 10:15:56.305078] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.557 [2024-07-13 10:15:56.305275] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.557 [2024-07-13 10:15:56.305296] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.557 [2024-07-13 10:15:56.305309] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.557 [2024-07-13 10:15:56.307327] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.557 [2024-07-13 10:15:56.316730] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.557 [2024-07-13 10:15:56.317042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.557 [2024-07-13 10:15:56.317167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.557 [2024-07-13 10:15:56.317194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.557 [2024-07-13 10:15:56.317215] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.557 [2024-07-13 10:15:56.317365] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.557 [2024-07-13 10:15:56.317526] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.557 [2024-07-13 10:15:56.317547] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.557 [2024-07-13 10:15:56.317560] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.557 [2024-07-13 10:15:56.319463] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.557 [2024-07-13 10:15:56.329021] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.557 [2024-07-13 10:15:56.329460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.557 [2024-07-13 10:15:56.329634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.557 [2024-07-13 10:15:56.329660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.557 [2024-07-13 10:15:56.329676] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.557 [2024-07-13 10:15:56.329875] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.557 [2024-07-13 10:15:56.330071] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.557 [2024-07-13 10:15:56.330092] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.557 [2024-07-13 10:15:56.330106] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.557 [2024-07-13 10:15:56.332217] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.557 [2024-07-13 10:15:56.341387] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.557 [2024-07-13 10:15:56.341680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.557 [2024-07-13 10:15:56.341831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.557 [2024-07-13 10:15:56.341858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.557 [2024-07-13 10:15:56.341883] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.557 [2024-07-13 10:15:56.342017] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.557 [2024-07-13 10:15:56.342198] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.557 [2024-07-13 10:15:56.342219] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.557 [2024-07-13 10:15:56.342233] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.557 [2024-07-13 10:15:56.344528] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.557 [2024-07-13 10:15:56.353503] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.557 [2024-07-13 10:15:56.353887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.557 [2024-07-13 10:15:56.354049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.557 [2024-07-13 10:15:56.354075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.557 [2024-07-13 10:15:56.354091] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.558 [2024-07-13 10:15:56.354262] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.558 [2024-07-13 10:15:56.354424] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.558 [2024-07-13 10:15:56.354445] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.558 [2024-07-13 10:15:56.354458] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.558 [2024-07-13 10:15:56.356601] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.558 [2024-07-13 10:15:56.365801] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.558 [2024-07-13 10:15:56.366152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.558 [2024-07-13 10:15:56.366312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.558 [2024-07-13 10:15:56.366338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.558 [2024-07-13 10:15:56.366354] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.558 [2024-07-13 10:15:56.366503] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.558 [2024-07-13 10:15:56.366653] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.558 [2024-07-13 10:15:56.366674] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.558 [2024-07-13 10:15:56.366688] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.558 [2024-07-13 10:15:56.368732] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.817 [2024-07-13 10:15:56.378124] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.817 [2024-07-13 10:15:56.378446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.817 [2024-07-13 10:15:56.378604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.817 [2024-07-13 10:15:56.378630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.817 [2024-07-13 10:15:56.378648] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.817 [2024-07-13 10:15:56.378813] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.817 [2024-07-13 10:15:56.378955] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.818 [2024-07-13 10:15:56.378978] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.818 [2024-07-13 10:15:56.378992] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.818 [2024-07-13 10:15:56.381044] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.818 [2024-07-13 10:15:56.390449] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.818 [2024-07-13 10:15:56.390763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.818 [2024-07-13 10:15:56.390926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.818 [2024-07-13 10:15:56.390955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.818 [2024-07-13 10:15:56.390971] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.818 [2024-07-13 10:15:56.391138] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.818 [2024-07-13 10:15:56.391305] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.818 [2024-07-13 10:15:56.391327] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.818 [2024-07-13 10:15:56.391340] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.818 [2024-07-13 10:15:56.393483] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.818 [2024-07-13 10:15:56.402625] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.818 [2024-07-13 10:15:56.402922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.818 [2024-07-13 10:15:56.403115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.818 [2024-07-13 10:15:56.403142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.818 [2024-07-13 10:15:56.403158] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.818 [2024-07-13 10:15:56.403338] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.818 [2024-07-13 10:15:56.403469] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.818 [2024-07-13 10:15:56.403491] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.818 [2024-07-13 10:15:56.403504] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.818 [2024-07-13 10:15:56.405563] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.818 [2024-07-13 10:15:56.414879] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.818 [2024-07-13 10:15:56.415182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.818 [2024-07-13 10:15:56.415337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.818 [2024-07-13 10:15:56.415363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.818 [2024-07-13 10:15:56.415379] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.818 [2024-07-13 10:15:56.415545] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.818 [2024-07-13 10:15:56.415736] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.818 [2024-07-13 10:15:56.415757] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.818 [2024-07-13 10:15:56.415771] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.818 [2024-07-13 10:15:56.417823] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.818 [2024-07-13 10:15:56.427021] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.818 [2024-07-13 10:15:56.427400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.818 [2024-07-13 10:15:56.427558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.818 [2024-07-13 10:15:56.427585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.818 [2024-07-13 10:15:56.427601] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.818 [2024-07-13 10:15:56.427766] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.818 [2024-07-13 10:15:56.427954] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.818 [2024-07-13 10:15:56.427981] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.818 [2024-07-13 10:15:56.427995] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.818 [2024-07-13 10:15:56.430052] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.818 [2024-07-13 10:15:56.439318] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.818 [2024-07-13 10:15:56.439732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.818 [2024-07-13 10:15:56.439888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.818 [2024-07-13 10:15:56.439916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.818 [2024-07-13 10:15:56.439932] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.818 [2024-07-13 10:15:56.440082] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.818 [2024-07-13 10:15:56.440247] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.818 [2024-07-13 10:15:56.440268] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.818 [2024-07-13 10:15:56.440282] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.818 [2024-07-13 10:15:56.442213] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.818 [2024-07-13 10:15:56.451713] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.818 [2024-07-13 10:15:56.452051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.818 [2024-07-13 10:15:56.452202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.818 [2024-07-13 10:15:56.452228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.818 [2024-07-13 10:15:56.452245] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.818 [2024-07-13 10:15:56.452346] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.818 [2024-07-13 10:15:56.452509] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.818 [2024-07-13 10:15:56.452530] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.818 [2024-07-13 10:15:56.452543] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.818 [2024-07-13 10:15:56.454507] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.818 [2024-07-13 10:15:56.463909] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.818 [2024-07-13 10:15:56.464220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.818 [2024-07-13 10:15:56.464380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.818 [2024-07-13 10:15:56.464406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.818 [2024-07-13 10:15:56.464423] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.818 [2024-07-13 10:15:56.464557] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.818 [2024-07-13 10:15:56.464703] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.818 [2024-07-13 10:15:56.464724] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.818 [2024-07-13 10:15:56.464742] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.818 [2024-07-13 10:15:56.466768] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.818 [2024-07-13 10:15:56.476262] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.818 [2024-07-13 10:15:56.476620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.818 [2024-07-13 10:15:56.476753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.818 [2024-07-13 10:15:56.476779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.818 [2024-07-13 10:15:56.476795] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.818 [2024-07-13 10:15:56.476905] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.818 [2024-07-13 10:15:56.477074] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.818 [2024-07-13 10:15:56.477096] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.818 [2024-07-13 10:15:56.477110] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.818 [2024-07-13 10:15:56.478953] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.818 [2024-07-13 10:15:56.488765] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.818 [2024-07-13 10:15:56.489064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.818 [2024-07-13 10:15:56.489247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.818 [2024-07-13 10:15:56.489274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.818 [2024-07-13 10:15:56.489290] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.818 [2024-07-13 10:15:56.489422] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.818 [2024-07-13 10:15:56.489590] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.818 [2024-07-13 10:15:56.489611] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.818 [2024-07-13 10:15:56.489625] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.818 [2024-07-13 10:15:56.491716] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.818 10:15:56 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:50.818 10:15:56 -- common/autotest_common.sh@852 -- # return 0 00:29:50.818 10:15:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:50.818 10:15:56 -- common/autotest_common.sh@718 -- # xtrace_disable 00:29:50.818 10:15:56 -- common/autotest_common.sh@10 -- # set +x 00:29:50.818 [2024-07-13 10:15:56.501222] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.818 [2024-07-13 10:15:56.501542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.818 [2024-07-13 10:15:56.501722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.818 [2024-07-13 10:15:56.501748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.818 [2024-07-13 10:15:56.501765] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.819 [2024-07-13 10:15:56.501923] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.819 [2024-07-13 10:15:56.502061] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.819 [2024-07-13 10:15:56.502089] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.819 [2024-07-13 10:15:56.502104] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.819 [2024-07-13 10:15:56.504465] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.819 [2024-07-13 10:15:56.513580] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.819 [2024-07-13 10:15:56.513986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.819 [2024-07-13 10:15:56.514109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.819 [2024-07-13 10:15:56.514136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.819 [2024-07-13 10:15:56.514154] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.819 [2024-07-13 10:15:56.514288] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.819 [2024-07-13 10:15:56.514471] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.819 [2024-07-13 10:15:56.514492] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.819 [2024-07-13 10:15:56.514505] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.819 [2024-07-13 10:15:56.516611] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.819 10:15:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:50.819 10:15:56 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:29:50.819 10:15:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:50.819 10:15:56 -- common/autotest_common.sh@10 -- # set +x 00:29:50.819 [2024-07-13 10:15:56.521242] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:50.819 [2024-07-13 10:15:56.525794] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.819 [2024-07-13 10:15:56.526116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.819 [2024-07-13 10:15:56.526301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.819 [2024-07-13 10:15:56.526327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.819 [2024-07-13 10:15:56.526344] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.819 [2024-07-13 10:15:56.526476] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.819 [2024-07-13 10:15:56.526610] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.819 [2024-07-13 10:15:56.526647] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.819 [2024-07-13 10:15:56.526662] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.819 10:15:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:50.819 10:15:56 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:29:50.819 10:15:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:50.819 10:15:56 -- common/autotest_common.sh@10 -- # set +x 00:29:50.819 [2024-07-13 10:15:56.528968] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.819 [2024-07-13 10:15:56.538129] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.819 [2024-07-13 10:15:56.538471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.819 [2024-07-13 10:15:56.538625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.819 [2024-07-13 10:15:56.538657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.819 [2024-07-13 10:15:56.538674] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.819 [2024-07-13 10:15:56.538757] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.819 [2024-07-13 10:15:56.538931] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.819 [2024-07-13 10:15:56.538954] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.819 [2024-07-13 10:15:56.538968] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.819 [2024-07-13 10:15:56.540859] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.819 [2024-07-13 10:15:56.550421] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.819 [2024-07-13 10:15:56.550957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.819 [2024-07-13 10:15:56.551137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.819 [2024-07-13 10:15:56.551169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.819 [2024-07-13 10:15:56.551188] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.819 [2024-07-13 10:15:56.551365] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.819 [2024-07-13 10:15:56.551501] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.819 [2024-07-13 10:15:56.551524] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.819 [2024-07-13 10:15:56.551541] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.819 [2024-07-13 10:15:56.553618] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.819 Malloc0 00:29:50.819 10:15:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:50.819 10:15:56 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:29:50.819 10:15:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:50.819 10:15:56 -- common/autotest_common.sh@10 -- # set +x 00:29:50.819 [2024-07-13 10:15:56.562626] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.819 [2024-07-13 10:15:56.563083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.819 [2024-07-13 10:15:56.563264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.819 [2024-07-13 10:15:56.563290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.819 [2024-07-13 10:15:56.563309] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.819 [2024-07-13 10:15:56.563446] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.819 [2024-07-13 10:15:56.563596] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.819 [2024-07-13 10:15:56.563617] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.819 [2024-07-13 10:15:56.563632] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.819 [2024-07-13 10:15:56.565707] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.819 10:15:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:50.819 10:15:56 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:29:50.819 10:15:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:50.819 10:15:56 -- common/autotest_common.sh@10 -- # set +x 00:29:50.819 [2024-07-13 10:15:56.575085] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.819 [2024-07-13 10:15:56.575422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.819 [2024-07-13 10:15:56.575569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:50.819 [2024-07-13 10:15:56.575598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1566c20 with addr=10.0.0.2, port=4420 00:29:50.819 [2024-07-13 10:15:56.575614] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1566c20 is same with the state(5) to be set 00:29:50.819 [2024-07-13 10:15:56.575764] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1566c20 (9): Bad file descriptor 00:29:50.819 [2024-07-13 10:15:56.575911] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:50.819 [2024-07-13 10:15:56.575934] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:50.819 [2024-07-13 10:15:56.575948] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:50.819 10:15:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:50.819 10:15:56 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:50.819 10:15:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:50.819 10:15:56 -- common/autotest_common.sh@10 -- # set +x 00:29:50.819 [2024-07-13 10:15:56.578170] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:50.819 [2024-07-13 10:15:56.579879] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:50.819 10:15:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:50.819 10:15:56 -- host/bdevperf.sh@38 -- # wait 2937832 00:29:50.819 [2024-07-13 10:15:56.587437] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:50.819 [2024-07-13 10:15:56.616475] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:30:00.801 00:30:00.801 Latency(us) 00:30:00.801 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:00.801 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:30:00.801 Verification LBA range: start 0x0 length 0x4000 00:30:00.801 Nvme1n1 : 15.01 9485.10 37.05 15691.48 0.00 5069.46 1001.24 20291.89 00:30:00.801 =================================================================================================================== 00:30:00.801 Total : 9485.10 37.05 15691.48 0.00 5069.46 1001.24 20291.89 00:30:00.801 10:16:05 -- host/bdevperf.sh@39 -- # sync 00:30:00.801 10:16:05 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:30:00.801 10:16:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:00.801 10:16:05 -- common/autotest_common.sh@10 -- # set +x 00:30:00.801 10:16:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:00.801 10:16:05 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:30:00.801 10:16:05 -- host/bdevperf.sh@44 -- # nvmftestfini 00:30:00.801 10:16:05 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:00.801 10:16:05 -- nvmf/common.sh@116 -- # sync 00:30:00.801 10:16:05 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:00.801 10:16:05 -- nvmf/common.sh@119 -- # set +e 00:30:00.801 10:16:05 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:00.801 10:16:05 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:00.801 rmmod nvme_tcp 00:30:00.801 rmmod nvme_fabrics 00:30:00.801 rmmod nvme_keyring 00:30:00.801 10:16:05 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:00.801 10:16:05 -- nvmf/common.sh@123 -- # set -e 00:30:00.801 10:16:05 -- nvmf/common.sh@124 -- # return 0 00:30:00.801 10:16:05 -- nvmf/common.sh@477 -- # '[' -n 2938560 ']' 00:30:00.801 10:16:05 -- nvmf/common.sh@478 -- # killprocess 2938560 00:30:00.801 10:16:05 -- common/autotest_common.sh@926 -- # '[' -z 2938560 ']' 00:30:00.801 10:16:05 -- common/autotest_common.sh@930 -- # kill -0 2938560 00:30:00.801 10:16:05 -- common/autotest_common.sh@931 -- # uname 00:30:00.801 10:16:05 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:30:00.801 10:16:05 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2938560 00:30:00.801 10:16:05 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:30:00.801 10:16:05 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:30:00.801 10:16:05 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2938560' 00:30:00.801 killing process with pid 2938560 00:30:00.801 10:16:05 -- common/autotest_common.sh@945 -- # kill 2938560 00:30:00.801 10:16:05 -- common/autotest_common.sh@950 -- # wait 2938560 00:30:00.801 10:16:05 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:00.801 10:16:05 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:00.801 10:16:05 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:00.801 10:16:05 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:00.801 10:16:05 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:00.801 10:16:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:00.801 10:16:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:00.801 10:16:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:02.179 10:16:07 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:02.179 00:30:02.179 real 0m23.140s 00:30:02.179 user 1m2.675s 00:30:02.179 sys 0m4.253s 00:30:02.179 10:16:07 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:30:02.179 10:16:07 -- common/autotest_common.sh@10 -- # set +x 00:30:02.179 ************************************ 00:30:02.179 END TEST nvmf_bdevperf 00:30:02.179 ************************************ 00:30:02.179 10:16:07 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:30:02.179 10:16:07 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:30:02.179 10:16:07 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:30:02.179 10:16:07 -- common/autotest_common.sh@10 -- # set +x 00:30:02.179 ************************************ 00:30:02.179 START TEST nvmf_target_disconnect 00:30:02.179 ************************************ 00:30:02.179 10:16:07 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:30:02.179 * Looking for test storage... 00:30:02.179 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:30:02.179 10:16:07 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:02.179 10:16:07 -- nvmf/common.sh@7 -- # uname -s 00:30:02.179 10:16:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:02.179 10:16:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:02.179 10:16:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:02.179 10:16:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:02.179 10:16:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:02.179 10:16:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:02.179 10:16:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:02.179 10:16:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:02.179 10:16:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:02.179 10:16:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:02.179 10:16:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:02.179 10:16:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:02.179 10:16:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:02.179 10:16:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:02.179 10:16:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:02.179 10:16:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:02.179 10:16:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:02.179 10:16:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:02.179 10:16:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:02.179 10:16:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:02.179 10:16:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:02.179 10:16:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:02.179 10:16:07 -- paths/export.sh@5 -- # export PATH 00:30:02.179 10:16:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:02.179 10:16:07 -- nvmf/common.sh@46 -- # : 0 00:30:02.179 10:16:07 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:02.179 10:16:07 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:02.179 10:16:07 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:02.179 10:16:07 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:02.179 10:16:07 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:02.179 10:16:07 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:02.179 10:16:07 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:02.179 10:16:07 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:02.179 10:16:07 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:30:02.179 10:16:07 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:30:02.179 10:16:07 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:30:02.179 10:16:07 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:30:02.179 10:16:07 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:02.179 10:16:07 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:02.179 10:16:07 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:02.179 10:16:07 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:02.179 10:16:07 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:02.179 10:16:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:02.179 10:16:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:02.179 10:16:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:02.179 10:16:07 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:02.179 10:16:07 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:02.179 10:16:07 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:02.179 10:16:07 -- common/autotest_common.sh@10 -- # set +x 00:30:04.084 10:16:09 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:04.084 10:16:09 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:04.084 10:16:09 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:04.084 10:16:09 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:04.084 10:16:09 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:04.084 10:16:09 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:04.084 10:16:09 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:04.084 10:16:09 -- nvmf/common.sh@294 -- # net_devs=() 00:30:04.084 10:16:09 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:04.084 10:16:09 -- nvmf/common.sh@295 -- # e810=() 00:30:04.084 10:16:09 -- nvmf/common.sh@295 -- # local -ga e810 00:30:04.084 10:16:09 -- nvmf/common.sh@296 -- # x722=() 00:30:04.084 10:16:09 -- nvmf/common.sh@296 -- # local -ga x722 00:30:04.084 10:16:09 -- nvmf/common.sh@297 -- # mlx=() 00:30:04.084 10:16:09 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:04.084 10:16:09 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:04.084 10:16:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:04.084 10:16:09 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:04.084 10:16:09 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:04.084 10:16:09 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:04.084 10:16:09 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:04.084 10:16:09 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:04.084 10:16:09 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:04.084 10:16:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:04.084 10:16:09 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:04.084 10:16:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:04.084 10:16:09 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:04.084 10:16:09 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:04.084 10:16:09 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:04.084 10:16:09 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:04.084 10:16:09 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:04.084 10:16:09 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:04.084 10:16:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:04.084 10:16:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:30:04.084 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:30:04.084 10:16:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:04.084 10:16:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:04.084 10:16:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:04.084 10:16:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:04.084 10:16:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:04.084 10:16:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:04.084 10:16:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:30:04.084 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:30:04.084 10:16:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:04.084 10:16:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:04.084 10:16:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:04.084 10:16:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:04.084 10:16:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:04.084 10:16:09 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:04.084 10:16:09 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:04.084 10:16:09 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:04.084 10:16:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:04.084 10:16:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:04.084 10:16:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:04.084 10:16:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:04.084 10:16:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:30:04.084 Found net devices under 0000:0a:00.0: cvl_0_0 00:30:04.084 10:16:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:04.084 10:16:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:04.084 10:16:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:04.084 10:16:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:04.084 10:16:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:04.084 10:16:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:30:04.084 Found net devices under 0000:0a:00.1: cvl_0_1 00:30:04.084 10:16:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:04.084 10:16:09 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:04.084 10:16:09 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:04.084 10:16:09 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:04.084 10:16:09 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:04.084 10:16:09 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:04.084 10:16:09 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:04.084 10:16:09 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:04.084 10:16:09 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:04.084 10:16:09 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:04.084 10:16:09 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:04.084 10:16:09 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:04.084 10:16:09 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:04.084 10:16:09 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:04.084 10:16:09 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:04.084 10:16:09 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:04.084 10:16:09 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:04.084 10:16:09 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:04.084 10:16:09 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:04.084 10:16:09 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:04.084 10:16:09 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:04.084 10:16:09 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:04.084 10:16:09 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:04.084 10:16:09 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:04.084 10:16:09 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:04.084 10:16:09 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:04.084 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:04.084 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.172 ms 00:30:04.084 00:30:04.084 --- 10.0.0.2 ping statistics --- 00:30:04.084 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:04.084 rtt min/avg/max/mdev = 0.172/0.172/0.172/0.000 ms 00:30:04.084 10:16:09 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:04.084 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:04.084 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.126 ms 00:30:04.084 00:30:04.084 --- 10.0.0.1 ping statistics --- 00:30:04.084 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:04.084 rtt min/avg/max/mdev = 0.126/0.126/0.126/0.000 ms 00:30:04.084 10:16:09 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:04.084 10:16:09 -- nvmf/common.sh@410 -- # return 0 00:30:04.084 10:16:09 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:04.084 10:16:09 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:04.084 10:16:09 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:04.084 10:16:09 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:04.084 10:16:09 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:04.084 10:16:09 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:04.084 10:16:09 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:04.084 10:16:09 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:30:04.084 10:16:09 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:30:04.084 10:16:09 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:30:04.084 10:16:09 -- common/autotest_common.sh@10 -- # set +x 00:30:04.084 ************************************ 00:30:04.084 START TEST nvmf_target_disconnect_tc1 00:30:04.084 ************************************ 00:30:04.084 10:16:09 -- common/autotest_common.sh@1104 -- # nvmf_target_disconnect_tc1 00:30:04.084 10:16:09 -- host/target_disconnect.sh@32 -- # set +e 00:30:04.084 10:16:09 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:04.084 EAL: No free 2048 kB hugepages reported on node 1 00:30:04.084 [2024-07-13 10:16:09.839313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.084 [2024-07-13 10:16:09.840201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:04.084 [2024-07-13 10:16:09.840251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xb74280 with addr=10.0.0.2, port=4420 00:30:04.084 [2024-07-13 10:16:09.840289] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:30:04.084 [2024-07-13 10:16:09.840321] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:30:04.084 [2024-07-13 10:16:09.840336] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:30:04.084 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:30:04.084 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:30:04.084 Initializing NVMe Controllers 00:30:04.084 10:16:09 -- host/target_disconnect.sh@33 -- # trap - ERR 00:30:04.084 10:16:09 -- host/target_disconnect.sh@33 -- # print_backtrace 00:30:04.085 10:16:09 -- common/autotest_common.sh@1132 -- # [[ hxBET =~ e ]] 00:30:04.085 10:16:09 -- common/autotest_common.sh@1132 -- # return 0 00:30:04.085 10:16:09 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:30:04.085 10:16:09 -- host/target_disconnect.sh@41 -- # set -e 00:30:04.085 00:30:04.085 real 0m0.085s 00:30:04.085 user 0m0.038s 00:30:04.085 sys 0m0.046s 00:30:04.085 10:16:09 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:30:04.085 10:16:09 -- common/autotest_common.sh@10 -- # set +x 00:30:04.085 ************************************ 00:30:04.085 END TEST nvmf_target_disconnect_tc1 00:30:04.085 ************************************ 00:30:04.085 10:16:09 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:30:04.085 10:16:09 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:30:04.085 10:16:09 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:30:04.085 10:16:09 -- common/autotest_common.sh@10 -- # set +x 00:30:04.085 ************************************ 00:30:04.085 START TEST nvmf_target_disconnect_tc2 00:30:04.085 ************************************ 00:30:04.085 10:16:09 -- common/autotest_common.sh@1104 -- # nvmf_target_disconnect_tc2 00:30:04.085 10:16:09 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:30:04.085 10:16:09 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:30:04.085 10:16:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:04.085 10:16:09 -- common/autotest_common.sh@712 -- # xtrace_disable 00:30:04.085 10:16:09 -- common/autotest_common.sh@10 -- # set +x 00:30:04.085 10:16:09 -- nvmf/common.sh@469 -- # nvmfpid=2941765 00:30:04.085 10:16:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:30:04.085 10:16:09 -- nvmf/common.sh@470 -- # waitforlisten 2941765 00:30:04.085 10:16:09 -- common/autotest_common.sh@819 -- # '[' -z 2941765 ']' 00:30:04.085 10:16:09 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:04.085 10:16:09 -- common/autotest_common.sh@824 -- # local max_retries=100 00:30:04.085 10:16:09 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:04.085 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:04.085 10:16:09 -- common/autotest_common.sh@828 -- # xtrace_disable 00:30:04.085 10:16:09 -- common/autotest_common.sh@10 -- # set +x 00:30:04.344 [2024-07-13 10:16:09.917027] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:30:04.344 [2024-07-13 10:16:09.917122] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:04.344 EAL: No free 2048 kB hugepages reported on node 1 00:30:04.344 [2024-07-13 10:16:09.982542] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:04.344 [2024-07-13 10:16:10.083961] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:04.344 [2024-07-13 10:16:10.084118] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:04.344 [2024-07-13 10:16:10.084134] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:04.344 [2024-07-13 10:16:10.084146] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:04.344 [2024-07-13 10:16:10.084229] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:30:04.344 [2024-07-13 10:16:10.084256] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:30:04.344 [2024-07-13 10:16:10.084316] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:30:04.344 [2024-07-13 10:16:10.084319] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:30:05.280 10:16:10 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:30:05.280 10:16:10 -- common/autotest_common.sh@852 -- # return 0 00:30:05.280 10:16:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:05.280 10:16:10 -- common/autotest_common.sh@718 -- # xtrace_disable 00:30:05.280 10:16:10 -- common/autotest_common.sh@10 -- # set +x 00:30:05.280 10:16:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:05.280 10:16:10 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:05.280 10:16:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:05.280 10:16:10 -- common/autotest_common.sh@10 -- # set +x 00:30:05.280 Malloc0 00:30:05.280 10:16:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:05.280 10:16:10 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:30:05.280 10:16:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:05.280 10:16:10 -- common/autotest_common.sh@10 -- # set +x 00:30:05.280 [2024-07-13 10:16:10.950507] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:05.280 10:16:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:05.280 10:16:10 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:05.280 10:16:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:05.280 10:16:10 -- common/autotest_common.sh@10 -- # set +x 00:30:05.280 10:16:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:05.280 10:16:10 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:05.280 10:16:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:05.280 10:16:10 -- common/autotest_common.sh@10 -- # set +x 00:30:05.280 10:16:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:05.280 10:16:10 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:05.280 10:16:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:05.280 10:16:10 -- common/autotest_common.sh@10 -- # set +x 00:30:05.280 [2024-07-13 10:16:10.978742] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:05.280 10:16:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:05.280 10:16:10 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:30:05.280 10:16:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:05.280 10:16:10 -- common/autotest_common.sh@10 -- # set +x 00:30:05.280 10:16:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:05.280 10:16:10 -- host/target_disconnect.sh@50 -- # reconnectpid=2941919 00:30:05.280 10:16:10 -- host/target_disconnect.sh@52 -- # sleep 2 00:30:05.280 10:16:10 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:05.280 EAL: No free 2048 kB hugepages reported on node 1 00:30:07.184 10:16:12 -- host/target_disconnect.sh@53 -- # kill -9 2941765 00:30:07.184 10:16:12 -- host/target_disconnect.sh@55 -- # sleep 2 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Write completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Write completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Write completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Write completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Write completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Write completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Write completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 [2024-07-13 10:16:13.003272] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Write completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Write completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Write completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Write completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Write completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Write completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Write completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Write completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Write completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Write completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Write completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Write completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Write completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Write completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 [2024-07-13 10:16:13.003552] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Write completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.452 Read completed with error (sct=0, sc=8) 00:30:07.452 starting I/O failed 00:30:07.453 Read completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Write completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Write completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Read completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Read completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Write completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Write completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Write completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Read completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Read completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Read completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Read completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Read completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Write completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Write completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Read completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Read completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Read completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Write completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 [2024-07-13 10:16:13.003844] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:07.453 Read completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Read completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Read completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Read completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Read completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Read completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Read completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Read completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Read completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Write completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Read completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Read completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Write completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Write completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Read completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Read completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Read completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Read completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Write completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Read completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Read completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Read completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Read completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Read completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Write completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Write completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Read completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Read completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Write completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Read completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Read completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 Read completed with error (sct=0, sc=8) 00:30:07.453 starting I/O failed 00:30:07.453 [2024-07-13 10:16:13.004164] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:07.453 [2024-07-13 10:16:13.004354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.004528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.004557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.453 qpair failed and we were unable to recover it. 00:30:07.453 [2024-07-13 10:16:13.004689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.004837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.004862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.453 qpair failed and we were unable to recover it. 00:30:07.453 [2024-07-13 10:16:13.005005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.005144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.005170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.453 qpair failed and we were unable to recover it. 00:30:07.453 [2024-07-13 10:16:13.005304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.005450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.005475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.453 qpair failed and we were unable to recover it. 00:30:07.453 [2024-07-13 10:16:13.005632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.005773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.005799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.453 qpair failed and we were unable to recover it. 00:30:07.453 [2024-07-13 10:16:13.005951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.006069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.006094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.453 qpair failed and we were unable to recover it. 00:30:07.453 [2024-07-13 10:16:13.006254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.006503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.006543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.453 qpair failed and we were unable to recover it. 00:30:07.453 [2024-07-13 10:16:13.006760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.006941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.006967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.453 qpair failed and we were unable to recover it. 00:30:07.453 [2024-07-13 10:16:13.007098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.007253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.007278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.453 qpair failed and we were unable to recover it. 00:30:07.453 [2024-07-13 10:16:13.007449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.007627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.007668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.453 qpair failed and we were unable to recover it. 00:30:07.453 [2024-07-13 10:16:13.007849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.007994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.008019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.453 qpair failed and we were unable to recover it. 00:30:07.453 [2024-07-13 10:16:13.008144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.008367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.008392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.453 qpair failed and we were unable to recover it. 00:30:07.453 [2024-07-13 10:16:13.008652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.008818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.008846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.453 qpair failed and we were unable to recover it. 00:30:07.453 [2024-07-13 10:16:13.009006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.009134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.009159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.453 qpair failed and we were unable to recover it. 00:30:07.453 [2024-07-13 10:16:13.009313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.009520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.009565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.453 qpair failed and we were unable to recover it. 00:30:07.453 [2024-07-13 10:16:13.009717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.009901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.009928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.453 qpair failed and we were unable to recover it. 00:30:07.453 [2024-07-13 10:16:13.010053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.010223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.010248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.453 qpair failed and we were unable to recover it. 00:30:07.453 [2024-07-13 10:16:13.010458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.010634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.010662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.453 qpair failed and we were unable to recover it. 00:30:07.453 [2024-07-13 10:16:13.010843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.010977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.011003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.453 qpair failed and we were unable to recover it. 00:30:07.453 [2024-07-13 10:16:13.011157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.011285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.011315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.453 qpair failed and we were unable to recover it. 00:30:07.453 [2024-07-13 10:16:13.011508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.011722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.011750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.453 qpair failed and we were unable to recover it. 00:30:07.453 [2024-07-13 10:16:13.011902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.012024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.012050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.453 qpair failed and we were unable to recover it. 00:30:07.453 [2024-07-13 10:16:13.012227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.012378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.012403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.453 qpair failed and we were unable to recover it. 00:30:07.453 [2024-07-13 10:16:13.012549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.012694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.012719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.453 qpair failed and we were unable to recover it. 00:30:07.453 [2024-07-13 10:16:13.012907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.013036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.013065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.453 qpair failed and we were unable to recover it. 00:30:07.453 [2024-07-13 10:16:13.013186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.013360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.013385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.453 qpair failed and we were unable to recover it. 00:30:07.453 [2024-07-13 10:16:13.013576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.013705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.013734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.453 qpair failed and we were unable to recover it. 00:30:07.453 [2024-07-13 10:16:13.013881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.014020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.014046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.453 qpair failed and we were unable to recover it. 00:30:07.453 [2024-07-13 10:16:13.014168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.014343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.014368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.453 qpair failed and we were unable to recover it. 00:30:07.453 [2024-07-13 10:16:13.014533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.014700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.014728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.453 qpair failed and we were unable to recover it. 00:30:07.453 [2024-07-13 10:16:13.014921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.015040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.015066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.453 qpair failed and we were unable to recover it. 00:30:07.453 [2024-07-13 10:16:13.015215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.015436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.015461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.453 qpair failed and we were unable to recover it. 00:30:07.453 [2024-07-13 10:16:13.015616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.453 [2024-07-13 10:16:13.015729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.015755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.015908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.016037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.016063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.016206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.016410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.016433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.016630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.016805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.016830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.016995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.017177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.017203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.017450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.017702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.017727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.017948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.018066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.018092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.018224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.018372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.018397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.018534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.018746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.018771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.018923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.019085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.019111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.019266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.019425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.019465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.019621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.019802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.019827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.020050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.020201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.020226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.020417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.020600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.020626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.020777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.020908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.020934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.021119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.021399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.021423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.021612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.021765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.021793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.021977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.022101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.022127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.022268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.022445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.022470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.022622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.022770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.022795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.022958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.023083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.023110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.023224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.023379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.023404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.023583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.023734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.023759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.023906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.024057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.024083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.024226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.024403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.024428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.024604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.024778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.024802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.024957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.025136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.025178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.025355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.025508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.025533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.025685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.025850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.025885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.026058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.026222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.026248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.026372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.026528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.026553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.026721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.026896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.026922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.027103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.027222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.027248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.027396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.027544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.027570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.027718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.027906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.027932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.028074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.028200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.028226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.028401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.028574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.028599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.028716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.028903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.028929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.029106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.029227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.029252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.029430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.029542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.029567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.029740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.029957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.029983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.030144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.030398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.030450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.030640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.030795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.030820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.030972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.031150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.031179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.031329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.031455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.031480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.031627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.031804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.454 [2024-07-13 10:16:13.031846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.454 qpair failed and we were unable to recover it. 00:30:07.454 [2024-07-13 10:16:13.032056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.032197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.032222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.455 qpair failed and we were unable to recover it. 00:30:07.455 [2024-07-13 10:16:13.032375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.032524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.032549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.455 qpair failed and we were unable to recover it. 00:30:07.455 [2024-07-13 10:16:13.032730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.032873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.032901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.455 qpair failed and we were unable to recover it. 00:30:07.455 [2024-07-13 10:16:13.033090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.033269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.033295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.455 qpair failed and we were unable to recover it. 00:30:07.455 [2024-07-13 10:16:13.033425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.033605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.033631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.455 qpair failed and we were unable to recover it. 00:30:07.455 [2024-07-13 10:16:13.033761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.033914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.033941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.455 qpair failed and we were unable to recover it. 00:30:07.455 [2024-07-13 10:16:13.034118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.034265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.034290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.455 qpair failed and we were unable to recover it. 00:30:07.455 [2024-07-13 10:16:13.034439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.034594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.034619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.455 qpair failed and we were unable to recover it. 00:30:07.455 [2024-07-13 10:16:13.034802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.034952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.034978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.455 qpair failed and we were unable to recover it. 00:30:07.455 [2024-07-13 10:16:13.035192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.035347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.035373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.455 qpair failed and we were unable to recover it. 00:30:07.455 [2024-07-13 10:16:13.035519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.035670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.035695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.455 qpair failed and we were unable to recover it. 00:30:07.455 [2024-07-13 10:16:13.035895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.036100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.036128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.455 qpair failed and we were unable to recover it. 00:30:07.455 [2024-07-13 10:16:13.036327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.036438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.036464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.455 qpair failed and we were unable to recover it. 00:30:07.455 [2024-07-13 10:16:13.036615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.036820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.036846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.455 qpair failed and we were unable to recover it. 00:30:07.455 [2024-07-13 10:16:13.036998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.037148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.037189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.455 qpair failed and we were unable to recover it. 00:30:07.455 [2024-07-13 10:16:13.037353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.037546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.037575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.455 qpair failed and we were unable to recover it. 00:30:07.455 [2024-07-13 10:16:13.037744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.037890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.037917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.455 qpair failed and we were unable to recover it. 00:30:07.455 [2024-07-13 10:16:13.038065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.038218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.038244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.455 qpair failed and we were unable to recover it. 00:30:07.455 [2024-07-13 10:16:13.038455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.038632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.038657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.455 qpair failed and we were unable to recover it. 00:30:07.455 [2024-07-13 10:16:13.038787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.038943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.038969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.455 qpair failed and we were unable to recover it. 00:30:07.455 [2024-07-13 10:16:13.039099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.039251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.039277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.455 qpair failed and we were unable to recover it. 00:30:07.455 [2024-07-13 10:16:13.039424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.039565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.039590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.455 qpair failed and we were unable to recover it. 00:30:07.455 [2024-07-13 10:16:13.039715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.039899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.039924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.455 qpair failed and we were unable to recover it. 00:30:07.455 [2024-07-13 10:16:13.040102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.040251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.040277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.455 qpair failed and we were unable to recover it. 00:30:07.455 [2024-07-13 10:16:13.040469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.040646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.040671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.455 qpair failed and we were unable to recover it. 00:30:07.455 [2024-07-13 10:16:13.040822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.041040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.041066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.455 qpair failed and we were unable to recover it. 00:30:07.455 [2024-07-13 10:16:13.041210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.041359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.041385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.455 qpair failed and we were unable to recover it. 00:30:07.455 [2024-07-13 10:16:13.041569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.041709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.041735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.455 qpair failed and we were unable to recover it. 00:30:07.455 [2024-07-13 10:16:13.041876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.042024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.042050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.455 qpair failed and we were unable to recover it. 00:30:07.455 [2024-07-13 10:16:13.042201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.042377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.042403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.455 qpair failed and we were unable to recover it. 00:30:07.455 [2024-07-13 10:16:13.042547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.042721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.042747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.455 qpair failed and we were unable to recover it. 00:30:07.455 [2024-07-13 10:16:13.042931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.043079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.043104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.455 qpair failed and we were unable to recover it. 00:30:07.455 [2024-07-13 10:16:13.043250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.043425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.043450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.455 qpair failed and we were unable to recover it. 00:30:07.455 [2024-07-13 10:16:13.043622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.043797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.043824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.455 qpair failed and we were unable to recover it. 00:30:07.455 [2024-07-13 10:16:13.044023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.044209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.044235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.455 qpair failed and we were unable to recover it. 00:30:07.455 [2024-07-13 10:16:13.044380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.044554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.044579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.455 qpair failed and we were unable to recover it. 00:30:07.455 [2024-07-13 10:16:13.044743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.044945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.455 [2024-07-13 10:16:13.044972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.455 qpair failed and we were unable to recover it. 00:30:07.455 [2024-07-13 10:16:13.045122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.045335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.045361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.045506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.045658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.045683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.045829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.045950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.045976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.046166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.046315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.046341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.046484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.046638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.046664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.046818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.047025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.047051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.047169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.047375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.047401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.047550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.047731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.047756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.047907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.048060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.048101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.048240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.048440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.048465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.048614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.048765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.048790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.048997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.049130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.049164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.049346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.049521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.049546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.049671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.049812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.049837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.049968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.050091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.050118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.050265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.050410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.050435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.050654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.050826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.050851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.051022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.051177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.051203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.051365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.051484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.051509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.051659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.051777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.051802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.051928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.052057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.052082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.052242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.052425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.052486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.052636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.052788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.052813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.052990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.053211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.053236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.053383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.053537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.053563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.053744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.053934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.053960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.054081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.054233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.054258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.054406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.054558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.054584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.054731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.054880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.054906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.055062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.055217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.055245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.055391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.055567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.055592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.055723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.055878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.055904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.056069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.056220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.056245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.056372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.056546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.056571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.056748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.056927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.056953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.057132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.057264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.057289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.057436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.057606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.057634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.057834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.058007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.058036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.058186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.058337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.058362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.058525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.058667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.058694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.058893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.059079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.059106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.059302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.059540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.059600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.059811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.059938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.059964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.060118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.060246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.060272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.060427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.060631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.060659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.456 qpair failed and we were unable to recover it. 00:30:07.456 [2024-07-13 10:16:13.060854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.060979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.456 [2024-07-13 10:16:13.061004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.061155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.061306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.061332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.061526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.061701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.061726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.061882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.062031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.062056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.062206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.062368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.062394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.062539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.062715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.062740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.062887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.063015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.063040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.063189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.063343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.063386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.063564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.063685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.063710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.063830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.063989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.064015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.064161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.064303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.064328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.064480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.064666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.064691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.064874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.064995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.065020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.065173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.065350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.065376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.065556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.065703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.065730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.065862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.066014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.066040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.066192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.066307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.066332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.066521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.066668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.066697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.066850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.067016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.067042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.067161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.067284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.067310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.067435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.067628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.067656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.067823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.068019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.068045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.068193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.068337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.068362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.068513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.068635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.068661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.068855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.069044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.069072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.069269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.069418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.069444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.069628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.069815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.069840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.070002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.070149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.070175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.070308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.070487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.070512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.070677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.070876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.070902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.071055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.071173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.071198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.071347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.071497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.071522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.071677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.071801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.071826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.071980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.072133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.072158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.072303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.072531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.072581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.072781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.072955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.072982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.073133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.073281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.073307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.073486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.073656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.073684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.073871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.074048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.074073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.074250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.074425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.074490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.074684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.074859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.074897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.075074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.075253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.075295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.075460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.075625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.075653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.457 qpair failed and we were unable to recover it. 00:30:07.457 [2024-07-13 10:16:13.075799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.457 [2024-07-13 10:16:13.075975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.076001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.458 qpair failed and we were unable to recover it. 00:30:07.458 [2024-07-13 10:16:13.076177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.076332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.076358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.458 qpair failed and we were unable to recover it. 00:30:07.458 [2024-07-13 10:16:13.076548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.076720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.076745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.458 qpair failed and we were unable to recover it. 00:30:07.458 [2024-07-13 10:16:13.076890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.077052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.077078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.458 qpair failed and we were unable to recover it. 00:30:07.458 [2024-07-13 10:16:13.077221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.077397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.077422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.458 qpair failed and we were unable to recover it. 00:30:07.458 [2024-07-13 10:16:13.077581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.077757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.077782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.458 qpair failed and we were unable to recover it. 00:30:07.458 [2024-07-13 10:16:13.077972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.078115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.078141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.458 qpair failed and we were unable to recover it. 00:30:07.458 [2024-07-13 10:16:13.078318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.078441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.078467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.458 qpair failed and we were unable to recover it. 00:30:07.458 [2024-07-13 10:16:13.078639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.078774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.078803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.458 qpair failed and we were unable to recover it. 00:30:07.458 [2024-07-13 10:16:13.078986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.079131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.079156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.458 qpair failed and we were unable to recover it. 00:30:07.458 [2024-07-13 10:16:13.079314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.079492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.079520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.458 qpair failed and we were unable to recover it. 00:30:07.458 [2024-07-13 10:16:13.079656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.079843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.079875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.458 qpair failed and we were unable to recover it. 00:30:07.458 [2024-07-13 10:16:13.080053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.080195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.080221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.458 qpair failed and we were unable to recover it. 00:30:07.458 [2024-07-13 10:16:13.080413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.080589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.080614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.458 qpair failed and we were unable to recover it. 00:30:07.458 [2024-07-13 10:16:13.080781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.080958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.080984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.458 qpair failed and we were unable to recover it. 00:30:07.458 [2024-07-13 10:16:13.081167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.081328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.081354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.458 qpair failed and we were unable to recover it. 00:30:07.458 [2024-07-13 10:16:13.081502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.081666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.081695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.458 qpair failed and we were unable to recover it. 00:30:07.458 [2024-07-13 10:16:13.081891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.082012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.082038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.458 qpair failed and we were unable to recover it. 00:30:07.458 [2024-07-13 10:16:13.082214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.082362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.082387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.458 qpair failed and we were unable to recover it. 00:30:07.458 [2024-07-13 10:16:13.082504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.082676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.082704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.458 qpair failed and we were unable to recover it. 00:30:07.458 [2024-07-13 10:16:13.082841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.083031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.083057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.458 qpair failed and we were unable to recover it. 00:30:07.458 [2024-07-13 10:16:13.083214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.083335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.083360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.458 qpair failed and we were unable to recover it. 00:30:07.458 [2024-07-13 10:16:13.083537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.083692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.083720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.458 qpair failed and we were unable to recover it. 00:30:07.458 [2024-07-13 10:16:13.083895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.084023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.084048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.458 qpair failed and we were unable to recover it. 00:30:07.458 [2024-07-13 10:16:13.084167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.084341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.084366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.458 qpair failed and we were unable to recover it. 00:30:07.458 [2024-07-13 10:16:13.084584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.084705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.084734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.458 qpair failed and we were unable to recover it. 00:30:07.458 [2024-07-13 10:16:13.084931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.085106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.085131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.458 qpair failed and we were unable to recover it. 00:30:07.458 [2024-07-13 10:16:13.085308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.085456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.085481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.458 qpair failed and we were unable to recover it. 00:30:07.458 [2024-07-13 10:16:13.085630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.085807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.085835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.458 qpair failed and we were unable to recover it. 00:30:07.458 [2024-07-13 10:16:13.085975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.086174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.086200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.458 qpair failed and we were unable to recover it. 00:30:07.458 [2024-07-13 10:16:13.086343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.086520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.086545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.458 qpair failed and we were unable to recover it. 00:30:07.458 [2024-07-13 10:16:13.086722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.086912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.086941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.458 qpair failed and we were unable to recover it. 00:30:07.458 [2024-07-13 10:16:13.087082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.087257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.087283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.458 qpair failed and we were unable to recover it. 00:30:07.458 [2024-07-13 10:16:13.087463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.087617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.087642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.458 qpair failed and we were unable to recover it. 00:30:07.458 [2024-07-13 10:16:13.087787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.087967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.087993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.458 qpair failed and we were unable to recover it. 00:30:07.458 [2024-07-13 10:16:13.088143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.088298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.088342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.458 qpair failed and we were unable to recover it. 00:30:07.458 [2024-07-13 10:16:13.088550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.088726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.088751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.458 qpair failed and we were unable to recover it. 00:30:07.458 [2024-07-13 10:16:13.088929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.089089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.089117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.458 qpair failed and we were unable to recover it. 00:30:07.458 [2024-07-13 10:16:13.089260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.089385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.089411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.458 qpair failed and we were unable to recover it. 00:30:07.458 [2024-07-13 10:16:13.089632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.089807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.089832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.458 qpair failed and we were unable to recover it. 00:30:07.458 [2024-07-13 10:16:13.089990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.090143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.090186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.458 qpair failed and we were unable to recover it. 00:30:07.458 [2024-07-13 10:16:13.090343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.090508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.458 [2024-07-13 10:16:13.090536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.458 qpair failed and we were unable to recover it. 00:30:07.458 [2024-07-13 10:16:13.090736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.090919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.090945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.091128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.091272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.091297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.091457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.091571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.091596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.091720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.091878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.091904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.092085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.092234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.092259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.092458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.092634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.092659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.092833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.093013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.093042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.093210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.093353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.093378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.093500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.093673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.093701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.093882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.094033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.094058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.094186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.094331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.094356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.094523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.094699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.094725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.094890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.095042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.095067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.095292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.095470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.095495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.095680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.095790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.095815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.095955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.096128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.096153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.096328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.096462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.096490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.096647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.096822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.096847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.096973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.097090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.097115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.097272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.097417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.097443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.097622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.097797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.097822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.097978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.098152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.098177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.098386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.098536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.098561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.098685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.098815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.098842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.099063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.099240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.099269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.099462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.099630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.099658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.099821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.100006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.100033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.100181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.100299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.100325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.100451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.100597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.100622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.100764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.100937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.100969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.101133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.101286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.101312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.101485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.101624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.101652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.101824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.101968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.101994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.102184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.102339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.102366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.102541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.102738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.102764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.102891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.103045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.103071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.103219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.103366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.103392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.103536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.103716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.103744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.103936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.104095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.104123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.104293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.104435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.104476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.104631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.104822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.104848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.105001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.105212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.105237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.105392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.105559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.459 [2024-07-13 10:16:13.105587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.459 qpair failed and we were unable to recover it. 00:30:07.459 [2024-07-13 10:16:13.105751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.105950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.105979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.460 qpair failed and we were unable to recover it. 00:30:07.460 [2024-07-13 10:16:13.106134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.106297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.106329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.460 qpair failed and we were unable to recover it. 00:30:07.460 [2024-07-13 10:16:13.106468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.106621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.106646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.460 qpair failed and we were unable to recover it. 00:30:07.460 [2024-07-13 10:16:13.106811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.107001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.107030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.460 qpair failed and we were unable to recover it. 00:30:07.460 [2024-07-13 10:16:13.107218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.107413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.107463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.460 qpair failed and we were unable to recover it. 00:30:07.460 [2024-07-13 10:16:13.107643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.107789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.107830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.460 qpair failed and we were unable to recover it. 00:30:07.460 [2024-07-13 10:16:13.107984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.108114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.108140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.460 qpair failed and we were unable to recover it. 00:30:07.460 [2024-07-13 10:16:13.108327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.108454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.108482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.460 qpair failed and we were unable to recover it. 00:30:07.460 [2024-07-13 10:16:13.108650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.108772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.108797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.460 qpair failed and we were unable to recover it. 00:30:07.460 [2024-07-13 10:16:13.108982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.109133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.109161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.460 qpair failed and we were unable to recover it. 00:30:07.460 [2024-07-13 10:16:13.109352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.109537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.109594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.460 qpair failed and we were unable to recover it. 00:30:07.460 [2024-07-13 10:16:13.109765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.109897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.109924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.460 qpair failed and we were unable to recover it. 00:30:07.460 [2024-07-13 10:16:13.110080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.110227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.110256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.460 qpair failed and we were unable to recover it. 00:30:07.460 [2024-07-13 10:16:13.110391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.110594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.110622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.460 qpair failed and we were unable to recover it. 00:30:07.460 [2024-07-13 10:16:13.110789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.110983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.111011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.460 qpair failed and we were unable to recover it. 00:30:07.460 [2024-07-13 10:16:13.111174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.111323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.111348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.460 qpair failed and we were unable to recover it. 00:30:07.460 [2024-07-13 10:16:13.111525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.111742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.111768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.460 qpair failed and we were unable to recover it. 00:30:07.460 [2024-07-13 10:16:13.111951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.112165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.112235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.460 qpair failed and we were unable to recover it. 00:30:07.460 [2024-07-13 10:16:13.112432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.112578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.112606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.460 qpair failed and we were unable to recover it. 00:30:07.460 [2024-07-13 10:16:13.112811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.112938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.112964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.460 qpair failed and we were unable to recover it. 00:30:07.460 [2024-07-13 10:16:13.113118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.113237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.113262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.460 qpair failed and we were unable to recover it. 00:30:07.460 [2024-07-13 10:16:13.113417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.113593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.113622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.460 qpair failed and we were unable to recover it. 00:30:07.460 [2024-07-13 10:16:13.113763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.113891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.113921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.460 qpair failed and we were unable to recover it. 00:30:07.460 [2024-07-13 10:16:13.114087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.114245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.114287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.460 qpair failed and we were unable to recover it. 00:30:07.460 [2024-07-13 10:16:13.114464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.114638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.114663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.460 qpair failed and we were unable to recover it. 00:30:07.460 [2024-07-13 10:16:13.114850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.115036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.115062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.460 qpair failed and we were unable to recover it. 00:30:07.460 [2024-07-13 10:16:13.115241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.115402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.115430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.460 qpair failed and we were unable to recover it. 00:30:07.460 [2024-07-13 10:16:13.115597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.115748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.115773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.460 qpair failed and we were unable to recover it. 00:30:07.460 [2024-07-13 10:16:13.115983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.116179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.116204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.460 qpair failed and we were unable to recover it. 00:30:07.460 [2024-07-13 10:16:13.116358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.116509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.116534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.460 qpair failed and we were unable to recover it. 00:30:07.460 [2024-07-13 10:16:13.116731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.116860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.116897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.460 qpair failed and we were unable to recover it. 00:30:07.460 [2024-07-13 10:16:13.117092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.117220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.117248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.460 qpair failed and we were unable to recover it. 00:30:07.460 [2024-07-13 10:16:13.117453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.117569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.117611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.460 qpair failed and we were unable to recover it. 00:30:07.460 [2024-07-13 10:16:13.117779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.117984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.118011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.460 qpair failed and we were unable to recover it. 00:30:07.460 [2024-07-13 10:16:13.118164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.118335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.118364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.460 qpair failed and we were unable to recover it. 00:30:07.460 [2024-07-13 10:16:13.118529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.118674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.118699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.460 qpair failed and we were unable to recover it. 00:30:07.460 [2024-07-13 10:16:13.118844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.119024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.119053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.460 qpair failed and we were unable to recover it. 00:30:07.460 [2024-07-13 10:16:13.119216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.119348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.119376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.460 qpair failed and we were unable to recover it. 00:30:07.460 [2024-07-13 10:16:13.119572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.119767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.119794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.460 qpair failed and we were unable to recover it. 00:30:07.460 [2024-07-13 10:16:13.119985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.120113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.120141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.460 qpair failed and we were unable to recover it. 00:30:07.460 [2024-07-13 10:16:13.120335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.120610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.460 [2024-07-13 10:16:13.120658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.460 qpair failed and we were unable to recover it. 00:30:07.460 [2024-07-13 10:16:13.120855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.121055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.121083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.461 qpair failed and we were unable to recover it. 00:30:07.461 [2024-07-13 10:16:13.121282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.121553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.121605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.461 qpair failed and we were unable to recover it. 00:30:07.461 [2024-07-13 10:16:13.121808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.121962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.122005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.461 qpair failed and we were unable to recover it. 00:30:07.461 [2024-07-13 10:16:13.122150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.122310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.122336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.461 qpair failed and we were unable to recover it. 00:30:07.461 [2024-07-13 10:16:13.122540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.122693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.122718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.461 qpair failed and we were unable to recover it. 00:30:07.461 [2024-07-13 10:16:13.122833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.123014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.123044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.461 qpair failed and we were unable to recover it. 00:30:07.461 [2024-07-13 10:16:13.123221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.123400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.123466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.461 qpair failed and we were unable to recover it. 00:30:07.461 [2024-07-13 10:16:13.123654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.123836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.123862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.461 qpair failed and we were unable to recover it. 00:30:07.461 [2024-07-13 10:16:13.124048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.124251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.124301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.461 qpair failed and we were unable to recover it. 00:30:07.461 [2024-07-13 10:16:13.124496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.124664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.124692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.461 qpair failed and we were unable to recover it. 00:30:07.461 [2024-07-13 10:16:13.124854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.125046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.125072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.461 qpair failed and we were unable to recover it. 00:30:07.461 [2024-07-13 10:16:13.125200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.125355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.125389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.461 qpair failed and we were unable to recover it. 00:30:07.461 [2024-07-13 10:16:13.125590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.125755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.125783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.461 qpair failed and we were unable to recover it. 00:30:07.461 [2024-07-13 10:16:13.125953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.126091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.126119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.461 qpair failed and we were unable to recover it. 00:30:07.461 [2024-07-13 10:16:13.126276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.126447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.126473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.461 qpair failed and we were unable to recover it. 00:30:07.461 [2024-07-13 10:16:13.126650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.126823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.126851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.461 qpair failed and we were unable to recover it. 00:30:07.461 [2024-07-13 10:16:13.127037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.127241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.127294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.461 qpair failed and we were unable to recover it. 00:30:07.461 [2024-07-13 10:16:13.127462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.127623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.127651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.461 qpair failed and we were unable to recover it. 00:30:07.461 [2024-07-13 10:16:13.127796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.127924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.127950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.461 qpair failed and we were unable to recover it. 00:30:07.461 [2024-07-13 10:16:13.128119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.128262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.128291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.461 qpair failed and we were unable to recover it. 00:30:07.461 [2024-07-13 10:16:13.128457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.128616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.128644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.461 qpair failed and we were unable to recover it. 00:30:07.461 [2024-07-13 10:16:13.128796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.128950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.128975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.461 qpair failed and we were unable to recover it. 00:30:07.461 [2024-07-13 10:16:13.129198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.129378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.129404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.461 qpair failed and we were unable to recover it. 00:30:07.461 [2024-07-13 10:16:13.129580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.129755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.129782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.461 qpair failed and we were unable to recover it. 00:30:07.461 [2024-07-13 10:16:13.129905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.130056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.130082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.461 qpair failed and we were unable to recover it. 00:30:07.461 [2024-07-13 10:16:13.130281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.130482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.130507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.461 qpair failed and we were unable to recover it. 00:30:07.461 [2024-07-13 10:16:13.130659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.130803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.130828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.461 qpair failed and we were unable to recover it. 00:30:07.461 [2024-07-13 10:16:13.131032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.131166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.131192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.461 qpair failed and we were unable to recover it. 00:30:07.461 [2024-07-13 10:16:13.131339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.131538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.131566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.461 qpair failed and we were unable to recover it. 00:30:07.461 [2024-07-13 10:16:13.131768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.131921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.131947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.461 qpair failed and we were unable to recover it. 00:30:07.461 [2024-07-13 10:16:13.132093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.132243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.132284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.461 qpair failed and we were unable to recover it. 00:30:07.461 [2024-07-13 10:16:13.132460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.132639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.132664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.461 qpair failed and we were unable to recover it. 00:30:07.461 [2024-07-13 10:16:13.132851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.133050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.133078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.461 qpair failed and we were unable to recover it. 00:30:07.461 [2024-07-13 10:16:13.133254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.133374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.133400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.461 qpair failed and we were unable to recover it. 00:30:07.461 [2024-07-13 10:16:13.133574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.133733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.133761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.461 qpair failed and we were unable to recover it. 00:30:07.461 [2024-07-13 10:16:13.133897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.134132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.134182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.461 qpair failed and we were unable to recover it. 00:30:07.461 [2024-07-13 10:16:13.134361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.134539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.134579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.461 qpair failed and we were unable to recover it. 00:30:07.461 [2024-07-13 10:16:13.134752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.134939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.134981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.461 qpair failed and we were unable to recover it. 00:30:07.461 [2024-07-13 10:16:13.135139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.135306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.135334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.461 qpair failed and we were unable to recover it. 00:30:07.461 [2024-07-13 10:16:13.135511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.135659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.135684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.461 qpair failed and we were unable to recover it. 00:30:07.461 [2024-07-13 10:16:13.135836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.135981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.136010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.461 qpair failed and we were unable to recover it. 00:30:07.461 [2024-07-13 10:16:13.136213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.461 [2024-07-13 10:16:13.136355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.136380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.462 qpair failed and we were unable to recover it. 00:30:07.462 [2024-07-13 10:16:13.136558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.136733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.136758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.462 qpair failed and we were unable to recover it. 00:30:07.462 [2024-07-13 10:16:13.136880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.137050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.137079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.462 qpair failed and we were unable to recover it. 00:30:07.462 [2024-07-13 10:16:13.137211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.137342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.137370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.462 qpair failed and we were unable to recover it. 00:30:07.462 [2024-07-13 10:16:13.137570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.137686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.137727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.462 qpair failed and we were unable to recover it. 00:30:07.462 [2024-07-13 10:16:13.137894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.139027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.139061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.462 qpair failed and we were unable to recover it. 00:30:07.462 [2024-07-13 10:16:13.139235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.139431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.139457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.462 qpair failed and we were unable to recover it. 00:30:07.462 [2024-07-13 10:16:13.139639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.139806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.139835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.462 qpair failed and we were unable to recover it. 00:30:07.462 [2024-07-13 10:16:13.139997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.140154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.140179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.462 qpair failed and we were unable to recover it. 00:30:07.462 [2024-07-13 10:16:13.140326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.140546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.140573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.462 qpair failed and we were unable to recover it. 00:30:07.462 [2024-07-13 10:16:13.140729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.140894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.140928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.462 qpair failed and we were unable to recover it. 00:30:07.462 [2024-07-13 10:16:13.141108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.141307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.141332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.462 qpair failed and we were unable to recover it. 00:30:07.462 [2024-07-13 10:16:13.141519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.141707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.141734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.462 qpair failed and we were unable to recover it. 00:30:07.462 [2024-07-13 10:16:13.141911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.142038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.142063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.462 qpair failed and we were unable to recover it. 00:30:07.462 [2024-07-13 10:16:13.142218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.142348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.142374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.462 qpair failed and we were unable to recover it. 00:30:07.462 [2024-07-13 10:16:13.142548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.142717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.142745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.462 qpair failed and we were unable to recover it. 00:30:07.462 [2024-07-13 10:16:13.142895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.143073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.143099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.462 qpair failed and we were unable to recover it. 00:30:07.462 [2024-07-13 10:16:13.143296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.143449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.143490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.462 qpair failed and we were unable to recover it. 00:30:07.462 [2024-07-13 10:16:13.143685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.143856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.143891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.462 qpair failed and we were unable to recover it. 00:30:07.462 [2024-07-13 10:16:13.144042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.144173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.144198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.462 qpair failed and we were unable to recover it. 00:30:07.462 [2024-07-13 10:16:13.144392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.144609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.144655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.462 qpair failed and we were unable to recover it. 00:30:07.462 [2024-07-13 10:16:13.144857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.145005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.145038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.462 qpair failed and we were unable to recover it. 00:30:07.462 [2024-07-13 10:16:13.145235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.145402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.145450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.462 qpair failed and we were unable to recover it. 00:30:07.462 [2024-07-13 10:16:13.145659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.145837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.145863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.462 qpair failed and we were unable to recover it. 00:30:07.462 [2024-07-13 10:16:13.146027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.146191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.146218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.462 qpair failed and we were unable to recover it. 00:30:07.462 [2024-07-13 10:16:13.146384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.146503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.146527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.462 qpair failed and we were unable to recover it. 00:30:07.462 [2024-07-13 10:16:13.146721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.146893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.146921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.462 qpair failed and we were unable to recover it. 00:30:07.462 [2024-07-13 10:16:13.147087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.147220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.147248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.462 qpair failed and we were unable to recover it. 00:30:07.462 [2024-07-13 10:16:13.147388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.147506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.147531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.462 qpair failed and we were unable to recover it. 00:30:07.462 [2024-07-13 10:16:13.147670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.147808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.147835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.462 qpair failed and we were unable to recover it. 00:30:07.462 [2024-07-13 10:16:13.147978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.148117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.148145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.462 qpair failed and we were unable to recover it. 00:30:07.462 [2024-07-13 10:16:13.148315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.148507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.148539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.462 qpair failed and we were unable to recover it. 00:30:07.462 [2024-07-13 10:16:13.148665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.148803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.148830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.462 qpair failed and we were unable to recover it. 00:30:07.462 [2024-07-13 10:16:13.148969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.149126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.149153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.462 qpair failed and we were unable to recover it. 00:30:07.462 [2024-07-13 10:16:13.149324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.149442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.149467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.462 qpair failed and we were unable to recover it. 00:30:07.462 [2024-07-13 10:16:13.149678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.149854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.149903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.462 qpair failed and we were unable to recover it. 00:30:07.462 [2024-07-13 10:16:13.150047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.150214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.150242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.462 qpair failed and we were unable to recover it. 00:30:07.462 [2024-07-13 10:16:13.150391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.150512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.150539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.462 qpair failed and we were unable to recover it. 00:30:07.462 [2024-07-13 10:16:13.150680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.150877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.150905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.462 qpair failed and we were unable to recover it. 00:30:07.462 [2024-07-13 10:16:13.151053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.151168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.151193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.462 qpair failed and we were unable to recover it. 00:30:07.462 [2024-07-13 10:16:13.151374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.151493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.151519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.462 qpair failed and we were unable to recover it. 00:30:07.462 [2024-07-13 10:16:13.151699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.462 [2024-07-13 10:16:13.151900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.151927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.152052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.152189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.152217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.152400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.152552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.152578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.152757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.152918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.152944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.153097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.153242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.153268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.153453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.153612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.153640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.153813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.153946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.153972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.154127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.154247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.154272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.154447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.154631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.154659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.154827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.154984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.155010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.155135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.155368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.155393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.155547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.156307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.156339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.156520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.156672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.156714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.156894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.157059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.157085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.157256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.157388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.157417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.157618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.157780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.157809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.157985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.158136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.158179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.158337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.158582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.158632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.158816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.158969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.158994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.159129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.159305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.159332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.159525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.159658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.159686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.159857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.160042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.160069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.160205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.160409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.160455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.160614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.160783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.160808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.160960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.161135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.161176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.161340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.161523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.161555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.161771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.161933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.161959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.162134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.162303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.162330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.162505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.162692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.162720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.162880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.163049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.163075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.163221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.163391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.163416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.163538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.163720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.163745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.163934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.164057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.164082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.164224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.164374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.164416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.164584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.164777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.164804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.164964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.165095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.165119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.165292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.165412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.165454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.165616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.165785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.165812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.165971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.166095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.166120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.166248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.166371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.166396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.166568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.166746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.166770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.166943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.167094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.167123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.167315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.167474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.167502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.167666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.167799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.167826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.168039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.168189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.168214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.168397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.168548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.168574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.168762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.168940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.168966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.463 qpair failed and we were unable to recover it. 00:30:07.463 [2024-07-13 10:16:13.169099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.463 [2024-07-13 10:16:13.169269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.169294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.464 qpair failed and we were unable to recover it. 00:30:07.464 [2024-07-13 10:16:13.169486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.169638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.169663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.464 qpair failed and we were unable to recover it. 00:30:07.464 [2024-07-13 10:16:13.169808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.169989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.170015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.464 qpair failed and we were unable to recover it. 00:30:07.464 [2024-07-13 10:16:13.170152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.170354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.170382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.464 qpair failed and we were unable to recover it. 00:30:07.464 [2024-07-13 10:16:13.170575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.170708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.170735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.464 qpair failed and we were unable to recover it. 00:30:07.464 [2024-07-13 10:16:13.170894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.171020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.171045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.464 qpair failed and we were unable to recover it. 00:30:07.464 [2024-07-13 10:16:13.171249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.171446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.171492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.464 qpair failed and we were unable to recover it. 00:30:07.464 [2024-07-13 10:16:13.171658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.171828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.171853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.464 qpair failed and we were unable to recover it. 00:30:07.464 [2024-07-13 10:16:13.171990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.172118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.172143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.464 qpair failed and we were unable to recover it. 00:30:07.464 [2024-07-13 10:16:13.172326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.172453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.172478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.464 qpair failed and we were unable to recover it. 00:30:07.464 [2024-07-13 10:16:13.172626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.172780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.172805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.464 qpair failed and we were unable to recover it. 00:30:07.464 [2024-07-13 10:16:13.172970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.173122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.173147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.464 qpair failed and we were unable to recover it. 00:30:07.464 [2024-07-13 10:16:13.173343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.173498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.173524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.464 qpair failed and we were unable to recover it. 00:30:07.464 [2024-07-13 10:16:13.173703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.173845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.173878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.464 qpair failed and we were unable to recover it. 00:30:07.464 [2024-07-13 10:16:13.174034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.174167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.174192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.464 qpair failed and we were unable to recover it. 00:30:07.464 [2024-07-13 10:16:13.174347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.174504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.174530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.464 qpair failed and we were unable to recover it. 00:30:07.464 [2024-07-13 10:16:13.174682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.174832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.174857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.464 qpair failed and we were unable to recover it. 00:30:07.464 [2024-07-13 10:16:13.174999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.175123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.175148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.464 qpair failed and we were unable to recover it. 00:30:07.464 [2024-07-13 10:16:13.175317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.175531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.175576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.464 qpair failed and we were unable to recover it. 00:30:07.464 [2024-07-13 10:16:13.175747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.175926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.175952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.464 qpair failed and we were unable to recover it. 00:30:07.464 [2024-07-13 10:16:13.176082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.176230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.176256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.464 qpair failed and we were unable to recover it. 00:30:07.464 [2024-07-13 10:16:13.176432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.176601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.176629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.464 qpair failed and we were unable to recover it. 00:30:07.464 [2024-07-13 10:16:13.176801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.176921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.176947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.464 qpair failed and we were unable to recover it. 00:30:07.464 [2024-07-13 10:16:13.177102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.177277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.177303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.464 qpair failed and we were unable to recover it. 00:30:07.464 [2024-07-13 10:16:13.177452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.177610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.177635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.464 qpair failed and we were unable to recover it. 00:30:07.464 [2024-07-13 10:16:13.177790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.177945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.177971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.464 qpair failed and we were unable to recover it. 00:30:07.464 [2024-07-13 10:16:13.178176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.178353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.178378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.464 qpair failed and we were unable to recover it. 00:30:07.464 [2024-07-13 10:16:13.178544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.178685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.178713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.464 qpair failed and we were unable to recover it. 00:30:07.464 [2024-07-13 10:16:13.178858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.179020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.179061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.464 qpair failed and we were unable to recover it. 00:30:07.464 [2024-07-13 10:16:13.179201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.179361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.179403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.464 qpair failed and we were unable to recover it. 00:30:07.464 [2024-07-13 10:16:13.179532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.179675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.179703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.464 qpair failed and we were unable to recover it. 00:30:07.464 [2024-07-13 10:16:13.179849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.179986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.180012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.464 qpair failed and we were unable to recover it. 00:30:07.464 [2024-07-13 10:16:13.180139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.180311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.180341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.464 qpair failed and we were unable to recover it. 00:30:07.464 [2024-07-13 10:16:13.180517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.180693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.180718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.464 qpair failed and we were unable to recover it. 00:30:07.464 [2024-07-13 10:16:13.180880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.181032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.181057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.464 qpair failed and we were unable to recover it. 00:30:07.464 [2024-07-13 10:16:13.181239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.181391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.181437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.464 qpair failed and we were unable to recover it. 00:30:07.464 [2024-07-13 10:16:13.181582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.181746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.181774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.464 qpair failed and we were unable to recover it. 00:30:07.464 [2024-07-13 10:16:13.181958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.182093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.182135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.464 qpair failed and we were unable to recover it. 00:30:07.464 [2024-07-13 10:16:13.182313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.182471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.182497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.464 qpair failed and we were unable to recover it. 00:30:07.464 [2024-07-13 10:16:13.182654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.182851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.182886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.464 qpair failed and we were unable to recover it. 00:30:07.464 [2024-07-13 10:16:13.183023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.464 [2024-07-13 10:16:13.183138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.183174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.465 qpair failed and we were unable to recover it. 00:30:07.465 [2024-07-13 10:16:13.183361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.183548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.183595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.465 qpair failed and we were unable to recover it. 00:30:07.465 [2024-07-13 10:16:13.183753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.183913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.183942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.465 qpair failed and we were unable to recover it. 00:30:07.465 [2024-07-13 10:16:13.184083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.184254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.184282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.465 qpair failed and we were unable to recover it. 00:30:07.465 [2024-07-13 10:16:13.184463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.184604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.184629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.465 qpair failed and we were unable to recover it. 00:30:07.465 [2024-07-13 10:16:13.184805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.184956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.184986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.465 qpair failed and we were unable to recover it. 00:30:07.465 [2024-07-13 10:16:13.185137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.185298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.185339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.465 qpair failed and we were unable to recover it. 00:30:07.465 [2024-07-13 10:16:13.185506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.185663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.185688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.465 qpair failed and we were unable to recover it. 00:30:07.465 [2024-07-13 10:16:13.185835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.186003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.186028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.465 qpair failed and we were unable to recover it. 00:30:07.465 [2024-07-13 10:16:13.186159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.186286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.186310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.465 qpair failed and we were unable to recover it. 00:30:07.465 [2024-07-13 10:16:13.186483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.186612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.186640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.465 qpair failed and we were unable to recover it. 00:30:07.465 [2024-07-13 10:16:13.186801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.186974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.187000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.465 qpair failed and we were unable to recover it. 00:30:07.465 [2024-07-13 10:16:13.187128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.187276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.187317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.465 qpair failed and we were unable to recover it. 00:30:07.465 [2024-07-13 10:16:13.187489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.187667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.187695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.465 qpair failed and we were unable to recover it. 00:30:07.465 [2024-07-13 10:16:13.187891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.188031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.188073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.465 qpair failed and we were unable to recover it. 00:30:07.465 [2024-07-13 10:16:13.188244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.188408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.188435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.465 qpair failed and we were unable to recover it. 00:30:07.465 [2024-07-13 10:16:13.188613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.188754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.188795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.465 qpair failed and we were unable to recover it. 00:30:07.465 [2024-07-13 10:16:13.188965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.189110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.189138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.465 qpair failed and we were unable to recover it. 00:30:07.465 [2024-07-13 10:16:13.189338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.189514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.189538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.465 qpair failed and we were unable to recover it. 00:30:07.465 [2024-07-13 10:16:13.189660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.189837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.189888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.465 qpair failed and we were unable to recover it. 00:30:07.465 [2024-07-13 10:16:13.190034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.190166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.190191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.465 qpair failed and we were unable to recover it. 00:30:07.465 [2024-07-13 10:16:13.190383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.190592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.190638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.465 qpair failed and we were unable to recover it. 00:30:07.465 [2024-07-13 10:16:13.190805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.190960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.190989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.465 qpair failed and we were unable to recover it. 00:30:07.465 [2024-07-13 10:16:13.191125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.191269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.191296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.465 qpair failed and we were unable to recover it. 00:30:07.465 [2024-07-13 10:16:13.191431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.191604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.191629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.465 qpair failed and we were unable to recover it. 00:30:07.465 [2024-07-13 10:16:13.191758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.191936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.191964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.465 qpair failed and we were unable to recover it. 00:30:07.465 [2024-07-13 10:16:13.192098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.192264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.192292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.465 qpair failed and we were unable to recover it. 00:30:07.465 [2024-07-13 10:16:13.192459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.192622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.192649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.465 qpair failed and we were unable to recover it. 00:30:07.465 [2024-07-13 10:16:13.192819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.192949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.192974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.465 qpair failed and we were unable to recover it. 00:30:07.465 [2024-07-13 10:16:13.193104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.193241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.193283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.465 qpair failed and we were unable to recover it. 00:30:07.465 [2024-07-13 10:16:13.193478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.193644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.193672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.465 qpair failed and we were unable to recover it. 00:30:07.465 [2024-07-13 10:16:13.193835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.194024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.194049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.465 qpair failed and we were unable to recover it. 00:30:07.465 [2024-07-13 10:16:13.194174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.194322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.194347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.465 qpair failed and we were unable to recover it. 00:30:07.465 [2024-07-13 10:16:13.194535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.194685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.194710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.465 qpair failed and we were unable to recover it. 00:30:07.465 [2024-07-13 10:16:13.194891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.195076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.195102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.465 qpair failed and we were unable to recover it. 00:30:07.465 [2024-07-13 10:16:13.195309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.195494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.195539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.465 qpair failed and we were unable to recover it. 00:30:07.465 [2024-07-13 10:16:13.195702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.195893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.195922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.465 qpair failed and we were unable to recover it. 00:30:07.465 [2024-07-13 10:16:13.196081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.196213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.196238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.465 qpair failed and we were unable to recover it. 00:30:07.465 [2024-07-13 10:16:13.196405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.196552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.196578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.465 qpair failed and we were unable to recover it. 00:30:07.465 [2024-07-13 10:16:13.196734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.196857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.196898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.465 qpair failed and we were unable to recover it. 00:30:07.465 [2024-07-13 10:16:13.197079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.197232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.197257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.465 qpair failed and we were unable to recover it. 00:30:07.465 [2024-07-13 10:16:13.197447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.197590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.197618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.465 qpair failed and we were unable to recover it. 00:30:07.465 [2024-07-13 10:16:13.197789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.465 [2024-07-13 10:16:13.197937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.197966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.198105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.198276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.198302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.198450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.198591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.198632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.198769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.198969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.198994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.199121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.199299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.199326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.199523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.199694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.199722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.199870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.200001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.200026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.200181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.200304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.200328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.200528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.200730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.200755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.200918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.201054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.201082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.201261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.201413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.201438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.201614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.201800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.201827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.201997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.202119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.202145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.202290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.202452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.202479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.202654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.202794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.202839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.202999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.203125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.203152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.203284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.203448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.203475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.203621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.203770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.203797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.203935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.204054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.204079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.204271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.204416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.204441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.204614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.204779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.204807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.204963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.205104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.205134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.205338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.205520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.205566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.205754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.205946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.205975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.206115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.206290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.206321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.206474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.206601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.206626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.206776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.206961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.206987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.207128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.207268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.207296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.207458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.207629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.207654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.207798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.207942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.207971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.208118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.208285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.208310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.208478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.208644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.208674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.208840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.208982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.209007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.209155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.209362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.209387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.209540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.209663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.209688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.209896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.210024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.210052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.210198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.210364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.210389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.210562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.210718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.210745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.210924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.211077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.211102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.211263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.211408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.211433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.211641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.211832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.211875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.212022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.212205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.212240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.212359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.212485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.212510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.466 [2024-07-13 10:16:13.212695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.212854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.466 [2024-07-13 10:16:13.212892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.466 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.213024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.213179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.213207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.467 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.213376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.213531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.213555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.467 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.213712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.213834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.213883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.467 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.214020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.214171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.214199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.467 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.214417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.214641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.214674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.467 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.214853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.215016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.215042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.467 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.215201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.215375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.215403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.467 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.215547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.215720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.215746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.467 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.215915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.216047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.216073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.467 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.216233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.216436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.216481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.467 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.216631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.216807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.216832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.467 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.217015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.217139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.217169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.467 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.217293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.217475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.217517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.467 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.217662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.217825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.217870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.467 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.218014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.218134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.218161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.467 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.218357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.218515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.218556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.467 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.218728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.218896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.218940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.467 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.219067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.219194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.219219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.467 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.219371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.219540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.219568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.467 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.219725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.219877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.219904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.467 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.220034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.220237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.220265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.467 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.220400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.220576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.220606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.467 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.220747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.220881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.220908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.467 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.221034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.221178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.221226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.467 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.221390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.221548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.221577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.467 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.221744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.221935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.221962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.467 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.222092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.222240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.222265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.467 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.222392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.222574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.222616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.467 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.222783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.222951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.222977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.467 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.223113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.223296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.223323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.467 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.223461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.223611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.223637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.467 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.223829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.223997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.224023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.467 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.224155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.224305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.224330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.467 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.224473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.224642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.224670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.467 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.224814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.224955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.224982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.467 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.225110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.225285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.225313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.467 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.225492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.225617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.225658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.467 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.225848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.226010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.226036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.467 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.226158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.226291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.226320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.467 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.226506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.226653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.226681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.467 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.226847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.227015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.227042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.467 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.227193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.227374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.227399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.467 qpair failed and we were unable to recover it. 00:30:07.467 [2024-07-13 10:16:13.227584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.467 [2024-07-13 10:16:13.227751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.227780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.227976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.228108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.228136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.228287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.228451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.228479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.228645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.228784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.228812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.228971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.229086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.229112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.229269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.229433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.229461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.229601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.229781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.229806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.229937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.230118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.230144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.230278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.230431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.230457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.230633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.230781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.230806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.230949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.231098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.231123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.231283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.231466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.231494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.231648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.231766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.231793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.231952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.232121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.232150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.232327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.232491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.232519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.232700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.232883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.232909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.233034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.233164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.233189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.233403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.233607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.233652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.233818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.234008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.234034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.234162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.234353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.234383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.234542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.234693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.234718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.234878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.235051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.235077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.235225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.235425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.235470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.235681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.235804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.235830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.236014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.236140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.236194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.236401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.236553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.236579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.236787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.236936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.236966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.237111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.237286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.237314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.237492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.237661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.237689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.237900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.238021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.238051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.238217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.238346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.238372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.238530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.238741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.238769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.238959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.239572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.239610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.239817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.240003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.240033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.240181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.240364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.240396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.240603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.240791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.240820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.240982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.241109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.241135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.241362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.241558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.241586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.242535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.242748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.242778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.242962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.243117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.243149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.243300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.243462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.243488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.243666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.243818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.243844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.243994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.244112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.244138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.244321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.244474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.244519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.468 qpair failed and we were unable to recover it. 00:30:07.468 [2024-07-13 10:16:13.244676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.468 [2024-07-13 10:16:13.244831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.244876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.469 qpair failed and we were unable to recover it. 00:30:07.469 [2024-07-13 10:16:13.245009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.245135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.245186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.469 qpair failed and we were unable to recover it. 00:30:07.469 [2024-07-13 10:16:13.245327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.245544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.245576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.469 qpair failed and we were unable to recover it. 00:30:07.469 [2024-07-13 10:16:13.245728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.245947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.245975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.469 qpair failed and we were unable to recover it. 00:30:07.469 [2024-07-13 10:16:13.246101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.246234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.246261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.469 qpair failed and we were unable to recover it. 00:30:07.469 [2024-07-13 10:16:13.246448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.246620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.246653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.469 qpair failed and we were unable to recover it. 00:30:07.469 [2024-07-13 10:16:13.246833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.246997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.247024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.469 qpair failed and we were unable to recover it. 00:30:07.469 [2024-07-13 10:16:13.247157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.247336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.247361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.469 qpair failed and we were unable to recover it. 00:30:07.469 [2024-07-13 10:16:13.247506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.247653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.247679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.469 qpair failed and we were unable to recover it. 00:30:07.469 [2024-07-13 10:16:13.247831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.247972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.247999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.469 qpair failed and we were unable to recover it. 00:30:07.469 [2024-07-13 10:16:13.248172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.248334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.248364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.469 qpair failed and we were unable to recover it. 00:30:07.469 [2024-07-13 10:16:13.248531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.248657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.248684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.469 qpair failed and we were unable to recover it. 00:30:07.469 [2024-07-13 10:16:13.248830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.248999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.249026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.469 qpair failed and we were unable to recover it. 00:30:07.469 [2024-07-13 10:16:13.249155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.249305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.249331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.469 qpair failed and we were unable to recover it. 00:30:07.469 [2024-07-13 10:16:13.249468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.249645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.249674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.469 qpair failed and we were unable to recover it. 00:30:07.469 [2024-07-13 10:16:13.249798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.249985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.250012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.469 qpair failed and we were unable to recover it. 00:30:07.469 [2024-07-13 10:16:13.250176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.250361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.250388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.469 qpair failed and we were unable to recover it. 00:30:07.469 [2024-07-13 10:16:13.250550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.250696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.250724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.469 qpair failed and we were unable to recover it. 00:30:07.469 [2024-07-13 10:16:13.250871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.251050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.251080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.469 qpair failed and we were unable to recover it. 00:30:07.469 [2024-07-13 10:16:13.251254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.251402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.251444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.469 qpair failed and we were unable to recover it. 00:30:07.469 [2024-07-13 10:16:13.251639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.251782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.251811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.469 qpair failed and we were unable to recover it. 00:30:07.469 [2024-07-13 10:16:13.252001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.252159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.252186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.469 qpair failed and we were unable to recover it. 00:30:07.469 [2024-07-13 10:16:13.252386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.252574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.252602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.469 qpair failed and we were unable to recover it. 00:30:07.469 [2024-07-13 10:16:13.252805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.252942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.252969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.469 qpair failed and we were unable to recover it. 00:30:07.469 [2024-07-13 10:16:13.253132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.253325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.253354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.469 qpair failed and we were unable to recover it. 00:30:07.469 [2024-07-13 10:16:13.253550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.253700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.253745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.469 qpair failed and we were unable to recover it. 00:30:07.469 [2024-07-13 10:16:13.253938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.254065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.254090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.469 qpair failed and we were unable to recover it. 00:30:07.469 [2024-07-13 10:16:13.254244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.255057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.255086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.469 qpair failed and we were unable to recover it. 00:30:07.469 [2024-07-13 10:16:13.255251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.255409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.255435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.469 qpair failed and we were unable to recover it. 00:30:07.469 [2024-07-13 10:16:13.255589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.255735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.255760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.469 qpair failed and we were unable to recover it. 00:30:07.469 [2024-07-13 10:16:13.255917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.256050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.256076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.469 qpair failed and we were unable to recover it. 00:30:07.469 [2024-07-13 10:16:13.256240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.256394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.256419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.469 qpair failed and we were unable to recover it. 00:30:07.469 [2024-07-13 10:16:13.256604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.256770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.256798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.469 qpair failed and we were unable to recover it. 00:30:07.469 [2024-07-13 10:16:13.256954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.257089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.257115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.469 qpair failed and we were unable to recover it. 00:30:07.469 [2024-07-13 10:16:13.257271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.257423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.257448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.469 qpair failed and we were unable to recover it. 00:30:07.469 [2024-07-13 10:16:13.257619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.257757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.257784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.469 qpair failed and we were unable to recover it. 00:30:07.469 [2024-07-13 10:16:13.257942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.258096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.258121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.469 qpair failed and we were unable to recover it. 00:30:07.469 [2024-07-13 10:16:13.258383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.258581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.469 [2024-07-13 10:16:13.258648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.469 qpair failed and we were unable to recover it. 00:30:07.469 [2024-07-13 10:16:13.258788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.766 [2024-07-13 10:16:13.258946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.766 [2024-07-13 10:16:13.258972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.766 qpair failed and we were unable to recover it. 00:30:07.766 [2024-07-13 10:16:13.259104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.766 [2024-07-13 10:16:13.259226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.766 [2024-07-13 10:16:13.259253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.766 qpair failed and we were unable to recover it. 00:30:07.766 [2024-07-13 10:16:13.259423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.259599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.259643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.767 qpair failed and we were unable to recover it. 00:30:07.767 [2024-07-13 10:16:13.259792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.259944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.259970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.767 qpair failed and we were unable to recover it. 00:30:07.767 [2024-07-13 10:16:13.260098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.260228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.260255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.767 qpair failed and we were unable to recover it. 00:30:07.767 [2024-07-13 10:16:13.260429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.260554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.260579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.767 qpair failed and we were unable to recover it. 00:30:07.767 [2024-07-13 10:16:13.260726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.260863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.260906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.767 qpair failed and we were unable to recover it. 00:30:07.767 [2024-07-13 10:16:13.261080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.261206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.261230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.767 qpair failed and we were unable to recover it. 00:30:07.767 [2024-07-13 10:16:13.261362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.261540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.261569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.767 qpair failed and we were unable to recover it. 00:30:07.767 [2024-07-13 10:16:13.261715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.261885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.261930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.767 qpair failed and we were unable to recover it. 00:30:07.767 [2024-07-13 10:16:13.262066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.262189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.262216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.767 qpair failed and we were unable to recover it. 00:30:07.767 [2024-07-13 10:16:13.262354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.262515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.262541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.767 qpair failed and we were unable to recover it. 00:30:07.767 [2024-07-13 10:16:13.262669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.262816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.262850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.767 qpair failed and we were unable to recover it. 00:30:07.767 [2024-07-13 10:16:13.263005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.263136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.263169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.767 qpair failed and we were unable to recover it. 00:30:07.767 [2024-07-13 10:16:13.263316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.263455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.263484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.767 qpair failed and we were unable to recover it. 00:30:07.767 [2024-07-13 10:16:13.263626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.263777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.263821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.767 qpair failed and we were unable to recover it. 00:30:07.767 [2024-07-13 10:16:13.263979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.264101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.264126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.767 qpair failed and we were unable to recover it. 00:30:07.767 [2024-07-13 10:16:13.264267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.264437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.264467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.767 qpair failed and we were unable to recover it. 00:30:07.767 [2024-07-13 10:16:13.264652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.264780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.264807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.767 qpair failed and we were unable to recover it. 00:30:07.767 [2024-07-13 10:16:13.264975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.265100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.265125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.767 qpair failed and we were unable to recover it. 00:30:07.767 [2024-07-13 10:16:13.265277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.265398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.265423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.767 qpair failed and we were unable to recover it. 00:30:07.767 [2024-07-13 10:16:13.265546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.265703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.265733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.767 qpair failed and we were unable to recover it. 00:30:07.767 [2024-07-13 10:16:13.265896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.266023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.266049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.767 qpair failed and we were unable to recover it. 00:30:07.767 [2024-07-13 10:16:13.266176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.266313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.266339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.767 qpair failed and we were unable to recover it. 00:30:07.767 [2024-07-13 10:16:13.266480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.266633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.266658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.767 qpair failed and we were unable to recover it. 00:30:07.767 [2024-07-13 10:16:13.266788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.266923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.266949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.767 qpair failed and we were unable to recover it. 00:30:07.767 [2024-07-13 10:16:13.267097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.267271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.267298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.767 qpair failed and we were unable to recover it. 00:30:07.767 [2024-07-13 10:16:13.267429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.267599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.267627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.767 qpair failed and we were unable to recover it. 00:30:07.767 [2024-07-13 10:16:13.267795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.267974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.268000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.767 qpair failed and we were unable to recover it. 00:30:07.767 [2024-07-13 10:16:13.268126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.268278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.268303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.767 qpair failed and we were unable to recover it. 00:30:07.767 [2024-07-13 10:16:13.268453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.268589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.268616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.767 qpair failed and we were unable to recover it. 00:30:07.767 [2024-07-13 10:16:13.268782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.268975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.269000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.767 qpair failed and we were unable to recover it. 00:30:07.767 [2024-07-13 10:16:13.269134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.767 [2024-07-13 10:16:13.269266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.269292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.768 qpair failed and we were unable to recover it. 00:30:07.768 [2024-07-13 10:16:13.269455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.269631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.269658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.768 qpair failed and we were unable to recover it. 00:30:07.768 [2024-07-13 10:16:13.269807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.269958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.269984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.768 qpair failed and we were unable to recover it. 00:30:07.768 [2024-07-13 10:16:13.270111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.270238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.270263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.768 qpair failed and we were unable to recover it. 00:30:07.768 [2024-07-13 10:16:13.270442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.270573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.270601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.768 qpair failed and we were unable to recover it. 00:30:07.768 [2024-07-13 10:16:13.270763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.270953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.270979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.768 qpair failed and we were unable to recover it. 00:30:07.768 [2024-07-13 10:16:13.271111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.271264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.271289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.768 qpair failed and we were unable to recover it. 00:30:07.768 [2024-07-13 10:16:13.271417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.271566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.271591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.768 qpair failed and we were unable to recover it. 00:30:07.768 [2024-07-13 10:16:13.271730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.271900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.271925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.768 qpair failed and we were unable to recover it. 00:30:07.768 [2024-07-13 10:16:13.272074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.272238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.272264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.768 qpair failed and we were unable to recover it. 00:30:07.768 [2024-07-13 10:16:13.272456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.272638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.272680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.768 qpair failed and we were unable to recover it. 00:30:07.768 [2024-07-13 10:16:13.272818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.272977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.273003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.768 qpair failed and we were unable to recover it. 00:30:07.768 [2024-07-13 10:16:13.273148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.273315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.273343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.768 qpair failed and we were unable to recover it. 00:30:07.768 [2024-07-13 10:16:13.273548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.273714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.273742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.768 qpair failed and we were unable to recover it. 00:30:07.768 [2024-07-13 10:16:13.273894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.274028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.274053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.768 qpair failed and we were unable to recover it. 00:30:07.768 [2024-07-13 10:16:13.274185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.274333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.274358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.768 qpair failed and we were unable to recover it. 00:30:07.768 [2024-07-13 10:16:13.274531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.274697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.274727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.768 qpair failed and we were unable to recover it. 00:30:07.768 [2024-07-13 10:16:13.274889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.275014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.275039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.768 qpair failed and we were unable to recover it. 00:30:07.768 [2024-07-13 10:16:13.275161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.275308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.275332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.768 qpair failed and we were unable to recover it. 00:30:07.768 [2024-07-13 10:16:13.275480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.275609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.275659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.768 qpair failed and we were unable to recover it. 00:30:07.768 [2024-07-13 10:16:13.275847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.275986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.276011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.768 qpair failed and we were unable to recover it. 00:30:07.768 [2024-07-13 10:16:13.276140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.276253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.276278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.768 qpair failed and we were unable to recover it. 00:30:07.768 [2024-07-13 10:16:13.276474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.276646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.276674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.768 qpair failed and we were unable to recover it. 00:30:07.768 [2024-07-13 10:16:13.276811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.276971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.276996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.768 qpair failed and we were unable to recover it. 00:30:07.768 [2024-07-13 10:16:13.277111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.277239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.277280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.768 qpair failed and we were unable to recover it. 00:30:07.768 [2024-07-13 10:16:13.277426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.277580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.277607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.768 qpair failed and we were unable to recover it. 00:30:07.768 [2024-07-13 10:16:13.277820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.278003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.278028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.768 qpair failed and we were unable to recover it. 00:30:07.768 [2024-07-13 10:16:13.278157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.278316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.278340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.768 qpair failed and we were unable to recover it. 00:30:07.768 [2024-07-13 10:16:13.278472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.278611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.278638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.768 qpair failed and we were unable to recover it. 00:30:07.768 [2024-07-13 10:16:13.278775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.278955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.278980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.768 qpair failed and we were unable to recover it. 00:30:07.768 [2024-07-13 10:16:13.279126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.279294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.768 [2024-07-13 10:16:13.279318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.769 qpair failed and we were unable to recover it. 00:30:07.769 [2024-07-13 10:16:13.279468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.279612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.279639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.769 qpair failed and we were unable to recover it. 00:30:07.769 [2024-07-13 10:16:13.279791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.279934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.279959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.769 qpair failed and we were unable to recover it. 00:30:07.769 [2024-07-13 10:16:13.280082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.280241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.280266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.769 qpair failed and we were unable to recover it. 00:30:07.769 [2024-07-13 10:16:13.280428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.280638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.280665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.769 qpair failed and we were unable to recover it. 00:30:07.769 [2024-07-13 10:16:13.280821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.280975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.281000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.769 qpair failed and we were unable to recover it. 00:30:07.769 [2024-07-13 10:16:13.281125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.281287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.281315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.769 qpair failed and we were unable to recover it. 00:30:07.769 [2024-07-13 10:16:13.281468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.281625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.281666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.769 qpair failed and we were unable to recover it. 00:30:07.769 [2024-07-13 10:16:13.281824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.281983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.282007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.769 qpair failed and we were unable to recover it. 00:30:07.769 [2024-07-13 10:16:13.282141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.282300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.282326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.769 qpair failed and we were unable to recover it. 00:30:07.769 [2024-07-13 10:16:13.282459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.282572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.282596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.769 qpair failed and we were unable to recover it. 00:30:07.769 [2024-07-13 10:16:13.282745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.282877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.282901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.769 qpair failed and we were unable to recover it. 00:30:07.769 [2024-07-13 10:16:13.283032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.283185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.283212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.769 qpair failed and we were unable to recover it. 00:30:07.769 [2024-07-13 10:16:13.283400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.283567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.283593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.769 qpair failed and we were unable to recover it. 00:30:07.769 [2024-07-13 10:16:13.283760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.283955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.283980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.769 qpair failed and we were unable to recover it. 00:30:07.769 [2024-07-13 10:16:13.284107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.284318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.284365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.769 qpair failed and we were unable to recover it. 00:30:07.769 [2024-07-13 10:16:13.284611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.284800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.284828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.769 qpair failed and we were unable to recover it. 00:30:07.769 [2024-07-13 10:16:13.284998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.285122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.285147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.769 qpair failed and we were unable to recover it. 00:30:07.769 [2024-07-13 10:16:13.285776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.285968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.285994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.769 qpair failed and we were unable to recover it. 00:30:07.769 [2024-07-13 10:16:13.286122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.286281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.286306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.769 qpair failed and we were unable to recover it. 00:30:07.769 [2024-07-13 10:16:13.286450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.286618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.286642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.769 qpair failed and we were unable to recover it. 00:30:07.769 [2024-07-13 10:16:13.286791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.286920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.286946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.769 qpair failed and we were unable to recover it. 00:30:07.769 [2024-07-13 10:16:13.287105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.287234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.287263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.769 qpair failed and we were unable to recover it. 00:30:07.769 [2024-07-13 10:16:13.287443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.287583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.287610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.769 qpair failed and we were unable to recover it. 00:30:07.769 [2024-07-13 10:16:13.287767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.287932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.287959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.769 qpair failed and we were unable to recover it. 00:30:07.769 [2024-07-13 10:16:13.288086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.288216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.288249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.769 qpair failed and we were unable to recover it. 00:30:07.769 [2024-07-13 10:16:13.288395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.288521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.288546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.769 qpair failed and we were unable to recover it. 00:30:07.769 [2024-07-13 10:16:13.288712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.288835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.288860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.769 qpair failed and we were unable to recover it. 00:30:07.769 [2024-07-13 10:16:13.289020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.289152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.289179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.769 qpair failed and we were unable to recover it. 00:30:07.769 [2024-07-13 10:16:13.289309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.289430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.289454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.769 qpair failed and we were unable to recover it. 00:30:07.769 [2024-07-13 10:16:13.289619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.289736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.769 [2024-07-13 10:16:13.289761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.769 qpair failed and we were unable to recover it. 00:30:07.769 [2024-07-13 10:16:13.289899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.290022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.290049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.770 qpair failed and we were unable to recover it. 00:30:07.770 [2024-07-13 10:16:13.290179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.290356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.290381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.770 qpair failed and we were unable to recover it. 00:30:07.770 [2024-07-13 10:16:13.290540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.290713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.290737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.770 qpair failed and we were unable to recover it. 00:30:07.770 [2024-07-13 10:16:13.290872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.291016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.291040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.770 qpair failed and we were unable to recover it. 00:30:07.770 [2024-07-13 10:16:13.291163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.291340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.291364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.770 qpair failed and we were unable to recover it. 00:30:07.770 [2024-07-13 10:16:13.291518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.291638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.291662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.770 qpair failed and we were unable to recover it. 00:30:07.770 [2024-07-13 10:16:13.291801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.291953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.291978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.770 qpair failed and we were unable to recover it. 00:30:07.770 [2024-07-13 10:16:13.292124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.292257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.292281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.770 qpair failed and we were unable to recover it. 00:30:07.770 [2024-07-13 10:16:13.292424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.292565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.292589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.770 qpair failed and we were unable to recover it. 00:30:07.770 [2024-07-13 10:16:13.292709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.292846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.292885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.770 qpair failed and we were unable to recover it. 00:30:07.770 [2024-07-13 10:16:13.293008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.293154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.293178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.770 qpair failed and we were unable to recover it. 00:30:07.770 [2024-07-13 10:16:13.293310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.293475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.293499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.770 qpair failed and we were unable to recover it. 00:30:07.770 [2024-07-13 10:16:13.293654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.293800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.293825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.770 qpair failed and we were unable to recover it. 00:30:07.770 [2024-07-13 10:16:13.293967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.294094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.294118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.770 qpair failed and we were unable to recover it. 00:30:07.770 [2024-07-13 10:16:13.294276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.294468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.294498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.770 qpair failed and we were unable to recover it. 00:30:07.770 [2024-07-13 10:16:13.294707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.294879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.294921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.770 qpair failed and we were unable to recover it. 00:30:07.770 [2024-07-13 10:16:13.295050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.295174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.295198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.770 qpair failed and we were unable to recover it. 00:30:07.770 [2024-07-13 10:16:13.295340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.295534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.295559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.770 qpair failed and we were unable to recover it. 00:30:07.770 [2024-07-13 10:16:13.295738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.295879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.295904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.770 qpair failed and we were unable to recover it. 00:30:07.770 [2024-07-13 10:16:13.296052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.296170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.296202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.770 qpair failed and we were unable to recover it. 00:30:07.770 [2024-07-13 10:16:13.296351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.296507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.296532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.770 qpair failed and we were unable to recover it. 00:30:07.770 [2024-07-13 10:16:13.296651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.296797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.296821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.770 qpair failed and we were unable to recover it. 00:30:07.770 [2024-07-13 10:16:13.296990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.297138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.297162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.770 qpair failed and we were unable to recover it. 00:30:07.770 [2024-07-13 10:16:13.297312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.297493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.297518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.770 qpair failed and we were unable to recover it. 00:30:07.770 [2024-07-13 10:16:13.297644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.297793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.297817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.770 qpair failed and we were unable to recover it. 00:30:07.770 [2024-07-13 10:16:13.297960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.298080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.298104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.770 qpair failed and we were unable to recover it. 00:30:07.770 [2024-07-13 10:16:13.298254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.298403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.298432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.770 qpair failed and we were unable to recover it. 00:30:07.770 [2024-07-13 10:16:13.298596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.298748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.298772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.770 qpair failed and we were unable to recover it. 00:30:07.770 [2024-07-13 10:16:13.298894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.299079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.299106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.770 qpair failed and we were unable to recover it. 00:30:07.770 [2024-07-13 10:16:13.299257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.299377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.299401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.770 qpair failed and we were unable to recover it. 00:30:07.770 [2024-07-13 10:16:13.299559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.299707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.770 [2024-07-13 10:16:13.299731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.770 qpair failed and we were unable to recover it. 00:30:07.771 [2024-07-13 10:16:13.299862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.299984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.300008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.771 qpair failed and we were unable to recover it. 00:30:07.771 [2024-07-13 10:16:13.300138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.300262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.300285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.771 qpair failed and we were unable to recover it. 00:30:07.771 [2024-07-13 10:16:13.300504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.300681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.300706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.771 qpair failed and we were unable to recover it. 00:30:07.771 [2024-07-13 10:16:13.300855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.300998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.301022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.771 qpair failed and we were unable to recover it. 00:30:07.771 [2024-07-13 10:16:13.301152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.301290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.301316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.771 qpair failed and we were unable to recover it. 00:30:07.771 [2024-07-13 10:16:13.301465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.301624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.301650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.771 qpair failed and we were unable to recover it. 00:30:07.771 [2024-07-13 10:16:13.301806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.301956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.301981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.771 qpair failed and we were unable to recover it. 00:30:07.771 [2024-07-13 10:16:13.302107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.302229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.302253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.771 qpair failed and we were unable to recover it. 00:30:07.771 [2024-07-13 10:16:13.302404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.302525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.302549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.771 qpair failed and we were unable to recover it. 00:30:07.771 [2024-07-13 10:16:13.302694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.302833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.302857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.771 qpair failed and we were unable to recover it. 00:30:07.771 [2024-07-13 10:16:13.302979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.303099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.303124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.771 qpair failed and we were unable to recover it. 00:30:07.771 [2024-07-13 10:16:13.303270] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1805dc0 is same with the state(5) to be set 00:30:07.771 [2024-07-13 10:16:13.303461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.303663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.303692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.771 qpair failed and we were unable to recover it. 00:30:07.771 [2024-07-13 10:16:13.303832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.303973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.304000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.771 qpair failed and we were unable to recover it. 00:30:07.771 [2024-07-13 10:16:13.304126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.304306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.304331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.771 qpair failed and we were unable to recover it. 00:30:07.771 [2024-07-13 10:16:13.304483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.304607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.304632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.771 qpair failed and we were unable to recover it. 00:30:07.771 [2024-07-13 10:16:13.304757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.304917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.304948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.771 qpair failed and we were unable to recover it. 00:30:07.771 [2024-07-13 10:16:13.305082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.305242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.305267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.771 qpair failed and we were unable to recover it. 00:30:07.771 [2024-07-13 10:16:13.305419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.305589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.305617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.771 qpair failed and we were unable to recover it. 00:30:07.771 [2024-07-13 10:16:13.305781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.305927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.305957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.771 qpair failed and we were unable to recover it. 00:30:07.771 [2024-07-13 10:16:13.306105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.306237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.306264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.771 qpair failed and we were unable to recover it. 00:30:07.771 [2024-07-13 10:16:13.306393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.306581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.306606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.771 qpair failed and we were unable to recover it. 00:30:07.771 [2024-07-13 10:16:13.306732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.306849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.306889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.771 qpair failed and we were unable to recover it. 00:30:07.771 [2024-07-13 10:16:13.307016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.307140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.307165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.771 qpair failed and we were unable to recover it. 00:30:07.771 [2024-07-13 10:16:13.307316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.307463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.307489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.771 qpair failed and we were unable to recover it. 00:30:07.771 [2024-07-13 10:16:13.307646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.771 [2024-07-13 10:16:13.307829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.307855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.772 qpair failed and we were unable to recover it. 00:30:07.772 [2024-07-13 10:16:13.308021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.308137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.308167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.772 qpair failed and we were unable to recover it. 00:30:07.772 [2024-07-13 10:16:13.308345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.308466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.308491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.772 qpair failed and we were unable to recover it. 00:30:07.772 [2024-07-13 10:16:13.308638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.308795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.308820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.772 qpair failed and we were unable to recover it. 00:30:07.772 [2024-07-13 10:16:13.308989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.309109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.309135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.772 qpair failed and we were unable to recover it. 00:30:07.772 [2024-07-13 10:16:13.309304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.309458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.309484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.772 qpair failed and we were unable to recover it. 00:30:07.772 [2024-07-13 10:16:13.309607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.309792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.309818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.772 qpair failed and we were unable to recover it. 00:30:07.772 [2024-07-13 10:16:13.309980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.310100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.310126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.772 qpair failed and we were unable to recover it. 00:30:07.772 [2024-07-13 10:16:13.310255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.310380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.310406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.772 qpair failed and we were unable to recover it. 00:30:07.772 [2024-07-13 10:16:13.310567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.310691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.310716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:07.772 qpair failed and we were unable to recover it. 00:30:07.772 [2024-07-13 10:16:13.310876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.311026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.311064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:07.772 qpair failed and we were unable to recover it. 00:30:07.772 [2024-07-13 10:16:13.311244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.311420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.311480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:07.772 qpair failed and we were unable to recover it. 00:30:07.772 [2024-07-13 10:16:13.311690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.311849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.311890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:07.772 qpair failed and we were unable to recover it. 00:30:07.772 [2024-07-13 10:16:13.312022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.312210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.312247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:07.772 qpair failed and we were unable to recover it. 00:30:07.772 [2024-07-13 10:16:13.312404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.312621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.312670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:07.772 qpair failed and we were unable to recover it. 00:30:07.772 [2024-07-13 10:16:13.312825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.312998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.313031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:07.772 qpair failed and we were unable to recover it. 00:30:07.772 [2024-07-13 10:16:13.313195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.313392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.313434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:07.772 qpair failed and we were unable to recover it. 00:30:07.772 [2024-07-13 10:16:13.313605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.313752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.313781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:07.772 qpair failed and we were unable to recover it. 00:30:07.772 [2024-07-13 10:16:13.313965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.314166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.314209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:07.772 qpair failed and we were unable to recover it. 00:30:07.772 [2024-07-13 10:16:13.314418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.314610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.314653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:07.772 qpair failed and we were unable to recover it. 00:30:07.772 [2024-07-13 10:16:13.314805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.314969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.315018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:07.772 qpair failed and we were unable to recover it. 00:30:07.772 [2024-07-13 10:16:13.315164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.315366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.315414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:07.772 qpair failed and we were unable to recover it. 00:30:07.772 [2024-07-13 10:16:13.315632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.315816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.315845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:07.772 qpair failed and we were unable to recover it. 00:30:07.772 [2024-07-13 10:16:13.316068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.316260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.316290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.772 qpair failed and we were unable to recover it. 00:30:07.772 [2024-07-13 10:16:13.316439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.316606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.316633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.772 qpair failed and we were unable to recover it. 00:30:07.772 [2024-07-13 10:16:13.316801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.316965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.316993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.772 qpair failed and we were unable to recover it. 00:30:07.772 [2024-07-13 10:16:13.317166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.317334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.317361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.772 qpair failed and we were unable to recover it. 00:30:07.772 [2024-07-13 10:16:13.317547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.317754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.317781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.772 qpair failed and we were unable to recover it. 00:30:07.772 [2024-07-13 10:16:13.317946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.318058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.318082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.772 qpair failed and we were unable to recover it. 00:30:07.772 [2024-07-13 10:16:13.318308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.318515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.318561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.772 qpair failed and we were unable to recover it. 00:30:07.772 [2024-07-13 10:16:13.318704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.318886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.772 [2024-07-13 10:16:13.318937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.773 qpair failed and we were unable to recover it. 00:30:07.773 [2024-07-13 10:16:13.319085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.319226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.319253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.773 qpair failed and we were unable to recover it. 00:30:07.773 [2024-07-13 10:16:13.319441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.319625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.319669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.773 qpair failed and we were unable to recover it. 00:30:07.773 [2024-07-13 10:16:13.319833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.320005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.320031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.773 qpair failed and we were unable to recover it. 00:30:07.773 [2024-07-13 10:16:13.320192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.320439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.320466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.773 qpair failed and we were unable to recover it. 00:30:07.773 [2024-07-13 10:16:13.320636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.320798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.320825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.773 qpair failed and we were unable to recover it. 00:30:07.773 [2024-07-13 10:16:13.321005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.321129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.321155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.773 qpair failed and we were unable to recover it. 00:30:07.773 [2024-07-13 10:16:13.321306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.321484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.321526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.773 qpair failed and we were unable to recover it. 00:30:07.773 [2024-07-13 10:16:13.321689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.321830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.321857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.773 qpair failed and we were unable to recover it. 00:30:07.773 [2024-07-13 10:16:13.322022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.322144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.322168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.773 qpair failed and we were unable to recover it. 00:30:07.773 [2024-07-13 10:16:13.322288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.322440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.322464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.773 qpair failed and we were unable to recover it. 00:30:07.773 [2024-07-13 10:16:13.322603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.322767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.322793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.773 qpair failed and we were unable to recover it. 00:30:07.773 [2024-07-13 10:16:13.322963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.323110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.323134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.773 qpair failed and we were unable to recover it. 00:30:07.773 [2024-07-13 10:16:13.323293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.323438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.323462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.773 qpair failed and we were unable to recover it. 00:30:07.773 [2024-07-13 10:16:13.323639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.323795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.323823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.773 qpair failed and we were unable to recover it. 00:30:07.773 [2024-07-13 10:16:13.324014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.324134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.324158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.773 qpair failed and we were unable to recover it. 00:30:07.773 [2024-07-13 10:16:13.324304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.324446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.324470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.773 qpair failed and we were unable to recover it. 00:30:07.773 [2024-07-13 10:16:13.324688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.324814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.324840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.773 qpair failed and we were unable to recover it. 00:30:07.773 [2024-07-13 10:16:13.324986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.325137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.325161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.773 qpair failed and we were unable to recover it. 00:30:07.773 [2024-07-13 10:16:13.325280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.325402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.325442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.773 qpair failed and we were unable to recover it. 00:30:07.773 [2024-07-13 10:16:13.325606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.325747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.325771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.773 qpair failed and we were unable to recover it. 00:30:07.773 [2024-07-13 10:16:13.325904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.326061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.326084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.773 qpair failed and we were unable to recover it. 00:30:07.773 [2024-07-13 10:16:13.326222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.326333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.326357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.773 qpair failed and we were unable to recover it. 00:30:07.773 [2024-07-13 10:16:13.326529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.326693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.326720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.773 qpair failed and we were unable to recover it. 00:30:07.773 [2024-07-13 10:16:13.326883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.327016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.327040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.773 qpair failed and we were unable to recover it. 00:30:07.773 [2024-07-13 10:16:13.327196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.327320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.327344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.773 qpair failed and we were unable to recover it. 00:30:07.773 [2024-07-13 10:16:13.327480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.327644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.327670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.773 qpair failed and we were unable to recover it. 00:30:07.773 [2024-07-13 10:16:13.327798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.327976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.328002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.773 qpair failed and we were unable to recover it. 00:30:07.773 [2024-07-13 10:16:13.328118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.328237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.328261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.773 qpair failed and we were unable to recover it. 00:30:07.773 [2024-07-13 10:16:13.328429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.328627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.328653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.773 qpair failed and we were unable to recover it. 00:30:07.773 [2024-07-13 10:16:13.328819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.328963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.328988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.773 qpair failed and we were unable to recover it. 00:30:07.773 [2024-07-13 10:16:13.329166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.773 [2024-07-13 10:16:13.329287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.329311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.774 qpair failed and we were unable to recover it. 00:30:07.774 [2024-07-13 10:16:13.329468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.329649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.329676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.774 qpair failed and we were unable to recover it. 00:30:07.774 [2024-07-13 10:16:13.329843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.329990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.330014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.774 qpair failed and we were unable to recover it. 00:30:07.774 [2024-07-13 10:16:13.330138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.330250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.330290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.774 qpair failed and we were unable to recover it. 00:30:07.774 [2024-07-13 10:16:13.330498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.330689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.330716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.774 qpair failed and we were unable to recover it. 00:30:07.774 [2024-07-13 10:16:13.330888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.331015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.331039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.774 qpair failed and we were unable to recover it. 00:30:07.774 [2024-07-13 10:16:13.331172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.331297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.331321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.774 qpair failed and we were unable to recover it. 00:30:07.774 [2024-07-13 10:16:13.331510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.331695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.331722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.774 qpair failed and we were unable to recover it. 00:30:07.774 [2024-07-13 10:16:13.331937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.332097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.332121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.774 qpair failed and we were unable to recover it. 00:30:07.774 [2024-07-13 10:16:13.332318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.332493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.332520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.774 qpair failed and we were unable to recover it. 00:30:07.774 [2024-07-13 10:16:13.332684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.332876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.332904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.774 qpair failed and we were unable to recover it. 00:30:07.774 [2024-07-13 10:16:13.333041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.333156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.333184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.774 qpair failed and we were unable to recover it. 00:30:07.774 [2024-07-13 10:16:13.333354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.333574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.333619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.774 qpair failed and we were unable to recover it. 00:30:07.774 [2024-07-13 10:16:13.333812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.334013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.334037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.774 qpair failed and we were unable to recover it. 00:30:07.774 [2024-07-13 10:16:13.334187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.334310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.334334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.774 qpair failed and we were unable to recover it. 00:30:07.774 [2024-07-13 10:16:13.334484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.334659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.334683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.774 qpair failed and we were unable to recover it. 00:30:07.774 [2024-07-13 10:16:13.334838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.334956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.334980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.774 qpair failed and we were unable to recover it. 00:30:07.774 [2024-07-13 10:16:13.335106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.335314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.335341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.774 qpair failed and we were unable to recover it. 00:30:07.774 [2024-07-13 10:16:13.335501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.335658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.335685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.774 qpair failed and we were unable to recover it. 00:30:07.774 [2024-07-13 10:16:13.335892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.336037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.336061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.774 qpair failed and we were unable to recover it. 00:30:07.774 [2024-07-13 10:16:13.336185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.336306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.336330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.774 qpair failed and we were unable to recover it. 00:30:07.774 [2024-07-13 10:16:13.336440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.336585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.336609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.774 qpair failed and we were unable to recover it. 00:30:07.774 [2024-07-13 10:16:13.336739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.336888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.336913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.774 qpair failed and we were unable to recover it. 00:30:07.774 [2024-07-13 10:16:13.337037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.337158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.337182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.774 qpair failed and we were unable to recover it. 00:30:07.774 [2024-07-13 10:16:13.337327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.337467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.337491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.774 qpair failed and we were unable to recover it. 00:30:07.774 [2024-07-13 10:16:13.337643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.337792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.337816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.774 qpair failed and we were unable to recover it. 00:30:07.774 [2024-07-13 10:16:13.337964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.338086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.338111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.774 qpair failed and we were unable to recover it. 00:30:07.774 [2024-07-13 10:16:13.338255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.338398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.338422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.774 qpair failed and we were unable to recover it. 00:30:07.774 [2024-07-13 10:16:13.338538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.338683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.338707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.774 qpair failed and we were unable to recover it. 00:30:07.774 [2024-07-13 10:16:13.338852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.339003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.339028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.774 qpair failed and we were unable to recover it. 00:30:07.774 [2024-07-13 10:16:13.339202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.339330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.774 [2024-07-13 10:16:13.339356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.774 qpair failed and we were unable to recover it. 00:30:07.774 [2024-07-13 10:16:13.339551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.339702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.339726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.775 qpair failed and we were unable to recover it. 00:30:07.775 [2024-07-13 10:16:13.339891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.340049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.340073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.775 qpair failed and we were unable to recover it. 00:30:07.775 [2024-07-13 10:16:13.340190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.340340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.340364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.775 qpair failed and we were unable to recover it. 00:30:07.775 [2024-07-13 10:16:13.340501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.340648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.340672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.775 qpair failed and we were unable to recover it. 00:30:07.775 [2024-07-13 10:16:13.340816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.340993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.341018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.775 qpair failed and we were unable to recover it. 00:30:07.775 [2024-07-13 10:16:13.341202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.341327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.341352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.775 qpair failed and we were unable to recover it. 00:30:07.775 [2024-07-13 10:16:13.341499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.341614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.341638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.775 qpair failed and we were unable to recover it. 00:30:07.775 [2024-07-13 10:16:13.341772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.341916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.341941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.775 qpair failed and we were unable to recover it. 00:30:07.775 [2024-07-13 10:16:13.342099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.342249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.342273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.775 qpair failed and we were unable to recover it. 00:30:07.775 [2024-07-13 10:16:13.342432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.342579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.342604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.775 qpair failed and we were unable to recover it. 00:30:07.775 [2024-07-13 10:16:13.342720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.342894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.342918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.775 qpair failed and we were unable to recover it. 00:30:07.775 [2024-07-13 10:16:13.343090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.343241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.343265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.775 qpair failed and we were unable to recover it. 00:30:07.775 [2024-07-13 10:16:13.343414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.343566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.343590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.775 qpair failed and we were unable to recover it. 00:30:07.775 [2024-07-13 10:16:13.343703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.343878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.343903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.775 qpair failed and we were unable to recover it. 00:30:07.775 [2024-07-13 10:16:13.344050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.344174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.344198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.775 qpair failed and we were unable to recover it. 00:30:07.775 [2024-07-13 10:16:13.344352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.344479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.344504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.775 qpair failed and we were unable to recover it. 00:30:07.775 [2024-07-13 10:16:13.344622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.344795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.344820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.775 qpair failed and we were unable to recover it. 00:30:07.775 [2024-07-13 10:16:13.344969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.345134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.345159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.775 qpair failed and we were unable to recover it. 00:30:07.775 [2024-07-13 10:16:13.345338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.345479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.345503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.775 qpair failed and we were unable to recover it. 00:30:07.775 [2024-07-13 10:16:13.345627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.345802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.345826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.775 qpair failed and we were unable to recover it. 00:30:07.775 [2024-07-13 10:16:13.345952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.346079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.346103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.775 qpair failed and we were unable to recover it. 00:30:07.775 [2024-07-13 10:16:13.346229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.346385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.346409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.775 qpair failed and we were unable to recover it. 00:30:07.775 [2024-07-13 10:16:13.346558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.346708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.346731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.775 qpair failed and we were unable to recover it. 00:30:07.775 [2024-07-13 10:16:13.346887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.347034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.347058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.775 qpair failed and we were unable to recover it. 00:30:07.775 [2024-07-13 10:16:13.347213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.347364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.347388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.775 qpair failed and we were unable to recover it. 00:30:07.775 [2024-07-13 10:16:13.347543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.347684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.347708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.775 qpair failed and we were unable to recover it. 00:30:07.775 [2024-07-13 10:16:13.347836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.775 [2024-07-13 10:16:13.348030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.348055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.776 qpair failed and we were unable to recover it. 00:30:07.776 [2024-07-13 10:16:13.348200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.348319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.348343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.776 qpair failed and we were unable to recover it. 00:30:07.776 [2024-07-13 10:16:13.348492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.348635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.348659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.776 qpair failed and we were unable to recover it. 00:30:07.776 [2024-07-13 10:16:13.348787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.348937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.348963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.776 qpair failed and we were unable to recover it. 00:30:07.776 [2024-07-13 10:16:13.349083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.349205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.349229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.776 qpair failed and we were unable to recover it. 00:30:07.776 [2024-07-13 10:16:13.349378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.349497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.349527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.776 qpair failed and we were unable to recover it. 00:30:07.776 [2024-07-13 10:16:13.349646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.349792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.349816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.776 qpair failed and we were unable to recover it. 00:30:07.776 [2024-07-13 10:16:13.350060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.350176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.350200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.776 qpair failed and we were unable to recover it. 00:30:07.776 [2024-07-13 10:16:13.350357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.350535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.350559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.776 qpair failed and we were unable to recover it. 00:30:07.776 [2024-07-13 10:16:13.350689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.350858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.350890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.776 qpair failed and we were unable to recover it. 00:30:07.776 [2024-07-13 10:16:13.351065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.351183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.351207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.776 qpair failed and we were unable to recover it. 00:30:07.776 [2024-07-13 10:16:13.351391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.351533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.351557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.776 qpair failed and we were unable to recover it. 00:30:07.776 [2024-07-13 10:16:13.351694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.351823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.351847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.776 qpair failed and we were unable to recover it. 00:30:07.776 [2024-07-13 10:16:13.351982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.352172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.352196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.776 qpair failed and we were unable to recover it. 00:30:07.776 [2024-07-13 10:16:13.352382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.352512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.352536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.776 qpair failed and we were unable to recover it. 00:30:07.776 [2024-07-13 10:16:13.352713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.352909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.352935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.776 qpair failed and we were unable to recover it. 00:30:07.776 [2024-07-13 10:16:13.353092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.353247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.353271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.776 qpair failed and we were unable to recover it. 00:30:07.776 [2024-07-13 10:16:13.353392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.353556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.353583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.776 qpair failed and we were unable to recover it. 00:30:07.776 [2024-07-13 10:16:13.353782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.353921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.353948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.776 qpair failed and we were unable to recover it. 00:30:07.776 [2024-07-13 10:16:13.354124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.354283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.354333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.776 qpair failed and we were unable to recover it. 00:30:07.776 [2024-07-13 10:16:13.354533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.354654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.354678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.776 qpair failed and we were unable to recover it. 00:30:07.776 [2024-07-13 10:16:13.354834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.355009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.355037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.776 qpair failed and we were unable to recover it. 00:30:07.776 [2024-07-13 10:16:13.355222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.355341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.355381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.776 qpair failed and we were unable to recover it. 00:30:07.776 [2024-07-13 10:16:13.355513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.355655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.355682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.776 qpair failed and we were unable to recover it. 00:30:07.776 [2024-07-13 10:16:13.355844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.355999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.356025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.776 qpair failed and we were unable to recover it. 00:30:07.776 [2024-07-13 10:16:13.356196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.356341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.356380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.776 qpair failed and we were unable to recover it. 00:30:07.776 [2024-07-13 10:16:13.356574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.356733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.356761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.776 qpair failed and we were unable to recover it. 00:30:07.776 [2024-07-13 10:16:13.356953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.357085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.357112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.776 qpair failed and we were unable to recover it. 00:30:07.776 [2024-07-13 10:16:13.357284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.357405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.357430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.776 qpair failed and we were unable to recover it. 00:30:07.776 [2024-07-13 10:16:13.357577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.357709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.357736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.776 qpair failed and we were unable to recover it. 00:30:07.776 [2024-07-13 10:16:13.357883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.358044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.776 [2024-07-13 10:16:13.358072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.776 qpair failed and we were unable to recover it. 00:30:07.777 [2024-07-13 10:16:13.358246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.358441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.358468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.777 qpair failed and we were unable to recover it. 00:30:07.777 [2024-07-13 10:16:13.358600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.358763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.358790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.777 qpair failed and we were unable to recover it. 00:30:07.777 [2024-07-13 10:16:13.358957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.359103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.359128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.777 qpair failed and we were unable to recover it. 00:30:07.777 [2024-07-13 10:16:13.359272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.359414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.359454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.777 qpair failed and we were unable to recover it. 00:30:07.777 [2024-07-13 10:16:13.359625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.359775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.359799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.777 qpair failed and we were unable to recover it. 00:30:07.777 [2024-07-13 10:16:13.359978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.360141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.360169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.777 qpair failed and we were unable to recover it. 00:30:07.777 [2024-07-13 10:16:13.360343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.360471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.360511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.777 qpair failed and we were unable to recover it. 00:30:07.777 [2024-07-13 10:16:13.360674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.360873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.360900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.777 qpair failed and we were unable to recover it. 00:30:07.777 [2024-07-13 10:16:13.361038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.361238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.361265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.777 qpair failed and we were unable to recover it. 00:30:07.777 [2024-07-13 10:16:13.361435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.361557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.361583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.777 qpair failed and we were unable to recover it. 00:30:07.777 [2024-07-13 10:16:13.361789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.361952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.361980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.777 qpair failed and we were unable to recover it. 00:30:07.777 [2024-07-13 10:16:13.362148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.362357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.362381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.777 qpair failed and we were unable to recover it. 00:30:07.777 [2024-07-13 10:16:13.362506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.362653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.362677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.777 qpair failed and we were unable to recover it. 00:30:07.777 [2024-07-13 10:16:13.362847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.363048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.363072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.777 qpair failed and we were unable to recover it. 00:30:07.777 [2024-07-13 10:16:13.363195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.363340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.363364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.777 qpair failed and we were unable to recover it. 00:30:07.777 [2024-07-13 10:16:13.363534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.363678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.363718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.777 qpair failed and we were unable to recover it. 00:30:07.777 [2024-07-13 10:16:13.363886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.364040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.364067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.777 qpair failed and we were unable to recover it. 00:30:07.777 [2024-07-13 10:16:13.364230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.364368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.364395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.777 qpair failed and we were unable to recover it. 00:30:07.777 [2024-07-13 10:16:13.364567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.364768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.364795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.777 qpair failed and we were unable to recover it. 00:30:07.777 [2024-07-13 10:16:13.364965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.365128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.365155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.777 qpair failed and we were unable to recover it. 00:30:07.777 [2024-07-13 10:16:13.365327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.365547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.365592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.777 qpair failed and we were unable to recover it. 00:30:07.777 [2024-07-13 10:16:13.365792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.365961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.365989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.777 qpair failed and we were unable to recover it. 00:30:07.777 [2024-07-13 10:16:13.366136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.366294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.366321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.777 qpair failed and we were unable to recover it. 00:30:07.777 [2024-07-13 10:16:13.366511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.366699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.366726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.777 qpair failed and we were unable to recover it. 00:30:07.777 [2024-07-13 10:16:13.366898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.367014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.367038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.777 qpair failed and we were unable to recover it. 00:30:07.777 [2024-07-13 10:16:13.367247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.367433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.367482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.777 qpair failed and we were unable to recover it. 00:30:07.777 [2024-07-13 10:16:13.367651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.367830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.367854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.777 qpair failed and we were unable to recover it. 00:30:07.777 [2024-07-13 10:16:13.368000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.368120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.368144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.777 qpair failed and we were unable to recover it. 00:30:07.777 [2024-07-13 10:16:13.368292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.368472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.368504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.777 qpair failed and we were unable to recover it. 00:30:07.777 [2024-07-13 10:16:13.368697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.368833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.368858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.777 qpair failed and we were unable to recover it. 00:30:07.777 [2024-07-13 10:16:13.369025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.777 [2024-07-13 10:16:13.369144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.369178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.778 qpair failed and we were unable to recover it. 00:30:07.778 [2024-07-13 10:16:13.369352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.369502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.369526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.778 qpair failed and we were unable to recover it. 00:30:07.778 [2024-07-13 10:16:13.369682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.369809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.369834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.778 qpair failed and we were unable to recover it. 00:30:07.778 [2024-07-13 10:16:13.369968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.370124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.370148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.778 qpair failed and we were unable to recover it. 00:30:07.778 [2024-07-13 10:16:13.370303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.370437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.370464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.778 qpair failed and we were unable to recover it. 00:30:07.778 [2024-07-13 10:16:13.370616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.370783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.370814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.778 qpair failed and we were unable to recover it. 00:30:07.778 [2024-07-13 10:16:13.370991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.371135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.371186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.778 qpair failed and we were unable to recover it. 00:30:07.778 [2024-07-13 10:16:13.371316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.371478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.371505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.778 qpair failed and we were unable to recover it. 00:30:07.778 [2024-07-13 10:16:13.371669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.371829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.371856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.778 qpair failed and we were unable to recover it. 00:30:07.778 [2024-07-13 10:16:13.372007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.372149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.372178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.778 qpair failed and we were unable to recover it. 00:30:07.778 [2024-07-13 10:16:13.372380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.372505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.372530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.778 qpair failed and we were unable to recover it. 00:30:07.778 [2024-07-13 10:16:13.372684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.372878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.372906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.778 qpair failed and we were unable to recover it. 00:30:07.778 [2024-07-13 10:16:13.373039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.373192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.373231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.778 qpair failed and we were unable to recover it. 00:30:07.778 [2024-07-13 10:16:13.373391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.373547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.373574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.778 qpair failed and we were unable to recover it. 00:30:07.778 [2024-07-13 10:16:13.373766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.373962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.373990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.778 qpair failed and we were unable to recover it. 00:30:07.778 [2024-07-13 10:16:13.374159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.374308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.374332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.778 qpair failed and we were unable to recover it. 00:30:07.778 [2024-07-13 10:16:13.374488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.374659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.374685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.778 qpair failed and we were unable to recover it. 00:30:07.778 [2024-07-13 10:16:13.374877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.374999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.375024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.778 qpair failed and we were unable to recover it. 00:30:07.778 [2024-07-13 10:16:13.375176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.375376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.375403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.778 qpair failed and we were unable to recover it. 00:30:07.778 [2024-07-13 10:16:13.375558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.375746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.375774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.778 qpair failed and we were unable to recover it. 00:30:07.778 [2024-07-13 10:16:13.375993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.376125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.376152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.778 qpair failed and we were unable to recover it. 00:30:07.778 [2024-07-13 10:16:13.376298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.376440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.376464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.778 qpair failed and we were unable to recover it. 00:30:07.778 [2024-07-13 10:16:13.376607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.376779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.376803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.778 qpair failed and we were unable to recover it. 00:30:07.778 [2024-07-13 10:16:13.376944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.377082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.377109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.778 qpair failed and we were unable to recover it. 00:30:07.778 [2024-07-13 10:16:13.377313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.377433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.377475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.778 qpair failed and we were unable to recover it. 00:30:07.778 [2024-07-13 10:16:13.377628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.377813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.377840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.778 qpair failed and we were unable to recover it. 00:30:07.778 [2024-07-13 10:16:13.377996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.378162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.378190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.778 qpair failed and we were unable to recover it. 00:30:07.778 [2024-07-13 10:16:13.378362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.378509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.378549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.778 qpair failed and we were unable to recover it. 00:30:07.778 [2024-07-13 10:16:13.378748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.378907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.378950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.778 qpair failed and we were unable to recover it. 00:30:07.778 [2024-07-13 10:16:13.379120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.379297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.379323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.778 qpair failed and we were unable to recover it. 00:30:07.778 [2024-07-13 10:16:13.379462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.379587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.778 [2024-07-13 10:16:13.379612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.778 qpair failed and we were unable to recover it. 00:30:07.778 [2024-07-13 10:16:13.379791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.379953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.379980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.779 qpair failed and we were unable to recover it. 00:30:07.779 [2024-07-13 10:16:13.380117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.380283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.380310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.779 qpair failed and we were unable to recover it. 00:30:07.779 [2024-07-13 10:16:13.380490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.380661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.380686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.779 qpair failed and we were unable to recover it. 00:30:07.779 [2024-07-13 10:16:13.380834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.381028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.381056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.779 qpair failed and we were unable to recover it. 00:30:07.779 [2024-07-13 10:16:13.381189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.381378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.381405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.779 qpair failed and we were unable to recover it. 00:30:07.779 [2024-07-13 10:16:13.381601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.381728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.381752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.779 qpair failed and we were unable to recover it. 00:30:07.779 [2024-07-13 10:16:13.381926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.382132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.382158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.779 qpair failed and we were unable to recover it. 00:30:07.779 [2024-07-13 10:16:13.382297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.382441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.382466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.779 qpair failed and we were unable to recover it. 00:30:07.779 [2024-07-13 10:16:13.382617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.382767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.382791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.779 qpair failed and we were unable to recover it. 00:30:07.779 [2024-07-13 10:16:13.382968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.383134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.383161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.779 qpair failed and we were unable to recover it. 00:30:07.779 [2024-07-13 10:16:13.383305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.383450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.383474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.779 qpair failed and we were unable to recover it. 00:30:07.779 [2024-07-13 10:16:13.383625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.383769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.383810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.779 qpair failed and we were unable to recover it. 00:30:07.779 [2024-07-13 10:16:13.384017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.384138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.384187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.779 qpair failed and we were unable to recover it. 00:30:07.779 [2024-07-13 10:16:13.384334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.384520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.384547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.779 qpair failed and we were unable to recover it. 00:30:07.779 [2024-07-13 10:16:13.384712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.384883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.384908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.779 qpair failed and we were unable to recover it. 00:30:07.779 [2024-07-13 10:16:13.385060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.385214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.385238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.779 qpair failed and we were unable to recover it. 00:30:07.779 [2024-07-13 10:16:13.385423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.385575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.385599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.779 qpair failed and we were unable to recover it. 00:30:07.779 [2024-07-13 10:16:13.385789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.385944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.385969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.779 qpair failed and we were unable to recover it. 00:30:07.779 [2024-07-13 10:16:13.386109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.386225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.386250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.779 qpair failed and we were unable to recover it. 00:30:07.779 [2024-07-13 10:16:13.386408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.386551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.386578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.779 qpair failed and we were unable to recover it. 00:30:07.779 [2024-07-13 10:16:13.386747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.386897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.386938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.779 qpair failed and we were unable to recover it. 00:30:07.779 [2024-07-13 10:16:13.387107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.387299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.387344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.779 qpair failed and we were unable to recover it. 00:30:07.779 [2024-07-13 10:16:13.387530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.387728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.387753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.779 qpair failed and we were unable to recover it. 00:30:07.779 [2024-07-13 10:16:13.387903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.388073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.388100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.779 qpair failed and we were unable to recover it. 00:30:07.779 [2024-07-13 10:16:13.388303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.388447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.388492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.779 qpair failed and we were unable to recover it. 00:30:07.779 [2024-07-13 10:16:13.388676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.388830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.388858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.779 qpair failed and we were unable to recover it. 00:30:07.779 [2024-07-13 10:16:13.388986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.389160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.779 [2024-07-13 10:16:13.389184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.779 qpair failed and we were unable to recover it. 00:30:07.780 [2024-07-13 10:16:13.389379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.389594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.389639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.780 qpair failed and we were unable to recover it. 00:30:07.780 [2024-07-13 10:16:13.389785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.389938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.389966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.780 qpair failed and we were unable to recover it. 00:30:07.780 [2024-07-13 10:16:13.390130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.390277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.390317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.780 qpair failed and we were unable to recover it. 00:30:07.780 [2024-07-13 10:16:13.390474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.390660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.390687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.780 qpair failed and we were unable to recover it. 00:30:07.780 [2024-07-13 10:16:13.390852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.391036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.391061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.780 qpair failed and we were unable to recover it. 00:30:07.780 [2024-07-13 10:16:13.391215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.391364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.391405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.780 qpair failed and we were unable to recover it. 00:30:07.780 [2024-07-13 10:16:13.391564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.391693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.391719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.780 qpair failed and we were unable to recover it. 00:30:07.780 [2024-07-13 10:16:13.391893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.392016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.392040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.780 qpair failed and we were unable to recover it. 00:30:07.780 [2024-07-13 10:16:13.392187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.392306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.392330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.780 qpair failed and we were unable to recover it. 00:30:07.780 [2024-07-13 10:16:13.392488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.392638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.392662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.780 qpair failed and we were unable to recover it. 00:30:07.780 [2024-07-13 10:16:13.392837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.393008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.393033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.780 qpair failed and we were unable to recover it. 00:30:07.780 [2024-07-13 10:16:13.393183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.393362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.393388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.780 qpair failed and we were unable to recover it. 00:30:07.780 [2024-07-13 10:16:13.393547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.393715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.393742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.780 qpair failed and we were unable to recover it. 00:30:07.780 [2024-07-13 10:16:13.393877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.394026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.394052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.780 qpair failed and we were unable to recover it. 00:30:07.780 [2024-07-13 10:16:13.394227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.394379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.394403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.780 qpair failed and we were unable to recover it. 00:30:07.780 [2024-07-13 10:16:13.394582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.394753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.394777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.780 qpair failed and we were unable to recover it. 00:30:07.780 [2024-07-13 10:16:13.394931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.395087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.395113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.780 qpair failed and we were unable to recover it. 00:30:07.780 [2024-07-13 10:16:13.395279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.395402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.395426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.780 qpair failed and we were unable to recover it. 00:30:07.780 [2024-07-13 10:16:13.395549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.395695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.395722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.780 qpair failed and we were unable to recover it. 00:30:07.780 [2024-07-13 10:16:13.395903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.396052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.396076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.780 qpair failed and we were unable to recover it. 00:30:07.780 [2024-07-13 10:16:13.396242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.396366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.396392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.780 qpair failed and we were unable to recover it. 00:30:07.780 [2024-07-13 10:16:13.396555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.396734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.396758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.780 qpair failed and we were unable to recover it. 00:30:07.780 [2024-07-13 10:16:13.396909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.397050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.397077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.780 qpair failed and we were unable to recover it. 00:30:07.780 [2024-07-13 10:16:13.397242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.397398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.397422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.780 qpair failed and we were unable to recover it. 00:30:07.780 [2024-07-13 10:16:13.397591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.397751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.397780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.780 qpair failed and we were unable to recover it. 00:30:07.780 [2024-07-13 10:16:13.397950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.398125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.398148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.780 qpair failed and we were unable to recover it. 00:30:07.780 [2024-07-13 10:16:13.398310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.398457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.398480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.780 qpair failed and we were unable to recover it. 00:30:07.780 [2024-07-13 10:16:13.398630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.398777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.398803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.780 qpair failed and we were unable to recover it. 00:30:07.780 [2024-07-13 10:16:13.399000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.399168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.399195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.780 qpair failed and we were unable to recover it. 00:30:07.780 [2024-07-13 10:16:13.399376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.399521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.399545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.780 qpair failed and we were unable to recover it. 00:30:07.780 [2024-07-13 10:16:13.399687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.780 [2024-07-13 10:16:13.399821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.399848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.781 qpair failed and we were unable to recover it. 00:30:07.781 [2024-07-13 10:16:13.399990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.400128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.400156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.781 qpair failed and we were unable to recover it. 00:30:07.781 [2024-07-13 10:16:13.400323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.400514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.400544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.781 qpair failed and we were unable to recover it. 00:30:07.781 [2024-07-13 10:16:13.400703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.400888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.400916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.781 qpair failed and we were unable to recover it. 00:30:07.781 [2024-07-13 10:16:13.401081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.401272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.401326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.781 qpair failed and we were unable to recover it. 00:30:07.781 [2024-07-13 10:16:13.401493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.401614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.401639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.781 qpair failed and we were unable to recover it. 00:30:07.781 [2024-07-13 10:16:13.401851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.402007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.402048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.781 qpair failed and we were unable to recover it. 00:30:07.781 [2024-07-13 10:16:13.402228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.402366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.402393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.781 qpair failed and we were unable to recover it. 00:30:07.781 [2024-07-13 10:16:13.402592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.402785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.402812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.781 qpair failed and we were unable to recover it. 00:30:07.781 [2024-07-13 10:16:13.402991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.403200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.403225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.781 qpair failed and we were unable to recover it. 00:30:07.781 [2024-07-13 10:16:13.403350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.403545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.403576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.781 qpair failed and we were unable to recover it. 00:30:07.781 [2024-07-13 10:16:13.403764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.403913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.403956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.781 qpair failed and we were unable to recover it. 00:30:07.781 [2024-07-13 10:16:13.404117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.404283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.404311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.781 qpair failed and we were unable to recover it. 00:30:07.781 [2024-07-13 10:16:13.404514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.404666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.404689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.781 qpair failed and we were unable to recover it. 00:30:07.781 [2024-07-13 10:16:13.404903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.405097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.405124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.781 qpair failed and we were unable to recover it. 00:30:07.781 [2024-07-13 10:16:13.405288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.405464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.405495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.781 qpair failed and we were unable to recover it. 00:30:07.781 [2024-07-13 10:16:13.405702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.405892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.405919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.781 qpair failed and we were unable to recover it. 00:30:07.781 [2024-07-13 10:16:13.406119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.406245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.406287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.781 qpair failed and we were unable to recover it. 00:30:07.781 [2024-07-13 10:16:13.406481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.406605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.406629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.781 qpair failed and we were unable to recover it. 00:30:07.781 [2024-07-13 10:16:13.406804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.406980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.407012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.781 qpair failed and we were unable to recover it. 00:30:07.781 [2024-07-13 10:16:13.407178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.407320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.407344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.781 qpair failed and we were unable to recover it. 00:30:07.781 [2024-07-13 10:16:13.407561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.407736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.407775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.781 qpair failed and we were unable to recover it. 00:30:07.781 [2024-07-13 10:16:13.407968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.408130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.408160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.781 qpair failed and we were unable to recover it. 00:30:07.781 [2024-07-13 10:16:13.408335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.408500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.408524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.781 qpair failed and we were unable to recover it. 00:30:07.781 [2024-07-13 10:16:13.408704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.408890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.408918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.781 qpair failed and we were unable to recover it. 00:30:07.781 [2024-07-13 10:16:13.409090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.409215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.409239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.781 qpair failed and we were unable to recover it. 00:30:07.781 [2024-07-13 10:16:13.409361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.409509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.409532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.781 qpair failed and we were unable to recover it. 00:30:07.781 [2024-07-13 10:16:13.409740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.409933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.409960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.781 qpair failed and we were unable to recover it. 00:30:07.781 [2024-07-13 10:16:13.410148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.410335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.410362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.781 qpair failed and we were unable to recover it. 00:30:07.781 [2024-07-13 10:16:13.410509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.410626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.410650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.781 qpair failed and we were unable to recover it. 00:30:07.781 [2024-07-13 10:16:13.410772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.410919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.781 [2024-07-13 10:16:13.410943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.781 qpair failed and we were unable to recover it. 00:30:07.782 [2024-07-13 10:16:13.411105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.411292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.411316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.782 qpair failed and we were unable to recover it. 00:30:07.782 [2024-07-13 10:16:13.411493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.411662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.411689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.782 qpair failed and we were unable to recover it. 00:30:07.782 [2024-07-13 10:16:13.411826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.412002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.412027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.782 qpair failed and we were unable to recover it. 00:30:07.782 [2024-07-13 10:16:13.412207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.412382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.412408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.782 qpair failed and we were unable to recover it. 00:30:07.782 [2024-07-13 10:16:13.412576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.412703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.412727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.782 qpair failed and we were unable to recover it. 00:30:07.782 [2024-07-13 10:16:13.412850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.412995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.413020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.782 qpair failed and we were unable to recover it. 00:30:07.782 [2024-07-13 10:16:13.413196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.413356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.413387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.782 qpair failed and we were unable to recover it. 00:30:07.782 [2024-07-13 10:16:13.413568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.413716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.413758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.782 qpair failed and we were unable to recover it. 00:30:07.782 [2024-07-13 10:16:13.413967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.414115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.414139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.782 qpair failed and we were unable to recover it. 00:30:07.782 [2024-07-13 10:16:13.414326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.414469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.414495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.782 qpair failed and we were unable to recover it. 00:30:07.782 [2024-07-13 10:16:13.414689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.414837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.414861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.782 qpair failed and we were unable to recover it. 00:30:07.782 [2024-07-13 10:16:13.415020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.415165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.415192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.782 qpair failed and we were unable to recover it. 00:30:07.782 [2024-07-13 10:16:13.415391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.415541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.415564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.782 qpair failed and we were unable to recover it. 00:30:07.782 [2024-07-13 10:16:13.415782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.415929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.415956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.782 qpair failed and we were unable to recover it. 00:30:07.782 [2024-07-13 10:16:13.416119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.416274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.416300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.782 qpair failed and we were unable to recover it. 00:30:07.782 [2024-07-13 10:16:13.416466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.416663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.416687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.782 qpair failed and we were unable to recover it. 00:30:07.782 [2024-07-13 10:16:13.416837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.417032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.417060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.782 qpair failed and we were unable to recover it. 00:30:07.782 [2024-07-13 10:16:13.417232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.417405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.417431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.782 qpair failed and we were unable to recover it. 00:30:07.782 [2024-07-13 10:16:13.417586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.417787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.417813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.782 qpair failed and we were unable to recover it. 00:30:07.782 [2024-07-13 10:16:13.417964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.418085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.418109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.782 qpair failed and we were unable to recover it. 00:30:07.782 [2024-07-13 10:16:13.418311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.418503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.418547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.782 qpair failed and we were unable to recover it. 00:30:07.782 [2024-07-13 10:16:13.418690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.418842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.418888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.782 qpair failed and we were unable to recover it. 00:30:07.782 [2024-07-13 10:16:13.419087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.419271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.419320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.782 qpair failed and we were unable to recover it. 00:30:07.782 [2024-07-13 10:16:13.419474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.419666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.419693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.782 qpair failed and we were unable to recover it. 00:30:07.782 [2024-07-13 10:16:13.419890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.420032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.420059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.782 qpair failed and we were unable to recover it. 00:30:07.782 [2024-07-13 10:16:13.420231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.420422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.420449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.782 qpair failed and we were unable to recover it. 00:30:07.782 [2024-07-13 10:16:13.420641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.420814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.420855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.782 qpair failed and we were unable to recover it. 00:30:07.782 [2024-07-13 10:16:13.421050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.421223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.421247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.782 qpair failed and we were unable to recover it. 00:30:07.782 [2024-07-13 10:16:13.421401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.421566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.421593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.782 qpair failed and we were unable to recover it. 00:30:07.782 [2024-07-13 10:16:13.421756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.421932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.421960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.782 qpair failed and we were unable to recover it. 00:30:07.782 [2024-07-13 10:16:13.422094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.422258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.782 [2024-07-13 10:16:13.422284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.783 qpair failed and we were unable to recover it. 00:30:07.783 [2024-07-13 10:16:13.422461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.422661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.422688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.783 qpair failed and we were unable to recover it. 00:30:07.783 [2024-07-13 10:16:13.422844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.423027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.423056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.783 qpair failed and we were unable to recover it. 00:30:07.783 [2024-07-13 10:16:13.423238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.423405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.423430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.783 qpair failed and we were unable to recover it. 00:30:07.783 [2024-07-13 10:16:13.423633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.423803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.423830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.783 qpair failed and we were unable to recover it. 00:30:07.783 [2024-07-13 10:16:13.424012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.424217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.424266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.783 qpair failed and we were unable to recover it. 00:30:07.783 [2024-07-13 10:16:13.424471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.424622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.424645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.783 qpair failed and we were unable to recover it. 00:30:07.783 [2024-07-13 10:16:13.424794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.424964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.424991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.783 qpair failed and we were unable to recover it. 00:30:07.783 [2024-07-13 10:16:13.425157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.425321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.425348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.783 qpair failed and we were unable to recover it. 00:30:07.783 [2024-07-13 10:16:13.425478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.425668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.425699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.783 qpair failed and we were unable to recover it. 00:30:07.783 [2024-07-13 10:16:13.425878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.426055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.426079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.783 qpair failed and we were unable to recover it. 00:30:07.783 [2024-07-13 10:16:13.426292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.426492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.426516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.783 qpair failed and we were unable to recover it. 00:30:07.783 [2024-07-13 10:16:13.426665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.426819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.426843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.783 qpair failed and we were unable to recover it. 00:30:07.783 [2024-07-13 10:16:13.427000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.427195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.427243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.783 qpair failed and we were unable to recover it. 00:30:07.783 [2024-07-13 10:16:13.427388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.427522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.427550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.783 qpair failed and we were unable to recover it. 00:30:07.783 [2024-07-13 10:16:13.427721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.427892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.427919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.783 qpair failed and we were unable to recover it. 00:30:07.783 [2024-07-13 10:16:13.428066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.428215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.428239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.783 qpair failed and we were unable to recover it. 00:30:07.783 [2024-07-13 10:16:13.428433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.428597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.428625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.783 qpair failed and we were unable to recover it. 00:30:07.783 [2024-07-13 10:16:13.428758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.428929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.428958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.783 qpair failed and we were unable to recover it. 00:30:07.783 [2024-07-13 10:16:13.429105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.429260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.429302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.783 qpair failed and we were unable to recover it. 00:30:07.783 [2024-07-13 10:16:13.429438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.429602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.429630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.783 qpair failed and we were unable to recover it. 00:30:07.783 [2024-07-13 10:16:13.429800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.430074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.430100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.783 qpair failed and we were unable to recover it. 00:30:07.783 [2024-07-13 10:16:13.430235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.430389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.430429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.783 qpair failed and we were unable to recover it. 00:30:07.783 [2024-07-13 10:16:13.430596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.430783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.430810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.783 qpair failed and we were unable to recover it. 00:30:07.783 [2024-07-13 10:16:13.430985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.431155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.431182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.783 qpair failed and we were unable to recover it. 00:30:07.783 [2024-07-13 10:16:13.431344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.431489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.431513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.783 qpair failed and we were unable to recover it. 00:30:07.783 [2024-07-13 10:16:13.431694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.431870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.431895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.783 qpair failed and we were unable to recover it. 00:30:07.783 [2024-07-13 10:16:13.432091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.432259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.432283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.783 qpair failed and we were unable to recover it. 00:30:07.783 [2024-07-13 10:16:13.432429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.432549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.432573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.783 qpair failed and we were unable to recover it. 00:30:07.783 [2024-07-13 10:16:13.432717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.432894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.432923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.783 qpair failed and we were unable to recover it. 00:30:07.783 [2024-07-13 10:16:13.433096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.433260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.783 [2024-07-13 10:16:13.433287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.783 qpair failed and we were unable to recover it. 00:30:07.783 [2024-07-13 10:16:13.433467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.433592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.433618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.784 qpair failed and we were unable to recover it. 00:30:07.784 [2024-07-13 10:16:13.433780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.433970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.433998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.784 qpair failed and we were unable to recover it. 00:30:07.784 [2024-07-13 10:16:13.434195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.434345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.434369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.784 qpair failed and we were unable to recover it. 00:30:07.784 [2024-07-13 10:16:13.434528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.434640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.434665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.784 qpair failed and we were unable to recover it. 00:30:07.784 [2024-07-13 10:16:13.434837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.435007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.435034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.784 qpair failed and we were unable to recover it. 00:30:07.784 [2024-07-13 10:16:13.435196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.435327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.435353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.784 qpair failed and we were unable to recover it. 00:30:07.784 [2024-07-13 10:16:13.435551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.435699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.435723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.784 qpair failed and we were unable to recover it. 00:30:07.784 [2024-07-13 10:16:13.435845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.435998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.436023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.784 qpair failed and we were unable to recover it. 00:30:07.784 [2024-07-13 10:16:13.436182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.436358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.436396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.784 qpair failed and we were unable to recover it. 00:30:07.784 [2024-07-13 10:16:13.436570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.436743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.436786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.784 qpair failed and we were unable to recover it. 00:30:07.784 [2024-07-13 10:16:13.436927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.437084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.437112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.784 qpair failed and we were unable to recover it. 00:30:07.784 [2024-07-13 10:16:13.437307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.437464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.437499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.784 qpair failed and we were unable to recover it. 00:30:07.784 [2024-07-13 10:16:13.437683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.437859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.437888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.784 qpair failed and we were unable to recover it. 00:30:07.784 [2024-07-13 10:16:13.438115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.438245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.438269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.784 qpair failed and we were unable to recover it. 00:30:07.784 [2024-07-13 10:16:13.438395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.438540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.438564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.784 qpair failed and we were unable to recover it. 00:30:07.784 [2024-07-13 10:16:13.438713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.438917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.438945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.784 qpair failed and we were unable to recover it. 00:30:07.784 [2024-07-13 10:16:13.439145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.439318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.439342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.784 qpair failed and we were unable to recover it. 00:30:07.784 [2024-07-13 10:16:13.439507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.439680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.439709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.784 qpair failed and we were unable to recover it. 00:30:07.784 [2024-07-13 10:16:13.439848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.440001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.440025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.784 qpair failed and we were unable to recover it. 00:30:07.784 [2024-07-13 10:16:13.440222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.440379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.440403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.784 qpair failed and we were unable to recover it. 00:30:07.784 [2024-07-13 10:16:13.440561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.440714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.440738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.784 qpair failed and we were unable to recover it. 00:30:07.784 [2024-07-13 10:16:13.440961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.441131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.441158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.784 qpair failed and we were unable to recover it. 00:30:07.784 [2024-07-13 10:16:13.441329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.441543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.441591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.784 qpair failed and we were unable to recover it. 00:30:07.784 [2024-07-13 10:16:13.441758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.441950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.441978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.784 qpair failed and we were unable to recover it. 00:30:07.784 [2024-07-13 10:16:13.442171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.442292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.442332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.784 qpair failed and we were unable to recover it. 00:30:07.784 [2024-07-13 10:16:13.442524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.442674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.442697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.784 qpair failed and we were unable to recover it. 00:30:07.784 [2024-07-13 10:16:13.442872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.443036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.784 [2024-07-13 10:16:13.443063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.784 qpair failed and we were unable to recover it. 00:30:07.785 [2024-07-13 10:16:13.443211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.443357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.443380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.785 qpair failed and we were unable to recover it. 00:30:07.785 [2024-07-13 10:16:13.443589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.443763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.443787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.785 qpair failed and we were unable to recover it. 00:30:07.785 [2024-07-13 10:16:13.443906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.444027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.444051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.785 qpair failed and we were unable to recover it. 00:30:07.785 [2024-07-13 10:16:13.444246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.444380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.444406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.785 qpair failed and we were unable to recover it. 00:30:07.785 [2024-07-13 10:16:13.444584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.444705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.444728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.785 qpair failed and we were unable to recover it. 00:30:07.785 [2024-07-13 10:16:13.444903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.445032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.445056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.785 qpair failed and we were unable to recover it. 00:30:07.785 [2024-07-13 10:16:13.445239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.445382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.445421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.785 qpair failed and we were unable to recover it. 00:30:07.785 [2024-07-13 10:16:13.445554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.445714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.445740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.785 qpair failed and we were unable to recover it. 00:30:07.785 [2024-07-13 10:16:13.445900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.446063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.446090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.785 qpair failed and we were unable to recover it. 00:30:07.785 [2024-07-13 10:16:13.446269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.446392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.446432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.785 qpair failed and we were unable to recover it. 00:30:07.785 [2024-07-13 10:16:13.446564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.446704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.446730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.785 qpair failed and we were unable to recover it. 00:30:07.785 [2024-07-13 10:16:13.446860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.447003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.447030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.785 qpair failed and we were unable to recover it. 00:30:07.785 [2024-07-13 10:16:13.447164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.447311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.447339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.785 qpair failed and we were unable to recover it. 00:30:07.785 [2024-07-13 10:16:13.447523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.447650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.447673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.785 qpair failed and we were unable to recover it. 00:30:07.785 [2024-07-13 10:16:13.447851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.448025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.448049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.785 qpair failed and we were unable to recover it. 00:30:07.785 [2024-07-13 10:16:13.448168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.448317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.448341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.785 qpair failed and we were unable to recover it. 00:30:07.785 [2024-07-13 10:16:13.448537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.448710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.448737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.785 qpair failed and we were unable to recover it. 00:30:07.785 [2024-07-13 10:16:13.448897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.449023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.449049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.785 qpair failed and we were unable to recover it. 00:30:07.785 [2024-07-13 10:16:13.449218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.449374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.449415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.785 qpair failed and we were unable to recover it. 00:30:07.785 [2024-07-13 10:16:13.449587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.449760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.449801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.785 qpair failed and we were unable to recover it. 00:30:07.785 [2024-07-13 10:16:13.449969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.450106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.450133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.785 qpair failed and we were unable to recover it. 00:30:07.785 [2024-07-13 10:16:13.450329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.450484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.450509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.785 qpair failed and we were unable to recover it. 00:30:07.785 [2024-07-13 10:16:13.450638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.450763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.450787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.785 qpair failed and we were unable to recover it. 00:30:07.785 [2024-07-13 10:16:13.450968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.451119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.451145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.785 qpair failed and we were unable to recover it. 00:30:07.785 [2024-07-13 10:16:13.451292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.451415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.451440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.785 qpair failed and we were unable to recover it. 00:30:07.785 [2024-07-13 10:16:13.451614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.451816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.451840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.785 qpair failed and we were unable to recover it. 00:30:07.785 [2024-07-13 10:16:13.452046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.452271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.452320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.785 qpair failed and we were unable to recover it. 00:30:07.785 [2024-07-13 10:16:13.452500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.452624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.452647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.785 qpair failed and we were unable to recover it. 00:30:07.785 [2024-07-13 10:16:13.452852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.453015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.453043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.785 qpair failed and we were unable to recover it. 00:30:07.785 [2024-07-13 10:16:13.453208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.453376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.453402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.785 qpair failed and we were unable to recover it. 00:30:07.785 [2024-07-13 10:16:13.453580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.785 [2024-07-13 10:16:13.453734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.453758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.786 qpair failed and we were unable to recover it. 00:30:07.786 [2024-07-13 10:16:13.453946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.454120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.454144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.786 qpair failed and we were unable to recover it. 00:30:07.786 [2024-07-13 10:16:13.454314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.454531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.454591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.786 qpair failed and we were unable to recover it. 00:30:07.786 [2024-07-13 10:16:13.454767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.454943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.454984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.786 qpair failed and we were unable to recover it. 00:30:07.786 [2024-07-13 10:16:13.455150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.455350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.455401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.786 qpair failed and we were unable to recover it. 00:30:07.786 [2024-07-13 10:16:13.455579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.455702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.455725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.786 qpair failed and we were unable to recover it. 00:30:07.786 [2024-07-13 10:16:13.455847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.456043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.456071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.786 qpair failed and we were unable to recover it. 00:30:07.786 [2024-07-13 10:16:13.456257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.456431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.456474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.786 qpair failed and we were unable to recover it. 00:30:07.786 [2024-07-13 10:16:13.456609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.456742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.456768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.786 qpair failed and we were unable to recover it. 00:30:07.786 [2024-07-13 10:16:13.456918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.457033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.457057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.786 qpair failed and we were unable to recover it. 00:30:07.786 [2024-07-13 10:16:13.457180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.457375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.457402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.786 qpair failed and we were unable to recover it. 00:30:07.786 [2024-07-13 10:16:13.457564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.457697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.457723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.786 qpair failed and we were unable to recover it. 00:30:07.786 [2024-07-13 10:16:13.457891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.458098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.458148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.786 qpair failed and we were unable to recover it. 00:30:07.786 [2024-07-13 10:16:13.458318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.458479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.458505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.786 qpair failed and we were unable to recover it. 00:30:07.786 [2024-07-13 10:16:13.458688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.458850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.458883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.786 qpair failed and we were unable to recover it. 00:30:07.786 [2024-07-13 10:16:13.459034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.459182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.459205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.786 qpair failed and we were unable to recover it. 00:30:07.786 [2024-07-13 10:16:13.459345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.459529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.459555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.786 qpair failed and we were unable to recover it. 00:30:07.786 [2024-07-13 10:16:13.459754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.459904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.459944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.786 qpair failed and we were unable to recover it. 00:30:07.786 [2024-07-13 10:16:13.460143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.460268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.460308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.786 qpair failed and we were unable to recover it. 00:30:07.786 [2024-07-13 10:16:13.460461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.460649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.460675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.786 qpair failed and we were unable to recover it. 00:30:07.786 [2024-07-13 10:16:13.460809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.461003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.461030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.786 qpair failed and we were unable to recover it. 00:30:07.786 [2024-07-13 10:16:13.461172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.461322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.461345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.786 qpair failed and we were unable to recover it. 00:30:07.786 [2024-07-13 10:16:13.461537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.461701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.461727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.786 qpair failed and we were unable to recover it. 00:30:07.786 [2024-07-13 10:16:13.461888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.462071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.462098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.786 qpair failed and we were unable to recover it. 00:30:07.786 [2024-07-13 10:16:13.462264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.462395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.462418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.786 qpair failed and we were unable to recover it. 00:30:07.786 [2024-07-13 10:16:13.462566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.462712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.462738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.786 qpair failed and we were unable to recover it. 00:30:07.786 [2024-07-13 10:16:13.462916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.463090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.463115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.786 qpair failed and we were unable to recover it. 00:30:07.786 [2024-07-13 10:16:13.463289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.463484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.463510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.786 qpair failed and we were unable to recover it. 00:30:07.786 [2024-07-13 10:16:13.463663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.463828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.463852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.786 qpair failed and we were unable to recover it. 00:30:07.786 [2024-07-13 10:16:13.464017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.464177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.464204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.786 qpair failed and we were unable to recover it. 00:30:07.786 [2024-07-13 10:16:13.464404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.464530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.786 [2024-07-13 10:16:13.464553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.786 qpair failed and we were unable to recover it. 00:30:07.786 [2024-07-13 10:16:13.464701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.464853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.464881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.787 qpair failed and we were unable to recover it. 00:30:07.787 [2024-07-13 10:16:13.465052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.465210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.465270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.787 qpair failed and we were unable to recover it. 00:30:07.787 [2024-07-13 10:16:13.465445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.465593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.465636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.787 qpair failed and we were unable to recover it. 00:30:07.787 [2024-07-13 10:16:13.465826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.466007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.466034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.787 qpair failed and we were unable to recover it. 00:30:07.787 [2024-07-13 10:16:13.466235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.466375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.466398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.787 qpair failed and we were unable to recover it. 00:30:07.787 [2024-07-13 10:16:13.466543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.466717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.466742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.787 qpair failed and we were unable to recover it. 00:30:07.787 [2024-07-13 10:16:13.466892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.467043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.467070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.787 qpair failed and we were unable to recover it. 00:30:07.787 [2024-07-13 10:16:13.467211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.467372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.467399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.787 qpair failed and we were unable to recover it. 00:30:07.787 [2024-07-13 10:16:13.467597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.467722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.467746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.787 qpair failed and we were unable to recover it. 00:30:07.787 [2024-07-13 10:16:13.467901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.468054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.468080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.787 qpair failed and we were unable to recover it. 00:30:07.787 [2024-07-13 10:16:13.468217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.468352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.468380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.787 qpair failed and we were unable to recover it. 00:30:07.787 [2024-07-13 10:16:13.468559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.468675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.468699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.787 qpair failed and we were unable to recover it. 00:30:07.787 [2024-07-13 10:16:13.468914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.469031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.469054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.787 qpair failed and we were unable to recover it. 00:30:07.787 [2024-07-13 10:16:13.469187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.469335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.469358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.787 qpair failed and we were unable to recover it. 00:30:07.787 [2024-07-13 10:16:13.469506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.469683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.469710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.787 qpair failed and we were unable to recover it. 00:30:07.787 [2024-07-13 10:16:13.469877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.470040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.470067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.787 qpair failed and we were unable to recover it. 00:30:07.787 [2024-07-13 10:16:13.470206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.470334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.470360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.787 qpair failed and we were unable to recover it. 00:30:07.787 [2024-07-13 10:16:13.470507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.470682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.470706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.787 qpair failed and we were unable to recover it. 00:30:07.787 [2024-07-13 10:16:13.470888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.471013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.471037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.787 qpair failed and we were unable to recover it. 00:30:07.787 [2024-07-13 10:16:13.471184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.471307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.471331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.787 qpair failed and we were unable to recover it. 00:30:07.787 [2024-07-13 10:16:13.471515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.471641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.471664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.787 qpair failed and we were unable to recover it. 00:30:07.787 [2024-07-13 10:16:13.471871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.472000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.472026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.787 qpair failed and we were unable to recover it. 00:30:07.787 [2024-07-13 10:16:13.472156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.472331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.472355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.787 qpair failed and we were unable to recover it. 00:30:07.787 [2024-07-13 10:16:13.472480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.472656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.472699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.787 qpair failed and we were unable to recover it. 00:30:07.787 [2024-07-13 10:16:13.472872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.473059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.473086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.787 qpair failed and we were unable to recover it. 00:30:07.787 [2024-07-13 10:16:13.473254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.473394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.473423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.787 qpair failed and we were unable to recover it. 00:30:07.787 [2024-07-13 10:16:13.473626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.473780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.473817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.787 qpair failed and we were unable to recover it. 00:30:07.787 [2024-07-13 10:16:13.474040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.474195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.474255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.787 qpair failed and we were unable to recover it. 00:30:07.787 [2024-07-13 10:16:13.474390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.474556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.474582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.787 qpair failed and we were unable to recover it. 00:30:07.787 [2024-07-13 10:16:13.474737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.474912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.474955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.787 qpair failed and we were unable to recover it. 00:30:07.787 [2024-07-13 10:16:13.475126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.475250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.787 [2024-07-13 10:16:13.475274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.787 qpair failed and we were unable to recover it. 00:30:07.788 [2024-07-13 10:16:13.475478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.475617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.475644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.788 qpair failed and we were unable to recover it. 00:30:07.788 [2024-07-13 10:16:13.475784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.475946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.475972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.788 qpair failed and we were unable to recover it. 00:30:07.788 [2024-07-13 10:16:13.476123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.476244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.476268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.788 qpair failed and we were unable to recover it. 00:30:07.788 [2024-07-13 10:16:13.476417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.476577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.476605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.788 qpair failed and we were unable to recover it. 00:30:07.788 [2024-07-13 10:16:13.476804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.476932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.476973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.788 qpair failed and we were unable to recover it. 00:30:07.788 [2024-07-13 10:16:13.477155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.477298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.477329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.788 qpair failed and we were unable to recover it. 00:30:07.788 [2024-07-13 10:16:13.477516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.477691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.477719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.788 qpair failed and we were unable to recover it. 00:30:07.788 [2024-07-13 10:16:13.477874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.478011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.478037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.788 qpair failed and we were unable to recover it. 00:30:07.788 [2024-07-13 10:16:13.478206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.478333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.478360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.788 qpair failed and we were unable to recover it. 00:30:07.788 [2024-07-13 10:16:13.478532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.478690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.478718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.788 qpair failed and we were unable to recover it. 00:30:07.788 [2024-07-13 10:16:13.478892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.479017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.479040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.788 qpair failed and we were unable to recover it. 00:30:07.788 [2024-07-13 10:16:13.479236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.479399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.479445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.788 qpair failed and we were unable to recover it. 00:30:07.788 [2024-07-13 10:16:13.479625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.479762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.479789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.788 qpair failed and we were unable to recover it. 00:30:07.788 [2024-07-13 10:16:13.479937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.480055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.480079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.788 qpair failed and we were unable to recover it. 00:30:07.788 [2024-07-13 10:16:13.480282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.480479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.480531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.788 qpair failed and we were unable to recover it. 00:30:07.788 [2024-07-13 10:16:13.480692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.480884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.480914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.788 qpair failed and we were unable to recover it. 00:30:07.788 [2024-07-13 10:16:13.481092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.481241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.481264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.788 qpair failed and we were unable to recover it. 00:30:07.788 [2024-07-13 10:16:13.481466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.481609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.481637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.788 qpair failed and we were unable to recover it. 00:30:07.788 [2024-07-13 10:16:13.481840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.481998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.482026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.788 qpair failed and we were unable to recover it. 00:30:07.788 [2024-07-13 10:16:13.482170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.482285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.482309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.788 qpair failed and we were unable to recover it. 00:30:07.788 [2024-07-13 10:16:13.482512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.482661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.482686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.788 qpair failed and we were unable to recover it. 00:30:07.788 [2024-07-13 10:16:13.482912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.483059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.483083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.788 qpair failed and we were unable to recover it. 00:30:07.788 [2024-07-13 10:16:13.483274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.483420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.483466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.788 qpair failed and we were unable to recover it. 00:30:07.788 [2024-07-13 10:16:13.483654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.483817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.483844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.788 qpair failed and we were unable to recover it. 00:30:07.788 [2024-07-13 10:16:13.483981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.484106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.484133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.788 qpair failed and we were unable to recover it. 00:30:07.788 [2024-07-13 10:16:13.484300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.484429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.484452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.788 qpair failed and we were unable to recover it. 00:30:07.788 [2024-07-13 10:16:13.484592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.484713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.788 [2024-07-13 10:16:13.484736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.789 qpair failed and we were unable to recover it. 00:30:07.789 [2024-07-13 10:16:13.484911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.485050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.485077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.789 qpair failed and we were unable to recover it. 00:30:07.789 [2024-07-13 10:16:13.485279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.485428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.485455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.789 qpair failed and we were unable to recover it. 00:30:07.789 [2024-07-13 10:16:13.485645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.485775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.485801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.789 qpair failed and we were unable to recover it. 00:30:07.789 [2024-07-13 10:16:13.485942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.486103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.486130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.789 qpair failed and we were unable to recover it. 00:30:07.789 [2024-07-13 10:16:13.486330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.486503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.486549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.789 qpair failed and we were unable to recover it. 00:30:07.789 [2024-07-13 10:16:13.486705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.486894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.486922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.789 qpair failed and we were unable to recover it. 00:30:07.789 [2024-07-13 10:16:13.487090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.487259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.487285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.789 qpair failed and we were unable to recover it. 00:30:07.789 [2024-07-13 10:16:13.487436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.487579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.487603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.789 qpair failed and we were unable to recover it. 00:30:07.789 [2024-07-13 10:16:13.487731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.487918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.487942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.789 qpair failed and we were unable to recover it. 00:30:07.789 [2024-07-13 10:16:13.488089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.488229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.488255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.789 qpair failed and we were unable to recover it. 00:30:07.789 [2024-07-13 10:16:13.488431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.488579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.488619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.789 qpair failed and we were unable to recover it. 00:30:07.789 [2024-07-13 10:16:13.488815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.489001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.489029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.789 qpair failed and we were unable to recover it. 00:30:07.789 [2024-07-13 10:16:13.489169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.489366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.489390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.789 qpair failed and we were unable to recover it. 00:30:07.789 [2024-07-13 10:16:13.489516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.489663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.489686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.789 qpair failed and we were unable to recover it. 00:30:07.789 [2024-07-13 10:16:13.489815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.489986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.490014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.789 qpair failed and we were unable to recover it. 00:30:07.789 [2024-07-13 10:16:13.490175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.490315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.490341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.789 qpair failed and we were unable to recover it. 00:30:07.789 [2024-07-13 10:16:13.490516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.490676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.490716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.789 qpair failed and we were unable to recover it. 00:30:07.789 [2024-07-13 10:16:13.490876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.491049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.491073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.789 qpair failed and we were unable to recover it. 00:30:07.789 [2024-07-13 10:16:13.491284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.491440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.491467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.789 qpair failed and we were unable to recover it. 00:30:07.789 [2024-07-13 10:16:13.491631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.491754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.491778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.789 qpair failed and we were unable to recover it. 00:30:07.789 [2024-07-13 10:16:13.491931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.492110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.492137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.789 qpair failed and we were unable to recover it. 00:30:07.789 [2024-07-13 10:16:13.492299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.492511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.492559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.789 qpair failed and we were unable to recover it. 00:30:07.789 [2024-07-13 10:16:13.492706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.492857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.492888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.789 qpair failed and we were unable to recover it. 00:30:07.789 [2024-07-13 10:16:13.493055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.493213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.493239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.789 qpair failed and we were unable to recover it. 00:30:07.789 [2024-07-13 10:16:13.493436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.493551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.493575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.789 qpair failed and we were unable to recover it. 00:30:07.789 [2024-07-13 10:16:13.493701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.493858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.493886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.789 qpair failed and we were unable to recover it. 00:30:07.789 [2024-07-13 10:16:13.494085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.494330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.494377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.789 qpair failed and we were unable to recover it. 00:30:07.789 [2024-07-13 10:16:13.494553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.494728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.494752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.789 qpair failed and we were unable to recover it. 00:30:07.789 [2024-07-13 10:16:13.494888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.495084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.495111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.789 qpair failed and we were unable to recover it. 00:30:07.789 [2024-07-13 10:16:13.495274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.495439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.495463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.789 qpair failed and we were unable to recover it. 00:30:07.789 [2024-07-13 10:16:13.495614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.789 [2024-07-13 10:16:13.495804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.495828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.790 qpair failed and we were unable to recover it. 00:30:07.790 [2024-07-13 10:16:13.495951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.496124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.496166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.790 qpair failed and we were unable to recover it. 00:30:07.790 [2024-07-13 10:16:13.496299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.496487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.496514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.790 qpair failed and we were unable to recover it. 00:30:07.790 [2024-07-13 10:16:13.496643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.496831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.496858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.790 qpair failed and we were unable to recover it. 00:30:07.790 [2024-07-13 10:16:13.497036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.497156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.497181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.790 qpair failed and we were unable to recover it. 00:30:07.790 [2024-07-13 10:16:13.497363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.497526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.497550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.790 qpair failed and we were unable to recover it. 00:30:07.790 [2024-07-13 10:16:13.497699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.497941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.497969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.790 qpair failed and we were unable to recover it. 00:30:07.790 [2024-07-13 10:16:13.498123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.498266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.498290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.790 qpair failed and we were unable to recover it. 00:30:07.790 [2024-07-13 10:16:13.498464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.498644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.498668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.790 qpair failed and we were unable to recover it. 00:30:07.790 [2024-07-13 10:16:13.498820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.498944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.498969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.790 qpair failed and we were unable to recover it. 00:30:07.790 [2024-07-13 10:16:13.499120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.499268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.499308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.790 qpair failed and we were unable to recover it. 00:30:07.790 [2024-07-13 10:16:13.499463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.499653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.499679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.790 qpair failed and we were unable to recover it. 00:30:07.790 [2024-07-13 10:16:13.499843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.499981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.500008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.790 qpair failed and we were unable to recover it. 00:30:07.790 [2024-07-13 10:16:13.500182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.500328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.500353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.790 qpair failed and we were unable to recover it. 00:30:07.790 [2024-07-13 10:16:13.500544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.500689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.500713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.790 qpair failed and we were unable to recover it. 00:30:07.790 [2024-07-13 10:16:13.500887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.501054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.501078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.790 qpair failed and we were unable to recover it. 00:30:07.790 [2024-07-13 10:16:13.501228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.501374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.501419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.790 qpair failed and we were unable to recover it. 00:30:07.790 [2024-07-13 10:16:13.501554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.501718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.501744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.790 qpair failed and we were unable to recover it. 00:30:07.790 [2024-07-13 10:16:13.501878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.502017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.502044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.790 qpair failed and we were unable to recover it. 00:30:07.790 [2024-07-13 10:16:13.502251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.502377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.502400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.790 qpair failed and we were unable to recover it. 00:30:07.790 [2024-07-13 10:16:13.502520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.502660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.502684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.790 qpair failed and we were unable to recover it. 00:30:07.790 [2024-07-13 10:16:13.502853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.503053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.503078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.790 qpair failed and we were unable to recover it. 00:30:07.790 [2024-07-13 10:16:13.503232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.503383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.503407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.790 qpair failed and we were unable to recover it. 00:30:07.790 [2024-07-13 10:16:13.503546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.503697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.503721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.790 qpair failed and we were unable to recover it. 00:30:07.790 [2024-07-13 10:16:13.503915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.504085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.504110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.790 qpair failed and we were unable to recover it. 00:30:07.790 [2024-07-13 10:16:13.504258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.504384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.504408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.790 qpair failed and we were unable to recover it. 00:30:07.790 [2024-07-13 10:16:13.504525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.504698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.504726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.790 qpair failed and we were unable to recover it. 00:30:07.790 [2024-07-13 10:16:13.504877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.505053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.505077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.790 qpair failed and we were unable to recover it. 00:30:07.790 [2024-07-13 10:16:13.505253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.505408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.505432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.790 qpair failed and we were unable to recover it. 00:30:07.790 [2024-07-13 10:16:13.505555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.505719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.505743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.790 qpair failed and we were unable to recover it. 00:30:07.790 [2024-07-13 10:16:13.505915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.506038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.790 [2024-07-13 10:16:13.506062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.790 qpair failed and we were unable to recover it. 00:30:07.791 [2024-07-13 10:16:13.506187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.506334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.506358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.791 qpair failed and we were unable to recover it. 00:30:07.791 [2024-07-13 10:16:13.506481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.506639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.506664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.791 qpair failed and we were unable to recover it. 00:30:07.791 [2024-07-13 10:16:13.506782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.506907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.506931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.791 qpair failed and we were unable to recover it. 00:30:07.791 [2024-07-13 10:16:13.507078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.507223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.507247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.791 qpair failed and we were unable to recover it. 00:30:07.791 [2024-07-13 10:16:13.507394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.507550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.507574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.791 qpair failed and we were unable to recover it. 00:30:07.791 [2024-07-13 10:16:13.507728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.507848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.507876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.791 qpair failed and we were unable to recover it. 00:30:07.791 [2024-07-13 10:16:13.508006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.508172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.508195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.791 qpair failed and we were unable to recover it. 00:30:07.791 [2024-07-13 10:16:13.508372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.508521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.508545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.791 qpair failed and we were unable to recover it. 00:30:07.791 [2024-07-13 10:16:13.508667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.508843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.508875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.791 qpair failed and we were unable to recover it. 00:30:07.791 [2024-07-13 10:16:13.509043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.509219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.509242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.791 qpair failed and we were unable to recover it. 00:30:07.791 [2024-07-13 10:16:13.509394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.509542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.509566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.791 qpair failed and we were unable to recover it. 00:30:07.791 [2024-07-13 10:16:13.509686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.509837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.509861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.791 qpair failed and we were unable to recover it. 00:30:07.791 [2024-07-13 10:16:13.510006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.510156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.510180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.791 qpair failed and we were unable to recover it. 00:30:07.791 [2024-07-13 10:16:13.510354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.510478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.510501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.791 qpair failed and we were unable to recover it. 00:30:07.791 [2024-07-13 10:16:13.510647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.510795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.510818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.791 qpair failed and we were unable to recover it. 00:30:07.791 [2024-07-13 10:16:13.510970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.511147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.511172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.791 qpair failed and we were unable to recover it. 00:30:07.791 [2024-07-13 10:16:13.511306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.511478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.511502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.791 qpair failed and we were unable to recover it. 00:30:07.791 [2024-07-13 10:16:13.511696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.511833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.511860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.791 qpair failed and we were unable to recover it. 00:30:07.791 [2024-07-13 10:16:13.512035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.512156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.512181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.791 qpair failed and we were unable to recover it. 00:30:07.791 [2024-07-13 10:16:13.512332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.512466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.512490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.791 qpair failed and we were unable to recover it. 00:30:07.791 [2024-07-13 10:16:13.512649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.512803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.512827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.791 qpair failed and we were unable to recover it. 00:30:07.791 [2024-07-13 10:16:13.512964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.513116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.513139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.791 qpair failed and we were unable to recover it. 00:30:07.791 [2024-07-13 10:16:13.513289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.513438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.513462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.791 qpair failed and we were unable to recover it. 00:30:07.791 [2024-07-13 10:16:13.513623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.513773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.513797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.791 qpair failed and we were unable to recover it. 00:30:07.791 [2024-07-13 10:16:13.513950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.514111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.514135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.791 qpair failed and we were unable to recover it. 00:30:07.791 [2024-07-13 10:16:13.514320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.514506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.514530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.791 qpair failed and we were unable to recover it. 00:30:07.791 [2024-07-13 10:16:13.514655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.514808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.514833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.791 qpair failed and we were unable to recover it. 00:30:07.791 [2024-07-13 10:16:13.515012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.515130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.515154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.791 qpair failed and we were unable to recover it. 00:30:07.791 [2024-07-13 10:16:13.515308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.515478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.515502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.791 qpair failed and we were unable to recover it. 00:30:07.791 [2024-07-13 10:16:13.515653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.515783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.515807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.791 qpair failed and we were unable to recover it. 00:30:07.791 [2024-07-13 10:16:13.515956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.791 [2024-07-13 10:16:13.516086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.516109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.792 qpair failed and we were unable to recover it. 00:30:07.792 [2024-07-13 10:16:13.516234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.516356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.516379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.792 qpair failed and we were unable to recover it. 00:30:07.792 [2024-07-13 10:16:13.516529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.516701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.516724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.792 qpair failed and we were unable to recover it. 00:30:07.792 [2024-07-13 10:16:13.516898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.517070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.517094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.792 qpair failed and we were unable to recover it. 00:30:07.792 [2024-07-13 10:16:13.517209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.517357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.517381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.792 qpair failed and we were unable to recover it. 00:30:07.792 [2024-07-13 10:16:13.517499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.517639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.517663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.792 qpair failed and we were unable to recover it. 00:30:07.792 [2024-07-13 10:16:13.517841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.517997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.518021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.792 qpair failed and we were unable to recover it. 00:30:07.792 [2024-07-13 10:16:13.518141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.518303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.518330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.792 qpair failed and we were unable to recover it. 00:30:07.792 [2024-07-13 10:16:13.518455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.518609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.518633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.792 qpair failed and we were unable to recover it. 00:30:07.792 [2024-07-13 10:16:13.518762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.518910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.518935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.792 qpair failed and we were unable to recover it. 00:30:07.792 [2024-07-13 10:16:13.519088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.519208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.519232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.792 qpair failed and we were unable to recover it. 00:30:07.792 [2024-07-13 10:16:13.519367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.519498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.519522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.792 qpair failed and we were unable to recover it. 00:30:07.792 [2024-07-13 10:16:13.519640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.519824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.519848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.792 qpair failed and we were unable to recover it. 00:30:07.792 [2024-07-13 10:16:13.520018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.520145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.520169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.792 qpair failed and we were unable to recover it. 00:30:07.792 [2024-07-13 10:16:13.520325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.520507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.520532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.792 qpair failed and we were unable to recover it. 00:30:07.792 [2024-07-13 10:16:13.520653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.520795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.520818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.792 qpair failed and we were unable to recover it. 00:30:07.792 [2024-07-13 10:16:13.520946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.521099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.521127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.792 qpair failed and we were unable to recover it. 00:30:07.792 [2024-07-13 10:16:13.521302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.521441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.521465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.792 qpair failed and we were unable to recover it. 00:30:07.792 [2024-07-13 10:16:13.521614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.521763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.521787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.792 qpair failed and we were unable to recover it. 00:30:07.792 [2024-07-13 10:16:13.521947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.522076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.522099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.792 qpair failed and we were unable to recover it. 00:30:07.792 [2024-07-13 10:16:13.522229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.522407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.522432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.792 qpair failed and we were unable to recover it. 00:30:07.792 [2024-07-13 10:16:13.522616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.522740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.522764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.792 qpair failed and we were unable to recover it. 00:30:07.792 [2024-07-13 10:16:13.522916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.523063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.523087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.792 qpair failed and we were unable to recover it. 00:30:07.792 [2024-07-13 10:16:13.523239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.523389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.523412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.792 qpair failed and we were unable to recover it. 00:30:07.792 [2024-07-13 10:16:13.523587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.523716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.523740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.792 qpair failed and we were unable to recover it. 00:30:07.792 [2024-07-13 10:16:13.523861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.524007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.792 [2024-07-13 10:16:13.524031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.792 qpair failed and we were unable to recover it. 00:30:07.792 [2024-07-13 10:16:13.524184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.524346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.524369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.793 qpair failed and we were unable to recover it. 00:30:07.793 [2024-07-13 10:16:13.524522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.524672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.524695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.793 qpair failed and we were unable to recover it. 00:30:07.793 [2024-07-13 10:16:13.524875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.525012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.525036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.793 qpair failed and we were unable to recover it. 00:30:07.793 [2024-07-13 10:16:13.525161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.525362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.525394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.793 qpair failed and we were unable to recover it. 00:30:07.793 [2024-07-13 10:16:13.525579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.525704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.525729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.793 qpair failed and we were unable to recover it. 00:30:07.793 [2024-07-13 10:16:13.525856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.526001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.526026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.793 qpair failed and we were unable to recover it. 00:30:07.793 [2024-07-13 10:16:13.526174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.526348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.526372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.793 qpair failed and we were unable to recover it. 00:30:07.793 [2024-07-13 10:16:13.526508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.526652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.526676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.793 qpair failed and we were unable to recover it. 00:30:07.793 [2024-07-13 10:16:13.526817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.526968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.526993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.793 qpair failed and we were unable to recover it. 00:30:07.793 [2024-07-13 10:16:13.527148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.527319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.527343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.793 qpair failed and we were unable to recover it. 00:30:07.793 [2024-07-13 10:16:13.527478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.527630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.527653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.793 qpair failed and we were unable to recover it. 00:30:07.793 [2024-07-13 10:16:13.527816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.527939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.527964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.793 qpair failed and we were unable to recover it. 00:30:07.793 [2024-07-13 10:16:13.528117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.528278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.528305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.793 qpair failed and we were unable to recover it. 00:30:07.793 [2024-07-13 10:16:13.528446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.528570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.528593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.793 qpair failed and we were unable to recover it. 00:30:07.793 [2024-07-13 10:16:13.528727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.528893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.528921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.793 qpair failed and we were unable to recover it. 00:30:07.793 [2024-07-13 10:16:13.529089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.529229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.529257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.793 qpair failed and we were unable to recover it. 00:30:07.793 [2024-07-13 10:16:13.529412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.529560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.529583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.793 qpair failed and we were unable to recover it. 00:30:07.793 [2024-07-13 10:16:13.529734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.529889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.529913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.793 qpair failed and we were unable to recover it. 00:30:07.793 [2024-07-13 10:16:13.530063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.530188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.530212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.793 qpair failed and we were unable to recover it. 00:30:07.793 [2024-07-13 10:16:13.530337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.530482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.530505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.793 qpair failed and we were unable to recover it. 00:30:07.793 [2024-07-13 10:16:13.530630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.530781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.530804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.793 qpair failed and we were unable to recover it. 00:30:07.793 [2024-07-13 10:16:13.530941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.531079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.531103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.793 qpair failed and we were unable to recover it. 00:30:07.793 [2024-07-13 10:16:13.531251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.531427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.531451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.793 qpair failed and we were unable to recover it. 00:30:07.793 [2024-07-13 10:16:13.531602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.531769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.531794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.793 qpair failed and we were unable to recover it. 00:30:07.793 [2024-07-13 10:16:13.531942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.532133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.532160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.793 qpair failed and we were unable to recover it. 00:30:07.793 [2024-07-13 10:16:13.532325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.532474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.532499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.793 qpair failed and we were unable to recover it. 00:30:07.793 [2024-07-13 10:16:13.532642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.532767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.532791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.793 qpair failed and we were unable to recover it. 00:30:07.793 [2024-07-13 10:16:13.532965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.533118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.533142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.793 qpair failed and we were unable to recover it. 00:30:07.793 [2024-07-13 10:16:13.533300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.533422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.533447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.793 qpair failed and we were unable to recover it. 00:30:07.793 [2024-07-13 10:16:13.533593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.533742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.533766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.793 qpair failed and we were unable to recover it. 00:30:07.793 [2024-07-13 10:16:13.533933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.793 [2024-07-13 10:16:13.534085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.534109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.794 qpair failed and we were unable to recover it. 00:30:07.794 [2024-07-13 10:16:13.534284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.534408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.534432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.794 qpair failed and we were unable to recover it. 00:30:07.794 [2024-07-13 10:16:13.534585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.534727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.534751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.794 qpair failed and we were unable to recover it. 00:30:07.794 [2024-07-13 10:16:13.534906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.535059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.535083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.794 qpair failed and we were unable to recover it. 00:30:07.794 [2024-07-13 10:16:13.535263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.535414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.535438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.794 qpair failed and we were unable to recover it. 00:30:07.794 [2024-07-13 10:16:13.535582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.535732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.535756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.794 qpair failed and we were unable to recover it. 00:30:07.794 [2024-07-13 10:16:13.535937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.536086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.536110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.794 qpair failed and we were unable to recover it. 00:30:07.794 [2024-07-13 10:16:13.536263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.536381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.536405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.794 qpair failed and we were unable to recover it. 00:30:07.794 [2024-07-13 10:16:13.536524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.536672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.536696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.794 qpair failed and we were unable to recover it. 00:30:07.794 [2024-07-13 10:16:13.536815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.536976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.537000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.794 qpair failed and we were unable to recover it. 00:30:07.794 [2024-07-13 10:16:13.537143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.537287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.537311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.794 qpair failed and we were unable to recover it. 00:30:07.794 [2024-07-13 10:16:13.537466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.537578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.537610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.794 qpair failed and we were unable to recover it. 00:30:07.794 [2024-07-13 10:16:13.537767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.537917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.537942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.794 qpair failed and we were unable to recover it. 00:30:07.794 [2024-07-13 10:16:13.538082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.538240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.538264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.794 qpair failed and we were unable to recover it. 00:30:07.794 [2024-07-13 10:16:13.538416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.538590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.538614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.794 qpair failed and we were unable to recover it. 00:30:07.794 [2024-07-13 10:16:13.538742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.538870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.538895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.794 qpair failed and we were unable to recover it. 00:30:07.794 [2024-07-13 10:16:13.539046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.539207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.539231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.794 qpair failed and we were unable to recover it. 00:30:07.794 [2024-07-13 10:16:13.539407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.539523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.539547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.794 qpair failed and we were unable to recover it. 00:30:07.794 [2024-07-13 10:16:13.539696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.539815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.539839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.794 qpair failed and we were unable to recover it. 00:30:07.794 [2024-07-13 10:16:13.539991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.540121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.540145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.794 qpair failed and we were unable to recover it. 00:30:07.794 [2024-07-13 10:16:13.540321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.540468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.540492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.794 qpair failed and we were unable to recover it. 00:30:07.794 [2024-07-13 10:16:13.540645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.540769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.540792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.794 qpair failed and we were unable to recover it. 00:30:07.794 [2024-07-13 10:16:13.540973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.541093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.541117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.794 qpair failed and we were unable to recover it. 00:30:07.794 [2024-07-13 10:16:13.541270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.541391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.541415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.794 qpair failed and we were unable to recover it. 00:30:07.794 [2024-07-13 10:16:13.541527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.541684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.541708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.794 qpair failed and we were unable to recover it. 00:30:07.794 [2024-07-13 10:16:13.541858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.541991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.542015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.794 qpair failed and we were unable to recover it. 00:30:07.794 [2024-07-13 10:16:13.542141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.542335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.542359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.794 qpair failed and we were unable to recover it. 00:30:07.794 [2024-07-13 10:16:13.542490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.542606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.542630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.794 qpair failed and we were unable to recover it. 00:30:07.794 [2024-07-13 10:16:13.542782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.542897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.542921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.794 qpair failed and we were unable to recover it. 00:30:07.794 [2024-07-13 10:16:13.543065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.543191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.543214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.794 qpair failed and we were unable to recover it. 00:30:07.794 [2024-07-13 10:16:13.543354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.543525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.794 [2024-07-13 10:16:13.543549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.794 qpair failed and we were unable to recover it. 00:30:07.794 [2024-07-13 10:16:13.543673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.543785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.543808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.795 qpair failed and we were unable to recover it. 00:30:07.795 [2024-07-13 10:16:13.543971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.544095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.544119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.795 qpair failed and we were unable to recover it. 00:30:07.795 [2024-07-13 10:16:13.544244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.544358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.544382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.795 qpair failed and we were unable to recover it. 00:30:07.795 [2024-07-13 10:16:13.544535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.544651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.544674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.795 qpair failed and we were unable to recover it. 00:30:07.795 [2024-07-13 10:16:13.544795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.544951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.544976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.795 qpair failed and we were unable to recover it. 00:30:07.795 [2024-07-13 10:16:13.545130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.545250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.545274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.795 qpair failed and we were unable to recover it. 00:30:07.795 [2024-07-13 10:16:13.545407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.545524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.545548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.795 qpair failed and we were unable to recover it. 00:30:07.795 [2024-07-13 10:16:13.545700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.545875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.545899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.795 qpair failed and we were unable to recover it. 00:30:07.795 [2024-07-13 10:16:13.546018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.546221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.546248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.795 qpair failed and we were unable to recover it. 00:30:07.795 [2024-07-13 10:16:13.546419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.546576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.546600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.795 qpair failed and we were unable to recover it. 00:30:07.795 [2024-07-13 10:16:13.546752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.546956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.546983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.795 qpair failed and we were unable to recover it. 00:30:07.795 [2024-07-13 10:16:13.547150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.547308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.547335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.795 qpair failed and we were unable to recover it. 00:30:07.795 [2024-07-13 10:16:13.547496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.547675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.547698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.795 qpair failed and we were unable to recover it. 00:30:07.795 [2024-07-13 10:16:13.547843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.547973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.547997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.795 qpair failed and we were unable to recover it. 00:30:07.795 [2024-07-13 10:16:13.548126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.548276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.548300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.795 qpair failed and we were unable to recover it. 00:30:07.795 [2024-07-13 10:16:13.548473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.548618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.548642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.795 qpair failed and we were unable to recover it. 00:30:07.795 [2024-07-13 10:16:13.548813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.548977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.549001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.795 qpair failed and we were unable to recover it. 00:30:07.795 [2024-07-13 10:16:13.549150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.549298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.549322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.795 qpair failed and we were unable to recover it. 00:30:07.795 [2024-07-13 10:16:13.549474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.549633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.549657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.795 qpair failed and we were unable to recover it. 00:30:07.795 [2024-07-13 10:16:13.549809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.549961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.549986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.795 qpair failed and we were unable to recover it. 00:30:07.795 [2024-07-13 10:16:13.550116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.550277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.550300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.795 qpair failed and we were unable to recover it. 00:30:07.795 [2024-07-13 10:16:13.550472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.550593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.550616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.795 qpair failed and we were unable to recover it. 00:30:07.795 [2024-07-13 10:16:13.550771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.550946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.550971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.795 qpair failed and we were unable to recover it. 00:30:07.795 [2024-07-13 10:16:13.551122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.551277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.551300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.795 qpair failed and we were unable to recover it. 00:30:07.795 [2024-07-13 10:16:13.551457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.551630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.551653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.795 qpair failed and we were unable to recover it. 00:30:07.795 [2024-07-13 10:16:13.551804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.551939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.551980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.795 qpair failed and we were unable to recover it. 00:30:07.795 [2024-07-13 10:16:13.552119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.552276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.552303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.795 qpair failed and we were unable to recover it. 00:30:07.795 [2024-07-13 10:16:13.552438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.552587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.552610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.795 qpair failed and we were unable to recover it. 00:30:07.795 [2024-07-13 10:16:13.552781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.552969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.552996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.795 qpair failed and we were unable to recover it. 00:30:07.795 [2024-07-13 10:16:13.553147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.553269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.553293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.795 qpair failed and we were unable to recover it. 00:30:07.795 [2024-07-13 10:16:13.553443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.553589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.795 [2024-07-13 10:16:13.553612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.795 qpair failed and we were unable to recover it. 00:30:07.796 [2024-07-13 10:16:13.553736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.796 [2024-07-13 10:16:13.553860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.796 [2024-07-13 10:16:13.553892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.796 qpair failed and we were unable to recover it. 00:30:07.796 [2024-07-13 10:16:13.554049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.796 [2024-07-13 10:16:13.554173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.796 [2024-07-13 10:16:13.554196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.796 qpair failed and we were unable to recover it. 00:30:07.796 [2024-07-13 10:16:13.554348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.796 [2024-07-13 10:16:13.554499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.796 [2024-07-13 10:16:13.554523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.796 qpair failed and we were unable to recover it. 00:30:07.796 [2024-07-13 10:16:13.554669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.796 [2024-07-13 10:16:13.554782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.796 [2024-07-13 10:16:13.554806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.796 qpair failed and we were unable to recover it. 00:30:07.796 [2024-07-13 10:16:13.554982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.796 [2024-07-13 10:16:13.555138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.796 [2024-07-13 10:16:13.555166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.796 qpair failed and we were unable to recover it. 00:30:07.796 [2024-07-13 10:16:13.555341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.796 [2024-07-13 10:16:13.555504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.796 [2024-07-13 10:16:13.555529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.796 qpair failed and we were unable to recover it. 00:30:07.796 [2024-07-13 10:16:13.555661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.796 [2024-07-13 10:16:13.555834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.796 [2024-07-13 10:16:13.555858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.796 qpair failed and we were unable to recover it. 00:30:07.796 [2024-07-13 10:16:13.556008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.796 [2024-07-13 10:16:13.556157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.796 [2024-07-13 10:16:13.556181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.796 qpair failed and we were unable to recover it. 00:30:07.796 [2024-07-13 10:16:13.556366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.796 [2024-07-13 10:16:13.556487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.796 [2024-07-13 10:16:13.556511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.796 qpair failed and we were unable to recover it. 00:30:07.796 [2024-07-13 10:16:13.556664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.796 [2024-07-13 10:16:13.556812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.796 [2024-07-13 10:16:13.556845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.796 qpair failed and we were unable to recover it. 00:30:07.796 [2024-07-13 10:16:13.557023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.796 [2024-07-13 10:16:13.557200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.796 [2024-07-13 10:16:13.557229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.796 qpair failed and we were unable to recover it. 00:30:07.796 [2024-07-13 10:16:13.557427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.796 [2024-07-13 10:16:13.557620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.796 [2024-07-13 10:16:13.557649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.796 qpair failed and we were unable to recover it. 00:30:07.796 [2024-07-13 10:16:13.557817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.796 [2024-07-13 10:16:13.557971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.796 [2024-07-13 10:16:13.557998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.796 qpair failed and we were unable to recover it. 00:30:07.796 [2024-07-13 10:16:13.558167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.796 [2024-07-13 10:16:13.558339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.796 [2024-07-13 10:16:13.558367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.796 qpair failed and we were unable to recover it. 00:30:07.796 [2024-07-13 10:16:13.558560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.796 [2024-07-13 10:16:13.558707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.796 [2024-07-13 10:16:13.558731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.796 qpair failed and we were unable to recover it. 00:30:07.796 [2024-07-13 10:16:13.558882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.796 [2024-07-13 10:16:13.559030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.796 [2024-07-13 10:16:13.559055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.796 qpair failed and we were unable to recover it. 00:30:07.796 [2024-07-13 10:16:13.559188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.796 [2024-07-13 10:16:13.559328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.796 [2024-07-13 10:16:13.559353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:07.796 qpair failed and we were unable to recover it. 00:30:07.796 [2024-07-13 10:16:13.559503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.796 [2024-07-13 10:16:13.559628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:07.796 [2024-07-13 10:16:13.559652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.081 qpair failed and we were unable to recover it. 00:30:08.081 [2024-07-13 10:16:13.559800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.081 [2024-07-13 10:16:13.559932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.081 [2024-07-13 10:16:13.559958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.081 qpair failed and we were unable to recover it. 00:30:08.081 [2024-07-13 10:16:13.560111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.081 [2024-07-13 10:16:13.560270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.081 [2024-07-13 10:16:13.560295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.081 qpair failed and we were unable to recover it. 00:30:08.081 [2024-07-13 10:16:13.560455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.081 [2024-07-13 10:16:13.560614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.081 [2024-07-13 10:16:13.560637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.081 qpair failed and we were unable to recover it. 00:30:08.081 [2024-07-13 10:16:13.560776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.081 [2024-07-13 10:16:13.560948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.081 [2024-07-13 10:16:13.560976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.081 qpair failed and we were unable to recover it. 00:30:08.081 [2024-07-13 10:16:13.561145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.081 [2024-07-13 10:16:13.561278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.081 [2024-07-13 10:16:13.561304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.081 qpair failed and we were unable to recover it. 00:30:08.081 [2024-07-13 10:16:13.561432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.081 [2024-07-13 10:16:13.561555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.081 [2024-07-13 10:16:13.561579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.081 qpair failed and we were unable to recover it. 00:30:08.081 [2024-07-13 10:16:13.561731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.561879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.561907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.082 qpair failed and we were unable to recover it. 00:30:08.082 [2024-07-13 10:16:13.562075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.562248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.562277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.082 qpair failed and we were unable to recover it. 00:30:08.082 [2024-07-13 10:16:13.562477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.562643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.562669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.082 qpair failed and we were unable to recover it. 00:30:08.082 [2024-07-13 10:16:13.562835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.563001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.563027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.082 qpair failed and we were unable to recover it. 00:30:08.082 [2024-07-13 10:16:13.563185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.563321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.563347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.082 qpair failed and we were unable to recover it. 00:30:08.082 [2024-07-13 10:16:13.563502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.563634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.563657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.082 qpair failed and we were unable to recover it. 00:30:08.082 [2024-07-13 10:16:13.563813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.563972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.563998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.082 qpair failed and we were unable to recover it. 00:30:08.082 [2024-07-13 10:16:13.564150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.564297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.564322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.082 qpair failed and we were unable to recover it. 00:30:08.082 [2024-07-13 10:16:13.564476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.564593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.564616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.082 qpair failed and we were unable to recover it. 00:30:08.082 [2024-07-13 10:16:13.564766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.564956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.564984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.082 qpair failed and we were unable to recover it. 00:30:08.082 [2024-07-13 10:16:13.565121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.565251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.565277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.082 qpair failed and we were unable to recover it. 00:30:08.082 [2024-07-13 10:16:13.565477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.565644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.565670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.082 qpair failed and we were unable to recover it. 00:30:08.082 [2024-07-13 10:16:13.565798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.565965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.565993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.082 qpair failed and we were unable to recover it. 00:30:08.082 [2024-07-13 10:16:13.566156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.566319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.566345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.082 qpair failed and we were unable to recover it. 00:30:08.082 [2024-07-13 10:16:13.566518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.566663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.566705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.082 qpair failed and we were unable to recover it. 00:30:08.082 [2024-07-13 10:16:13.566876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.567034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.567062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.082 qpair failed and we were unable to recover it. 00:30:08.082 [2024-07-13 10:16:13.567225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.567364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.567390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.082 qpair failed and we were unable to recover it. 00:30:08.082 [2024-07-13 10:16:13.567541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.567683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.567706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.082 qpair failed and we were unable to recover it. 00:30:08.082 [2024-07-13 10:16:13.567883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.568059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.568083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.082 qpair failed and we were unable to recover it. 00:30:08.082 [2024-07-13 10:16:13.568206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.568353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.568376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.082 qpair failed and we were unable to recover it. 00:30:08.082 [2024-07-13 10:16:13.568532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.568671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.568695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.082 qpair failed and we were unable to recover it. 00:30:08.082 [2024-07-13 10:16:13.568843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.569027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.569054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.082 qpair failed and we were unable to recover it. 00:30:08.082 [2024-07-13 10:16:13.569236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.569390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.569413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.082 qpair failed and we were unable to recover it. 00:30:08.082 [2024-07-13 10:16:13.569564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.569720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.569760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.082 qpair failed and we were unable to recover it. 00:30:08.082 [2024-07-13 10:16:13.569902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.570031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.570057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.082 qpair failed and we were unable to recover it. 00:30:08.082 [2024-07-13 10:16:13.570248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.570406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.570453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.082 qpair failed and we were unable to recover it. 00:30:08.082 [2024-07-13 10:16:13.570623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.570769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.570810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.082 qpair failed and we were unable to recover it. 00:30:08.082 [2024-07-13 10:16:13.570972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.571154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.571193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.082 qpair failed and we were unable to recover it. 00:30:08.082 [2024-07-13 10:16:13.571355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.571491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.571517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.082 qpair failed and we were unable to recover it. 00:30:08.082 [2024-07-13 10:16:13.571727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.571907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.571964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.082 qpair failed and we were unable to recover it. 00:30:08.082 [2024-07-13 10:16:13.572126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.082 [2024-07-13 10:16:13.572363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.572412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.083 qpair failed and we were unable to recover it. 00:30:08.083 [2024-07-13 10:16:13.572551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.572713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.572739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.083 qpair failed and we were unable to recover it. 00:30:08.083 [2024-07-13 10:16:13.572918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.573062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.573104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.083 qpair failed and we were unable to recover it. 00:30:08.083 [2024-07-13 10:16:13.573280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.573432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.573456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.083 qpair failed and we were unable to recover it. 00:30:08.083 [2024-07-13 10:16:13.573635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.573805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.573830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.083 qpair failed and we were unable to recover it. 00:30:08.083 [2024-07-13 10:16:13.574016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.574171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.574213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.083 qpair failed and we were unable to recover it. 00:30:08.083 [2024-07-13 10:16:13.574381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.574551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.574575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.083 qpair failed and we were unable to recover it. 00:30:08.083 [2024-07-13 10:16:13.574726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.574929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.574963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.083 qpair failed and we were unable to recover it. 00:30:08.083 [2024-07-13 10:16:13.575113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.575319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.575376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.083 qpair failed and we were unable to recover it. 00:30:08.083 [2024-07-13 10:16:13.575571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.575695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.575722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.083 qpair failed and we were unable to recover it. 00:30:08.083 [2024-07-13 10:16:13.575884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.576019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.576046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.083 qpair failed and we were unable to recover it. 00:30:08.083 [2024-07-13 10:16:13.576191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.576338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.576362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.083 qpair failed and we were unable to recover it. 00:30:08.083 [2024-07-13 10:16:13.576567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.576690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.576714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.083 qpair failed and we were unable to recover it. 00:30:08.083 [2024-07-13 10:16:13.576890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.577061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.577087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.083 qpair failed and we were unable to recover it. 00:30:08.083 [2024-07-13 10:16:13.577255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.577386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.577410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.083 qpair failed and we were unable to recover it. 00:30:08.083 [2024-07-13 10:16:13.577554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.577689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.577716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.083 qpair failed and we were unable to recover it. 00:30:08.083 [2024-07-13 10:16:13.577887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.578035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.578059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.083 qpair failed and we were unable to recover it. 00:30:08.083 [2024-07-13 10:16:13.578176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.578326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.578349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.083 qpair failed and we were unable to recover it. 00:30:08.083 [2024-07-13 10:16:13.578535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.578679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.578705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.083 qpair failed and we were unable to recover it. 00:30:08.083 [2024-07-13 10:16:13.578861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.579030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.579055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.083 qpair failed and we were unable to recover it. 00:30:08.083 [2024-07-13 10:16:13.579241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.579438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.579464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.083 qpair failed and we were unable to recover it. 00:30:08.083 [2024-07-13 10:16:13.579631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.579765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.579792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.083 qpair failed and we were unable to recover it. 00:30:08.083 [2024-07-13 10:16:13.579993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.580151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.580176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.083 qpair failed and we were unable to recover it. 00:30:08.083 [2024-07-13 10:16:13.580357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.580551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.580606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.083 qpair failed and we were unable to recover it. 00:30:08.083 [2024-07-13 10:16:13.580771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.580953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.580978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.083 qpair failed and we were unable to recover it. 00:30:08.083 [2024-07-13 10:16:13.581156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.581351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.581397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.083 qpair failed and we were unable to recover it. 00:30:08.083 [2024-07-13 10:16:13.581549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.581718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.581742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.083 qpair failed and we were unable to recover it. 00:30:08.083 [2024-07-13 10:16:13.581908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.582038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.582063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.083 qpair failed and we were unable to recover it. 00:30:08.083 [2024-07-13 10:16:13.582223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.582429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.582477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.083 qpair failed and we were unable to recover it. 00:30:08.083 [2024-07-13 10:16:13.582645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.582784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.582808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.083 qpair failed and we were unable to recover it. 00:30:08.083 [2024-07-13 10:16:13.582986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.583149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.083 [2024-07-13 10:16:13.583173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.083 qpair failed and we were unable to recover it. 00:30:08.084 [2024-07-13 10:16:13.583349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.583506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.583561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.084 qpair failed and we were unable to recover it. 00:30:08.084 [2024-07-13 10:16:13.583754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.583896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.583939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.084 qpair failed and we were unable to recover it. 00:30:08.084 [2024-07-13 10:16:13.584108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.584255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.584279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.084 qpair failed and we were unable to recover it. 00:30:08.084 [2024-07-13 10:16:13.584430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.584583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.584609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.084 qpair failed and we were unable to recover it. 00:30:08.084 [2024-07-13 10:16:13.584750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.584874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.584899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.084 qpair failed and we were unable to recover it. 00:30:08.084 [2024-07-13 10:16:13.585018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.585141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.585164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.084 qpair failed and we were unable to recover it. 00:30:08.084 [2024-07-13 10:16:13.585380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.585527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.585566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.084 qpair failed and we were unable to recover it. 00:30:08.084 [2024-07-13 10:16:13.585719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.585921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.585948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.084 qpair failed and we were unable to recover it. 00:30:08.084 [2024-07-13 10:16:13.586088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.586259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.586286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.084 qpair failed and we were unable to recover it. 00:30:08.084 [2024-07-13 10:16:13.586454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.586606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.586632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.084 qpair failed and we were unable to recover it. 00:30:08.084 [2024-07-13 10:16:13.586772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.586941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.586966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.084 qpair failed and we were unable to recover it. 00:30:08.084 [2024-07-13 10:16:13.587103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.587253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.587276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.084 qpair failed and we were unable to recover it. 00:30:08.084 [2024-07-13 10:16:13.587406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.587555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.587579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.084 qpair failed and we were unable to recover it. 00:30:08.084 [2024-07-13 10:16:13.587737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.587932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.587957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.084 qpair failed and we were unable to recover it. 00:30:08.084 [2024-07-13 10:16:13.588075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.588198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.588221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.084 qpair failed and we were unable to recover it. 00:30:08.084 [2024-07-13 10:16:13.588393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.588550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.588577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.084 qpair failed and we were unable to recover it. 00:30:08.084 [2024-07-13 10:16:13.588764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.588930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.588957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.084 qpair failed and we were unable to recover it. 00:30:08.084 [2024-07-13 10:16:13.589150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.589297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.589324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.084 qpair failed and we were unable to recover it. 00:30:08.084 [2024-07-13 10:16:13.589492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.589646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.589673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.084 qpair failed and we were unable to recover it. 00:30:08.084 [2024-07-13 10:16:13.589809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.589938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.589964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.084 qpair failed and we were unable to recover it. 00:30:08.084 [2024-07-13 10:16:13.590119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.590289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.590316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.084 qpair failed and we were unable to recover it. 00:30:08.084 [2024-07-13 10:16:13.590482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.590631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.590654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.084 qpair failed and we were unable to recover it. 00:30:08.084 [2024-07-13 10:16:13.590809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.590961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.590985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.084 qpair failed and we were unable to recover it. 00:30:08.084 [2024-07-13 10:16:13.591201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.591356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.591380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.084 qpair failed and we were unable to recover it. 00:30:08.084 [2024-07-13 10:16:13.591554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.591733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.591758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.084 qpair failed and we were unable to recover it. 00:30:08.084 [2024-07-13 10:16:13.591908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.592036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.592076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.084 qpair failed and we were unable to recover it. 00:30:08.084 [2024-07-13 10:16:13.592270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.592489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.592538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.084 qpair failed and we were unable to recover it. 00:30:08.084 [2024-07-13 10:16:13.592737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.592888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.592916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.084 qpair failed and we were unable to recover it. 00:30:08.084 [2024-07-13 10:16:13.593046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.593217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.593242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.084 qpair failed and we were unable to recover it. 00:30:08.084 [2024-07-13 10:16:13.593404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.593597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.593621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.084 qpair failed and we were unable to recover it. 00:30:08.084 [2024-07-13 10:16:13.593784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.084 [2024-07-13 10:16:13.593947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.593975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.085 qpair failed and we were unable to recover it. 00:30:08.085 [2024-07-13 10:16:13.594149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.594355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.594403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.085 qpair failed and we were unable to recover it. 00:30:08.085 [2024-07-13 10:16:13.594566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.594706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.594733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.085 qpair failed and we were unable to recover it. 00:30:08.085 [2024-07-13 10:16:13.594876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.595013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.595039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.085 qpair failed and we were unable to recover it. 00:30:08.085 [2024-07-13 10:16:13.595224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.595338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.595361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.085 qpair failed and we were unable to recover it. 00:30:08.085 [2024-07-13 10:16:13.595484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.595666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.595689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.085 qpair failed and we were unable to recover it. 00:30:08.085 [2024-07-13 10:16:13.595828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.595997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.596025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.085 qpair failed and we were unable to recover it. 00:30:08.085 [2024-07-13 10:16:13.596166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.596316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.596339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.085 qpair failed and we were unable to recover it. 00:30:08.085 [2024-07-13 10:16:13.596459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.596583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.596606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.085 qpair failed and we were unable to recover it. 00:30:08.085 [2024-07-13 10:16:13.596758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.596880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.596905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.085 qpair failed and we were unable to recover it. 00:30:08.085 [2024-07-13 10:16:13.597027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.597180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.597219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.085 qpair failed and we were unable to recover it. 00:30:08.085 [2024-07-13 10:16:13.597395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.597550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.597574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.085 qpair failed and we were unable to recover it. 00:30:08.085 [2024-07-13 10:16:13.597776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.597904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.597929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.085 qpair failed and we were unable to recover it. 00:30:08.085 [2024-07-13 10:16:13.598120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.598267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.598291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.085 qpair failed and we were unable to recover it. 00:30:08.085 [2024-07-13 10:16:13.598419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.598571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.598595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.085 qpair failed and we were unable to recover it. 00:30:08.085 [2024-07-13 10:16:13.598769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.598963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.598990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.085 qpair failed and we were unable to recover it. 00:30:08.085 [2024-07-13 10:16:13.599168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.599317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.599359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.085 qpair failed and we were unable to recover it. 00:30:08.085 [2024-07-13 10:16:13.599496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.599685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.599712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.085 qpair failed and we were unable to recover it. 00:30:08.085 [2024-07-13 10:16:13.599862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.600051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.600075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.085 qpair failed and we were unable to recover it. 00:30:08.085 [2024-07-13 10:16:13.600212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.600368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.600409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.085 qpair failed and we were unable to recover it. 00:30:08.085 [2024-07-13 10:16:13.600573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.600744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.600769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.085 qpair failed and we were unable to recover it. 00:30:08.085 [2024-07-13 10:16:13.600946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.601096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.601120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.085 qpair failed and we were unable to recover it. 00:30:08.085 [2024-07-13 10:16:13.601296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.601441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.601465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.085 qpair failed and we were unable to recover it. 00:30:08.085 [2024-07-13 10:16:13.601613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.601742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.601766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.085 qpair failed and we were unable to recover it. 00:30:08.085 [2024-07-13 10:16:13.601895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.602045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.602069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.085 qpair failed and we were unable to recover it. 00:30:08.085 [2024-07-13 10:16:13.602220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.602363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.602388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.085 qpair failed and we were unable to recover it. 00:30:08.085 [2024-07-13 10:16:13.602601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.602749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.602772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.085 qpair failed and we were unable to recover it. 00:30:08.085 [2024-07-13 10:16:13.602951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.603118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.603145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.085 qpair failed and we were unable to recover it. 00:30:08.085 [2024-07-13 10:16:13.603299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.603450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.603475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.085 qpair failed and we were unable to recover it. 00:30:08.085 [2024-07-13 10:16:13.603678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.603847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.603878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.085 qpair failed and we were unable to recover it. 00:30:08.085 [2024-07-13 10:16:13.604022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.604153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.085 [2024-07-13 10:16:13.604180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.085 qpair failed and we were unable to recover it. 00:30:08.086 [2024-07-13 10:16:13.604326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.604471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.604496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.086 qpair failed and we were unable to recover it. 00:30:08.086 [2024-07-13 10:16:13.604651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.604812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.604838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.086 qpair failed and we were unable to recover it. 00:30:08.086 [2024-07-13 10:16:13.604986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.605117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.605141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.086 qpair failed and we were unable to recover it. 00:30:08.086 [2024-07-13 10:16:13.605357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.605523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.605550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.086 qpair failed and we were unable to recover it. 00:30:08.086 [2024-07-13 10:16:13.605712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.605902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.605929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.086 qpair failed and we were unable to recover it. 00:30:08.086 [2024-07-13 10:16:13.606067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.606265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.606289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.086 qpair failed and we were unable to recover it. 00:30:08.086 [2024-07-13 10:16:13.606439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.606589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.606630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.086 qpair failed and we were unable to recover it. 00:30:08.086 [2024-07-13 10:16:13.606793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.606930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.606957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.086 qpair failed and we were unable to recover it. 00:30:08.086 [2024-07-13 10:16:13.607122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.607310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.607337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.086 qpair failed and we were unable to recover it. 00:30:08.086 [2024-07-13 10:16:13.607508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.607699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.607726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.086 qpair failed and we were unable to recover it. 00:30:08.086 [2024-07-13 10:16:13.607916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.608061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.608085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.086 qpair failed and we were unable to recover it. 00:30:08.086 [2024-07-13 10:16:13.608234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.608373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.608400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.086 qpair failed and we were unable to recover it. 00:30:08.086 [2024-07-13 10:16:13.608540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.608714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.608753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.086 qpair failed and we were unable to recover it. 00:30:08.086 [2024-07-13 10:16:13.608945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.609114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.609141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.086 qpair failed and we were unable to recover it. 00:30:08.086 [2024-07-13 10:16:13.609332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.609456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.609480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.086 qpair failed and we were unable to recover it. 00:30:08.086 [2024-07-13 10:16:13.609631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.609770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.609811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.086 qpair failed and we were unable to recover it. 00:30:08.086 [2024-07-13 10:16:13.609967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.610087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.610111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.086 qpair failed and we were unable to recover it. 00:30:08.086 [2024-07-13 10:16:13.610292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.610440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.610469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.086 qpair failed and we were unable to recover it. 00:30:08.086 [2024-07-13 10:16:13.610678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.610805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.610829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.086 qpair failed and we were unable to recover it. 00:30:08.086 [2024-07-13 10:16:13.611007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.611160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.611183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.086 qpair failed and we were unable to recover it. 00:30:08.086 [2024-07-13 10:16:13.611352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.611555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.611579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.086 qpair failed and we were unable to recover it. 00:30:08.086 [2024-07-13 10:16:13.611754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.611880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.611905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.086 qpair failed and we were unable to recover it. 00:30:08.086 [2024-07-13 10:16:13.612090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.612291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.612341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.086 qpair failed and we were unable to recover it. 00:30:08.086 [2024-07-13 10:16:13.612479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.612639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.612666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.086 qpair failed and we were unable to recover it. 00:30:08.086 [2024-07-13 10:16:13.612806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.612959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.086 [2024-07-13 10:16:13.612983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.086 qpair failed and we were unable to recover it. 00:30:08.086 [2024-07-13 10:16:13.613125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.613295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.613318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.087 qpair failed and we were unable to recover it. 00:30:08.087 [2024-07-13 10:16:13.613461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.613629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.613669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.087 qpair failed and we were unable to recover it. 00:30:08.087 [2024-07-13 10:16:13.613851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.613999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.614022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.087 qpair failed and we were unable to recover it. 00:30:08.087 [2024-07-13 10:16:13.614162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.614317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.614342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.087 qpair failed and we were unable to recover it. 00:30:08.087 [2024-07-13 10:16:13.614512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.614675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.614702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.087 qpair failed and we were unable to recover it. 00:30:08.087 [2024-07-13 10:16:13.614890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.615076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.615109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.087 qpair failed and we were unable to recover it. 00:30:08.087 [2024-07-13 10:16:13.615260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.615411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.615435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.087 qpair failed and we were unable to recover it. 00:30:08.087 [2024-07-13 10:16:13.615613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.615759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.615786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.087 qpair failed and we were unable to recover it. 00:30:08.087 [2024-07-13 10:16:13.615963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.616132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.616159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.087 qpair failed and we were unable to recover it. 00:30:08.087 [2024-07-13 10:16:13.616357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.616502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.616525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.087 qpair failed and we were unable to recover it. 00:30:08.087 [2024-07-13 10:16:13.616664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.616855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.616888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.087 qpair failed and we were unable to recover it. 00:30:08.087 [2024-07-13 10:16:13.617066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.617248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.617305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.087 qpair failed and we were unable to recover it. 00:30:08.087 [2024-07-13 10:16:13.617508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.617684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.617725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.087 qpair failed and we were unable to recover it. 00:30:08.087 [2024-07-13 10:16:13.617905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.618086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.618145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.087 qpair failed and we were unable to recover it. 00:30:08.087 [2024-07-13 10:16:13.618316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.618465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.618504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.087 qpair failed and we were unable to recover it. 00:30:08.087 [2024-07-13 10:16:13.618671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.618833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.618859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.087 qpair failed and we were unable to recover it. 00:30:08.087 [2024-07-13 10:16:13.619033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.619193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.619220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.087 qpair failed and we were unable to recover it. 00:30:08.087 [2024-07-13 10:16:13.619371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.619545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.619587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.087 qpair failed and we were unable to recover it. 00:30:08.087 [2024-07-13 10:16:13.619724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.619890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.619918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.087 qpair failed and we were unable to recover it. 00:30:08.087 [2024-07-13 10:16:13.620077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.620292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.620342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.087 qpair failed and we were unable to recover it. 00:30:08.087 [2024-07-13 10:16:13.620477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.620646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.620669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.087 qpair failed and we were unable to recover it. 00:30:08.087 [2024-07-13 10:16:13.620886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.621009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.621035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.087 qpair failed and we were unable to recover it. 00:30:08.087 [2024-07-13 10:16:13.621250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.621415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.621441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.087 qpair failed and we were unable to recover it. 00:30:08.087 [2024-07-13 10:16:13.621639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.621792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.621816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.087 qpair failed and we were unable to recover it. 00:30:08.087 [2024-07-13 10:16:13.621969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.622115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.622139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.087 qpair failed and we were unable to recover it. 00:30:08.087 [2024-07-13 10:16:13.622310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.622534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.622585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.087 qpair failed and we were unable to recover it. 00:30:08.087 [2024-07-13 10:16:13.622785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.622945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.622972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.087 qpair failed and we were unable to recover it. 00:30:08.087 [2024-07-13 10:16:13.623165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.623312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.623337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.087 qpair failed and we were unable to recover it. 00:30:08.087 [2024-07-13 10:16:13.623452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.623621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.623648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.087 qpair failed and we were unable to recover it. 00:30:08.087 [2024-07-13 10:16:13.623803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.623971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.623997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.087 qpair failed and we were unable to recover it. 00:30:08.087 [2024-07-13 10:16:13.624180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.087 [2024-07-13 10:16:13.624314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.624341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.088 qpair failed and we were unable to recover it. 00:30:08.088 [2024-07-13 10:16:13.624478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.624644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.624668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.088 qpair failed and we were unable to recover it. 00:30:08.088 [2024-07-13 10:16:13.624842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.625046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.625073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.088 qpair failed and we were unable to recover it. 00:30:08.088 [2024-07-13 10:16:13.625244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.625422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.625462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.088 qpair failed and we were unable to recover it. 00:30:08.088 [2024-07-13 10:16:13.625632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.625798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.625825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.088 qpair failed and we were unable to recover it. 00:30:08.088 [2024-07-13 10:16:13.625989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.626141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.626165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.088 qpair failed and we were unable to recover it. 00:30:08.088 [2024-07-13 10:16:13.626371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.626574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.626623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.088 qpair failed and we were unable to recover it. 00:30:08.088 [2024-07-13 10:16:13.626764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.626964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.626989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.088 qpair failed and we were unable to recover it. 00:30:08.088 [2024-07-13 10:16:13.627138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.627283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.627324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.088 qpair failed and we were unable to recover it. 00:30:08.088 [2024-07-13 10:16:13.627460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.627627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.627655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.088 qpair failed and we were unable to recover it. 00:30:08.088 [2024-07-13 10:16:13.627813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.627973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.628001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.088 qpair failed and we were unable to recover it. 00:30:08.088 [2024-07-13 10:16:13.628137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.628330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.628357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.088 qpair failed and we were unable to recover it. 00:30:08.088 [2024-07-13 10:16:13.628516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.628702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.628729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.088 qpair failed and we were unable to recover it. 00:30:08.088 [2024-07-13 10:16:13.628863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.629027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.629057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.088 qpair failed and we were unable to recover it. 00:30:08.088 [2024-07-13 10:16:13.629255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.629414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.629441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.088 qpair failed and we were unable to recover it. 00:30:08.088 [2024-07-13 10:16:13.629576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.629754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.629777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.088 qpair failed and we were unable to recover it. 00:30:08.088 [2024-07-13 10:16:13.629964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.630135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.630164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.088 qpair failed and we were unable to recover it. 00:30:08.088 [2024-07-13 10:16:13.630328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.630446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.630470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.088 qpair failed and we were unable to recover it. 00:30:08.088 [2024-07-13 10:16:13.630599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.630748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.630772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.088 qpair failed and we were unable to recover it. 00:30:08.088 [2024-07-13 10:16:13.630922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.631070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.631093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.088 qpair failed and we were unable to recover it. 00:30:08.088 [2024-07-13 10:16:13.631265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.631428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.631455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.088 qpair failed and we were unable to recover it. 00:30:08.088 [2024-07-13 10:16:13.631616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.631779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.631805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.088 qpair failed and we were unable to recover it. 00:30:08.088 [2024-07-13 10:16:13.631941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.632066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.632093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.088 qpair failed and we were unable to recover it. 00:30:08.088 [2024-07-13 10:16:13.632290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.632416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.632444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.088 qpair failed and we were unable to recover it. 00:30:08.088 [2024-07-13 10:16:13.632597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.632735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.632762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.088 qpair failed and we were unable to recover it. 00:30:08.088 [2024-07-13 10:16:13.632908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.633095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.633121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.088 qpair failed and we were unable to recover it. 00:30:08.088 [2024-07-13 10:16:13.633299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.633447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.633471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.088 qpair failed and we were unable to recover it. 00:30:08.088 [2024-07-13 10:16:13.633669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.633875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.633903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.088 qpair failed and we were unable to recover it. 00:30:08.088 [2024-07-13 10:16:13.634069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.634193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.634218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.088 qpair failed and we were unable to recover it. 00:30:08.088 [2024-07-13 10:16:13.634373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.634523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.088 [2024-07-13 10:16:13.634566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.088 qpair failed and we were unable to recover it. 00:30:08.088 [2024-07-13 10:16:13.634747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.634894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.634919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.089 qpair failed and we were unable to recover it. 00:30:08.089 [2024-07-13 10:16:13.635039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.635208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.635234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.089 qpair failed and we were unable to recover it. 00:30:08.089 [2024-07-13 10:16:13.635432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.635581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.635605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.089 qpair failed and we were unable to recover it. 00:30:08.089 [2024-07-13 10:16:13.635728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.635880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.635906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.089 qpair failed and we were unable to recover it. 00:30:08.089 [2024-07-13 10:16:13.636050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.636256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.636299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.089 qpair failed and we were unable to recover it. 00:30:08.089 [2024-07-13 10:16:13.636486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.636612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.636653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.089 qpair failed and we were unable to recover it. 00:30:08.089 [2024-07-13 10:16:13.636823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.637016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.637043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.089 qpair failed and we were unable to recover it. 00:30:08.089 [2024-07-13 10:16:13.637231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.637443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.637492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.089 qpair failed and we were unable to recover it. 00:30:08.089 [2024-07-13 10:16:13.637664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.637785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.637808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.089 qpair failed and we were unable to recover it. 00:30:08.089 [2024-07-13 10:16:13.637958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.638102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.638128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.089 qpair failed and we were unable to recover it. 00:30:08.089 [2024-07-13 10:16:13.638291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.638431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.638458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.089 qpair failed and we were unable to recover it. 00:30:08.089 [2024-07-13 10:16:13.638653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.638777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.638800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.089 qpair failed and we were unable to recover it. 00:30:08.089 [2024-07-13 10:16:13.638962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.639111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.639137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.089 qpair failed and we were unable to recover it. 00:30:08.089 [2024-07-13 10:16:13.639305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.639476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.639503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.089 qpair failed and we were unable to recover it. 00:30:08.089 [2024-07-13 10:16:13.639665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.639838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.639861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.089 qpair failed and we were unable to recover it. 00:30:08.089 [2024-07-13 10:16:13.640034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.640164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.640190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.089 qpair failed and we were unable to recover it. 00:30:08.089 [2024-07-13 10:16:13.640320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.640458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.640485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.089 qpair failed and we were unable to recover it. 00:30:08.089 [2024-07-13 10:16:13.640658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.640857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.640889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.089 qpair failed and we were unable to recover it. 00:30:08.089 [2024-07-13 10:16:13.641073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.641245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.641284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.089 qpair failed and we were unable to recover it. 00:30:08.089 [2024-07-13 10:16:13.641480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.641603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.641626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.089 qpair failed and we were unable to recover it. 00:30:08.089 [2024-07-13 10:16:13.641775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.641927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.641970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.089 qpair failed and we were unable to recover it. 00:30:08.089 [2024-07-13 10:16:13.642150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.642295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.642319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.089 qpair failed and we were unable to recover it. 00:30:08.089 [2024-07-13 10:16:13.642465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.642628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.642655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.089 qpair failed and we were unable to recover it. 00:30:08.089 [2024-07-13 10:16:13.642819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.642997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.643021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.089 qpair failed and we were unable to recover it. 00:30:08.089 [2024-07-13 10:16:13.643148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.643294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.643318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.089 qpair failed and we were unable to recover it. 00:30:08.089 [2024-07-13 10:16:13.643447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.643639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.643666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.089 qpair failed and we were unable to recover it. 00:30:08.089 [2024-07-13 10:16:13.643837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.643969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.643993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.089 qpair failed and we were unable to recover it. 00:30:08.089 [2024-07-13 10:16:13.644172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.644351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.644375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.089 qpair failed and we were unable to recover it. 00:30:08.089 [2024-07-13 10:16:13.644526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.644678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.644717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.089 qpair failed and we were unable to recover it. 00:30:08.089 [2024-07-13 10:16:13.644893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.645066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.645090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.089 qpair failed and we were unable to recover it. 00:30:08.089 [2024-07-13 10:16:13.645241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.645402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.089 [2024-07-13 10:16:13.645429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.089 qpair failed and we were unable to recover it. 00:30:08.090 [2024-07-13 10:16:13.645617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.645783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.645809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.090 qpair failed and we were unable to recover it. 00:30:08.090 [2024-07-13 10:16:13.645983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.646132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.646156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.090 qpair failed and we were unable to recover it. 00:30:08.090 [2024-07-13 10:16:13.646311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.646500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.646527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.090 qpair failed and we were unable to recover it. 00:30:08.090 [2024-07-13 10:16:13.646720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.646941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.646969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.090 qpair failed and we were unable to recover it. 00:30:08.090 [2024-07-13 10:16:13.647139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.647330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.647356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.090 qpair failed and we were unable to recover it. 00:30:08.090 [2024-07-13 10:16:13.647544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.647680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.647707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.090 qpair failed and we were unable to recover it. 00:30:08.090 [2024-07-13 10:16:13.647848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.647992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.648019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.090 qpair failed and we were unable to recover it. 00:30:08.090 [2024-07-13 10:16:13.648169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.648294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.648317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.090 qpair failed and we were unable to recover it. 00:30:08.090 [2024-07-13 10:16:13.648478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.648626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.648649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.090 qpair failed and we were unable to recover it. 00:30:08.090 [2024-07-13 10:16:13.648799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.648978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.649004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.090 qpair failed and we were unable to recover it. 00:30:08.090 [2024-07-13 10:16:13.649128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.649306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.649348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.090 qpair failed and we were unable to recover it. 00:30:08.090 [2024-07-13 10:16:13.649514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.649693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.649716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.090 qpair failed and we were unable to recover it. 00:30:08.090 [2024-07-13 10:16:13.649870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.650044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.650071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.090 qpair failed and we were unable to recover it. 00:30:08.090 [2024-07-13 10:16:13.650214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.650384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.650426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.090 qpair failed and we were unable to recover it. 00:30:08.090 [2024-07-13 10:16:13.650582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.650744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.650770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.090 qpair failed and we were unable to recover it. 00:30:08.090 [2024-07-13 10:16:13.650933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.651095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.651122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.090 qpair failed and we were unable to recover it. 00:30:08.090 [2024-07-13 10:16:13.651271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.651419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.651442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.090 qpair failed and we were unable to recover it. 00:30:08.090 [2024-07-13 10:16:13.651614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.651750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.651776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.090 qpair failed and we were unable to recover it. 00:30:08.090 [2024-07-13 10:16:13.651917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.652126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.652153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.090 qpair failed and we were unable to recover it. 00:30:08.090 [2024-07-13 10:16:13.652336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.652486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.652509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.090 qpair failed and we were unable to recover it. 00:30:08.090 [2024-07-13 10:16:13.652693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.652895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.652920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.090 qpair failed and we were unable to recover it. 00:30:08.090 [2024-07-13 10:16:13.653063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.653225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.653251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.090 qpair failed and we were unable to recover it. 00:30:08.090 [2024-07-13 10:16:13.653428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.653544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.653567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.090 qpair failed and we were unable to recover it. 00:30:08.090 [2024-07-13 10:16:13.653742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.653905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.653932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.090 qpair failed and we were unable to recover it. 00:30:08.090 [2024-07-13 10:16:13.654069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.654210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.654234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.090 qpair failed and we were unable to recover it. 00:30:08.090 [2024-07-13 10:16:13.654385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.654576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.654602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.090 qpair failed and we were unable to recover it. 00:30:08.090 [2024-07-13 10:16:13.654765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.090 [2024-07-13 10:16:13.654944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.654984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.091 qpair failed and we were unable to recover it. 00:30:08.091 [2024-07-13 10:16:13.655124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.655284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.655311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.091 qpair failed and we were unable to recover it. 00:30:08.091 [2024-07-13 10:16:13.655514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.655657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.655684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.091 qpair failed and we were unable to recover it. 00:30:08.091 [2024-07-13 10:16:13.655852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.656039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.656066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.091 qpair failed and we were unable to recover it. 00:30:08.091 [2024-07-13 10:16:13.656223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.656375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.656401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.091 qpair failed and we were unable to recover it. 00:30:08.091 [2024-07-13 10:16:13.656550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.656669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.656693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.091 qpair failed and we were unable to recover it. 00:30:08.091 [2024-07-13 10:16:13.656893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.657084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.657110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.091 qpair failed and we were unable to recover it. 00:30:08.091 [2024-07-13 10:16:13.657249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.657415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.657442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.091 qpair failed and we were unable to recover it. 00:30:08.091 [2024-07-13 10:16:13.657592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.657743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.657767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.091 qpair failed and we were unable to recover it. 00:30:08.091 [2024-07-13 10:16:13.657932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.658098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.658123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.091 qpair failed and we were unable to recover it. 00:30:08.091 [2024-07-13 10:16:13.658310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.658445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.658472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.091 qpair failed and we were unable to recover it. 00:30:08.091 [2024-07-13 10:16:13.658640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.658791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.658815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.091 qpair failed and we were unable to recover it. 00:30:08.091 [2024-07-13 10:16:13.658952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.659132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.659158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.091 qpair failed and we were unable to recover it. 00:30:08.091 [2024-07-13 10:16:13.659357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.659554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.659600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.091 qpair failed and we were unable to recover it. 00:30:08.091 [2024-07-13 10:16:13.659747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.659937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.659977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.091 qpair failed and we were unable to recover it. 00:30:08.091 [2024-07-13 10:16:13.660112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.660333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.660382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.091 qpair failed and we were unable to recover it. 00:30:08.091 [2024-07-13 10:16:13.660527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.660693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.660719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.091 qpair failed and we were unable to recover it. 00:30:08.091 [2024-07-13 10:16:13.660919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.661081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.661106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.091 qpair failed and we were unable to recover it. 00:30:08.091 [2024-07-13 10:16:13.661275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.661452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.661476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.091 qpair failed and we were unable to recover it. 00:30:08.091 [2024-07-13 10:16:13.661631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.661778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.661805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.091 qpair failed and we were unable to recover it. 00:30:08.091 [2024-07-13 10:16:13.661978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.662106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.662130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.091 qpair failed and we were unable to recover it. 00:30:08.091 [2024-07-13 10:16:13.662305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.662513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.662562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.091 qpair failed and we were unable to recover it. 00:30:08.091 [2024-07-13 10:16:13.662721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.662913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.662940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.091 qpair failed and we were unable to recover it. 00:30:08.091 [2024-07-13 10:16:13.663093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.663243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.663268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.091 qpair failed and we were unable to recover it. 00:30:08.091 [2024-07-13 10:16:13.663418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.663581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.663608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.091 qpair failed and we were unable to recover it. 00:30:08.091 [2024-07-13 10:16:13.663777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.663983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.664007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.091 qpair failed and we were unable to recover it. 00:30:08.091 [2024-07-13 10:16:13.664159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.664280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.664303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.091 qpair failed and we were unable to recover it. 00:30:08.091 [2024-07-13 10:16:13.664453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.664571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.664595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.091 qpair failed and we were unable to recover it. 00:30:08.091 [2024-07-13 10:16:13.664804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.664942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.664967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.091 qpair failed and we were unable to recover it. 00:30:08.091 [2024-07-13 10:16:13.665115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.665240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.665279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.091 qpair failed and we were unable to recover it. 00:30:08.091 [2024-07-13 10:16:13.665441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.665602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.091 [2024-07-13 10:16:13.665628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.091 qpair failed and we were unable to recover it. 00:30:08.091 [2024-07-13 10:16:13.665794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.665927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.665955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.092 qpair failed and we were unable to recover it. 00:30:08.092 [2024-07-13 10:16:13.666132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.666286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.666309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.092 qpair failed and we were unable to recover it. 00:30:08.092 [2024-07-13 10:16:13.666514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.666655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.666682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.092 qpair failed and we were unable to recover it. 00:30:08.092 [2024-07-13 10:16:13.666849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.667054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.667081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.092 qpair failed and we were unable to recover it. 00:30:08.092 [2024-07-13 10:16:13.667260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.667411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.667451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.092 qpair failed and we were unable to recover it. 00:30:08.092 [2024-07-13 10:16:13.667615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.667776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.667802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.092 qpair failed and we were unable to recover it. 00:30:08.092 [2024-07-13 10:16:13.667980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.668132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.668172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.092 qpair failed and we were unable to recover it. 00:30:08.092 [2024-07-13 10:16:13.668322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.668496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.668544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.092 qpair failed and we were unable to recover it. 00:30:08.092 [2024-07-13 10:16:13.668706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.668872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.668899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.092 qpair failed and we were unable to recover it. 00:30:08.092 [2024-07-13 10:16:13.669062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.669230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.669256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.092 qpair failed and we were unable to recover it. 00:30:08.092 [2024-07-13 10:16:13.669421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.669642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.669703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.092 qpair failed and we were unable to recover it. 00:30:08.092 [2024-07-13 10:16:13.669880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.670010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.670036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.092 qpair failed and we were unable to recover it. 00:30:08.092 [2024-07-13 10:16:13.670180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.670330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.670354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.092 qpair failed and we were unable to recover it. 00:30:08.092 [2024-07-13 10:16:13.670479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.670623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.670647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.092 qpair failed and we were unable to recover it. 00:30:08.092 [2024-07-13 10:16:13.670772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.670921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.670946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.092 qpair failed and we were unable to recover it. 00:30:08.092 [2024-07-13 10:16:13.671102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.671228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.671254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.092 qpair failed and we were unable to recover it. 00:30:08.092 [2024-07-13 10:16:13.671442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.671610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.671637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.092 qpair failed and we were unable to recover it. 00:30:08.092 [2024-07-13 10:16:13.671801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.671960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.671988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.092 qpair failed and we were unable to recover it. 00:30:08.092 [2024-07-13 10:16:13.672163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.672309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.672332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.092 qpair failed and we were unable to recover it. 00:30:08.092 [2024-07-13 10:16:13.672511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.672677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.672704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.092 qpair failed and we were unable to recover it. 00:30:08.092 [2024-07-13 10:16:13.672850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.673021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.673046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.092 qpair failed and we were unable to recover it. 00:30:08.092 [2024-07-13 10:16:13.673233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.673382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.673405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.092 qpair failed and we were unable to recover it. 00:30:08.092 [2024-07-13 10:16:13.673570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.673724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.673748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.092 qpair failed and we were unable to recover it. 00:30:08.092 [2024-07-13 10:16:13.673923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.674090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.674117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.092 qpair failed and we were unable to recover it. 00:30:08.092 [2024-07-13 10:16:13.674293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.674497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.674520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.092 qpair failed and we were unable to recover it. 00:30:08.092 [2024-07-13 10:16:13.674696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.674837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.674864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.092 qpair failed and we were unable to recover it. 00:30:08.092 [2024-07-13 10:16:13.675050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.675297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.675349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.092 qpair failed and we were unable to recover it. 00:30:08.092 [2024-07-13 10:16:13.675523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.675638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.675662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.092 qpair failed and we were unable to recover it. 00:30:08.092 [2024-07-13 10:16:13.675844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.675998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.676022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.092 qpair failed and we were unable to recover it. 00:30:08.092 [2024-07-13 10:16:13.676174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.676393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.676418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.092 qpair failed and we were unable to recover it. 00:30:08.092 [2024-07-13 10:16:13.676570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.676746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.092 [2024-07-13 10:16:13.676787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.093 qpair failed and we were unable to recover it. 00:30:08.093 [2024-07-13 10:16:13.676962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.677089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.677113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.093 qpair failed and we were unable to recover it. 00:30:08.093 [2024-07-13 10:16:13.677264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.677430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.677457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.093 qpair failed and we were unable to recover it. 00:30:08.093 [2024-07-13 10:16:13.677623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.677788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.677814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.093 qpair failed and we were unable to recover it. 00:30:08.093 [2024-07-13 10:16:13.677994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.678179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.678203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.093 qpair failed and we were unable to recover it. 00:30:08.093 [2024-07-13 10:16:13.678406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.678614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.678664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.093 qpair failed and we were unable to recover it. 00:30:08.093 [2024-07-13 10:16:13.678838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.678988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.679013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.093 qpair failed and we were unable to recover it. 00:30:08.093 [2024-07-13 10:16:13.679138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.679265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.679289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.093 qpair failed and we were unable to recover it. 00:30:08.093 [2024-07-13 10:16:13.679495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.679635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.679662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.093 qpair failed and we were unable to recover it. 00:30:08.093 [2024-07-13 10:16:13.679864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.680014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.680038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.093 qpair failed and we were unable to recover it. 00:30:08.093 [2024-07-13 10:16:13.680208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.680325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.680365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.093 qpair failed and we were unable to recover it. 00:30:08.093 [2024-07-13 10:16:13.680523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.680664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.680691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.093 qpair failed and we were unable to recover it. 00:30:08.093 [2024-07-13 10:16:13.680861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.680993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.681018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.093 qpair failed and we were unable to recover it. 00:30:08.093 [2024-07-13 10:16:13.681137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.681259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.681283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.093 qpair failed and we were unable to recover it. 00:30:08.093 [2024-07-13 10:16:13.681451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.681638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.681665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.093 qpair failed and we were unable to recover it. 00:30:08.093 [2024-07-13 10:16:13.681862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.682024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.682048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.093 qpair failed and we were unable to recover it. 00:30:08.093 [2024-07-13 10:16:13.682197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.682314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.682338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.093 qpair failed and we were unable to recover it. 00:30:08.093 [2024-07-13 10:16:13.682483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.682613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.682637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.093 qpair failed and we were unable to recover it. 00:30:08.093 [2024-07-13 10:16:13.682754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.682905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.682930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.093 qpair failed and we were unable to recover it. 00:30:08.093 [2024-07-13 10:16:13.683107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.683256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.683283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.093 qpair failed and we were unable to recover it. 00:30:08.093 [2024-07-13 10:16:13.683461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.683610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.683634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.093 qpair failed and we were unable to recover it. 00:30:08.093 [2024-07-13 10:16:13.683782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.683929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.683959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.093 qpair failed and we were unable to recover it. 00:30:08.093 [2024-07-13 10:16:13.684166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.684313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.684373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.093 qpair failed and we were unable to recover it. 00:30:08.093 [2024-07-13 10:16:13.684535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.684695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.684722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.093 qpair failed and we were unable to recover it. 00:30:08.093 [2024-07-13 10:16:13.684899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.685046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.685071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.093 qpair failed and we were unable to recover it. 00:30:08.093 [2024-07-13 10:16:13.685196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.685366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.685407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.093 qpair failed and we were unable to recover it. 00:30:08.093 [2024-07-13 10:16:13.685578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.685740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.685767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.093 qpair failed and we were unable to recover it. 00:30:08.093 [2024-07-13 10:16:13.685936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.686073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.686100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.093 qpair failed and we were unable to recover it. 00:30:08.093 [2024-07-13 10:16:13.686272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.686428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.686456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.093 qpair failed and we were unable to recover it. 00:30:08.093 [2024-07-13 10:16:13.686637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.686797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.686821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.093 qpair failed and we were unable to recover it. 00:30:08.093 [2024-07-13 10:16:13.686947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.687113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.687140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.093 qpair failed and we were unable to recover it. 00:30:08.093 [2024-07-13 10:16:13.687302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.093 [2024-07-13 10:16:13.687428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.687454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.094 qpair failed and we were unable to recover it. 00:30:08.094 [2024-07-13 10:16:13.687652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.687817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.687844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.094 qpair failed and we were unable to recover it. 00:30:08.094 [2024-07-13 10:16:13.688018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.688204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.688231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.094 qpair failed and we were unable to recover it. 00:30:08.094 [2024-07-13 10:16:13.688405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.688561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.688587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.094 qpair failed and we were unable to recover it. 00:30:08.094 [2024-07-13 10:16:13.688717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.688899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.688923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.094 qpair failed and we were unable to recover it. 00:30:08.094 [2024-07-13 10:16:13.689099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.689293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.689347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.094 qpair failed and we were unable to recover it. 00:30:08.094 [2024-07-13 10:16:13.689491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.689618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.689641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.094 qpair failed and we were unable to recover it. 00:30:08.094 [2024-07-13 10:16:13.689766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.689933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.689965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.094 qpair failed and we were unable to recover it. 00:30:08.094 [2024-07-13 10:16:13.690130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.690289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.690316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.094 qpair failed and we were unable to recover it. 00:30:08.094 [2024-07-13 10:16:13.690463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.690588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.690612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.094 qpair failed and we were unable to recover it. 00:30:08.094 [2024-07-13 10:16:13.690766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.690922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.690949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.094 qpair failed and we were unable to recover it. 00:30:08.094 [2024-07-13 10:16:13.691089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.691260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.691283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.094 qpair failed and we were unable to recover it. 00:30:08.094 [2024-07-13 10:16:13.691458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.691578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.691621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.094 qpair failed and we were unable to recover it. 00:30:08.094 [2024-07-13 10:16:13.691811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.692002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.692026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.094 qpair failed and we were unable to recover it. 00:30:08.094 [2024-07-13 10:16:13.692181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.692389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.692414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.094 qpair failed and we were unable to recover it. 00:30:08.094 [2024-07-13 10:16:13.692565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.692710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.692750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.094 qpair failed and we were unable to recover it. 00:30:08.094 [2024-07-13 10:16:13.692890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.693055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.693081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.094 qpair failed and we were unable to recover it. 00:30:08.094 [2024-07-13 10:16:13.693249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.693485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.693542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.094 qpair failed and we were unable to recover it. 00:30:08.094 [2024-07-13 10:16:13.693721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.693888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.693914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.094 qpair failed and we were unable to recover it. 00:30:08.094 [2024-07-13 10:16:13.694094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.694258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.694284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.094 qpair failed and we were unable to recover it. 00:30:08.094 [2024-07-13 10:16:13.694473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.694664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.694691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.094 qpair failed and we were unable to recover it. 00:30:08.094 [2024-07-13 10:16:13.694861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.694984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.695008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.094 qpair failed and we were unable to recover it. 00:30:08.094 [2024-07-13 10:16:13.695185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.695334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.695357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.094 qpair failed and we were unable to recover it. 00:30:08.094 [2024-07-13 10:16:13.695532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.695683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.695710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.094 qpair failed and we were unable to recover it. 00:30:08.094 [2024-07-13 10:16:13.695871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.696045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.696069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.094 qpair failed and we were unable to recover it. 00:30:08.094 [2024-07-13 10:16:13.696226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.696367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.696391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.094 qpair failed and we were unable to recover it. 00:30:08.094 [2024-07-13 10:16:13.696563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.696727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.094 [2024-07-13 10:16:13.696753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.094 qpair failed and we were unable to recover it. 00:30:08.095 [2024-07-13 10:16:13.696935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.697078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.697102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.095 qpair failed and we were unable to recover it. 00:30:08.095 [2024-07-13 10:16:13.697254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.697433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.697456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.095 qpair failed and we were unable to recover it. 00:30:08.095 [2024-07-13 10:16:13.697603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.697775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.697801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.095 qpair failed and we were unable to recover it. 00:30:08.095 [2024-07-13 10:16:13.697950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.698126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.698150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.095 qpair failed and we were unable to recover it. 00:30:08.095 [2024-07-13 10:16:13.698299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.698463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.698488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.095 qpair failed and we were unable to recover it. 00:30:08.095 [2024-07-13 10:16:13.698662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.698813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.698839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.095 qpair failed and we were unable to recover it. 00:30:08.095 [2024-07-13 10:16:13.699039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.699186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.699209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.095 qpair failed and we were unable to recover it. 00:30:08.095 [2024-07-13 10:16:13.699415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.699601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.699650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.095 qpair failed and we were unable to recover it. 00:30:08.095 [2024-07-13 10:16:13.699815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.699957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.699985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.095 qpair failed and we were unable to recover it. 00:30:08.095 [2024-07-13 10:16:13.700158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.700333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.700374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.095 qpair failed and we were unable to recover it. 00:30:08.095 [2024-07-13 10:16:13.700540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.700715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.700739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.095 qpair failed and we were unable to recover it. 00:30:08.095 [2024-07-13 10:16:13.700933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.701065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.701092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.095 qpair failed and we were unable to recover it. 00:30:08.095 [2024-07-13 10:16:13.701291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.701456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.701483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.095 qpair failed and we were unable to recover it. 00:30:08.095 [2024-07-13 10:16:13.701675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.701828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.701884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.095 qpair failed and we were unable to recover it. 00:30:08.095 [2024-07-13 10:16:13.702052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.702182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.702208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.095 qpair failed and we were unable to recover it. 00:30:08.095 [2024-07-13 10:16:13.702355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.702500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.702523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.095 qpair failed and we were unable to recover it. 00:30:08.095 [2024-07-13 10:16:13.702683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.702798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.702823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.095 qpair failed and we were unable to recover it. 00:30:08.095 [2024-07-13 10:16:13.702993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.703129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.703154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.095 qpair failed and we were unable to recover it. 00:30:08.095 [2024-07-13 10:16:13.703325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.703513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.703540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.095 qpair failed and we were unable to recover it. 00:30:08.095 [2024-07-13 10:16:13.703704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.703841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.703872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.095 qpair failed and we were unable to recover it. 00:30:08.095 [2024-07-13 10:16:13.704014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.704204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.704230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.095 qpair failed and we were unable to recover it. 00:30:08.095 [2024-07-13 10:16:13.704375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.704526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.704550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.095 qpair failed and we were unable to recover it. 00:30:08.095 [2024-07-13 10:16:13.704706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.704863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.704896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.095 qpair failed and we were unable to recover it. 00:30:08.095 [2024-07-13 10:16:13.705041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.705180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.705207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.095 qpair failed and we were unable to recover it. 00:30:08.095 [2024-07-13 10:16:13.705400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.705561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.705586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.095 qpair failed and we were unable to recover it. 00:30:08.095 [2024-07-13 10:16:13.705784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.705975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.706003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.095 qpair failed and we were unable to recover it. 00:30:08.095 [2024-07-13 10:16:13.706169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.706301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.706327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.095 qpair failed and we were unable to recover it. 00:30:08.095 [2024-07-13 10:16:13.706470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.706621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.706644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.095 qpair failed and we were unable to recover it. 00:30:08.095 [2024-07-13 10:16:13.706821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.707020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.707045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.095 qpair failed and we were unable to recover it. 00:30:08.095 [2024-07-13 10:16:13.707194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.707380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.095 [2024-07-13 10:16:13.707404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.095 qpair failed and we were unable to recover it. 00:30:08.095 [2024-07-13 10:16:13.707583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.707731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.707755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.096 qpair failed and we were unable to recover it. 00:30:08.096 [2024-07-13 10:16:13.707909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.708057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.708088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.096 qpair failed and we were unable to recover it. 00:30:08.096 [2024-07-13 10:16:13.708280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.708470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.708524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.096 qpair failed and we were unable to recover it. 00:30:08.096 [2024-07-13 10:16:13.708667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.708842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.708888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.096 qpair failed and we were unable to recover it. 00:30:08.096 [2024-07-13 10:16:13.709083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.709229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.709268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.096 qpair failed and we were unable to recover it. 00:30:08.096 [2024-07-13 10:16:13.709455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.709671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.709725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.096 qpair failed and we were unable to recover it. 00:30:08.096 [2024-07-13 10:16:13.709923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.710070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.710093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.096 qpair failed and we were unable to recover it. 00:30:08.096 [2024-07-13 10:16:13.710263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.710458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.710482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.096 qpair failed and we were unable to recover it. 00:30:08.096 [2024-07-13 10:16:13.710653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.710796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.710822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.096 qpair failed and we were unable to recover it. 00:30:08.096 [2024-07-13 10:16:13.710997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.711140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.711164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.096 qpair failed and we were unable to recover it. 00:30:08.096 [2024-07-13 10:16:13.711320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.711516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.711540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.096 qpair failed and we were unable to recover it. 00:30:08.096 [2024-07-13 10:16:13.711713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.711879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.711906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.096 qpair failed and we were unable to recover it. 00:30:08.096 [2024-07-13 10:16:13.712091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.712264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.712288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.096 qpair failed and we were unable to recover it. 00:30:08.096 [2024-07-13 10:16:13.712453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.712599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.712623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.096 qpair failed and we were unable to recover it. 00:30:08.096 [2024-07-13 10:16:13.712768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.712912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.712938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.096 qpair failed and we were unable to recover it. 00:30:08.096 [2024-07-13 10:16:13.713108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.713253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.713292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.096 qpair failed and we were unable to recover it. 00:30:08.096 [2024-07-13 10:16:13.713454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.713621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.713645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.096 qpair failed and we were unable to recover it. 00:30:08.096 [2024-07-13 10:16:13.713778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.713903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.713928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.096 qpair failed and we were unable to recover it. 00:30:08.096 [2024-07-13 10:16:13.714077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.714189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.714213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.096 qpair failed and we were unable to recover it. 00:30:08.096 [2024-07-13 10:16:13.714339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.714533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.714559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.096 qpair failed and we were unable to recover it. 00:30:08.096 [2024-07-13 10:16:13.714686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.714876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.714904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.096 qpair failed and we were unable to recover it. 00:30:08.096 [2024-07-13 10:16:13.715048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.715229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.715252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.096 qpair failed and we were unable to recover it. 00:30:08.096 [2024-07-13 10:16:13.715434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.715600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.715623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.096 qpair failed and we were unable to recover it. 00:30:08.096 [2024-07-13 10:16:13.715772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.715944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.715969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.096 qpair failed and we were unable to recover it. 00:30:08.096 [2024-07-13 10:16:13.716119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.716284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.716311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.096 qpair failed and we were unable to recover it. 00:30:08.096 [2024-07-13 10:16:13.716522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.716670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.716694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.096 qpair failed and we were unable to recover it. 00:30:08.096 [2024-07-13 10:16:13.716889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.717130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.717187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.096 qpair failed and we were unable to recover it. 00:30:08.096 [2024-07-13 10:16:13.717352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.717543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.717570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.096 qpair failed and we were unable to recover it. 00:30:08.096 [2024-07-13 10:16:13.717708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.717835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.717861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.096 qpair failed and we were unable to recover it. 00:30:08.096 [2024-07-13 10:16:13.718057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.718240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.718265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.096 qpair failed and we were unable to recover it. 00:30:08.096 [2024-07-13 10:16:13.718476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.718637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.096 [2024-07-13 10:16:13.718663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.096 qpair failed and we were unable to recover it. 00:30:08.097 [2024-07-13 10:16:13.718804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.718969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.718996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.097 qpair failed and we were unable to recover it. 00:30:08.097 [2024-07-13 10:16:13.719189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.719391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.719441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.097 qpair failed and we were unable to recover it. 00:30:08.097 [2024-07-13 10:16:13.719599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.719751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.719775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.097 qpair failed and we were unable to recover it. 00:30:08.097 [2024-07-13 10:16:13.719944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.720189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.720246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.097 qpair failed and we were unable to recover it. 00:30:08.097 [2024-07-13 10:16:13.720414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.720572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.720598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.097 qpair failed and we were unable to recover it. 00:30:08.097 [2024-07-13 10:16:13.720768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.720925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.720950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.097 qpair failed and we were unable to recover it. 00:30:08.097 [2024-07-13 10:16:13.721123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.721253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.721280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.097 qpair failed and we were unable to recover it. 00:30:08.097 [2024-07-13 10:16:13.721407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.721593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.721617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.097 qpair failed and we were unable to recover it. 00:30:08.097 [2024-07-13 10:16:13.721802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.721960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.721984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.097 qpair failed and we were unable to recover it. 00:30:08.097 [2024-07-13 10:16:13.722134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.722278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.722305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.097 qpair failed and we were unable to recover it. 00:30:08.097 [2024-07-13 10:16:13.722441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.722643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.722670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.097 qpair failed and we were unable to recover it. 00:30:08.097 [2024-07-13 10:16:13.722842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.722973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.723013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.097 qpair failed and we were unable to recover it. 00:30:08.097 [2024-07-13 10:16:13.723174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.723339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.723365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.097 qpair failed and we were unable to recover it. 00:30:08.097 [2024-07-13 10:16:13.723525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.723693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.723719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.097 qpair failed and we were unable to recover it. 00:30:08.097 [2024-07-13 10:16:13.723907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.724159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.724219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.097 qpair failed and we were unable to recover it. 00:30:08.097 [2024-07-13 10:16:13.724423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.724604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.724628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.097 qpair failed and we were unable to recover it. 00:30:08.097 [2024-07-13 10:16:13.724801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.724980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.725004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.097 qpair failed and we were unable to recover it. 00:30:08.097 [2024-07-13 10:16:13.725191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.725347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.725397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.097 qpair failed and we were unable to recover it. 00:30:08.097 [2024-07-13 10:16:13.725534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.725707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.725734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.097 qpair failed and we were unable to recover it. 00:30:08.097 [2024-07-13 10:16:13.725923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.726122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.726145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.097 qpair failed and we were unable to recover it. 00:30:08.097 [2024-07-13 10:16:13.726295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.726470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.726530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.097 qpair failed and we were unable to recover it. 00:30:08.097 [2024-07-13 10:16:13.726703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.726846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.726880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.097 qpair failed and we were unable to recover it. 00:30:08.097 [2024-07-13 10:16:13.727075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.727219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.727243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.097 qpair failed and we were unable to recover it. 00:30:08.097 [2024-07-13 10:16:13.727363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.727489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.727513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.097 qpair failed and we were unable to recover it. 00:30:08.097 [2024-07-13 10:16:13.727662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.727814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.727852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.097 qpair failed and we were unable to recover it. 00:30:08.097 [2024-07-13 10:16:13.728004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.728162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.728189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.097 qpair failed and we were unable to recover it. 00:30:08.097 [2024-07-13 10:16:13.728361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.728509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.728533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.097 qpair failed and we were unable to recover it. 00:30:08.097 [2024-07-13 10:16:13.728703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.728864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.728897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.097 qpair failed and we were unable to recover it. 00:30:08.097 [2024-07-13 10:16:13.729086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.729294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.729344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.097 qpair failed and we were unable to recover it. 00:30:08.097 [2024-07-13 10:16:13.729522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.729691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.729718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.097 qpair failed and we were unable to recover it. 00:30:08.097 [2024-07-13 10:16:13.729856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.730033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.097 [2024-07-13 10:16:13.730060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.098 qpair failed and we were unable to recover it. 00:30:08.098 [2024-07-13 10:16:13.730226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.730390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.730417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.098 qpair failed and we were unable to recover it. 00:30:08.098 [2024-07-13 10:16:13.730619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.730813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.730840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.098 qpair failed and we were unable to recover it. 00:30:08.098 [2024-07-13 10:16:13.731000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.731120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.731144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.098 qpair failed and we were unable to recover it. 00:30:08.098 [2024-07-13 10:16:13.731313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.731470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.731496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.098 qpair failed and we were unable to recover it. 00:30:08.098 [2024-07-13 10:16:13.731692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.731882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.731924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.098 qpair failed and we were unable to recover it. 00:30:08.098 [2024-07-13 10:16:13.732072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.732242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.732303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.098 qpair failed and we were unable to recover it. 00:30:08.098 [2024-07-13 10:16:13.732461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.732627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.732650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.098 qpair failed and we were unable to recover it. 00:30:08.098 [2024-07-13 10:16:13.732824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.732998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.733025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.098 qpair failed and we were unable to recover it. 00:30:08.098 [2024-07-13 10:16:13.733188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.733400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.733455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.098 qpair failed and we were unable to recover it. 00:30:08.098 [2024-07-13 10:16:13.733617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.733776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.733802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.098 qpair failed and we were unable to recover it. 00:30:08.098 [2024-07-13 10:16:13.733980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.734131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.734155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.098 qpair failed and we were unable to recover it. 00:30:08.098 [2024-07-13 10:16:13.734288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.734471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.734498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.098 qpair failed and we were unable to recover it. 00:30:08.098 [2024-07-13 10:16:13.734659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.734846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.734879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.098 qpair failed and we were unable to recover it. 00:30:08.098 [2024-07-13 10:16:13.735081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.735234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.735257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.098 qpair failed and we were unable to recover it. 00:30:08.098 [2024-07-13 10:16:13.735390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.735538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.735564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.098 qpair failed and we were unable to recover it. 00:30:08.098 [2024-07-13 10:16:13.735708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.735873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.735900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.098 qpair failed and we were unable to recover it. 00:30:08.098 [2024-07-13 10:16:13.736048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.736191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.736215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.098 qpair failed and we were unable to recover it. 00:30:08.098 [2024-07-13 10:16:13.736393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.736571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.736630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.098 qpair failed and we were unable to recover it. 00:30:08.098 [2024-07-13 10:16:13.736797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.736976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.737001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.098 qpair failed and we were unable to recover it. 00:30:08.098 [2024-07-13 10:16:13.737150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.737322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.737362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.098 qpair failed and we were unable to recover it. 00:30:08.098 [2024-07-13 10:16:13.737549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.737719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.737743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.098 qpair failed and we were unable to recover it. 00:30:08.098 [2024-07-13 10:16:13.737886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.738067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.738095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.098 qpair failed and we were unable to recover it. 00:30:08.098 [2024-07-13 10:16:13.738268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.738415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.738455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.098 qpair failed and we were unable to recover it. 00:30:08.098 [2024-07-13 10:16:13.738648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.738785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.738812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.098 qpair failed and we were unable to recover it. 00:30:08.098 [2024-07-13 10:16:13.738948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.739070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.739096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.098 qpair failed and we were unable to recover it. 00:30:08.098 [2024-07-13 10:16:13.739270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.739429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.739470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.098 qpair failed and we were unable to recover it. 00:30:08.098 [2024-07-13 10:16:13.739670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.739819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.739859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.098 qpair failed and we were unable to recover it. 00:30:08.098 [2024-07-13 10:16:13.740034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.740145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.740170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.098 qpair failed and we were unable to recover it. 00:30:08.098 [2024-07-13 10:16:13.740345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.740468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.740508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.098 qpair failed and we were unable to recover it. 00:30:08.098 [2024-07-13 10:16:13.740695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.098 [2024-07-13 10:16:13.740855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.740889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.099 qpair failed and we were unable to recover it. 00:30:08.099 [2024-07-13 10:16:13.741030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.741165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.741191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.099 qpair failed and we were unable to recover it. 00:30:08.099 [2024-07-13 10:16:13.741361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.741512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.741536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.099 qpair failed and we were unable to recover it. 00:30:08.099 [2024-07-13 10:16:13.741684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.741852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.741888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.099 qpair failed and we were unable to recover it. 00:30:08.099 [2024-07-13 10:16:13.742034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.742180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.742203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.099 qpair failed and we were unable to recover it. 00:30:08.099 [2024-07-13 10:16:13.742378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.742540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.742567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.099 qpair failed and we were unable to recover it. 00:30:08.099 [2024-07-13 10:16:13.742761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.742910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.742950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.099 qpair failed and we were unable to recover it. 00:30:08.099 [2024-07-13 10:16:13.743116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.743312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.743336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.099 qpair failed and we were unable to recover it. 00:30:08.099 [2024-07-13 10:16:13.743463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.743608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.743633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.099 qpair failed and we were unable to recover it. 00:30:08.099 [2024-07-13 10:16:13.743848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.744000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.744040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.099 qpair failed and we were unable to recover it. 00:30:08.099 [2024-07-13 10:16:13.744244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.744386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.744410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.099 qpair failed and we were unable to recover it. 00:30:08.099 [2024-07-13 10:16:13.744627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.744820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.744846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.099 qpair failed and we were unable to recover it. 00:30:08.099 [2024-07-13 10:16:13.745015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.745213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.745241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.099 qpair failed and we were unable to recover it. 00:30:08.099 [2024-07-13 10:16:13.745398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.745592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.745653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.099 qpair failed and we were unable to recover it. 00:30:08.099 [2024-07-13 10:16:13.745802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.745979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.746022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.099 qpair failed and we were unable to recover it. 00:30:08.099 [2024-07-13 10:16:13.746209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.746442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.746502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.099 qpair failed and we were unable to recover it. 00:30:08.099 [2024-07-13 10:16:13.746693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.746830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.746856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.099 qpair failed and we were unable to recover it. 00:30:08.099 [2024-07-13 10:16:13.747010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.747136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.747159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.099 qpair failed and we were unable to recover it. 00:30:08.099 [2024-07-13 10:16:13.747284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.747460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.747500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.099 qpair failed and we were unable to recover it. 00:30:08.099 [2024-07-13 10:16:13.747688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.747878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.747906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.099 qpair failed and we were unable to recover it. 00:30:08.099 [2024-07-13 10:16:13.748080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.748290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.748341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.099 qpair failed and we were unable to recover it. 00:30:08.099 [2024-07-13 10:16:13.748503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.748661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.748687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.099 qpair failed and we were unable to recover it. 00:30:08.099 [2024-07-13 10:16:13.748827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.749000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.749029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.099 qpair failed and we were unable to recover it. 00:30:08.099 [2024-07-13 10:16:13.749154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.749308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.749332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.099 qpair failed and we were unable to recover it. 00:30:08.099 [2024-07-13 10:16:13.749546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.749680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.749707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.099 qpair failed and we were unable to recover it. 00:30:08.099 [2024-07-13 10:16:13.749911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.750060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.750084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.099 qpair failed and we were unable to recover it. 00:30:08.099 [2024-07-13 10:16:13.750264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.750432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.099 [2024-07-13 10:16:13.750459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.100 qpair failed and we were unable to recover it. 00:30:08.100 [2024-07-13 10:16:13.750586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.750746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.750773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.100 qpair failed and we were unable to recover it. 00:30:08.100 [2024-07-13 10:16:13.750960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.751083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.751107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.100 qpair failed and we were unable to recover it. 00:30:08.100 [2024-07-13 10:16:13.751259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.751384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.751409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.100 qpair failed and we were unable to recover it. 00:30:08.100 [2024-07-13 10:16:13.751562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.751737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.751763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.100 qpair failed and we were unable to recover it. 00:30:08.100 [2024-07-13 10:16:13.751956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.752122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.752149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.100 qpair failed and we were unable to recover it. 00:30:08.100 [2024-07-13 10:16:13.752322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.752478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.752501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.100 qpair failed and we were unable to recover it. 00:30:08.100 [2024-07-13 10:16:13.752704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.752854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.752886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.100 qpair failed and we were unable to recover it. 00:30:08.100 [2024-07-13 10:16:13.753051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.753203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.753230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.100 qpair failed and we were unable to recover it. 00:30:08.100 [2024-07-13 10:16:13.753377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.753528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.753551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.100 qpair failed and we were unable to recover it. 00:30:08.100 [2024-07-13 10:16:13.753722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.753918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.753946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.100 qpair failed and we were unable to recover it. 00:30:08.100 [2024-07-13 10:16:13.754115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.754303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.754329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.100 qpair failed and we were unable to recover it. 00:30:08.100 [2024-07-13 10:16:13.754494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.754686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.754713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.100 qpair failed and we were unable to recover it. 00:30:08.100 [2024-07-13 10:16:13.754880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.755056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.755083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.100 qpair failed and we were unable to recover it. 00:30:08.100 [2024-07-13 10:16:13.755256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.755418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.755446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.100 qpair failed and we were unable to recover it. 00:30:08.100 [2024-07-13 10:16:13.755612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.755767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.755791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.100 qpair failed and we were unable to recover it. 00:30:08.100 [2024-07-13 10:16:13.755939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.756112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.756138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.100 qpair failed and we were unable to recover it. 00:30:08.100 [2024-07-13 10:16:13.756319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.756469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.756493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.100 qpair failed and we were unable to recover it. 00:30:08.100 [2024-07-13 10:16:13.756617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.756792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.756816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.100 qpair failed and we were unable to recover it. 00:30:08.100 [2024-07-13 10:16:13.756977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.757131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.757155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.100 qpair failed and we were unable to recover it. 00:30:08.100 [2024-07-13 10:16:13.757283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.757457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.757481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.100 qpair failed and we were unable to recover it. 00:30:08.100 [2024-07-13 10:16:13.757602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.757748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.757772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.100 qpair failed and we were unable to recover it. 00:30:08.100 [2024-07-13 10:16:13.757896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.758048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.758072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.100 qpair failed and we were unable to recover it. 00:30:08.100 [2024-07-13 10:16:13.758197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.758371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.758396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.100 qpair failed and we were unable to recover it. 00:30:08.100 [2024-07-13 10:16:13.758515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.758663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.758687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.100 qpair failed and we were unable to recover it. 00:30:08.100 [2024-07-13 10:16:13.758838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.759018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.759042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.100 qpair failed and we were unable to recover it. 00:30:08.100 [2024-07-13 10:16:13.759186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.759304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.759328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.100 qpair failed and we were unable to recover it. 00:30:08.100 [2024-07-13 10:16:13.759482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.759611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.759651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.100 qpair failed and we were unable to recover it. 00:30:08.100 [2024-07-13 10:16:13.759830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.759993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.760017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.100 qpair failed and we were unable to recover it. 00:30:08.100 [2024-07-13 10:16:13.760193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.760314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.760337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.100 qpair failed and we were unable to recover it. 00:30:08.100 [2024-07-13 10:16:13.760461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.760637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.100 [2024-07-13 10:16:13.760661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.100 qpair failed and we were unable to recover it. 00:30:08.100 [2024-07-13 10:16:13.760843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.761027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.761051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.101 qpair failed and we were unable to recover it. 00:30:08.101 [2024-07-13 10:16:13.761165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.761283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.761306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.101 qpair failed and we were unable to recover it. 00:30:08.101 [2024-07-13 10:16:13.761452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.761605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.761628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.101 qpair failed and we were unable to recover it. 00:30:08.101 [2024-07-13 10:16:13.761780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.761947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.761975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.101 qpair failed and we were unable to recover it. 00:30:08.101 [2024-07-13 10:16:13.762107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.762311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.762334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.101 qpair failed and we were unable to recover it. 00:30:08.101 [2024-07-13 10:16:13.762452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.762598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.762621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.101 qpair failed and we were unable to recover it. 00:30:08.101 [2024-07-13 10:16:13.762813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.762934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.762962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.101 qpair failed and we were unable to recover it. 00:30:08.101 [2024-07-13 10:16:13.763138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.763272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.763296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.101 qpair failed and we were unable to recover it. 00:30:08.101 [2024-07-13 10:16:13.763424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.763614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.763641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.101 qpair failed and we were unable to recover it. 00:30:08.101 [2024-07-13 10:16:13.763841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.763998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.764025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.101 qpair failed and we were unable to recover it. 00:30:08.101 [2024-07-13 10:16:13.764153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.764275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.764301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.101 qpair failed and we were unable to recover it. 00:30:08.101 [2024-07-13 10:16:13.764470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.764652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.764676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.101 qpair failed and we were unable to recover it. 00:30:08.101 [2024-07-13 10:16:13.764814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.764988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.765014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.101 qpair failed and we were unable to recover it. 00:30:08.101 [2024-07-13 10:16:13.765165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.765358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.765385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.101 qpair failed and we were unable to recover it. 00:30:08.101 [2024-07-13 10:16:13.765550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.765698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.765721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.101 qpair failed and we were unable to recover it. 00:30:08.101 [2024-07-13 10:16:13.765879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.766014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.766054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.101 qpair failed and we were unable to recover it. 00:30:08.101 [2024-07-13 10:16:13.766192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.766360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.766394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.101 qpair failed and we were unable to recover it. 00:30:08.101 [2024-07-13 10:16:13.766563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.766716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.766739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.101 qpair failed and we were unable to recover it. 00:30:08.101 [2024-07-13 10:16:13.766882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.767079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.767104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.101 qpair failed and we were unable to recover it. 00:30:08.101 [2024-07-13 10:16:13.767279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.767429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.767454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.101 qpair failed and we were unable to recover it. 00:30:08.101 [2024-07-13 10:16:13.767615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.767742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.767766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.101 qpair failed and we were unable to recover it. 00:30:08.101 [2024-07-13 10:16:13.767889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.768061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.768088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.101 qpair failed and we were unable to recover it. 00:30:08.101 [2024-07-13 10:16:13.768260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.768430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.768454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.101 qpair failed and we were unable to recover it. 00:30:08.101 [2024-07-13 10:16:13.768605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.768728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.768752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.101 qpair failed and we were unable to recover it. 00:30:08.101 [2024-07-13 10:16:13.768933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.769107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.769135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.101 qpair failed and we were unable to recover it. 00:30:08.101 [2024-07-13 10:16:13.769310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.769450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.769477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.101 qpair failed and we were unable to recover it. 00:30:08.101 [2024-07-13 10:16:13.769651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.769822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.769845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.101 qpair failed and we were unable to recover it. 00:30:08.101 [2024-07-13 10:16:13.769984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.770154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.770184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.101 qpair failed and we were unable to recover it. 00:30:08.101 [2024-07-13 10:16:13.770331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.770500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.770527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.101 qpair failed and we were unable to recover it. 00:30:08.101 [2024-07-13 10:16:13.770673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.770827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.770851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.101 qpair failed and we were unable to recover it. 00:30:08.101 [2024-07-13 10:16:13.771005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.771155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.101 [2024-07-13 10:16:13.771179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.102 qpair failed and we were unable to recover it. 00:30:08.102 [2024-07-13 10:16:13.771332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.771474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.771498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.102 qpair failed and we were unable to recover it. 00:30:08.102 [2024-07-13 10:16:13.771701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.771893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.771920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.102 qpair failed and we were unable to recover it. 00:30:08.102 [2024-07-13 10:16:13.772083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.772232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.772256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.102 qpair failed and we were unable to recover it. 00:30:08.102 [2024-07-13 10:16:13.772428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.772573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.772597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.102 qpair failed and we were unable to recover it. 00:30:08.102 [2024-07-13 10:16:13.772720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.772844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.772884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.102 qpair failed and we were unable to recover it. 00:30:08.102 [2024-07-13 10:16:13.773048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.773200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.773224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.102 qpair failed and we were unable to recover it. 00:30:08.102 [2024-07-13 10:16:13.773402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.773555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.773578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.102 qpair failed and we were unable to recover it. 00:30:08.102 [2024-07-13 10:16:13.773705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.773826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.773850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.102 qpair failed and we were unable to recover it. 00:30:08.102 [2024-07-13 10:16:13.773975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.774172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.774199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.102 qpair failed and we were unable to recover it. 00:30:08.102 [2024-07-13 10:16:13.774358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.774568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.774624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.102 qpair failed and we were unable to recover it. 00:30:08.102 [2024-07-13 10:16:13.774788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.774915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.774939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.102 qpair failed and we were unable to recover it. 00:30:08.102 [2024-07-13 10:16:13.775088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.775204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.775227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.102 qpair failed and we were unable to recover it. 00:30:08.102 [2024-07-13 10:16:13.775405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.775559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.775583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.102 qpair failed and we were unable to recover it. 00:30:08.102 [2024-07-13 10:16:13.775705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.775859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.775890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.102 qpair failed and we were unable to recover it. 00:30:08.102 [2024-07-13 10:16:13.776018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.776222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.776246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.102 qpair failed and we were unable to recover it. 00:30:08.102 [2024-07-13 10:16:13.776372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.776551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.776578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.102 qpair failed and we were unable to recover it. 00:30:08.102 [2024-07-13 10:16:13.776802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.776986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.777011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.102 qpair failed and we were unable to recover it. 00:30:08.102 [2024-07-13 10:16:13.777191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.777343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.777386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.102 qpair failed and we were unable to recover it. 00:30:08.102 [2024-07-13 10:16:13.777580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.777765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.777792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.102 qpair failed and we were unable to recover it. 00:30:08.102 [2024-07-13 10:16:13.777953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.778099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.778124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.102 qpair failed and we were unable to recover it. 00:30:08.102 [2024-07-13 10:16:13.778252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.778371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.778395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.102 qpair failed and we were unable to recover it. 00:30:08.102 [2024-07-13 10:16:13.778519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.778645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.778669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.102 qpair failed and we were unable to recover it. 00:30:08.102 [2024-07-13 10:16:13.778816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.778984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.779012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.102 qpair failed and we were unable to recover it. 00:30:08.102 [2024-07-13 10:16:13.779177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.779324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.779350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.102 qpair failed and we were unable to recover it. 00:30:08.102 [2024-07-13 10:16:13.779509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.779656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.779680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.102 qpair failed and we were unable to recover it. 00:30:08.102 [2024-07-13 10:16:13.779830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.780027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.780055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.102 qpair failed and we were unable to recover it. 00:30:08.102 [2024-07-13 10:16:13.780221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.780395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.780451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.102 qpair failed and we were unable to recover it. 00:30:08.102 [2024-07-13 10:16:13.780624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.780801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.780825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.102 qpair failed and we were unable to recover it. 00:30:08.102 [2024-07-13 10:16:13.780985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.781161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.781185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.102 qpair failed and we were unable to recover it. 00:30:08.102 [2024-07-13 10:16:13.781321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.781457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.781484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.102 qpair failed and we were unable to recover it. 00:30:08.102 [2024-07-13 10:16:13.781647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.102 [2024-07-13 10:16:13.781775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.781802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.103 qpair failed and we were unable to recover it. 00:30:08.103 [2024-07-13 10:16:13.781970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.782123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.782147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.103 qpair failed and we were unable to recover it. 00:30:08.103 [2024-07-13 10:16:13.782270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.782394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.782417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.103 qpair failed and we were unable to recover it. 00:30:08.103 [2024-07-13 10:16:13.782583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.782775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.782802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.103 qpair failed and we were unable to recover it. 00:30:08.103 [2024-07-13 10:16:13.782939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.783066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.783091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.103 qpair failed and we were unable to recover it. 00:30:08.103 [2024-07-13 10:16:13.783268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.783476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.783525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.103 qpair failed and we were unable to recover it. 00:30:08.103 [2024-07-13 10:16:13.783665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.783834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.783871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.103 qpair failed and we were unable to recover it. 00:30:08.103 [2024-07-13 10:16:13.784078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.784296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.784345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.103 qpair failed and we were unable to recover it. 00:30:08.103 [2024-07-13 10:16:13.784511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.784644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.784671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.103 qpair failed and we were unable to recover it. 00:30:08.103 [2024-07-13 10:16:13.784850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.785057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.785084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.103 qpair failed and we were unable to recover it. 00:30:08.103 [2024-07-13 10:16:13.785251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.785401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.785425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.103 qpair failed and we were unable to recover it. 00:30:08.103 [2024-07-13 10:16:13.785586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.785763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.785786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.103 qpair failed and we were unable to recover it. 00:30:08.103 [2024-07-13 10:16:13.785939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.786090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.786116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.103 qpair failed and we were unable to recover it. 00:30:08.103 [2024-07-13 10:16:13.786279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.786466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.786511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.103 qpair failed and we were unable to recover it. 00:30:08.103 [2024-07-13 10:16:13.786660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.786793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.786819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.103 qpair failed and we were unable to recover it. 00:30:08.103 [2024-07-13 10:16:13.787002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.787132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.787155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.103 qpair failed and we were unable to recover it. 00:30:08.103 [2024-07-13 10:16:13.787328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.787504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.787553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.103 qpair failed and we were unable to recover it. 00:30:08.103 [2024-07-13 10:16:13.787728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.787864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.787913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.103 qpair failed and we were unable to recover it. 00:30:08.103 [2024-07-13 10:16:13.788045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.788205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.788229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.103 qpair failed and we were unable to recover it. 00:30:08.103 [2024-07-13 10:16:13.788348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.788497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.788521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.103 qpair failed and we were unable to recover it. 00:30:08.103 [2024-07-13 10:16:13.788656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.788830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.788855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.103 qpair failed and we were unable to recover it. 00:30:08.103 [2024-07-13 10:16:13.789039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.789193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.789220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.103 qpair failed and we were unable to recover it. 00:30:08.103 [2024-07-13 10:16:13.789393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.789514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.789538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.103 qpair failed and we were unable to recover it. 00:30:08.103 [2024-07-13 10:16:13.789692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.789864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.789895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.103 qpair failed and we were unable to recover it. 00:30:08.103 [2024-07-13 10:16:13.790045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.790231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.790258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.103 qpair failed and we were unable to recover it. 00:30:08.103 [2024-07-13 10:16:13.790425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.790573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.790613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.103 qpair failed and we were unable to recover it. 00:30:08.103 [2024-07-13 10:16:13.790789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.790943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.103 [2024-07-13 10:16:13.790968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.103 qpair failed and we were unable to recover it. 00:30:08.103 [2024-07-13 10:16:13.791106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.791222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.791246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.104 qpair failed and we were unable to recover it. 00:30:08.104 [2024-07-13 10:16:13.791399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.791547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.791571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.104 qpair failed and we were unable to recover it. 00:30:08.104 [2024-07-13 10:16:13.791722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.791844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.791872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.104 qpair failed and we were unable to recover it. 00:30:08.104 [2024-07-13 10:16:13.792029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.792177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.792200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.104 qpair failed and we were unable to recover it. 00:30:08.104 [2024-07-13 10:16:13.792387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.792566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.792590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.104 qpair failed and we were unable to recover it. 00:30:08.104 [2024-07-13 10:16:13.792721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.792842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.792881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.104 qpair failed and we were unable to recover it. 00:30:08.104 [2024-07-13 10:16:13.793009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.793132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.793155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.104 qpair failed and we were unable to recover it. 00:30:08.104 [2024-07-13 10:16:13.793333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.793501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.793527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.104 qpair failed and we were unable to recover it. 00:30:08.104 [2024-07-13 10:16:13.793684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.793814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.793840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.104 qpair failed and we were unable to recover it. 00:30:08.104 [2024-07-13 10:16:13.794014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.794187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.794211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.104 qpair failed and we were unable to recover it. 00:30:08.104 [2024-07-13 10:16:13.794393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.794568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.794592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.104 qpair failed and we were unable to recover it. 00:30:08.104 [2024-07-13 10:16:13.794718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.794878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.794903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.104 qpair failed and we were unable to recover it. 00:30:08.104 [2024-07-13 10:16:13.795055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.795204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.795227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.104 qpair failed and we were unable to recover it. 00:30:08.104 [2024-07-13 10:16:13.795381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.795530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.795554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.104 qpair failed and we were unable to recover it. 00:30:08.104 [2024-07-13 10:16:13.795710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.795885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.795927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.104 qpair failed and we were unable to recover it. 00:30:08.104 [2024-07-13 10:16:13.796088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.796252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.796278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.104 qpair failed and we were unable to recover it. 00:30:08.104 [2024-07-13 10:16:13.796433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.796583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.796624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.104 qpair failed and we were unable to recover it. 00:30:08.104 [2024-07-13 10:16:13.796792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.796964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.796989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.104 qpair failed and we were unable to recover it. 00:30:08.104 [2024-07-13 10:16:13.797115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.797305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.797329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.104 qpair failed and we were unable to recover it. 00:30:08.104 [2024-07-13 10:16:13.797480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.797629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.797653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.104 qpair failed and we were unable to recover it. 00:30:08.104 [2024-07-13 10:16:13.797823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.797955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.797979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.104 qpair failed and we were unable to recover it. 00:30:08.104 [2024-07-13 10:16:13.798110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.798252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.798278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.104 qpair failed and we were unable to recover it. 00:30:08.104 [2024-07-13 10:16:13.798475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.798601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.798641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.104 qpair failed and we were unable to recover it. 00:30:08.104 [2024-07-13 10:16:13.798806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.798969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.798996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.104 qpair failed and we were unable to recover it. 00:30:08.104 [2024-07-13 10:16:13.799163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.799334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.799358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.104 qpair failed and we were unable to recover it. 00:30:08.104 [2024-07-13 10:16:13.799486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.799605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.799628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.104 qpair failed and we were unable to recover it. 00:30:08.104 [2024-07-13 10:16:13.799776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.799896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.799920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.104 qpair failed and we were unable to recover it. 00:30:08.104 [2024-07-13 10:16:13.800056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.800203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.800227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.104 qpair failed and we were unable to recover it. 00:30:08.104 [2024-07-13 10:16:13.800377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.800550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.800573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.104 qpair failed and we were unable to recover it. 00:30:08.104 [2024-07-13 10:16:13.800777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.800934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.800962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.104 qpair failed and we were unable to recover it. 00:30:08.104 [2024-07-13 10:16:13.801151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.104 [2024-07-13 10:16:13.801337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.801395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.105 qpair failed and we were unable to recover it. 00:30:08.105 [2024-07-13 10:16:13.801540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.801702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.801726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.105 qpair failed and we were unable to recover it. 00:30:08.105 [2024-07-13 10:16:13.801882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.802036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.802061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.105 qpair failed and we were unable to recover it. 00:30:08.105 [2024-07-13 10:16:13.802183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.802333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.802357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.105 qpair failed and we were unable to recover it. 00:30:08.105 [2024-07-13 10:16:13.802509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.802656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.802679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.105 qpair failed and we were unable to recover it. 00:30:08.105 [2024-07-13 10:16:13.802796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.802927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.802952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.105 qpair failed and we were unable to recover it. 00:30:08.105 [2024-07-13 10:16:13.803100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.803263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.803291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.105 qpair failed and we were unable to recover it. 00:30:08.105 [2024-07-13 10:16:13.803491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.803617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.803660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.105 qpair failed and we were unable to recover it. 00:30:08.105 [2024-07-13 10:16:13.803816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.803956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.803993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.105 qpair failed and we were unable to recover it. 00:30:08.105 [2024-07-13 10:16:13.804159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.804325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.804349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.105 qpair failed and we were unable to recover it. 00:30:08.105 [2024-07-13 10:16:13.804478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.804650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.804674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.105 qpair failed and we were unable to recover it. 00:30:08.105 [2024-07-13 10:16:13.804810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.804927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.804951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.105 qpair failed and we were unable to recover it. 00:30:08.105 [2024-07-13 10:16:13.805070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.805216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.805239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.105 qpair failed and we were unable to recover it. 00:30:08.105 [2024-07-13 10:16:13.805392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.805617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.805661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.105 qpair failed and we were unable to recover it. 00:30:08.105 [2024-07-13 10:16:13.805801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.805973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.805997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.105 qpair failed and we were unable to recover it. 00:30:08.105 [2024-07-13 10:16:13.806124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.806276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.806302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.105 qpair failed and we were unable to recover it. 00:30:08.105 [2024-07-13 10:16:13.806491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.806672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.806696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.105 qpair failed and we were unable to recover it. 00:30:08.105 [2024-07-13 10:16:13.806819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.806944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.806985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.105 qpair failed and we were unable to recover it. 00:30:08.105 [2024-07-13 10:16:13.807152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.807312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.807338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.105 qpair failed and we were unable to recover it. 00:30:08.105 [2024-07-13 10:16:13.807510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.807655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.807679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.105 qpair failed and we were unable to recover it. 00:30:08.105 [2024-07-13 10:16:13.807829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.807984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.808009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.105 qpair failed and we were unable to recover it. 00:30:08.105 [2024-07-13 10:16:13.808157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.808327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.808353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.105 qpair failed and we were unable to recover it. 00:30:08.105 [2024-07-13 10:16:13.808532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.808657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.808681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.105 qpair failed and we were unable to recover it. 00:30:08.105 [2024-07-13 10:16:13.808829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.808993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.809018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.105 qpair failed and we were unable to recover it. 00:30:08.105 [2024-07-13 10:16:13.809169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.809281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.809304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.105 qpair failed and we were unable to recover it. 00:30:08.105 [2024-07-13 10:16:13.809466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.809582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.809606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.105 qpair failed and we were unable to recover it. 00:30:08.105 [2024-07-13 10:16:13.809731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.809876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.809900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.105 qpair failed and we were unable to recover it. 00:30:08.105 [2024-07-13 10:16:13.810032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.810176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.810199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.105 qpair failed and we were unable to recover it. 00:30:08.105 [2024-07-13 10:16:13.810384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.810532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.810572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.105 qpair failed and we were unable to recover it. 00:30:08.105 [2024-07-13 10:16:13.810763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.810926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.810954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.105 qpair failed and we were unable to recover it. 00:30:08.105 [2024-07-13 10:16:13.811143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.811284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.105 [2024-07-13 10:16:13.811311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.105 qpair failed and we were unable to recover it. 00:30:08.105 [2024-07-13 10:16:13.811509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.811693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.811717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.106 qpair failed and we were unable to recover it. 00:30:08.106 [2024-07-13 10:16:13.811877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.812000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.812025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.106 qpair failed and we were unable to recover it. 00:30:08.106 [2024-07-13 10:16:13.812161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.812362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.812386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.106 qpair failed and we were unable to recover it. 00:30:08.106 [2024-07-13 10:16:13.812537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.812658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.812682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.106 qpair failed and we were unable to recover it. 00:30:08.106 [2024-07-13 10:16:13.812873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.813055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.813080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.106 qpair failed and we were unable to recover it. 00:30:08.106 [2024-07-13 10:16:13.813202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.813352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.813376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.106 qpair failed and we were unable to recover it. 00:30:08.106 [2024-07-13 10:16:13.813556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.813697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.813721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.106 qpair failed and we were unable to recover it. 00:30:08.106 [2024-07-13 10:16:13.813895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.814053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.814080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.106 qpair failed and we were unable to recover it. 00:30:08.106 [2024-07-13 10:16:13.814249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.814437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.814465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.106 qpair failed and we were unable to recover it. 00:30:08.106 [2024-07-13 10:16:13.814634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.814787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.814813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.106 qpair failed and we were unable to recover it. 00:30:08.106 [2024-07-13 10:16:13.814989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.815137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.815162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.106 qpair failed and we were unable to recover it. 00:30:08.106 [2024-07-13 10:16:13.815309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.815482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.815508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.106 qpair failed and we were unable to recover it. 00:30:08.106 [2024-07-13 10:16:13.815678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.815826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.815885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.106 qpair failed and we were unable to recover it. 00:30:08.106 [2024-07-13 10:16:13.816046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.816273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.816323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.106 qpair failed and we were unable to recover it. 00:30:08.106 [2024-07-13 10:16:13.816479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.816599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.816623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.106 qpair failed and we were unable to recover it. 00:30:08.106 [2024-07-13 10:16:13.816775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.816924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.816949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.106 qpair failed and we were unable to recover it. 00:30:08.106 [2024-07-13 10:16:13.817092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.817209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.817233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.106 qpair failed and we were unable to recover it. 00:30:08.106 [2024-07-13 10:16:13.817384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.817531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.817555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.106 qpair failed and we were unable to recover it. 00:30:08.106 [2024-07-13 10:16:13.817774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.817953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.817977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.106 qpair failed and we were unable to recover it. 00:30:08.106 [2024-07-13 10:16:13.818107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.818246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.818272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.106 qpair failed and we were unable to recover it. 00:30:08.106 [2024-07-13 10:16:13.818436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.818559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.818591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.106 qpair failed and we were unable to recover it. 00:30:08.106 [2024-07-13 10:16:13.818766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.818941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.818965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.106 qpair failed and we were unable to recover it. 00:30:08.106 [2024-07-13 10:16:13.819092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.819242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.819281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.106 qpair failed and we were unable to recover it. 00:30:08.106 [2024-07-13 10:16:13.819455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.819623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.819649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.106 qpair failed and we were unable to recover it. 00:30:08.106 [2024-07-13 10:16:13.819820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.819990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.820015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.106 qpair failed and we were unable to recover it. 00:30:08.106 [2024-07-13 10:16:13.820184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.820381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.820405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.106 qpair failed and we were unable to recover it. 00:30:08.106 [2024-07-13 10:16:13.820551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.820712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.820739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.106 qpair failed and we were unable to recover it. 00:30:08.106 [2024-07-13 10:16:13.820885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.821004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.821028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.106 qpair failed and we were unable to recover it. 00:30:08.106 [2024-07-13 10:16:13.821205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.821351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.821376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.106 qpair failed and we were unable to recover it. 00:30:08.106 [2024-07-13 10:16:13.821552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.821691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.821718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.106 qpair failed and we were unable to recover it. 00:30:08.106 [2024-07-13 10:16:13.821870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.822012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.106 [2024-07-13 10:16:13.822040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.106 qpair failed and we were unable to recover it. 00:30:08.107 [2024-07-13 10:16:13.822198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.822343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.822367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.107 qpair failed and we were unable to recover it. 00:30:08.107 [2024-07-13 10:16:13.822584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.822734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.822758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.107 qpair failed and we were unable to recover it. 00:30:08.107 [2024-07-13 10:16:13.822884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.823059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.823100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.107 qpair failed and we were unable to recover it. 00:30:08.107 [2024-07-13 10:16:13.823267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.823455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.823479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.107 qpair failed and we were unable to recover it. 00:30:08.107 [2024-07-13 10:16:13.823655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.823777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.823801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.107 qpair failed and we were unable to recover it. 00:30:08.107 [2024-07-13 10:16:13.823951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.824147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.824173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.107 qpair failed and we were unable to recover it. 00:30:08.107 [2024-07-13 10:16:13.824366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.824529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.824580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.107 qpair failed and we were unable to recover it. 00:30:08.107 [2024-07-13 10:16:13.824747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.824884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.824911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.107 qpair failed and we were unable to recover it. 00:30:08.107 [2024-07-13 10:16:13.825082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.825245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.825272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.107 qpair failed and we were unable to recover it. 00:30:08.107 [2024-07-13 10:16:13.825406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.825595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.825622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.107 qpair failed and we were unable to recover it. 00:30:08.107 [2024-07-13 10:16:13.825792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.825959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.825986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.107 qpair failed and we were unable to recover it. 00:30:08.107 [2024-07-13 10:16:13.826160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.826279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.826303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.107 qpair failed and we were unable to recover it. 00:30:08.107 [2024-07-13 10:16:13.826479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.826651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.826678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.107 qpair failed and we were unable to recover it. 00:30:08.107 [2024-07-13 10:16:13.826846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.827034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.827062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.107 qpair failed and we were unable to recover it. 00:30:08.107 [2024-07-13 10:16:13.827216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.827334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.827358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.107 qpair failed and we were unable to recover it. 00:30:08.107 [2024-07-13 10:16:13.827504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.827678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.827720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.107 qpair failed and we were unable to recover it. 00:30:08.107 [2024-07-13 10:16:13.827917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.828095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.828119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.107 qpair failed and we were unable to recover it. 00:30:08.107 [2024-07-13 10:16:13.828267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.828389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.828413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.107 qpair failed and we were unable to recover it. 00:30:08.107 [2024-07-13 10:16:13.828535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.828686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.828711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.107 qpair failed and we were unable to recover it. 00:30:08.107 [2024-07-13 10:16:13.828847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.829058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.829082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.107 qpair failed and we were unable to recover it. 00:30:08.107 [2024-07-13 10:16:13.829235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.829378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.829403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.107 qpair failed and we were unable to recover it. 00:30:08.107 [2024-07-13 10:16:13.829553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.829717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.829743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.107 qpair failed and we were unable to recover it. 00:30:08.107 [2024-07-13 10:16:13.829922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.830074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.830098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.107 qpair failed and we were unable to recover it. 00:30:08.107 [2024-07-13 10:16:13.830244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.830393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.830434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.107 qpair failed and we were unable to recover it. 00:30:08.107 [2024-07-13 10:16:13.830605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.830794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.830820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.107 qpair failed and we were unable to recover it. 00:30:08.107 [2024-07-13 10:16:13.831000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.831141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.831167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.107 qpair failed and we were unable to recover it. 00:30:08.107 [2024-07-13 10:16:13.831361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.107 [2024-07-13 10:16:13.831488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.831513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.108 qpair failed and we were unable to recover it. 00:30:08.108 [2024-07-13 10:16:13.831666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.831786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.831810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.108 qpair failed and we were unable to recover it. 00:30:08.108 [2024-07-13 10:16:13.831965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.832090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.832113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.108 qpair failed and we were unable to recover it. 00:30:08.108 [2024-07-13 10:16:13.832260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.832407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.832431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.108 qpair failed and we were unable to recover it. 00:30:08.108 [2024-07-13 10:16:13.832609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.832772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.832799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.108 qpair failed and we were unable to recover it. 00:30:08.108 [2024-07-13 10:16:13.832994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.833159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.833187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.108 qpair failed and we were unable to recover it. 00:30:08.108 [2024-07-13 10:16:13.833326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.833477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.833502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.108 qpair failed and we were unable to recover it. 00:30:08.108 [2024-07-13 10:16:13.833673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.833828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.833852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.108 qpair failed and we were unable to recover it. 00:30:08.108 [2024-07-13 10:16:13.834011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.834132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.834155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.108 qpair failed and we were unable to recover it. 00:30:08.108 [2024-07-13 10:16:13.834306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.834429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.834469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.108 qpair failed and we were unable to recover it. 00:30:08.108 [2024-07-13 10:16:13.834666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.834792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.834818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.108 qpair failed and we were unable to recover it. 00:30:08.108 [2024-07-13 10:16:13.834973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.835120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.835143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.108 qpair failed and we were unable to recover it. 00:30:08.108 [2024-07-13 10:16:13.835291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.835437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.835461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.108 qpair failed and we were unable to recover it. 00:30:08.108 [2024-07-13 10:16:13.835604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.835754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.835778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.108 qpair failed and we were unable to recover it. 00:30:08.108 [2024-07-13 10:16:13.835906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.836058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.836083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.108 qpair failed and we were unable to recover it. 00:30:08.108 [2024-07-13 10:16:13.836232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.836432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.836458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.108 qpair failed and we were unable to recover it. 00:30:08.108 [2024-07-13 10:16:13.836651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.836819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.836845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.108 qpair failed and we were unable to recover it. 00:30:08.108 [2024-07-13 10:16:13.836988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.837177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.837203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.108 qpair failed and we were unable to recover it. 00:30:08.108 [2024-07-13 10:16:13.837373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.837538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.837604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.108 qpair failed and we were unable to recover it. 00:30:08.108 [2024-07-13 10:16:13.837797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.837963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.837991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.108 qpair failed and we were unable to recover it. 00:30:08.108 [2024-07-13 10:16:13.838180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.838339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.838366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.108 qpair failed and we were unable to recover it. 00:30:08.108 [2024-07-13 10:16:13.838525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.838680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.838704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.108 qpair failed and we were unable to recover it. 00:30:08.108 [2024-07-13 10:16:13.838929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.839095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.839122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.108 qpair failed and we were unable to recover it. 00:30:08.108 [2024-07-13 10:16:13.839296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.839441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.839465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.108 qpair failed and we were unable to recover it. 00:30:08.108 [2024-07-13 10:16:13.839619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.839743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.839786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.108 qpair failed and we were unable to recover it. 00:30:08.108 [2024-07-13 10:16:13.839940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.840115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.840139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.108 qpair failed and we were unable to recover it. 00:30:08.108 [2024-07-13 10:16:13.840355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.840538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.840562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.108 qpair failed and we were unable to recover it. 00:30:08.108 [2024-07-13 10:16:13.840712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.840885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.840909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.108 qpair failed and we were unable to recover it. 00:30:08.108 [2024-07-13 10:16:13.841064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.841230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.841256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.108 qpair failed and we were unable to recover it. 00:30:08.108 [2024-07-13 10:16:13.841414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.841587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.841610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.108 qpair failed and we were unable to recover it. 00:30:08.108 [2024-07-13 10:16:13.841784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.108 [2024-07-13 10:16:13.841994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.842019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.109 qpair failed and we were unable to recover it. 00:30:08.109 [2024-07-13 10:16:13.842211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.842383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.842432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.109 qpair failed and we were unable to recover it. 00:30:08.109 [2024-07-13 10:16:13.842621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.842810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.842837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.109 qpair failed and we were unable to recover it. 00:30:08.109 [2024-07-13 10:16:13.842985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.843136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.843159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.109 qpair failed and we were unable to recover it. 00:30:08.109 [2024-07-13 10:16:13.843336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.843488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.843512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.109 qpair failed and we were unable to recover it. 00:30:08.109 [2024-07-13 10:16:13.843668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.843855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.843887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.109 qpair failed and we were unable to recover it. 00:30:08.109 [2024-07-13 10:16:13.844040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.844162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.844186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.109 qpair failed and we were unable to recover it. 00:30:08.109 [2024-07-13 10:16:13.844339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.844483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.844506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.109 qpair failed and we were unable to recover it. 00:30:08.109 [2024-07-13 10:16:13.844657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.844821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.844847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.109 qpair failed and we were unable to recover it. 00:30:08.109 [2024-07-13 10:16:13.845002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.845119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.845142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.109 qpair failed and we were unable to recover it. 00:30:08.109 [2024-07-13 10:16:13.845346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.845505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.845531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.109 qpair failed and we were unable to recover it. 00:30:08.109 [2024-07-13 10:16:13.845705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.845875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.845902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.109 qpair failed and we were unable to recover it. 00:30:08.109 [2024-07-13 10:16:13.846048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.846236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.846262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.109 qpair failed and we were unable to recover it. 00:30:08.109 [2024-07-13 10:16:13.846423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.846589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.846618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.109 qpair failed and we were unable to recover it. 00:30:08.109 [2024-07-13 10:16:13.846805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.846960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.846986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.109 qpair failed and we were unable to recover it. 00:30:08.109 [2024-07-13 10:16:13.847143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.847266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.847289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.109 qpair failed and we were unable to recover it. 00:30:08.109 [2024-07-13 10:16:13.847477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.847623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.847647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.109 qpair failed and we were unable to recover it. 00:30:08.109 [2024-07-13 10:16:13.847817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.848050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.848106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.109 qpair failed and we were unable to recover it. 00:30:08.109 [2024-07-13 10:16:13.848297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.848445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.848469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.109 qpair failed and we were unable to recover it. 00:30:08.109 [2024-07-13 10:16:13.848591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.848767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.848793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.109 qpair failed and we were unable to recover it. 00:30:08.109 [2024-07-13 10:16:13.848941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.849107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.849133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.109 qpair failed and we were unable to recover it. 00:30:08.109 [2024-07-13 10:16:13.849282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.849396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.849419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.109 qpair failed and we were unable to recover it. 00:30:08.109 [2024-07-13 10:16:13.849590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.849717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.849741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.109 qpair failed and we were unable to recover it. 00:30:08.109 [2024-07-13 10:16:13.849930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.850108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.850131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.109 qpair failed and we were unable to recover it. 00:30:08.109 [2024-07-13 10:16:13.850323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.850499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.850524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.109 qpair failed and we were unable to recover it. 00:30:08.109 [2024-07-13 10:16:13.850694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.850857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.850891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.109 qpair failed and we were unable to recover it. 00:30:08.109 [2024-07-13 10:16:13.851055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.851192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.851219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.109 qpair failed and we were unable to recover it. 00:30:08.109 [2024-07-13 10:16:13.851372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.851493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.851517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.109 qpair failed and we were unable to recover it. 00:30:08.109 [2024-07-13 10:16:13.851672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.851845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.851886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.109 qpair failed and we were unable to recover it. 00:30:08.109 [2024-07-13 10:16:13.852012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.852157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.852182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.109 qpair failed and we were unable to recover it. 00:30:08.109 [2024-07-13 10:16:13.852330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.852451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.109 [2024-07-13 10:16:13.852490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.109 qpair failed and we were unable to recover it. 00:30:08.110 [2024-07-13 10:16:13.852633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.852798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.852824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.110 qpair failed and we were unable to recover it. 00:30:08.110 [2024-07-13 10:16:13.852998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.853131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.853158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.110 qpair failed and we were unable to recover it. 00:30:08.110 [2024-07-13 10:16:13.853319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.853439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.853463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.110 qpair failed and we were unable to recover it. 00:30:08.110 [2024-07-13 10:16:13.853630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.853782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.853808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.110 qpair failed and we were unable to recover it. 00:30:08.110 [2024-07-13 10:16:13.853979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.854142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.854169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.110 qpair failed and we were unable to recover it. 00:30:08.110 [2024-07-13 10:16:13.854316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.854463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.854487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.110 qpair failed and we were unable to recover it. 00:30:08.110 [2024-07-13 10:16:13.854683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.854850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.854883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.110 qpair failed and we were unable to recover it. 00:30:08.110 [2024-07-13 10:16:13.855051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.855191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.855217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.110 qpair failed and we were unable to recover it. 00:30:08.110 [2024-07-13 10:16:13.855390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.855509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.855533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.110 qpair failed and we were unable to recover it. 00:30:08.110 [2024-07-13 10:16:13.855664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.855814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.855838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.110 qpair failed and we were unable to recover it. 00:30:08.110 [2024-07-13 10:16:13.856000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.856176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.856200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.110 qpair failed and we were unable to recover it. 00:30:08.110 [2024-07-13 10:16:13.856376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.856498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.856522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.110 qpair failed and we were unable to recover it. 00:30:08.110 [2024-07-13 10:16:13.856670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.856817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.856841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.110 qpair failed and we were unable to recover it. 00:30:08.110 [2024-07-13 10:16:13.857000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.857146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.857169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.110 qpair failed and we were unable to recover it. 00:30:08.110 [2024-07-13 10:16:13.857318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.857468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.857496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.110 qpair failed and we were unable to recover it. 00:30:08.110 [2024-07-13 10:16:13.857623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.857759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.857786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.110 qpair failed and we were unable to recover it. 00:30:08.110 [2024-07-13 10:16:13.857944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.858107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.858134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.110 qpair failed and we were unable to recover it. 00:30:08.110 [2024-07-13 10:16:13.858282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.858401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.858424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.110 qpair failed and we were unable to recover it. 00:30:08.110 [2024-07-13 10:16:13.858576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.858721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.858744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.110 qpair failed and we were unable to recover it. 00:30:08.110 [2024-07-13 10:16:13.858923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.859046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.859069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.110 qpair failed and we were unable to recover it. 00:30:08.110 [2024-07-13 10:16:13.859239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.859380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.859404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.110 qpair failed and we were unable to recover it. 00:30:08.110 [2024-07-13 10:16:13.859602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.859745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.859771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.110 qpair failed and we were unable to recover it. 00:30:08.110 [2024-07-13 10:16:13.859928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.860107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.860130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.110 qpair failed and we were unable to recover it. 00:30:08.110 [2024-07-13 10:16:13.860330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.860475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.860498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.110 qpair failed and we were unable to recover it. 00:30:08.110 [2024-07-13 10:16:13.860649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.860831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.860854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.110 qpair failed and we were unable to recover it. 00:30:08.110 [2024-07-13 10:16:13.861009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.861149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.861176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.110 qpair failed and we were unable to recover it. 00:30:08.110 [2024-07-13 10:16:13.861312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.861471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.861495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.110 qpair failed and we were unable to recover it. 00:30:08.110 [2024-07-13 10:16:13.861644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.861768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.861792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.110 qpair failed and we were unable to recover it. 00:30:08.110 [2024-07-13 10:16:13.861959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.862115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.862138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.110 qpair failed and we were unable to recover it. 00:30:08.110 [2024-07-13 10:16:13.862289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.862485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.110 [2024-07-13 10:16:13.862512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.110 qpair failed and we were unable to recover it. 00:30:08.110 [2024-07-13 10:16:13.862647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.862803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.862829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.111 qpair failed and we were unable to recover it. 00:30:08.111 [2024-07-13 10:16:13.863006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.863141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.863167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.111 qpair failed and we were unable to recover it. 00:30:08.111 [2024-07-13 10:16:13.863354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.863471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.863511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.111 qpair failed and we were unable to recover it. 00:30:08.111 [2024-07-13 10:16:13.863677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.863839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.863871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.111 qpair failed and we were unable to recover it. 00:30:08.111 [2024-07-13 10:16:13.864035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.864284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.864334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.111 qpair failed and we were unable to recover it. 00:30:08.111 [2024-07-13 10:16:13.864538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.864689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.864712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.111 qpair failed and we were unable to recover it. 00:30:08.111 [2024-07-13 10:16:13.864870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.864997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.865022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.111 qpair failed and we were unable to recover it. 00:30:08.111 [2024-07-13 10:16:13.865146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.865302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.865327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.111 qpair failed and we were unable to recover it. 00:30:08.111 [2024-07-13 10:16:13.865475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.865621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.865644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.111 qpair failed and we were unable to recover it. 00:30:08.111 [2024-07-13 10:16:13.865797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.865928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.865952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.111 qpair failed and we were unable to recover it. 00:30:08.111 [2024-07-13 10:16:13.866065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.866211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.866234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.111 qpair failed and we were unable to recover it. 00:30:08.111 [2024-07-13 10:16:13.866359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.866531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.866554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.111 qpair failed and we were unable to recover it. 00:30:08.111 [2024-07-13 10:16:13.866729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.866879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.866912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.111 qpair failed and we were unable to recover it. 00:30:08.111 [2024-07-13 10:16:13.867085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.867243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.867267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.111 qpair failed and we were unable to recover it. 00:30:08.111 [2024-07-13 10:16:13.867390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.867508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.867532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.111 qpair failed and we were unable to recover it. 00:30:08.111 [2024-07-13 10:16:13.867713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.867830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.867854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.111 qpair failed and we were unable to recover it. 00:30:08.111 [2024-07-13 10:16:13.868034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.868158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.868184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.111 qpair failed and we were unable to recover it. 00:30:08.111 [2024-07-13 10:16:13.868310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.868461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.868488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.111 qpair failed and we were unable to recover it. 00:30:08.111 [2024-07-13 10:16:13.868634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.868782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.868806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.111 qpair failed and we were unable to recover it. 00:30:08.111 [2024-07-13 10:16:13.868954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.869102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.869126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.111 qpair failed and we were unable to recover it. 00:30:08.111 [2024-07-13 10:16:13.869280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.869429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.869453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.111 qpair failed and we were unable to recover it. 00:30:08.111 [2024-07-13 10:16:13.869627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.869808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.869855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.111 qpair failed and we were unable to recover it. 00:30:08.111 [2024-07-13 10:16:13.870034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.870151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.870174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.111 qpair failed and we were unable to recover it. 00:30:08.111 [2024-07-13 10:16:13.870322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.870498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.870522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.111 qpair failed and we were unable to recover it. 00:30:08.111 [2024-07-13 10:16:13.870641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.870806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.870832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.111 qpair failed and we were unable to recover it. 00:30:08.111 [2024-07-13 10:16:13.870985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.871140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.871167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.111 qpair failed and we were unable to recover it. 00:30:08.111 [2024-07-13 10:16:13.871382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.871558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.871582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.111 qpair failed and we were unable to recover it. 00:30:08.111 [2024-07-13 10:16:13.871712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.871859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.871890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.111 qpair failed and we were unable to recover it. 00:30:08.111 [2024-07-13 10:16:13.872067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.872279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.872307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.111 qpair failed and we were unable to recover it. 00:30:08.111 [2024-07-13 10:16:13.872440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.872559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.872583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.111 qpair failed and we were unable to recover it. 00:30:08.111 [2024-07-13 10:16:13.872735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.872879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.111 [2024-07-13 10:16:13.872903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.112 qpair failed and we were unable to recover it. 00:30:08.112 [2024-07-13 10:16:13.873035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.873189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.873215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.399 qpair failed and we were unable to recover it. 00:30:08.399 [2024-07-13 10:16:13.873377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.873526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.873568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.399 qpair failed and we were unable to recover it. 00:30:08.399 [2024-07-13 10:16:13.873756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.873966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.873994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.399 qpair failed and we were unable to recover it. 00:30:08.399 [2024-07-13 10:16:13.874158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.874372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.874421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.399 qpair failed and we were unable to recover it. 00:30:08.399 [2024-07-13 10:16:13.874617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.874764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.874795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.399 qpair failed and we were unable to recover it. 00:30:08.399 [2024-07-13 10:16:13.874962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.875097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.875123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.399 qpair failed and we were unable to recover it. 00:30:08.399 [2024-07-13 10:16:13.875283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.875440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.875465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.399 qpair failed and we were unable to recover it. 00:30:08.399 [2024-07-13 10:16:13.875615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.875735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.875759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.399 qpair failed and we were unable to recover it. 00:30:08.399 [2024-07-13 10:16:13.875936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.876105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.876133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.399 qpair failed and we were unable to recover it. 00:30:08.399 [2024-07-13 10:16:13.876305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.876470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.876495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.399 qpair failed and we were unable to recover it. 00:30:08.399 [2024-07-13 10:16:13.876628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.876753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.876777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.399 qpair failed and we were unable to recover it. 00:30:08.399 [2024-07-13 10:16:13.877039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.877208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.877236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.399 qpair failed and we were unable to recover it. 00:30:08.399 [2024-07-13 10:16:13.877373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.877541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.877567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.399 qpair failed and we were unable to recover it. 00:30:08.399 [2024-07-13 10:16:13.877711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.877864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.877896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.399 qpair failed and we were unable to recover it. 00:30:08.399 [2024-07-13 10:16:13.878014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.878164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.878195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.399 qpair failed and we were unable to recover it. 00:30:08.399 [2024-07-13 10:16:13.878376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.878523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.878547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.399 qpair failed and we were unable to recover it. 00:30:08.399 [2024-07-13 10:16:13.878670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.878821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.878846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.399 qpair failed and we were unable to recover it. 00:30:08.399 [2024-07-13 10:16:13.878978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.879099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.879122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.399 qpair failed and we were unable to recover it. 00:30:08.399 [2024-07-13 10:16:13.879250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.879426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.879449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.399 qpair failed and we were unable to recover it. 00:30:08.399 [2024-07-13 10:16:13.879571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.879693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.879716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.399 qpair failed and we were unable to recover it. 00:30:08.399 [2024-07-13 10:16:13.879898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.880013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.880038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.399 qpair failed and we were unable to recover it. 00:30:08.399 [2024-07-13 10:16:13.880211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.880355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.880379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.399 qpair failed and we were unable to recover it. 00:30:08.399 [2024-07-13 10:16:13.880521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.880647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.880670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.399 qpair failed and we were unable to recover it. 00:30:08.399 [2024-07-13 10:16:13.880839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.881022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.399 [2024-07-13 10:16:13.881047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.400 qpair failed and we were unable to recover it. 00:30:08.400 [2024-07-13 10:16:13.881222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.881376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.881400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.400 qpair failed and we were unable to recover it. 00:30:08.400 [2024-07-13 10:16:13.881582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.881759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.881786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.400 qpair failed and we were unable to recover it. 00:30:08.400 [2024-07-13 10:16:13.881980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.882155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.882180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.400 qpair failed and we were unable to recover it. 00:30:08.400 [2024-07-13 10:16:13.882306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.882426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.882449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.400 qpair failed and we were unable to recover it. 00:30:08.400 [2024-07-13 10:16:13.882598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.882746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.882770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.400 qpair failed and we were unable to recover it. 00:30:08.400 [2024-07-13 10:16:13.882925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.883113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.883141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.400 qpair failed and we were unable to recover it. 00:30:08.400 [2024-07-13 10:16:13.883335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.883486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.883509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.400 qpair failed and we were unable to recover it. 00:30:08.400 [2024-07-13 10:16:13.883652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.883799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.883822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.400 qpair failed and we were unable to recover it. 00:30:08.400 [2024-07-13 10:16:13.883981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.884124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.884149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.400 qpair failed and we were unable to recover it. 00:30:08.400 [2024-07-13 10:16:13.884338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.884505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.884531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.400 qpair failed and we were unable to recover it. 00:30:08.400 [2024-07-13 10:16:13.884704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.884850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.884881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.400 qpair failed and we were unable to recover it. 00:30:08.400 [2024-07-13 10:16:13.885041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.885216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.885240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.400 qpair failed and we were unable to recover it. 00:30:08.400 [2024-07-13 10:16:13.885368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.885539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.885566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.400 qpair failed and we were unable to recover it. 00:30:08.400 [2024-07-13 10:16:13.885712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.885891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.885916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.400 qpair failed and we were unable to recover it. 00:30:08.400 [2024-07-13 10:16:13.886060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.886205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.886229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.400 qpair failed and we were unable to recover it. 00:30:08.400 [2024-07-13 10:16:13.886381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.886502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.886526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.400 qpair failed and we were unable to recover it. 00:30:08.400 [2024-07-13 10:16:13.886735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.886882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.886906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.400 qpair failed and we were unable to recover it. 00:30:08.400 [2024-07-13 10:16:13.887056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.887314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.887364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.400 qpair failed and we were unable to recover it. 00:30:08.400 [2024-07-13 10:16:13.887538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.887711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.887736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.400 qpair failed and we were unable to recover it. 00:30:08.400 [2024-07-13 10:16:13.887887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.888029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.888070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.400 qpair failed and we were unable to recover it. 00:30:08.400 [2024-07-13 10:16:13.888240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.888383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.888407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.400 qpair failed and we were unable to recover it. 00:30:08.400 [2024-07-13 10:16:13.888542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.888691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.888715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.400 qpair failed and we were unable to recover it. 00:30:08.400 [2024-07-13 10:16:13.888854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.889002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.889027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.400 qpair failed and we were unable to recover it. 00:30:08.400 [2024-07-13 10:16:13.889154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.889330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.889357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.400 qpair failed and we were unable to recover it. 00:30:08.400 [2024-07-13 10:16:13.889522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.889689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.889716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.400 qpair failed and we were unable to recover it. 00:30:08.400 [2024-07-13 10:16:13.889892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.890063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.890087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.400 qpair failed and we were unable to recover it. 00:30:08.400 [2024-07-13 10:16:13.890200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.890375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.890416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.400 qpair failed and we were unable to recover it. 00:30:08.400 [2024-07-13 10:16:13.890569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.890713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.890741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.400 qpair failed and we were unable to recover it. 00:30:08.400 [2024-07-13 10:16:13.890912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.891065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.891090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.400 qpair failed and we were unable to recover it. 00:30:08.400 [2024-07-13 10:16:13.891264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.891381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.891405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.400 qpair failed and we were unable to recover it. 00:30:08.400 [2024-07-13 10:16:13.891556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.891771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.891799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.400 qpair failed and we were unable to recover it. 00:30:08.400 [2024-07-13 10:16:13.891994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.892125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.892149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.400 qpair failed and we were unable to recover it. 00:30:08.400 [2024-07-13 10:16:13.892308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.400 [2024-07-13 10:16:13.892457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.892481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.401 qpair failed and we were unable to recover it. 00:30:08.401 [2024-07-13 10:16:13.892631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.892784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.892808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.401 qpair failed and we were unable to recover it. 00:30:08.401 [2024-07-13 10:16:13.892953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.893073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.893097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.401 qpair failed and we were unable to recover it. 00:30:08.401 [2024-07-13 10:16:13.893290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.893405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.893429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.401 qpair failed and we were unable to recover it. 00:30:08.401 [2024-07-13 10:16:13.893614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.893744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.893768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.401 qpair failed and we were unable to recover it. 00:30:08.401 [2024-07-13 10:16:13.893940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.894103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.894130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.401 qpair failed and we were unable to recover it. 00:30:08.401 [2024-07-13 10:16:13.894259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.894388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.894415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.401 qpair failed and we were unable to recover it. 00:30:08.401 [2024-07-13 10:16:13.894578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.894736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.894763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.401 qpair failed and we were unable to recover it. 00:30:08.401 [2024-07-13 10:16:13.894933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.895078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.895102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.401 qpair failed and we were unable to recover it. 00:30:08.401 [2024-07-13 10:16:13.895275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.895476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.895527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.401 qpair failed and we were unable to recover it. 00:30:08.401 [2024-07-13 10:16:13.895697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.895861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.895902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.401 qpair failed and we were unable to recover it. 00:30:08.401 [2024-07-13 10:16:13.896100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.896229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.896253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.401 qpair failed and we were unable to recover it. 00:30:08.401 [2024-07-13 10:16:13.896406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.896554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.896580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.401 qpair failed and we were unable to recover it. 00:30:08.401 [2024-07-13 10:16:13.896712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.896854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.896891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.401 qpair failed and we were unable to recover it. 00:30:08.401 [2024-07-13 10:16:13.897045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.897196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.897220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.401 qpair failed and we were unable to recover it. 00:30:08.401 [2024-07-13 10:16:13.897372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.897491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.897515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.401 qpair failed and we were unable to recover it. 00:30:08.401 [2024-07-13 10:16:13.897667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.897782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.897822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.401 qpair failed and we were unable to recover it. 00:30:08.401 [2024-07-13 10:16:13.897976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.898128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.898152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.401 qpair failed and we were unable to recover it. 00:30:08.401 [2024-07-13 10:16:13.898271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.898397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.898421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.401 qpair failed and we were unable to recover it. 00:30:08.401 [2024-07-13 10:16:13.898566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.898685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.898709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.401 qpair failed and we were unable to recover it. 00:30:08.401 [2024-07-13 10:16:13.898916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.899077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.899101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.401 qpair failed and we were unable to recover it. 00:30:08.401 [2024-07-13 10:16:13.899280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.899468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.899495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.401 qpair failed and we were unable to recover it. 00:30:08.401 [2024-07-13 10:16:13.899622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.899778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.899804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.401 qpair failed and we were unable to recover it. 00:30:08.401 [2024-07-13 10:16:13.899980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.900127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.900150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.401 qpair failed and we were unable to recover it. 00:30:08.401 [2024-07-13 10:16:13.900300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.900451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.900478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.401 qpair failed and we were unable to recover it. 00:30:08.401 [2024-07-13 10:16:13.900642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.900812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.900838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.401 qpair failed and we were unable to recover it. 00:30:08.401 [2024-07-13 10:16:13.900994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.901147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.901172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.401 qpair failed and we were unable to recover it. 00:30:08.401 [2024-07-13 10:16:13.901320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.901456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.901482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.401 qpair failed and we were unable to recover it. 00:30:08.401 [2024-07-13 10:16:13.901645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.901809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.901838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.401 qpair failed and we were unable to recover it. 00:30:08.401 [2024-07-13 10:16:13.902017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.902175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.902199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.401 qpair failed and we were unable to recover it. 00:30:08.401 [2024-07-13 10:16:13.902348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.902495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.902519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.401 qpair failed and we were unable to recover it. 00:30:08.401 [2024-07-13 10:16:13.902647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.902773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.902797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.401 qpair failed and we were unable to recover it. 00:30:08.401 [2024-07-13 10:16:13.902958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.903105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.401 [2024-07-13 10:16:13.903129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.401 qpair failed and we were unable to recover it. 00:30:08.401 [2024-07-13 10:16:13.903310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.903485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.903508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.402 qpair failed and we were unable to recover it. 00:30:08.402 [2024-07-13 10:16:13.903656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.903778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.903802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.402 qpair failed and we were unable to recover it. 00:30:08.402 [2024-07-13 10:16:13.903948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.904095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.904137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.402 qpair failed and we were unable to recover it. 00:30:08.402 [2024-07-13 10:16:13.904303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.904498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.904521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.402 qpair failed and we were unable to recover it. 00:30:08.402 [2024-07-13 10:16:13.904648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.904771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.904796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.402 qpair failed and we were unable to recover it. 00:30:08.402 [2024-07-13 10:16:13.904959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.905104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.905128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.402 qpair failed and we were unable to recover it. 00:30:08.402 [2024-07-13 10:16:13.905283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.905485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.905512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.402 qpair failed and we were unable to recover it. 00:30:08.402 [2024-07-13 10:16:13.905655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.905834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.905858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.402 qpair failed and we were unable to recover it. 00:30:08.402 [2024-07-13 10:16:13.906050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.906253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.906301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.402 qpair failed and we were unable to recover it. 00:30:08.402 [2024-07-13 10:16:13.906434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.906637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.906661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.402 qpair failed and we were unable to recover it. 00:30:08.402 [2024-07-13 10:16:13.906787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.907002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.907027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.402 qpair failed and we were unable to recover it. 00:30:08.402 [2024-07-13 10:16:13.907158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.907310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.907333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.402 qpair failed and we were unable to recover it. 00:30:08.402 [2024-07-13 10:16:13.907460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.907615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.907639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.402 qpair failed and we were unable to recover it. 00:30:08.402 [2024-07-13 10:16:13.907798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.907980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.908005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.402 qpair failed and we were unable to recover it. 00:30:08.402 [2024-07-13 10:16:13.908160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.908335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.908358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.402 qpair failed and we were unable to recover it. 00:30:08.402 [2024-07-13 10:16:13.908516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.908642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.908665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.402 qpair failed and we were unable to recover it. 00:30:08.402 [2024-07-13 10:16:13.908818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.908991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.909016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.402 qpair failed and we were unable to recover it. 00:30:08.402 [2024-07-13 10:16:13.909212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.909375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.909402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.402 qpair failed and we were unable to recover it. 00:30:08.402 [2024-07-13 10:16:13.909596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.909782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.909805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.402 qpair failed and we were unable to recover it. 00:30:08.402 [2024-07-13 10:16:13.909965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.910114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.910138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.402 qpair failed and we were unable to recover it. 00:30:08.402 [2024-07-13 10:16:13.910287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.910440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.910464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.402 qpair failed and we were unable to recover it. 00:30:08.402 [2024-07-13 10:16:13.910602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.910784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.910808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.402 qpair failed and we were unable to recover it. 00:30:08.402 [2024-07-13 10:16:13.910937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.911132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.911159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.402 qpair failed and we were unable to recover it. 00:30:08.402 [2024-07-13 10:16:13.911356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.911471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.911494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.402 qpair failed and we were unable to recover it. 00:30:08.402 [2024-07-13 10:16:13.911706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.911877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.911905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.402 qpair failed and we were unable to recover it. 00:30:08.402 [2024-07-13 10:16:13.912051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.912223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.912248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.402 qpair failed and we were unable to recover it. 00:30:08.402 [2024-07-13 10:16:13.912371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.912515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.912539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.402 qpair failed and we were unable to recover it. 00:30:08.402 [2024-07-13 10:16:13.912688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.912840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.912874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.402 qpair failed and we were unable to recover it. 00:30:08.402 [2024-07-13 10:16:13.913040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.913206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.913231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.402 qpair failed and we were unable to recover it. 00:30:08.402 [2024-07-13 10:16:13.913384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.913557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.913581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.402 qpair failed and we were unable to recover it. 00:30:08.402 [2024-07-13 10:16:13.913735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.913890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.913917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.402 qpair failed and we were unable to recover it. 00:30:08.402 [2024-07-13 10:16:13.914084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.914256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.914280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.402 qpair failed and we were unable to recover it. 00:30:08.402 [2024-07-13 10:16:13.914431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.914589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.402 [2024-07-13 10:16:13.914612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.402 qpair failed and we were unable to recover it. 00:30:08.403 [2024-07-13 10:16:13.914735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.914877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.914917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.403 qpair failed and we were unable to recover it. 00:30:08.403 [2024-07-13 10:16:13.915082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.915240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.915267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.403 qpair failed and we were unable to recover it. 00:30:08.403 [2024-07-13 10:16:13.915439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.915585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.915608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.403 qpair failed and we were unable to recover it. 00:30:08.403 [2024-07-13 10:16:13.915791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.915916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.915942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.403 qpair failed and we were unable to recover it. 00:30:08.403 [2024-07-13 10:16:13.916093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.916281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.916337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.403 qpair failed and we were unable to recover it. 00:30:08.403 [2024-07-13 10:16:13.916513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.916662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.916703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.403 qpair failed and we were unable to recover it. 00:30:08.403 [2024-07-13 10:16:13.916899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.917084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.917111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.403 qpair failed and we were unable to recover it. 00:30:08.403 [2024-07-13 10:16:13.917276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.917422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.917446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.403 qpair failed and we were unable to recover it. 00:30:08.403 [2024-07-13 10:16:13.917596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.917723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.917747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.403 qpair failed and we were unable to recover it. 00:30:08.403 [2024-07-13 10:16:13.917906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.918055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.918078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.403 qpair failed and we were unable to recover it. 00:30:08.403 [2024-07-13 10:16:13.918230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.918411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.918435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.403 qpair failed and we were unable to recover it. 00:30:08.403 [2024-07-13 10:16:13.918593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.918738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.918765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.403 qpair failed and we were unable to recover it. 00:30:08.403 [2024-07-13 10:16:13.918948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.919100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.919124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.403 qpair failed and we were unable to recover it. 00:30:08.403 [2024-07-13 10:16:13.919303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.919464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.919490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.403 qpair failed and we were unable to recover it. 00:30:08.403 [2024-07-13 10:16:13.919656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.919807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.919831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.403 qpair failed and we were unable to recover it. 00:30:08.403 [2024-07-13 10:16:13.920009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.920172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.920228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.403 qpair failed and we were unable to recover it. 00:30:08.403 [2024-07-13 10:16:13.920398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.920540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.920571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.403 qpair failed and we were unable to recover it. 00:30:08.403 [2024-07-13 10:16:13.920760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.920879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.920904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.403 qpair failed and we were unable to recover it. 00:30:08.403 [2024-07-13 10:16:13.921057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.921213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.921240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.403 qpair failed and we were unable to recover it. 00:30:08.403 [2024-07-13 10:16:13.921377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.921533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.921559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.403 qpair failed and we were unable to recover it. 00:30:08.403 [2024-07-13 10:16:13.921752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.921902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.921926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.403 qpair failed and we were unable to recover it. 00:30:08.403 [2024-07-13 10:16:13.922051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.922198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.922222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.403 qpair failed and we were unable to recover it. 00:30:08.403 [2024-07-13 10:16:13.922368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.922523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.922548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.403 qpair failed and we were unable to recover it. 00:30:08.403 [2024-07-13 10:16:13.922753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.922898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.922922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.403 qpair failed and we were unable to recover it. 00:30:08.403 [2024-07-13 10:16:13.923053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.923227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.923252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.403 qpair failed and we were unable to recover it. 00:30:08.403 [2024-07-13 10:16:13.923381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.923533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.923557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.403 qpair failed and we were unable to recover it. 00:30:08.403 [2024-07-13 10:16:13.923692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.403 [2024-07-13 10:16:13.923881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.923906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.404 qpair failed and we were unable to recover it. 00:30:08.404 [2024-07-13 10:16:13.924072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.924282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.924332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.404 qpair failed and we were unable to recover it. 00:30:08.404 [2024-07-13 10:16:13.924493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.924647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.924673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.404 qpair failed and we were unable to recover it. 00:30:08.404 [2024-07-13 10:16:13.924842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.925023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.925066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.404 qpair failed and we were unable to recover it. 00:30:08.404 [2024-07-13 10:16:13.925229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.925390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.925417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.404 qpair failed and we were unable to recover it. 00:30:08.404 [2024-07-13 10:16:13.925585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.925745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.925771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.404 qpair failed and we were unable to recover it. 00:30:08.404 [2024-07-13 10:16:13.925942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.926075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.926100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.404 qpair failed and we were unable to recover it. 00:30:08.404 [2024-07-13 10:16:13.926223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.926339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.926364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.404 qpair failed and we were unable to recover it. 00:30:08.404 [2024-07-13 10:16:13.926537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.926727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.926754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.404 qpair failed and we were unable to recover it. 00:30:08.404 [2024-07-13 10:16:13.926927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.927058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.927083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.404 qpair failed and we were unable to recover it. 00:30:08.404 [2024-07-13 10:16:13.927233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.927356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.927380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.404 qpair failed and we were unable to recover it. 00:30:08.404 [2024-07-13 10:16:13.927551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.927696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.927722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.404 qpair failed and we were unable to recover it. 00:30:08.404 [2024-07-13 10:16:13.927890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.928067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.928091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.404 qpair failed and we were unable to recover it. 00:30:08.404 [2024-07-13 10:16:13.928219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.928365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.928389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.404 qpair failed and we were unable to recover it. 00:30:08.404 [2024-07-13 10:16:13.928534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.928657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.928682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.404 qpair failed and we were unable to recover it. 00:30:08.404 [2024-07-13 10:16:13.928835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.929013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.929039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.404 qpair failed and we were unable to recover it. 00:30:08.404 [2024-07-13 10:16:13.929215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.929387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.929434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.404 qpair failed and we were unable to recover it. 00:30:08.404 [2024-07-13 10:16:13.929628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.929787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.929816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.404 qpair failed and we were unable to recover it. 00:30:08.404 [2024-07-13 10:16:13.929968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.930093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.930132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.404 qpair failed and we were unable to recover it. 00:30:08.404 [2024-07-13 10:16:13.930274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.930440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.930472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.404 qpair failed and we were unable to recover it. 00:30:08.404 [2024-07-13 10:16:13.930634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.930821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.930850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.404 qpair failed and we were unable to recover it. 00:30:08.404 [2024-07-13 10:16:13.931004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.931118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.931142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.404 qpair failed and we were unable to recover it. 00:30:08.404 [2024-07-13 10:16:13.931316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.931467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.931493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.404 qpair failed and we were unable to recover it. 00:30:08.404 [2024-07-13 10:16:13.931681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.931854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.931901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.404 qpair failed and we were unable to recover it. 00:30:08.404 [2024-07-13 10:16:13.932056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.932194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.932217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.404 qpair failed and we were unable to recover it. 00:30:08.404 [2024-07-13 10:16:13.932345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.932461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.932485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.404 qpair failed and we were unable to recover it. 00:30:08.404 [2024-07-13 10:16:13.932612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.932758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.932782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.404 qpair failed and we were unable to recover it. 00:30:08.404 [2024-07-13 10:16:13.932935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.933085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.933109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.404 qpair failed and we were unable to recover it. 00:30:08.404 [2024-07-13 10:16:13.933256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.933408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.933431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.404 qpair failed and we were unable to recover it. 00:30:08.404 [2024-07-13 10:16:13.933640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.933796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.933822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.404 qpair failed and we were unable to recover it. 00:30:08.404 [2024-07-13 10:16:13.934025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.934245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.934292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.404 qpair failed and we were unable to recover it. 00:30:08.404 [2024-07-13 10:16:13.934428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.934611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.934635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.404 qpair failed and we were unable to recover it. 00:30:08.404 [2024-07-13 10:16:13.934789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.934940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.404 [2024-07-13 10:16:13.934979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.404 qpair failed and we were unable to recover it. 00:30:08.404 [2024-07-13 10:16:13.935150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.935301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.935325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.405 qpair failed and we were unable to recover it. 00:30:08.405 [2024-07-13 10:16:13.935469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.935595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.935619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.405 qpair failed and we were unable to recover it. 00:30:08.405 [2024-07-13 10:16:13.935797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.935976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.936018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.405 qpair failed and we were unable to recover it. 00:30:08.405 [2024-07-13 10:16:13.936168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.936293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.936317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.405 qpair failed and we were unable to recover it. 00:30:08.405 [2024-07-13 10:16:13.936436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.936584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.936608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.405 qpair failed and we were unable to recover it. 00:30:08.405 [2024-07-13 10:16:13.936782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.936934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.936959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.405 qpair failed and we were unable to recover it. 00:30:08.405 [2024-07-13 10:16:13.937080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.937204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.937227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.405 qpair failed and we were unable to recover it. 00:30:08.405 [2024-07-13 10:16:13.937352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.937498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.937522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.405 qpair failed and we were unable to recover it. 00:30:08.405 [2024-07-13 10:16:13.937676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.937850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.937881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.405 qpair failed and we were unable to recover it. 00:30:08.405 [2024-07-13 10:16:13.938009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.938190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.938214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.405 qpair failed and we were unable to recover it. 00:30:08.405 [2024-07-13 10:16:13.938384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.938553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.938579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.405 qpair failed and we were unable to recover it. 00:30:08.405 [2024-07-13 10:16:13.938739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.938904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.938931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.405 qpair failed and we were unable to recover it. 00:30:08.405 [2024-07-13 10:16:13.939085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.939213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.939237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.405 qpair failed and we were unable to recover it. 00:30:08.405 [2024-07-13 10:16:13.939383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.939530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.939553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.405 qpair failed and we were unable to recover it. 00:30:08.405 [2024-07-13 10:16:13.939677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.939828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.939851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.405 qpair failed and we were unable to recover it. 00:30:08.405 [2024-07-13 10:16:13.939990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.940171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.940195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.405 qpair failed and we were unable to recover it. 00:30:08.405 [2024-07-13 10:16:13.940346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.940494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.940518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.405 qpair failed and we were unable to recover it. 00:30:08.405 [2024-07-13 10:16:13.940672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.940846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.940896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.405 qpair failed and we were unable to recover it. 00:30:08.405 [2024-07-13 10:16:13.941081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.941271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.941298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.405 qpair failed and we were unable to recover it. 00:30:08.405 [2024-07-13 10:16:13.941502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.941704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.941751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.405 qpair failed and we were unable to recover it. 00:30:08.405 [2024-07-13 10:16:13.941923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.942112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.942139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.405 qpair failed and we were unable to recover it. 00:30:08.405 [2024-07-13 10:16:13.942333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.942505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.942534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.405 qpair failed and we were unable to recover it. 00:30:08.405 [2024-07-13 10:16:13.942734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.942910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.942934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.405 qpair failed and we were unable to recover it. 00:30:08.405 [2024-07-13 10:16:13.943056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.943180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.943221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.405 qpair failed and we were unable to recover it. 00:30:08.405 [2024-07-13 10:16:13.943393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.943542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.943582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.405 qpair failed and we were unable to recover it. 00:30:08.405 [2024-07-13 10:16:13.943771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.943936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.943963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.405 qpair failed and we were unable to recover it. 00:30:08.405 [2024-07-13 10:16:13.944152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.944312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.944336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.405 qpair failed and we were unable to recover it. 00:30:08.405 [2024-07-13 10:16:13.944484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.944639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.944664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.405 qpair failed and we were unable to recover it. 00:30:08.405 [2024-07-13 10:16:13.944878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.945012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.945039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.405 qpair failed and we were unable to recover it. 00:30:08.405 [2024-07-13 10:16:13.945205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.945420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.945474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.405 qpair failed and we were unable to recover it. 00:30:08.405 [2024-07-13 10:16:13.945651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.945805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.945829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.405 qpair failed and we were unable to recover it. 00:30:08.405 [2024-07-13 10:16:13.945986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.946136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.946160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.405 qpair failed and we were unable to recover it. 00:30:08.405 [2024-07-13 10:16:13.946290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.946491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.405 [2024-07-13 10:16:13.946518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.405 qpair failed and we were unable to recover it. 00:30:08.405 [2024-07-13 10:16:13.946658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.946812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.946835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.406 qpair failed and we were unable to recover it. 00:30:08.406 [2024-07-13 10:16:13.947016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.947180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.947206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.406 qpair failed and we were unable to recover it. 00:30:08.406 [2024-07-13 10:16:13.947344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.947498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.947525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.406 qpair failed and we were unable to recover it. 00:30:08.406 [2024-07-13 10:16:13.947696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.947815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.947838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.406 qpair failed and we were unable to recover it. 00:30:08.406 [2024-07-13 10:16:13.947984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.948108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.948138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.406 qpair failed and we were unable to recover it. 00:30:08.406 [2024-07-13 10:16:13.948307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.948439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.948466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.406 qpair failed and we were unable to recover it. 00:30:08.406 [2024-07-13 10:16:13.948612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.948752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.948776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.406 qpair failed and we were unable to recover it. 00:30:08.406 [2024-07-13 10:16:13.948944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.949070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.949094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.406 qpair failed and we were unable to recover it. 00:30:08.406 [2024-07-13 10:16:13.949273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.949417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.949441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.406 qpair failed and we were unable to recover it. 00:30:08.406 [2024-07-13 10:16:13.949617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.949792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.949815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.406 qpair failed and we were unable to recover it. 00:30:08.406 [2024-07-13 10:16:13.949964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.950109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.950133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.406 qpair failed and we were unable to recover it. 00:30:08.406 [2024-07-13 10:16:13.950255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.950382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.950406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.406 qpair failed and we were unable to recover it. 00:30:08.406 [2024-07-13 10:16:13.950555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.950678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.950718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.406 qpair failed and we were unable to recover it. 00:30:08.406 [2024-07-13 10:16:13.950852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.951027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.951051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.406 qpair failed and we were unable to recover it. 00:30:08.406 [2024-07-13 10:16:13.951219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.951410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.951465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.406 qpair failed and we were unable to recover it. 00:30:08.406 [2024-07-13 10:16:13.951632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.951787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.951811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.406 qpair failed and we were unable to recover it. 00:30:08.406 [2024-07-13 10:16:13.951938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.952086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.952110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.406 qpair failed and we were unable to recover it. 00:30:08.406 [2024-07-13 10:16:13.952234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.952409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.952435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.406 qpair failed and we were unable to recover it. 00:30:08.406 [2024-07-13 10:16:13.952608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.952758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.952782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.406 qpair failed and we were unable to recover it. 00:30:08.406 [2024-07-13 10:16:13.952932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.953080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.953121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.406 qpair failed and we were unable to recover it. 00:30:08.406 [2024-07-13 10:16:13.953283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.953467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.953516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.406 qpair failed and we were unable to recover it. 00:30:08.406 [2024-07-13 10:16:13.953655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.953831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.953879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.406 qpair failed and we were unable to recover it. 00:30:08.406 [2024-07-13 10:16:13.954039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.954229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.954279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.406 qpair failed and we were unable to recover it. 00:30:08.406 [2024-07-13 10:16:13.954405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.954566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.954593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.406 qpair failed and we were unable to recover it. 00:30:08.406 [2024-07-13 10:16:13.954789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.954932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.954957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.406 qpair failed and we were unable to recover it. 00:30:08.406 [2024-07-13 10:16:13.955115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.955266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.955290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.406 qpair failed and we were unable to recover it. 00:30:08.406 [2024-07-13 10:16:13.955411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.955591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.955615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.406 qpair failed and we were unable to recover it. 00:30:08.406 [2024-07-13 10:16:13.955776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.955949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.955973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.406 qpair failed and we were unable to recover it. 00:30:08.406 [2024-07-13 10:16:13.956161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.956309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.956359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.406 qpair failed and we were unable to recover it. 00:30:08.406 [2024-07-13 10:16:13.956531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.956678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.956701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.406 qpair failed and we were unable to recover it. 00:30:08.406 [2024-07-13 10:16:13.956841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.957000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.957024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.406 qpair failed and we were unable to recover it. 00:30:08.406 [2024-07-13 10:16:13.957152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.957324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.957351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.406 qpair failed and we were unable to recover it. 00:30:08.406 [2024-07-13 10:16:13.957518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.957707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.406 [2024-07-13 10:16:13.957733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.406 qpair failed and we were unable to recover it. 00:30:08.406 [2024-07-13 10:16:13.957902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.958056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.958080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.407 qpair failed and we were unable to recover it. 00:30:08.407 [2024-07-13 10:16:13.958243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.958392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.958416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.407 qpair failed and we were unable to recover it. 00:30:08.407 [2024-07-13 10:16:13.958548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.958669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.958709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.407 qpair failed and we were unable to recover it. 00:30:08.407 [2024-07-13 10:16:13.958878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.959022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.959046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.407 qpair failed and we were unable to recover it. 00:30:08.407 [2024-07-13 10:16:13.959195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.959320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.959344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.407 qpair failed and we were unable to recover it. 00:30:08.407 [2024-07-13 10:16:13.959513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.959649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.959675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.407 qpair failed and we were unable to recover it. 00:30:08.407 [2024-07-13 10:16:13.959845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.959978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.960002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.407 qpair failed and we were unable to recover it. 00:30:08.407 [2024-07-13 10:16:13.960184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.960302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.960326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.407 qpair failed and we were unable to recover it. 00:30:08.407 [2024-07-13 10:16:13.960520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.960690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.960714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.407 qpair failed and we were unable to recover it. 00:30:08.407 [2024-07-13 10:16:13.960860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.961014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.961057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.407 qpair failed and we were unable to recover it. 00:30:08.407 [2024-07-13 10:16:13.961223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.961415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.961472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.407 qpair failed and we were unable to recover it. 00:30:08.407 [2024-07-13 10:16:13.961630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.961791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.961817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.407 qpair failed and we were unable to recover it. 00:30:08.407 [2024-07-13 10:16:13.961993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.962119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.962159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.407 qpair failed and we were unable to recover it. 00:30:08.407 [2024-07-13 10:16:13.962369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.962541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.962565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.407 qpair failed and we were unable to recover it. 00:30:08.407 [2024-07-13 10:16:13.962724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.962879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.962903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.407 qpair failed and we were unable to recover it. 00:30:08.407 [2024-07-13 10:16:13.963116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.963240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.963265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.407 qpair failed and we were unable to recover it. 00:30:08.407 [2024-07-13 10:16:13.963389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.963507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.963531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.407 qpair failed and we were unable to recover it. 00:30:08.407 [2024-07-13 10:16:13.963710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.963847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.963876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.407 qpair failed and we were unable to recover it. 00:30:08.407 [2024-07-13 10:16:13.964025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.964199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.964223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.407 qpair failed and we were unable to recover it. 00:30:08.407 [2024-07-13 10:16:13.964423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.964627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.964675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.407 qpair failed and we were unable to recover it. 00:30:08.407 [2024-07-13 10:16:13.964889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.965035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.965062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.407 qpair failed and we were unable to recover it. 00:30:08.407 [2024-07-13 10:16:13.965197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.965322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.965346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.407 qpair failed and we were unable to recover it. 00:30:08.407 [2024-07-13 10:16:13.965531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.965711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.965734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.407 qpair failed and we were unable to recover it. 00:30:08.407 [2024-07-13 10:16:13.965953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.966085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.966109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.407 qpair failed and we were unable to recover it. 00:30:08.407 [2024-07-13 10:16:13.966284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.966439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.966462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.407 qpair failed and we were unable to recover it. 00:30:08.407 [2024-07-13 10:16:13.966583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.966712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.966735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.407 qpair failed and we were unable to recover it. 00:30:08.407 [2024-07-13 10:16:13.966946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.967123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.967147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.407 qpair failed and we were unable to recover it. 00:30:08.407 [2024-07-13 10:16:13.967269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.967419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.407 [2024-07-13 10:16:13.967443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.407 qpair failed and we were unable to recover it. 00:30:08.408 [2024-07-13 10:16:13.967572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.967688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.967712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.408 qpair failed and we were unable to recover it. 00:30:08.408 [2024-07-13 10:16:13.967893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.968040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.968066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.408 qpair failed and we were unable to recover it. 00:30:08.408 [2024-07-13 10:16:13.968235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.968381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.968405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.408 qpair failed and we were unable to recover it. 00:30:08.408 [2024-07-13 10:16:13.968607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.968770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.968797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.408 qpair failed and we were unable to recover it. 00:30:08.408 [2024-07-13 10:16:13.968973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.969106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.969136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.408 qpair failed and we were unable to recover it. 00:30:08.408 [2024-07-13 10:16:13.969309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.969460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.969484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.408 qpair failed and we were unable to recover it. 00:30:08.408 [2024-07-13 10:16:13.969635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.969783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.969806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.408 qpair failed and we were unable to recover it. 00:30:08.408 [2024-07-13 10:16:13.969977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.970103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.970129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.408 qpair failed and we were unable to recover it. 00:30:08.408 [2024-07-13 10:16:13.970281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.970405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.970428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.408 qpair failed and we were unable to recover it. 00:30:08.408 [2024-07-13 10:16:13.970608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.970764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.970790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.408 qpair failed and we were unable to recover it. 00:30:08.408 [2024-07-13 10:16:13.970968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.971092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.971115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.408 qpair failed and we were unable to recover it. 00:30:08.408 [2024-07-13 10:16:13.971239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.971383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.971406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.408 qpair failed and we were unable to recover it. 00:30:08.408 [2024-07-13 10:16:13.971536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.971685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.971708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.408 qpair failed and we were unable to recover it. 00:30:08.408 [2024-07-13 10:16:13.971889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.972095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.972120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.408 qpair failed and we were unable to recover it. 00:30:08.408 [2024-07-13 10:16:13.972243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.972361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.972384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.408 qpair failed and we were unable to recover it. 00:30:08.408 [2024-07-13 10:16:13.972512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.972671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.972694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.408 qpair failed and we were unable to recover it. 00:30:08.408 [2024-07-13 10:16:13.972883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.973031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.973056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.408 qpair failed and we were unable to recover it. 00:30:08.408 [2024-07-13 10:16:13.973229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.973348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.973387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.408 qpair failed and we were unable to recover it. 00:30:08.408 [2024-07-13 10:16:13.973543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.973701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.973727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.408 qpair failed and we were unable to recover it. 00:30:08.408 [2024-07-13 10:16:13.973899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.974059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.974086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.408 qpair failed and we were unable to recover it. 00:30:08.408 [2024-07-13 10:16:13.974261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.974409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.974435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.408 qpair failed and we were unable to recover it. 00:30:08.408 [2024-07-13 10:16:13.974553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.974678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.974703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.408 qpair failed and we were unable to recover it. 00:30:08.408 [2024-07-13 10:16:13.974881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.975052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.975079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.408 qpair failed and we were unable to recover it. 00:30:08.408 [2024-07-13 10:16:13.975223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.975399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.975441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.408 qpair failed and we were unable to recover it. 00:30:08.408 [2024-07-13 10:16:13.975600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.975809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.975836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.408 qpair failed and we were unable to recover it. 00:30:08.408 [2024-07-13 10:16:13.975994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.976146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.976170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.408 qpair failed and we were unable to recover it. 00:30:08.408 [2024-07-13 10:16:13.976321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.976448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.976472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.408 qpair failed and we were unable to recover it. 00:30:08.408 [2024-07-13 10:16:13.976619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.976790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.976816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.408 qpair failed and we were unable to recover it. 00:30:08.408 [2024-07-13 10:16:13.976950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.977115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.977142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.408 qpair failed and we were unable to recover it. 00:30:08.408 [2024-07-13 10:16:13.977283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.977459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.977483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.408 qpair failed and we were unable to recover it. 00:30:08.408 [2024-07-13 10:16:13.977654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.977861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.977900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.408 qpair failed and we were unable to recover it. 00:30:08.408 [2024-07-13 10:16:13.978033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.978212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.978238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.408 qpair failed and we were unable to recover it. 00:30:08.408 [2024-07-13 10:16:13.978405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.978557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.408 [2024-07-13 10:16:13.978581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.409 qpair failed and we were unable to recover it. 00:30:08.409 [2024-07-13 10:16:13.978757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.978932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.978957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.409 qpair failed and we were unable to recover it. 00:30:08.409 [2024-07-13 10:16:13.979109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.979290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.979314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.409 qpair failed and we were unable to recover it. 00:30:08.409 [2024-07-13 10:16:13.979466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.979616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.979640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.409 qpair failed and we were unable to recover it. 00:30:08.409 [2024-07-13 10:16:13.979818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.979949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.979973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.409 qpair failed and we were unable to recover it. 00:30:08.409 [2024-07-13 10:16:13.980148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.980337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.980364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.409 qpair failed and we were unable to recover it. 00:30:08.409 [2024-07-13 10:16:13.980539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.980661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.980684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.409 qpair failed and we were unable to recover it. 00:30:08.409 [2024-07-13 10:16:13.980891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.981054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.981080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.409 qpair failed and we were unable to recover it. 00:30:08.409 [2024-07-13 10:16:13.981249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.981398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.981425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.409 qpair failed and we were unable to recover it. 00:30:08.409 [2024-07-13 10:16:13.981592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.981785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.981810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.409 qpair failed and we were unable to recover it. 00:30:08.409 [2024-07-13 10:16:13.981963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.982082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.982105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.409 qpair failed and we were unable to recover it. 00:30:08.409 [2024-07-13 10:16:13.982231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.982349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.982373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.409 qpair failed and we were unable to recover it. 00:30:08.409 [2024-07-13 10:16:13.982521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.982667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.982691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.409 qpair failed and we were unable to recover it. 00:30:08.409 [2024-07-13 10:16:13.982818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.982977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.983002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.409 qpair failed and we were unable to recover it. 00:30:08.409 [2024-07-13 10:16:13.983168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.983333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.983359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.409 qpair failed and we were unable to recover it. 00:30:08.409 [2024-07-13 10:16:13.983529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.983703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.983728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.409 qpair failed and we were unable to recover it. 00:30:08.409 [2024-07-13 10:16:13.983877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.984025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.984066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.409 qpair failed and we were unable to recover it. 00:30:08.409 [2024-07-13 10:16:13.984231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.984412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.984436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.409 qpair failed and we were unable to recover it. 00:30:08.409 [2024-07-13 10:16:13.984591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.984743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.984767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.409 qpair failed and we were unable to recover it. 00:30:08.409 [2024-07-13 10:16:13.984890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.985040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.985065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.409 qpair failed and we were unable to recover it. 00:30:08.409 [2024-07-13 10:16:13.985215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.985400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.985452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.409 qpair failed and we were unable to recover it. 00:30:08.409 [2024-07-13 10:16:13.985634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.985838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.985864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.409 qpair failed and we were unable to recover it. 00:30:08.409 [2024-07-13 10:16:13.986059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.986204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.986227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.409 qpair failed and we were unable to recover it. 00:30:08.409 [2024-07-13 10:16:13.986405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.986581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.986643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.409 qpair failed and we were unable to recover it. 00:30:08.409 [2024-07-13 10:16:13.986880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.987073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.987097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.409 qpair failed and we were unable to recover it. 00:30:08.409 [2024-07-13 10:16:13.987229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.987354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.987377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.409 qpair failed and we were unable to recover it. 00:30:08.409 [2024-07-13 10:16:13.987535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.987710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.987736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.409 qpair failed and we were unable to recover it. 00:30:08.409 [2024-07-13 10:16:13.987935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.988056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.988098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.409 qpair failed and we were unable to recover it. 00:30:08.409 [2024-07-13 10:16:13.988298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.988414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.988438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.409 qpair failed and we were unable to recover it. 00:30:08.409 [2024-07-13 10:16:13.988562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.988690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.988715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.409 qpair failed and we were unable to recover it. 00:30:08.409 [2024-07-13 10:16:13.988873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.989001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.989025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.409 qpair failed and we were unable to recover it. 00:30:08.409 [2024-07-13 10:16:13.989186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.989381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.989408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.409 qpair failed and we were unable to recover it. 00:30:08.409 [2024-07-13 10:16:13.989577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.989712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.989738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.409 qpair failed and we were unable to recover it. 00:30:08.409 [2024-07-13 10:16:13.989887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.409 [2024-07-13 10:16:13.990037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.990079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.410 qpair failed and we were unable to recover it. 00:30:08.410 [2024-07-13 10:16:13.990274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.990434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.990461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.410 qpair failed and we were unable to recover it. 00:30:08.410 [2024-07-13 10:16:13.990625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.990761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.990787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.410 qpair failed and we were unable to recover it. 00:30:08.410 [2024-07-13 10:16:13.990962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.991112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.991136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.410 qpair failed and we were unable to recover it. 00:30:08.410 [2024-07-13 10:16:13.991285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.991440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.991464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.410 qpair failed and we were unable to recover it. 00:30:08.410 [2024-07-13 10:16:13.991642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.991774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.991800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.410 qpair failed and we were unable to recover it. 00:30:08.410 [2024-07-13 10:16:13.991978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.992123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.992148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.410 qpair failed and we were unable to recover it. 00:30:08.410 [2024-07-13 10:16:13.992269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.992420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.992444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.410 qpair failed and we were unable to recover it. 00:30:08.410 [2024-07-13 10:16:13.992572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.992717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.992743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.410 qpair failed and we were unable to recover it. 00:30:08.410 [2024-07-13 10:16:13.992912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.993066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.993107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.410 qpair failed and we were unable to recover it. 00:30:08.410 [2024-07-13 10:16:13.993274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.993446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.993471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.410 qpair failed and we were unable to recover it. 00:30:08.410 [2024-07-13 10:16:13.993596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.993743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.993767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.410 qpair failed and we were unable to recover it. 00:30:08.410 [2024-07-13 10:16:13.993922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.994047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.994071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.410 qpair failed and we were unable to recover it. 00:30:08.410 [2024-07-13 10:16:13.994246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.994478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.994531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.410 qpair failed and we were unable to recover it. 00:30:08.410 [2024-07-13 10:16:13.994722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.994887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.994915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.410 qpair failed and we were unable to recover it. 00:30:08.410 [2024-07-13 10:16:13.995128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.995311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.995359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.410 qpair failed and we were unable to recover it. 00:30:08.410 [2024-07-13 10:16:13.995522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.995660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.995686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.410 qpair failed and we were unable to recover it. 00:30:08.410 [2024-07-13 10:16:13.995881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.996029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.996053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.410 qpair failed and we were unable to recover it. 00:30:08.410 [2024-07-13 10:16:13.996175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.996319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.996342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.410 qpair failed and we were unable to recover it. 00:30:08.410 [2024-07-13 10:16:13.996473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.996619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.996642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.410 qpair failed and we were unable to recover it. 00:30:08.410 [2024-07-13 10:16:13.996784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.996913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.996938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.410 qpair failed and we were unable to recover it. 00:30:08.410 [2024-07-13 10:16:13.997075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.997223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.997247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.410 qpair failed and we were unable to recover it. 00:30:08.410 [2024-07-13 10:16:13.997417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.997583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.997611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.410 qpair failed and we were unable to recover it. 00:30:08.410 [2024-07-13 10:16:13.997803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.997935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.997962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.410 qpair failed and we were unable to recover it. 00:30:08.410 [2024-07-13 10:16:13.998130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.998276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.998301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.410 qpair failed and we were unable to recover it. 00:30:08.410 [2024-07-13 10:16:13.998430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.998579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.998602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.410 qpair failed and we were unable to recover it. 00:30:08.410 [2024-07-13 10:16:13.998762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.998910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.998934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.410 qpair failed and we were unable to recover it. 00:30:08.410 [2024-07-13 10:16:13.999057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.999203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.999226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.410 qpair failed and we were unable to recover it. 00:30:08.410 [2024-07-13 10:16:13.999398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.999548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.999572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.410 qpair failed and we were unable to recover it. 00:30:08.410 [2024-07-13 10:16:13.999697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.999840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:13.999864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.410 qpair failed and we were unable to recover it. 00:30:08.410 [2024-07-13 10:16:13.999998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:14.000129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:14.000153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.410 qpair failed and we were unable to recover it. 00:30:08.410 [2024-07-13 10:16:14.000345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:14.000553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:14.000594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.410 qpair failed and we were unable to recover it. 00:30:08.410 [2024-07-13 10:16:14.000775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:14.000939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:14.000967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.410 qpair failed and we were unable to recover it. 00:30:08.410 [2024-07-13 10:16:14.001152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.410 [2024-07-13 10:16:14.001304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.001328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.411 qpair failed and we were unable to recover it. 00:30:08.411 [2024-07-13 10:16:14.001481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.001672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.001699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.411 qpair failed and we were unable to recover it. 00:30:08.411 [2024-07-13 10:16:14.001838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.002024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.002049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.411 qpair failed and we were unable to recover it. 00:30:08.411 [2024-07-13 10:16:14.002230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.002382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.002441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.411 qpair failed and we were unable to recover it. 00:30:08.411 [2024-07-13 10:16:14.002604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.002795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.002822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.411 qpair failed and we were unable to recover it. 00:30:08.411 [2024-07-13 10:16:14.003010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.003182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.003206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.411 qpair failed and we were unable to recover it. 00:30:08.411 [2024-07-13 10:16:14.003354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.003479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.003504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.411 qpair failed and we were unable to recover it. 00:30:08.411 [2024-07-13 10:16:14.003658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.003801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.003841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.411 qpair failed and we were unable to recover it. 00:30:08.411 [2024-07-13 10:16:14.003984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.004148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.004176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.411 qpair failed and we were unable to recover it. 00:30:08.411 [2024-07-13 10:16:14.004351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.004522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.004547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.411 qpair failed and we were unable to recover it. 00:30:08.411 [2024-07-13 10:16:14.004673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.004810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.004837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.411 qpair failed and we were unable to recover it. 00:30:08.411 [2024-07-13 10:16:14.005053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.005172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.005196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.411 qpair failed and we were unable to recover it. 00:30:08.411 [2024-07-13 10:16:14.005372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.005488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.005529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.411 qpair failed and we were unable to recover it. 00:30:08.411 [2024-07-13 10:16:14.005677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.005852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.005888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.411 qpair failed and we were unable to recover it. 00:30:08.411 [2024-07-13 10:16:14.006072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.006249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.006273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.411 qpair failed and we were unable to recover it. 00:30:08.411 [2024-07-13 10:16:14.006416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.006594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.006618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.411 qpair failed and we were unable to recover it. 00:30:08.411 [2024-07-13 10:16:14.006768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.006889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.006914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.411 qpair failed and we were unable to recover it. 00:30:08.411 [2024-07-13 10:16:14.007042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.007219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.007243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.411 qpair failed and we were unable to recover it. 00:30:08.411 [2024-07-13 10:16:14.007424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.007547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.007577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.411 qpair failed and we were unable to recover it. 00:30:08.411 [2024-07-13 10:16:14.007759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.007921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.007948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.411 qpair failed and we were unable to recover it. 00:30:08.411 [2024-07-13 10:16:14.008139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.008291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.008315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.411 qpair failed and we were unable to recover it. 00:30:08.411 [2024-07-13 10:16:14.008430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.008574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.008598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.411 qpair failed and we were unable to recover it. 00:30:08.411 [2024-07-13 10:16:14.008792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.008958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.008986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.411 qpair failed and we were unable to recover it. 00:30:08.411 [2024-07-13 10:16:14.009111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.009274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.009303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.411 qpair failed and we were unable to recover it. 00:30:08.411 [2024-07-13 10:16:14.009447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.009592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.009616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.411 qpair failed and we were unable to recover it. 00:30:08.411 [2024-07-13 10:16:14.009759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.009894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.009923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.411 qpair failed and we were unable to recover it. 00:30:08.411 [2024-07-13 10:16:14.010092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.010332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.010380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.411 qpair failed and we were unable to recover it. 00:30:08.411 [2024-07-13 10:16:14.010566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.010719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.010743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.411 qpair failed and we were unable to recover it. 00:30:08.411 [2024-07-13 10:16:14.010893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.411 [2024-07-13 10:16:14.011043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.011067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.412 qpair failed and we were unable to recover it. 00:30:08.412 [2024-07-13 10:16:14.011193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.011351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.011375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.412 qpair failed and we were unable to recover it. 00:30:08.412 [2024-07-13 10:16:14.011529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.011706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.011730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.412 qpair failed and we were unable to recover it. 00:30:08.412 [2024-07-13 10:16:14.011857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.012016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.012042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.412 qpair failed and we were unable to recover it. 00:30:08.412 [2024-07-13 10:16:14.012195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.012356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.012383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.412 qpair failed and we were unable to recover it. 00:30:08.412 [2024-07-13 10:16:14.012545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.012686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.012728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.412 qpair failed and we were unable to recover it. 00:30:08.412 [2024-07-13 10:16:14.012900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.013054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.013081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.412 qpair failed and we were unable to recover it. 00:30:08.412 [2024-07-13 10:16:14.013247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.013405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.013432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.412 qpair failed and we were unable to recover it. 00:30:08.412 [2024-07-13 10:16:14.013597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.013763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.013789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.412 qpair failed and we were unable to recover it. 00:30:08.412 [2024-07-13 10:16:14.013962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.014082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.014106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.412 qpair failed and we were unable to recover it. 00:30:08.412 [2024-07-13 10:16:14.014255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.014405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.014429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.412 qpair failed and we were unable to recover it. 00:30:08.412 [2024-07-13 10:16:14.014550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.014664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.014688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.412 qpair failed and we were unable to recover it. 00:30:08.412 [2024-07-13 10:16:14.014859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.015035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.015061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.412 qpair failed and we were unable to recover it. 00:30:08.412 [2024-07-13 10:16:14.015230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.015386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.015410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.412 qpair failed and we were unable to recover it. 00:30:08.412 [2024-07-13 10:16:14.015536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.015685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.015709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.412 qpair failed and we were unable to recover it. 00:30:08.412 [2024-07-13 10:16:14.015890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.016057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.016084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.412 qpair failed and we were unable to recover it. 00:30:08.412 [2024-07-13 10:16:14.016220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.016380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.016406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.412 qpair failed and we were unable to recover it. 00:30:08.412 [2024-07-13 10:16:14.016604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.016750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.016774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.412 qpair failed and we were unable to recover it. 00:30:08.412 [2024-07-13 10:16:14.016923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.017090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.017116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.412 qpair failed and we were unable to recover it. 00:30:08.412 [2024-07-13 10:16:14.017281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.017461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.017501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.412 qpair failed and we were unable to recover it. 00:30:08.412 [2024-07-13 10:16:14.017690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.017860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.017890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.412 qpair failed and we were unable to recover it. 00:30:08.412 [2024-07-13 10:16:14.018079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.018284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.018332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.412 qpair failed and we were unable to recover it. 00:30:08.412 [2024-07-13 10:16:14.018534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.018704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.018730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.412 qpair failed and we were unable to recover it. 00:30:08.412 [2024-07-13 10:16:14.018900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.019024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.019049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.412 qpair failed and we were unable to recover it. 00:30:08.412 [2024-07-13 10:16:14.019196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.019351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.019375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.412 qpair failed and we were unable to recover it. 00:30:08.412 [2024-07-13 10:16:14.019554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.019723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.019748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.412 qpair failed and we were unable to recover it. 00:30:08.412 [2024-07-13 10:16:14.019930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.020081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.020106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.412 qpair failed and we were unable to recover it. 00:30:08.412 [2024-07-13 10:16:14.020231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.020402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.020426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.412 qpair failed and we were unable to recover it. 00:30:08.412 [2024-07-13 10:16:14.020577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.020701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.020725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.412 qpair failed and we were unable to recover it. 00:30:08.412 [2024-07-13 10:16:14.020887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.021011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.021035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.412 qpair failed and we were unable to recover it. 00:30:08.412 [2024-07-13 10:16:14.021215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.021445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.021494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.412 qpair failed and we were unable to recover it. 00:30:08.412 [2024-07-13 10:16:14.021624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.021790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.021817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.412 qpair failed and we were unable to recover it. 00:30:08.412 [2024-07-13 10:16:14.021985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.022134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.412 [2024-07-13 10:16:14.022158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.412 qpair failed and we were unable to recover it. 00:30:08.412 [2024-07-13 10:16:14.022282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.022419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.022446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.413 qpair failed and we were unable to recover it. 00:30:08.413 [2024-07-13 10:16:14.022608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.022804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.022827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.413 qpair failed and we were unable to recover it. 00:30:08.413 [2024-07-13 10:16:14.022971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.023122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.023148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.413 qpair failed and we were unable to recover it. 00:30:08.413 [2024-07-13 10:16:14.023297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.023419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.023443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.413 qpair failed and we were unable to recover it. 00:30:08.413 [2024-07-13 10:16:14.023570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.023717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.023741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.413 qpair failed and we were unable to recover it. 00:30:08.413 [2024-07-13 10:16:14.023893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.024009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.024033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.413 qpair failed and we were unable to recover it. 00:30:08.413 [2024-07-13 10:16:14.024188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.024337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.024362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.413 qpair failed and we were unable to recover it. 00:30:08.413 [2024-07-13 10:16:14.024517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.024690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.024717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.413 qpair failed and we were unable to recover it. 00:30:08.413 [2024-07-13 10:16:14.024909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.025035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.025079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.413 qpair failed and we were unable to recover it. 00:30:08.413 [2024-07-13 10:16:14.025221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.025378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.025401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.413 qpair failed and we were unable to recover it. 00:30:08.413 [2024-07-13 10:16:14.025560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.025731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.025756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.413 qpair failed and we were unable to recover it. 00:30:08.413 [2024-07-13 10:16:14.025878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.026001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.026024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.413 qpair failed and we were unable to recover it. 00:30:08.413 [2024-07-13 10:16:14.026170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.026386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.026437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.413 qpair failed and we were unable to recover it. 00:30:08.413 [2024-07-13 10:16:14.026601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.026760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.026787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.413 qpair failed and we were unable to recover it. 00:30:08.413 [2024-07-13 10:16:14.026925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.027072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.027096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.413 qpair failed and we were unable to recover it. 00:30:08.413 [2024-07-13 10:16:14.027271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.027462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.027489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.413 qpair failed and we were unable to recover it. 00:30:08.413 [2024-07-13 10:16:14.027661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.027792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.027816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.413 qpair failed and we were unable to recover it. 00:30:08.413 [2024-07-13 10:16:14.027995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.028143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.028167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.413 qpair failed and we were unable to recover it. 00:30:08.413 [2024-07-13 10:16:14.028294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.028463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.028490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.413 qpair failed and we were unable to recover it. 00:30:08.413 [2024-07-13 10:16:14.028665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.028794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.028822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.413 qpair failed and we were unable to recover it. 00:30:08.413 [2024-07-13 10:16:14.029032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.029159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.029182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.413 qpair failed and we were unable to recover it. 00:30:08.413 [2024-07-13 10:16:14.029310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.029462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.029487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.413 qpair failed and we were unable to recover it. 00:30:08.413 [2024-07-13 10:16:14.029614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.029791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.029815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.413 qpair failed and we were unable to recover it. 00:30:08.413 [2024-07-13 10:16:14.030031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.030199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.030225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.413 qpair failed and we were unable to recover it. 00:30:08.413 [2024-07-13 10:16:14.030401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.030621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.030671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.413 qpair failed and we were unable to recover it. 00:30:08.413 [2024-07-13 10:16:14.030833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.030981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.031005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.413 qpair failed and we were unable to recover it. 00:30:08.413 [2024-07-13 10:16:14.031159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.031280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.031304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.413 qpair failed and we were unable to recover it. 00:30:08.413 [2024-07-13 10:16:14.031452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.031604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.031628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.413 qpair failed and we were unable to recover it. 00:30:08.413 [2024-07-13 10:16:14.031778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.031926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.031954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.413 qpair failed and we were unable to recover it. 00:30:08.413 [2024-07-13 10:16:14.032104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.032278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.032322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.413 qpair failed and we were unable to recover it. 00:30:08.413 [2024-07-13 10:16:14.032481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.032652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.032678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.413 qpair failed and we were unable to recover it. 00:30:08.413 [2024-07-13 10:16:14.032841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.033003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.033028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.413 qpair failed and we were unable to recover it. 00:30:08.413 [2024-07-13 10:16:14.033174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.413 [2024-07-13 10:16:14.033290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.033313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.414 qpair failed and we were unable to recover it. 00:30:08.414 [2024-07-13 10:16:14.033517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.033684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.033711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.414 qpair failed and we were unable to recover it. 00:30:08.414 [2024-07-13 10:16:14.033917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.034093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.034116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.414 qpair failed and we were unable to recover it. 00:30:08.414 [2024-07-13 10:16:14.034266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.034416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.034458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.414 qpair failed and we were unable to recover it. 00:30:08.414 [2024-07-13 10:16:14.034595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.034764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.034788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.414 qpair failed and we were unable to recover it. 00:30:08.414 [2024-07-13 10:16:14.034941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.035115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.035141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.414 qpair failed and we were unable to recover it. 00:30:08.414 [2024-07-13 10:16:14.035311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.035461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.035485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.414 qpair failed and we were unable to recover it. 00:30:08.414 [2024-07-13 10:16:14.035621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.035793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.035818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.414 qpair failed and we were unable to recover it. 00:30:08.414 [2024-07-13 10:16:14.035995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.036206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.036261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.414 qpair failed and we were unable to recover it. 00:30:08.414 [2024-07-13 10:16:14.036425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.036580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.036604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.414 qpair failed and we were unable to recover it. 00:30:08.414 [2024-07-13 10:16:14.036730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.036849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.036881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.414 qpair failed and we were unable to recover it. 00:30:08.414 [2024-07-13 10:16:14.037076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.037267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.037314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.414 qpair failed and we were unable to recover it. 00:30:08.414 [2024-07-13 10:16:14.037514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.037688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.037712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.414 qpair failed and we were unable to recover it. 00:30:08.414 [2024-07-13 10:16:14.037862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.037992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.038016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.414 qpair failed and we were unable to recover it. 00:30:08.414 [2024-07-13 10:16:14.038169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.038340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.038364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.414 qpair failed and we were unable to recover it. 00:30:08.414 [2024-07-13 10:16:14.038512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.038660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.038684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.414 qpair failed and we were unable to recover it. 00:30:08.414 [2024-07-13 10:16:14.038806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.038958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.038983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.414 qpair failed and we were unable to recover it. 00:30:08.414 [2024-07-13 10:16:14.039107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.039240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.039263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.414 qpair failed and we were unable to recover it. 00:30:08.414 [2024-07-13 10:16:14.039457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.039582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.039605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.414 qpair failed and we were unable to recover it. 00:30:08.414 [2024-07-13 10:16:14.039752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.039907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.039933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.414 qpair failed and we were unable to recover it. 00:30:08.414 [2024-07-13 10:16:14.040081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.040248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.040272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.414 qpair failed and we were unable to recover it. 00:30:08.414 [2024-07-13 10:16:14.040426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.040578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.040602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.414 qpair failed and we were unable to recover it. 00:30:08.414 [2024-07-13 10:16:14.040770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.040953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.040978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.414 qpair failed and we were unable to recover it. 00:30:08.414 [2024-07-13 10:16:14.041130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.041304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.041328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.414 qpair failed and we were unable to recover it. 00:30:08.414 [2024-07-13 10:16:14.041454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.041603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.041627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.414 qpair failed and we were unable to recover it. 00:30:08.414 [2024-07-13 10:16:14.041777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.041941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.041968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.414 qpair failed and we were unable to recover it. 00:30:08.414 [2024-07-13 10:16:14.042136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.042265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.042291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.414 qpair failed and we were unable to recover it. 00:30:08.414 [2024-07-13 10:16:14.042429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.042550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.042578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.414 qpair failed and we were unable to recover it. 00:30:08.414 [2024-07-13 10:16:14.042720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.042875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.042900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.414 qpair failed and we were unable to recover it. 00:30:08.414 [2024-07-13 10:16:14.043013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.043137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.043161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.414 qpair failed and we were unable to recover it. 00:30:08.414 [2024-07-13 10:16:14.043343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.043493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.043519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.414 qpair failed and we were unable to recover it. 00:30:08.414 [2024-07-13 10:16:14.043672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.043787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.043810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.414 qpair failed and we were unable to recover it. 00:30:08.414 [2024-07-13 10:16:14.043987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.044102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.044125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.414 qpair failed and we were unable to recover it. 00:30:08.414 [2024-07-13 10:16:14.044302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.414 [2024-07-13 10:16:14.044433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.044457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.415 qpair failed and we were unable to recover it. 00:30:08.415 [2024-07-13 10:16:14.044581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.044699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.044724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.415 qpair failed and we were unable to recover it. 00:30:08.415 [2024-07-13 10:16:14.044889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.045071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.045097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.415 qpair failed and we were unable to recover it. 00:30:08.415 [2024-07-13 10:16:14.045268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.045394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.045418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.415 qpair failed and we were unable to recover it. 00:30:08.415 [2024-07-13 10:16:14.045566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.045760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.045787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.415 qpair failed and we were unable to recover it. 00:30:08.415 [2024-07-13 10:16:14.045973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.046146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.046170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.415 qpair failed and we were unable to recover it. 00:30:08.415 [2024-07-13 10:16:14.046320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.046472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.046514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.415 qpair failed and we were unable to recover it. 00:30:08.415 [2024-07-13 10:16:14.046701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.046871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.046899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.415 qpair failed and we were unable to recover it. 00:30:08.415 [2024-07-13 10:16:14.047042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.047216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.047243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.415 qpair failed and we were unable to recover it. 00:30:08.415 [2024-07-13 10:16:14.047440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.047592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.047616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.415 qpair failed and we were unable to recover it. 00:30:08.415 [2024-07-13 10:16:14.047790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.047950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.047976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.415 qpair failed and we were unable to recover it. 00:30:08.415 [2024-07-13 10:16:14.048106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.048260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.048285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.415 qpair failed and we were unable to recover it. 00:30:08.415 [2024-07-13 10:16:14.048432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.048546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.048570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.415 qpair failed and we were unable to recover it. 00:30:08.415 [2024-07-13 10:16:14.048698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.048816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.048841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.415 qpair failed and we were unable to recover it. 00:30:08.415 [2024-07-13 10:16:14.049007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.049133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.049159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.415 qpair failed and we were unable to recover it. 00:30:08.415 [2024-07-13 10:16:14.049293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.049466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.049490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.415 qpair failed and we were unable to recover it. 00:30:08.415 [2024-07-13 10:16:14.049624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.049758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.049787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.415 qpair failed and we were unable to recover it. 00:30:08.415 [2024-07-13 10:16:14.049949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.050115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.050141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.415 qpair failed and we were unable to recover it. 00:30:08.415 [2024-07-13 10:16:14.050314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.050465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.050508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.415 qpair failed and we were unable to recover it. 00:30:08.415 [2024-07-13 10:16:14.050716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.050862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.050893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.415 qpair failed and we were unable to recover it. 00:30:08.415 [2024-07-13 10:16:14.051070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.051216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.051240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.415 qpair failed and we were unable to recover it. 00:30:08.415 [2024-07-13 10:16:14.051382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.051501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.051525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.415 qpair failed and we were unable to recover it. 00:30:08.415 [2024-07-13 10:16:14.051657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.051820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.051847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.415 qpair failed and we were unable to recover it. 00:30:08.415 [2024-07-13 10:16:14.052037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.052180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.052208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.415 qpair failed and we were unable to recover it. 00:30:08.415 [2024-07-13 10:16:14.052375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.052498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.052524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.415 qpair failed and we were unable to recover it. 00:30:08.415 [2024-07-13 10:16:14.052705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.052826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.052850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.415 qpair failed and we were unable to recover it. 00:30:08.415 [2024-07-13 10:16:14.053003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.053130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.053157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.415 qpair failed and we were unable to recover it. 00:30:08.415 [2024-07-13 10:16:14.053291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.053444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.053468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.415 qpair failed and we were unable to recover it. 00:30:08.415 [2024-07-13 10:16:14.053614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.053739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.415 [2024-07-13 10:16:14.053763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.416 qpair failed and we were unable to recover it. 00:30:08.416 [2024-07-13 10:16:14.053941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.054154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.054178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.416 qpair failed and we were unable to recover it. 00:30:08.416 [2024-07-13 10:16:14.054357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.054504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.054529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.416 qpair failed and we were unable to recover it. 00:30:08.416 [2024-07-13 10:16:14.054713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.054878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.054906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.416 qpair failed and we were unable to recover it. 00:30:08.416 [2024-07-13 10:16:14.055063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.055192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.055217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.416 qpair failed and we were unable to recover it. 00:30:08.416 [2024-07-13 10:16:14.055370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.055514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.055554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.416 qpair failed and we were unable to recover it. 00:30:08.416 [2024-07-13 10:16:14.055722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.055886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.055914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.416 qpair failed and we were unable to recover it. 00:30:08.416 [2024-07-13 10:16:14.056084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.056216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.056243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.416 qpair failed and we were unable to recover it. 00:30:08.416 [2024-07-13 10:16:14.056431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.056580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.056604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.416 qpair failed and we were unable to recover it. 00:30:08.416 [2024-07-13 10:16:14.056724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.056958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.056985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.416 qpair failed and we were unable to recover it. 00:30:08.416 [2024-07-13 10:16:14.057125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.057265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.057292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.416 qpair failed and we were unable to recover it. 00:30:08.416 [2024-07-13 10:16:14.057487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.057632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.057655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.416 qpair failed and we were unable to recover it. 00:30:08.416 [2024-07-13 10:16:14.057803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.057952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.057977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.416 qpair failed and we were unable to recover it. 00:30:08.416 [2024-07-13 10:16:14.058104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.058234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.058260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.416 qpair failed and we were unable to recover it. 00:30:08.416 [2024-07-13 10:16:14.058416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.058593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.058618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.416 qpair failed and we were unable to recover it. 00:30:08.416 [2024-07-13 10:16:14.058795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.058941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.058965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.416 qpair failed and we were unable to recover it. 00:30:08.416 [2024-07-13 10:16:14.059160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.059371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.059418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.416 qpair failed and we were unable to recover it. 00:30:08.416 [2024-07-13 10:16:14.059588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.059735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.059764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.416 qpair failed and we were unable to recover it. 00:30:08.416 [2024-07-13 10:16:14.059920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.060071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.060095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.416 qpair failed and we were unable to recover it. 00:30:08.416 [2024-07-13 10:16:14.060227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.060376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.060400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.416 qpair failed and we were unable to recover it. 00:30:08.416 [2024-07-13 10:16:14.060525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.060672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.060696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.416 qpair failed and we were unable to recover it. 00:30:08.416 [2024-07-13 10:16:14.060848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.060979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.061003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.416 qpair failed and we were unable to recover it. 00:30:08.416 [2024-07-13 10:16:14.061155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.061310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.061333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.416 qpair failed and we were unable to recover it. 00:30:08.416 [2024-07-13 10:16:14.061454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.061605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.061629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.416 qpair failed and we were unable to recover it. 00:30:08.416 [2024-07-13 10:16:14.061772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.061935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.061963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.416 qpair failed and we were unable to recover it. 00:30:08.416 [2024-07-13 10:16:14.062130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.062324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.062348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.416 qpair failed and we were unable to recover it. 00:30:08.416 [2024-07-13 10:16:14.062505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.062650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.062675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.416 qpair failed and we were unable to recover it. 00:30:08.416 [2024-07-13 10:16:14.062849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.063000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.063027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.416 qpair failed and we were unable to recover it. 00:30:08.416 [2024-07-13 10:16:14.063200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.063447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.063499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.416 qpair failed and we were unable to recover it. 00:30:08.416 [2024-07-13 10:16:14.063668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.063849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.063886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.416 qpair failed and we were unable to recover it. 00:30:08.416 [2024-07-13 10:16:14.064032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.064235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.064259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.416 qpair failed and we were unable to recover it. 00:30:08.416 [2024-07-13 10:16:14.064408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.064555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.064581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.416 qpair failed and we were unable to recover it. 00:30:08.416 [2024-07-13 10:16:14.064725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.064853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.064884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.416 qpair failed and we were unable to recover it. 00:30:08.416 [2024-07-13 10:16:14.065020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.065198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.416 [2024-07-13 10:16:14.065222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.417 qpair failed and we were unable to recover it. 00:30:08.417 [2024-07-13 10:16:14.065374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.065565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.065610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.417 qpair failed and we were unable to recover it. 00:30:08.417 [2024-07-13 10:16:14.065791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.065971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.065996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.417 qpair failed and we were unable to recover it. 00:30:08.417 [2024-07-13 10:16:14.066129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.066303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.066327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.417 qpair failed and we were unable to recover it. 00:30:08.417 [2024-07-13 10:16:14.066439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.066574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.066600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.417 qpair failed and we were unable to recover it. 00:30:08.417 [2024-07-13 10:16:14.066757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.066881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.066905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.417 qpair failed and we were unable to recover it. 00:30:08.417 [2024-07-13 10:16:14.067029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.067155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.067178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.417 qpair failed and we were unable to recover it. 00:30:08.417 [2024-07-13 10:16:14.067349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.067463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.067487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.417 qpair failed and we were unable to recover it. 00:30:08.417 [2024-07-13 10:16:14.067636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.067810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.067834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.417 qpair failed and we were unable to recover it. 00:30:08.417 [2024-07-13 10:16:14.068003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.068150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.068174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.417 qpair failed and we were unable to recover it. 00:30:08.417 [2024-07-13 10:16:14.068316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.068499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.068523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.417 qpair failed and we were unable to recover it. 00:30:08.417 [2024-07-13 10:16:14.068680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.068878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.068906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.417 qpair failed and we were unable to recover it. 00:30:08.417 [2024-07-13 10:16:14.069074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.069273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.069300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.417 qpair failed and we were unable to recover it. 00:30:08.417 [2024-07-13 10:16:14.069463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.069598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.069625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.417 qpair failed and we were unable to recover it. 00:30:08.417 [2024-07-13 10:16:14.069771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.069926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.069950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.417 qpair failed and we were unable to recover it. 00:30:08.417 [2024-07-13 10:16:14.070083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.070229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.070252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.417 qpair failed and we were unable to recover it. 00:30:08.417 [2024-07-13 10:16:14.070429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.070588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.070615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.417 qpair failed and we were unable to recover it. 00:30:08.417 [2024-07-13 10:16:14.070770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.070944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.070969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.417 qpair failed and we were unable to recover it. 00:30:08.417 [2024-07-13 10:16:14.071121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.071247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.071271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.417 qpair failed and we were unable to recover it. 00:30:08.417 [2024-07-13 10:16:14.071440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.071615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.071639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.417 qpair failed and we were unable to recover it. 00:30:08.417 [2024-07-13 10:16:14.071788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.071956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.071983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.417 qpair failed and we were unable to recover it. 00:30:08.417 [2024-07-13 10:16:14.072133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.072309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.072332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.417 qpair failed and we were unable to recover it. 00:30:08.417 [2024-07-13 10:16:14.072450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.072561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.072585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.417 qpair failed and we were unable to recover it. 00:30:08.417 [2024-07-13 10:16:14.072739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.072886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.072928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.417 qpair failed and we were unable to recover it. 00:30:08.417 [2024-07-13 10:16:14.073096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.073293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.073341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.417 qpair failed and we were unable to recover it. 00:30:08.417 [2024-07-13 10:16:14.073509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.073712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.073740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.417 qpair failed and we were unable to recover it. 00:30:08.417 [2024-07-13 10:16:14.073910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.074103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.074130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.417 qpair failed and we were unable to recover it. 00:30:08.417 [2024-07-13 10:16:14.074266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.074430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.074456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.417 qpair failed and we were unable to recover it. 00:30:08.417 [2024-07-13 10:16:14.074619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.074749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.074775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.417 qpair failed and we were unable to recover it. 00:30:08.417 [2024-07-13 10:16:14.074941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.075092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.075117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.417 qpair failed and we were unable to recover it. 00:30:08.417 [2024-07-13 10:16:14.075261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.075445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.075471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.417 qpair failed and we were unable to recover it. 00:30:08.417 [2024-07-13 10:16:14.075636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.075785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.075809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.417 qpair failed and we were unable to recover it. 00:30:08.417 [2024-07-13 10:16:14.075938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.076100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.076124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.417 qpair failed and we were unable to recover it. 00:30:08.417 [2024-07-13 10:16:14.076257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.076428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.417 [2024-07-13 10:16:14.076457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.417 qpair failed and we were unable to recover it. 00:30:08.418 [2024-07-13 10:16:14.076599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.076727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.076754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.418 qpair failed and we were unable to recover it. 00:30:08.418 [2024-07-13 10:16:14.076924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.077071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.077116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.418 qpair failed and we were unable to recover it. 00:30:08.418 [2024-07-13 10:16:14.077278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.077443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.077471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.418 qpair failed and we were unable to recover it. 00:30:08.418 [2024-07-13 10:16:14.077634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.077772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.077798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.418 qpair failed and we were unable to recover it. 00:30:08.418 [2024-07-13 10:16:14.077943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.078094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.078134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.418 qpair failed and we were unable to recover it. 00:30:08.418 [2024-07-13 10:16:14.078278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.078426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.078450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.418 qpair failed and we were unable to recover it. 00:30:08.418 [2024-07-13 10:16:14.078600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.078745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.078768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.418 qpair failed and we were unable to recover it. 00:30:08.418 [2024-07-13 10:16:14.078945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.079139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.079166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.418 qpair failed and we were unable to recover it. 00:30:08.418 [2024-07-13 10:16:14.079344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.079540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.079566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.418 qpair failed and we were unable to recover it. 00:30:08.418 [2024-07-13 10:16:14.079754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.079944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.079971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.418 qpair failed and we were unable to recover it. 00:30:08.418 [2024-07-13 10:16:14.080146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.080266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.080290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.418 qpair failed and we were unable to recover it. 00:30:08.418 [2024-07-13 10:16:14.080440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.080631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.080662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.418 qpair failed and we were unable to recover it. 00:30:08.418 [2024-07-13 10:16:14.080850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.080989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.081016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.418 qpair failed and we were unable to recover it. 00:30:08.418 [2024-07-13 10:16:14.081182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.081298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.081322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.418 qpair failed and we were unable to recover it. 00:30:08.418 [2024-07-13 10:16:14.081505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.081631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.081657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.418 qpair failed and we were unable to recover it. 00:30:08.418 [2024-07-13 10:16:14.081809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.081999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.082027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.418 qpair failed and we were unable to recover it. 00:30:08.418 [2024-07-13 10:16:14.082194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.082318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.082342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.418 qpair failed and we were unable to recover it. 00:30:08.418 [2024-07-13 10:16:14.082490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.082640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.082664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.418 qpair failed and we were unable to recover it. 00:30:08.418 [2024-07-13 10:16:14.082818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.083003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.083030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.418 qpair failed and we were unable to recover it. 00:30:08.418 [2024-07-13 10:16:14.083177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.083350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.083375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.418 qpair failed and we were unable to recover it. 00:30:08.418 [2024-07-13 10:16:14.083576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.083765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.083791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.418 qpair failed and we were unable to recover it. 00:30:08.418 [2024-07-13 10:16:14.083944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.084054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.084078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.418 qpair failed and we were unable to recover it. 00:30:08.418 [2024-07-13 10:16:14.084236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.084386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.084410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.418 qpair failed and we were unable to recover it. 00:30:08.418 [2024-07-13 10:16:14.084588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.084738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.084762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.418 qpair failed and we were unable to recover it. 00:30:08.418 [2024-07-13 10:16:14.084939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.085065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.085089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.418 qpair failed and we were unable to recover it. 00:30:08.418 [2024-07-13 10:16:14.085238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.085443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.085500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.418 qpair failed and we were unable to recover it. 00:30:08.418 [2024-07-13 10:16:14.085691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.085854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.085889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.418 qpair failed and we were unable to recover it. 00:30:08.418 [2024-07-13 10:16:14.086097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.086256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.086298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.418 qpair failed and we were unable to recover it. 00:30:08.418 [2024-07-13 10:16:14.086469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.086632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.086656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.418 qpair failed and we were unable to recover it. 00:30:08.418 [2024-07-13 10:16:14.086820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.086995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.087023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.418 qpair failed and we were unable to recover it. 00:30:08.418 [2024-07-13 10:16:14.087150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.087308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.087335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.418 qpair failed and we were unable to recover it. 00:30:08.418 [2024-07-13 10:16:14.087505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.087680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.087704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.418 qpair failed and we were unable to recover it. 00:30:08.418 [2024-07-13 10:16:14.087836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.087994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.418 [2024-07-13 10:16:14.088020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.418 qpair failed and we were unable to recover it. 00:30:08.419 [2024-07-13 10:16:14.088196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.088316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.088340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.419 qpair failed and we were unable to recover it. 00:30:08.419 [2024-07-13 10:16:14.088486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.088675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.088702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.419 qpair failed and we were unable to recover it. 00:30:08.419 [2024-07-13 10:16:14.088836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.089030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.089058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.419 qpair failed and we were unable to recover it. 00:30:08.419 [2024-07-13 10:16:14.089247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.089413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.089440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.419 qpair failed and we were unable to recover it. 00:30:08.419 [2024-07-13 10:16:14.089604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.089777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.089802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.419 qpair failed and we were unable to recover it. 00:30:08.419 [2024-07-13 10:16:14.089954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.090074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.090101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.419 qpair failed and we were unable to recover it. 00:30:08.419 [2024-07-13 10:16:14.090297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.090460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.090514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.419 qpair failed and we were unable to recover it. 00:30:08.419 [2024-07-13 10:16:14.090648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.090798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.090823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.419 qpair failed and we were unable to recover it. 00:30:08.419 [2024-07-13 10:16:14.090980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.091132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.091157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.419 qpair failed and we were unable to recover it. 00:30:08.419 [2024-07-13 10:16:14.091391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.091622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.091671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.419 qpair failed and we were unable to recover it. 00:30:08.419 [2024-07-13 10:16:14.091885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.092059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.092084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.419 qpair failed and we were unable to recover it. 00:30:08.419 [2024-07-13 10:16:14.092312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.092483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.092507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.419 qpair failed and we were unable to recover it. 00:30:08.419 [2024-07-13 10:16:14.092635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.092839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.092863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.419 qpair failed and we were unable to recover it. 00:30:08.419 [2024-07-13 10:16:14.093048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.093196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.093220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.419 qpair failed and we were unable to recover it. 00:30:08.419 [2024-07-13 10:16:14.093364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.093541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.093565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.419 qpair failed and we were unable to recover it. 00:30:08.419 [2024-07-13 10:16:14.093816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.093972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.093997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.419 qpair failed and we were unable to recover it. 00:30:08.419 [2024-07-13 10:16:14.094127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.094247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.094271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.419 qpair failed and we were unable to recover it. 00:30:08.419 [2024-07-13 10:16:14.094420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.094570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.094594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.419 qpair failed and we were unable to recover it. 00:30:08.419 [2024-07-13 10:16:14.094742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.094917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.094942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.419 qpair failed and we were unable to recover it. 00:30:08.419 [2024-07-13 10:16:14.095095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.095271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.095298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.419 qpair failed and we were unable to recover it. 00:30:08.419 [2024-07-13 10:16:14.095466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.095634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.095661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.419 qpair failed and we were unable to recover it. 00:30:08.419 [2024-07-13 10:16:14.095807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.095961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.095986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.419 qpair failed and we were unable to recover it. 00:30:08.419 [2024-07-13 10:16:14.096120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.096263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.096303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.419 qpair failed and we were unable to recover it. 00:30:08.419 [2024-07-13 10:16:14.096471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.096634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.096661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.419 qpair failed and we were unable to recover it. 00:30:08.419 [2024-07-13 10:16:14.096851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.097004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.097032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.419 qpair failed and we were unable to recover it. 00:30:08.419 [2024-07-13 10:16:14.097198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.097347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.097371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.419 qpair failed and we were unable to recover it. 00:30:08.419 [2024-07-13 10:16:14.097497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.097666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.097695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.419 qpair failed and we were unable to recover it. 00:30:08.419 [2024-07-13 10:16:14.097830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.097976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.419 [2024-07-13 10:16:14.098004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.419 qpair failed and we were unable to recover it. 00:30:08.419 [2024-07-13 10:16:14.098169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.098312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.098336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.420 qpair failed and we were unable to recover it. 00:30:08.420 [2024-07-13 10:16:14.098463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.098667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.098698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.420 qpair failed and we were unable to recover it. 00:30:08.420 [2024-07-13 10:16:14.098825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.098999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.099027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.420 qpair failed and we were unable to recover it. 00:30:08.420 [2024-07-13 10:16:14.099196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.099392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.099432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.420 qpair failed and we were unable to recover it. 00:30:08.420 [2024-07-13 10:16:14.099602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.099742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.099766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.420 qpair failed and we were unable to recover it. 00:30:08.420 [2024-07-13 10:16:14.099952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.100119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.100146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.420 qpair failed and we were unable to recover it. 00:30:08.420 [2024-07-13 10:16:14.100324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.100488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.100512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.420 qpair failed and we were unable to recover it. 00:30:08.420 [2024-07-13 10:16:14.100687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.100808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.100832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.420 qpair failed and we were unable to recover it. 00:30:08.420 [2024-07-13 10:16:14.100994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.101201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.101227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.420 qpair failed and we were unable to recover it. 00:30:08.420 [2024-07-13 10:16:14.101395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.101549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.101573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.420 qpair failed and we were unable to recover it. 00:30:08.420 [2024-07-13 10:16:14.101726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.101929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.101957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.420 qpair failed and we were unable to recover it. 00:30:08.420 [2024-07-13 10:16:14.102170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.102334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.102385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.420 qpair failed and we were unable to recover it. 00:30:08.420 [2024-07-13 10:16:14.102559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.102726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.102754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.420 qpair failed and we were unable to recover it. 00:30:08.420 [2024-07-13 10:16:14.102910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.103066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.103092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.420 qpair failed and we were unable to recover it. 00:30:08.420 [2024-07-13 10:16:14.103227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.103416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.103443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.420 qpair failed and we were unable to recover it. 00:30:08.420 [2024-07-13 10:16:14.103632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.103781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.103806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.420 qpair failed and we were unable to recover it. 00:30:08.420 [2024-07-13 10:16:14.103954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.104072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.104096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.420 qpair failed and we were unable to recover it. 00:30:08.420 [2024-07-13 10:16:14.104245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.104405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.104431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.420 qpair failed and we were unable to recover it. 00:30:08.420 [2024-07-13 10:16:14.104604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.104747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.104771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.420 qpair failed and we were unable to recover it. 00:30:08.420 [2024-07-13 10:16:14.104918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.105079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.105106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.420 qpair failed and we were unable to recover it. 00:30:08.420 [2024-07-13 10:16:14.105264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.105405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.105431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.420 qpair failed and we were unable to recover it. 00:30:08.420 [2024-07-13 10:16:14.105602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.105781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.105805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.420 qpair failed and we were unable to recover it. 00:30:08.420 [2024-07-13 10:16:14.105937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.106061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.106085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.420 qpair failed and we were unable to recover it. 00:30:08.420 [2024-07-13 10:16:14.106228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.106438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.106464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.420 qpair failed and we were unable to recover it. 00:30:08.420 [2024-07-13 10:16:14.106634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.106778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.106802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.420 qpair failed and we were unable to recover it. 00:30:08.420 [2024-07-13 10:16:14.106955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.107108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.107132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.420 qpair failed and we were unable to recover it. 00:30:08.420 [2024-07-13 10:16:14.107265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.107413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.107436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.420 qpair failed and we were unable to recover it. 00:30:08.420 [2024-07-13 10:16:14.107586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.107713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.107738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.420 qpair failed and we were unable to recover it. 00:30:08.420 [2024-07-13 10:16:14.107898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.108047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.108071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.420 qpair failed and we were unable to recover it. 00:30:08.420 [2024-07-13 10:16:14.108220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.108371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.108395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.420 qpair failed and we were unable to recover it. 00:30:08.420 [2024-07-13 10:16:14.108572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.108763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.108790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.420 qpair failed and we were unable to recover it. 00:30:08.420 [2024-07-13 10:16:14.108937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.109111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.109135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.420 qpair failed and we were unable to recover it. 00:30:08.420 [2024-07-13 10:16:14.109291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.109489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.420 [2024-07-13 10:16:14.109513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.420 qpair failed and we were unable to recover it. 00:30:08.420 [2024-07-13 10:16:14.109634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.109782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.109806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.421 qpair failed and we were unable to recover it. 00:30:08.421 [2024-07-13 10:16:14.109958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.110126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.110152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.421 qpair failed and we were unable to recover it. 00:30:08.421 [2024-07-13 10:16:14.110309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.110459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.110483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.421 qpair failed and we were unable to recover it. 00:30:08.421 [2024-07-13 10:16:14.110608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.110759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.110784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.421 qpair failed and we were unable to recover it. 00:30:08.421 [2024-07-13 10:16:14.110915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.111087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.111111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.421 qpair failed and we were unable to recover it. 00:30:08.421 [2024-07-13 10:16:14.111239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.111408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.111433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.421 qpair failed and we were unable to recover it. 00:30:08.421 [2024-07-13 10:16:14.111634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.111790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.111813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.421 qpair failed and we were unable to recover it. 00:30:08.421 [2024-07-13 10:16:14.111938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.112069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.112093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.421 qpair failed and we were unable to recover it. 00:30:08.421 [2024-07-13 10:16:14.112217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.112359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.112383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.421 qpair failed and we were unable to recover it. 00:30:08.421 [2024-07-13 10:16:14.112559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.112705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.112729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.421 qpair failed and we were unable to recover it. 00:30:08.421 [2024-07-13 10:16:14.112890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.113044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.113069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.421 qpair failed and we were unable to recover it. 00:30:08.421 [2024-07-13 10:16:14.113193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.113340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.113363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.421 qpair failed and we were unable to recover it. 00:30:08.421 [2024-07-13 10:16:14.113486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.113659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.113701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.421 qpair failed and we were unable to recover it. 00:30:08.421 [2024-07-13 10:16:14.113856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.114014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.114038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.421 qpair failed and we were unable to recover it. 00:30:08.421 [2024-07-13 10:16:14.114182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.114343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.114370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.421 qpair failed and we were unable to recover it. 00:30:08.421 [2024-07-13 10:16:14.114541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.114664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.114688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.421 qpair failed and we were unable to recover it. 00:30:08.421 [2024-07-13 10:16:14.114842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.115023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.115050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.421 qpair failed and we were unable to recover it. 00:30:08.421 [2024-07-13 10:16:14.115211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.115348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.115375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.421 qpair failed and we were unable to recover it. 00:30:08.421 [2024-07-13 10:16:14.115546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.115693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.115716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.421 qpair failed and we were unable to recover it. 00:30:08.421 [2024-07-13 10:16:14.115850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.115978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.116007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.421 qpair failed and we were unable to recover it. 00:30:08.421 [2024-07-13 10:16:14.116171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.116374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.116401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.421 qpair failed and we were unable to recover it. 00:30:08.421 [2024-07-13 10:16:14.116596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.116742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.116766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.421 qpair failed and we were unable to recover it. 00:30:08.421 [2024-07-13 10:16:14.116920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.117073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.117096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.421 qpair failed and we were unable to recover it. 00:30:08.421 [2024-07-13 10:16:14.117233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.117375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.117402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.421 qpair failed and we were unable to recover it. 00:30:08.421 [2024-07-13 10:16:14.117569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.117686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.117710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.421 qpair failed and we were unable to recover it. 00:30:08.421 [2024-07-13 10:16:14.117886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.118008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.118032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.421 qpair failed and we were unable to recover it. 00:30:08.421 [2024-07-13 10:16:14.118182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.118324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.118348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.421 qpair failed and we were unable to recover it. 00:30:08.421 [2024-07-13 10:16:14.118494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.118620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.118643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.421 qpair failed and we were unable to recover it. 00:30:08.421 [2024-07-13 10:16:14.118786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.118938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.118963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.421 qpair failed and we were unable to recover it. 00:30:08.421 [2024-07-13 10:16:14.119107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.119265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.119289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.421 qpair failed and we were unable to recover it. 00:30:08.421 [2024-07-13 10:16:14.119417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.119571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.119594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.421 qpair failed and we were unable to recover it. 00:30:08.421 [2024-07-13 10:16:14.119742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.119889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.119913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.421 qpair failed and we were unable to recover it. 00:30:08.421 [2024-07-13 10:16:14.120087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.120251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.120278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.421 qpair failed and we were unable to recover it. 00:30:08.421 [2024-07-13 10:16:14.120448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.421 [2024-07-13 10:16:14.120602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.120626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.422 qpair failed and we were unable to recover it. 00:30:08.422 [2024-07-13 10:16:14.120747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.120897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.120921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.422 qpair failed and we were unable to recover it. 00:30:08.422 [2024-07-13 10:16:14.121078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.121189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.121214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.422 qpair failed and we were unable to recover it. 00:30:08.422 [2024-07-13 10:16:14.121365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.121507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.121547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.422 qpair failed and we were unable to recover it. 00:30:08.422 [2024-07-13 10:16:14.121739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.121901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.121929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.422 qpair failed and we were unable to recover it. 00:30:08.422 [2024-07-13 10:16:14.122090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.122235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.122262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.422 qpair failed and we were unable to recover it. 00:30:08.422 [2024-07-13 10:16:14.122410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.122556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.122580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.422 qpair failed and we were unable to recover it. 00:30:08.422 [2024-07-13 10:16:14.122710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.122873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.122898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.422 qpair failed and we were unable to recover it. 00:30:08.422 [2024-07-13 10:16:14.123055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.123242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.123293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.422 qpair failed and we were unable to recover it. 00:30:08.422 [2024-07-13 10:16:14.123438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.123584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.123608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.422 qpair failed and we were unable to recover it. 00:30:08.422 [2024-07-13 10:16:14.123814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.123978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.124003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.422 qpair failed and we were unable to recover it. 00:30:08.422 [2024-07-13 10:16:14.124120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.124247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.124271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.422 qpair failed and we were unable to recover it. 00:30:08.422 [2024-07-13 10:16:14.124448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.124594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.124618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.422 qpair failed and we were unable to recover it. 00:30:08.422 [2024-07-13 10:16:14.124827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.124995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.125023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.422 qpair failed and we were unable to recover it. 00:30:08.422 [2024-07-13 10:16:14.125183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.125323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.125350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.422 qpair failed and we were unable to recover it. 00:30:08.422 [2024-07-13 10:16:14.125518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.125665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.125689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.422 qpair failed and we were unable to recover it. 00:30:08.422 [2024-07-13 10:16:14.125892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.126090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.126114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.422 qpair failed and we were unable to recover it. 00:30:08.422 [2024-07-13 10:16:14.126286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.126435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.126478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.422 qpair failed and we were unable to recover it. 00:30:08.422 [2024-07-13 10:16:14.126666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.126809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.126832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.422 qpair failed and we were unable to recover it. 00:30:08.422 [2024-07-13 10:16:14.126956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.127084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.127107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.422 qpair failed and we were unable to recover it. 00:30:08.422 [2024-07-13 10:16:14.127307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.127467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.127494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.422 qpair failed and we were unable to recover it. 00:30:08.422 [2024-07-13 10:16:14.127686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.127830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.127853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.422 qpair failed and we were unable to recover it. 00:30:08.422 [2024-07-13 10:16:14.128018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.128165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.128189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.422 qpair failed and we were unable to recover it. 00:30:08.422 [2024-07-13 10:16:14.128392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.128549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.128575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.422 qpair failed and we were unable to recover it. 00:30:08.422 [2024-07-13 10:16:14.128724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.128884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.128909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.422 qpair failed and we were unable to recover it. 00:30:08.422 [2024-07-13 10:16:14.129088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.129282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.129331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.422 qpair failed and we were unable to recover it. 00:30:08.422 [2024-07-13 10:16:14.129469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.129628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.129654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.422 qpair failed and we were unable to recover it. 00:30:08.422 [2024-07-13 10:16:14.129850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.130042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.130067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.422 qpair failed and we were unable to recover it. 00:30:08.422 [2024-07-13 10:16:14.130218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.130341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.130365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.422 qpair failed and we were unable to recover it. 00:30:08.422 [2024-07-13 10:16:14.130543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.130692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.130736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.422 qpair failed and we were unable to recover it. 00:30:08.422 [2024-07-13 10:16:14.130909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.131064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.131088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.422 qpair failed and we were unable to recover it. 00:30:08.422 [2024-07-13 10:16:14.131203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.131377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.131401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.422 qpair failed and we were unable to recover it. 00:30:08.422 [2024-07-13 10:16:14.131529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.131652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.131676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.422 qpair failed and we were unable to recover it. 00:30:08.422 [2024-07-13 10:16:14.131850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.422 [2024-07-13 10:16:14.132025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.132049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.423 qpair failed and we were unable to recover it. 00:30:08.423 [2024-07-13 10:16:14.132220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.132381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.132408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.423 qpair failed and we were unable to recover it. 00:30:08.423 [2024-07-13 10:16:14.132570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.132710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.132734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.423 qpair failed and we were unable to recover it. 00:30:08.423 [2024-07-13 10:16:14.132890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.133063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.133087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.423 qpair failed and we were unable to recover it. 00:30:08.423 [2024-07-13 10:16:14.133252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.133447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.133500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.423 qpair failed and we were unable to recover it. 00:30:08.423 [2024-07-13 10:16:14.133666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.133797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.133824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.423 qpair failed and we were unable to recover it. 00:30:08.423 [2024-07-13 10:16:14.133971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.134117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.134141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.423 qpair failed and we were unable to recover it. 00:30:08.423 [2024-07-13 10:16:14.134260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.134407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.134431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.423 qpair failed and we were unable to recover it. 00:30:08.423 [2024-07-13 10:16:14.134555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.134705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.134728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.423 qpair failed and we were unable to recover it. 00:30:08.423 [2024-07-13 10:16:14.134883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.135034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.135059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.423 qpair failed and we were unable to recover it. 00:30:08.423 [2024-07-13 10:16:14.135235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.135346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.135370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.423 qpair failed and we were unable to recover it. 00:30:08.423 [2024-07-13 10:16:14.135502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.135644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.135669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.423 qpair failed and we were unable to recover it. 00:30:08.423 [2024-07-13 10:16:14.135828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.135987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.136028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.423 qpair failed and we were unable to recover it. 00:30:08.423 [2024-07-13 10:16:14.136196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.136359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.136388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.423 qpair failed and we were unable to recover it. 00:30:08.423 [2024-07-13 10:16:14.136517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.136705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.136735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.423 qpair failed and we were unable to recover it. 00:30:08.423 [2024-07-13 10:16:14.136890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.137062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.137087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.423 qpair failed and we were unable to recover it. 00:30:08.423 [2024-07-13 10:16:14.137257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.137381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.137407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.423 qpair failed and we were unable to recover it. 00:30:08.423 [2024-07-13 10:16:14.137575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.137736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.137761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.423 qpair failed and we were unable to recover it. 00:30:08.423 [2024-07-13 10:16:14.137899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.138025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.138049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.423 qpair failed and we were unable to recover it. 00:30:08.423 [2024-07-13 10:16:14.138175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.138328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.138352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.423 qpair failed and we were unable to recover it. 00:30:08.423 [2024-07-13 10:16:14.138523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.138662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.138688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.423 qpair failed and we were unable to recover it. 00:30:08.423 [2024-07-13 10:16:14.138863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.139003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.139026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.423 qpair failed and we were unable to recover it. 00:30:08.423 [2024-07-13 10:16:14.139175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.139332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.139356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.423 qpair failed and we were unable to recover it. 00:30:08.423 [2024-07-13 10:16:14.139504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.139679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.139721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.423 qpair failed and we were unable to recover it. 00:30:08.423 [2024-07-13 10:16:14.139908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.140062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.140086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.423 qpair failed and we were unable to recover it. 00:30:08.423 [2024-07-13 10:16:14.140239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.140392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.140417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.423 qpair failed and we were unable to recover it. 00:30:08.423 [2024-07-13 10:16:14.140575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.140732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.140759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.423 qpair failed and we were unable to recover it. 00:30:08.423 [2024-07-13 10:16:14.140964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.141116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.141139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.423 qpair failed and we were unable to recover it. 00:30:08.423 [2024-07-13 10:16:14.141286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.141412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.423 [2024-07-13 10:16:14.141435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.423 qpair failed and we were unable to recover it. 00:30:08.424 [2024-07-13 10:16:14.141551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.141675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.141699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.424 qpair failed and we were unable to recover it. 00:30:08.424 [2024-07-13 10:16:14.141850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.141985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.142009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.424 qpair failed and we were unable to recover it. 00:30:08.424 [2024-07-13 10:16:14.142137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.142287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.142313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.424 qpair failed and we were unable to recover it. 00:30:08.424 [2024-07-13 10:16:14.142479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.142646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.142671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.424 qpair failed and we were unable to recover it. 00:30:08.424 [2024-07-13 10:16:14.142833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.142970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.142993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.424 qpair failed and we were unable to recover it. 00:30:08.424 [2024-07-13 10:16:14.143185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.143348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.143374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.424 qpair failed and we were unable to recover it. 00:30:08.424 [2024-07-13 10:16:14.143578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.143707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.143733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.424 qpair failed and we were unable to recover it. 00:30:08.424 [2024-07-13 10:16:14.143937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.144089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.144113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.424 qpair failed and we were unable to recover it. 00:30:08.424 [2024-07-13 10:16:14.144296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.144462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.144486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.424 qpair failed and we were unable to recover it. 00:30:08.424 [2024-07-13 10:16:14.144613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.144731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.144754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.424 qpair failed and we were unable to recover it. 00:30:08.424 [2024-07-13 10:16:14.144889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.145041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.145065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.424 qpair failed and we were unable to recover it. 00:30:08.424 [2024-07-13 10:16:14.145237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.145373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.145399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.424 qpair failed and we were unable to recover it. 00:30:08.424 [2024-07-13 10:16:14.145561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.145751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.145778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.424 qpair failed and we were unable to recover it. 00:30:08.424 [2024-07-13 10:16:14.145950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.146099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.146139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.424 qpair failed and we were unable to recover it. 00:30:08.424 [2024-07-13 10:16:14.146300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.146459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.146486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.424 qpair failed and we were unable to recover it. 00:30:08.424 [2024-07-13 10:16:14.146636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.146788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.146812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.424 qpair failed and we were unable to recover it. 00:30:08.424 [2024-07-13 10:16:14.146965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.147092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.147118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.424 qpair failed and we were unable to recover it. 00:30:08.424 [2024-07-13 10:16:14.147272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.147429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.147453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.424 qpair failed and we were unable to recover it. 00:30:08.424 [2024-07-13 10:16:14.147576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.147721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.147745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.424 qpair failed and we were unable to recover it. 00:30:08.424 [2024-07-13 10:16:14.147894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.148068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.148095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.424 qpair failed and we were unable to recover it. 00:30:08.424 [2024-07-13 10:16:14.148249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.148515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.148565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.424 qpair failed and we were unable to recover it. 00:30:08.424 [2024-07-13 10:16:14.148769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.148919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.148944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.424 qpair failed and we were unable to recover it. 00:30:08.424 [2024-07-13 10:16:14.149091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.149245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.149269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.424 qpair failed and we were unable to recover it. 00:30:08.424 [2024-07-13 10:16:14.149459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.149603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.149630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.424 qpair failed and we were unable to recover it. 00:30:08.424 [2024-07-13 10:16:14.149797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.149955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.149982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.424 qpair failed and we were unable to recover it. 00:30:08.424 [2024-07-13 10:16:14.150130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.150251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.150275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.424 qpair failed and we were unable to recover it. 00:30:08.424 [2024-07-13 10:16:14.150419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.150568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.150592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.424 qpair failed and we were unable to recover it. 00:30:08.424 [2024-07-13 10:16:14.150714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.150886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.150914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.424 qpair failed and we were unable to recover it. 00:30:08.424 [2024-07-13 10:16:14.151090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.151221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.151246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.424 qpair failed and we were unable to recover it. 00:30:08.424 [2024-07-13 10:16:14.151420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.151592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.151616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.424 qpair failed and we were unable to recover it. 00:30:08.424 [2024-07-13 10:16:14.151785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.151958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.151983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.424 qpair failed and we were unable to recover it. 00:30:08.424 [2024-07-13 10:16:14.152154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.152336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.152361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.424 qpair failed and we were unable to recover it. 00:30:08.424 [2024-07-13 10:16:14.152523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.152649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.424 [2024-07-13 10:16:14.152674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.424 qpair failed and we were unable to recover it. 00:30:08.425 [2024-07-13 10:16:14.152843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.153008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.153036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.425 qpair failed and we were unable to recover it. 00:30:08.425 [2024-07-13 10:16:14.153232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.153346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.153387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.425 qpair failed and we were unable to recover it. 00:30:08.425 [2024-07-13 10:16:14.153521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.153714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.153741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.425 qpair failed and we were unable to recover it. 00:30:08.425 [2024-07-13 10:16:14.153914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.154076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.154105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.425 qpair failed and we were unable to recover it. 00:30:08.425 [2024-07-13 10:16:14.154283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.154426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.154451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.425 qpair failed and we were unable to recover it. 00:30:08.425 [2024-07-13 10:16:14.154639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.154814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.154855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.425 qpair failed and we were unable to recover it. 00:30:08.425 [2024-07-13 10:16:14.155030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.155198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.155225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.425 qpair failed and we were unable to recover it. 00:30:08.425 [2024-07-13 10:16:14.155373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.155521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.155547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.425 qpair failed and we were unable to recover it. 00:30:08.425 [2024-07-13 10:16:14.155701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.155863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.155896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.425 qpair failed and we were unable to recover it. 00:30:08.425 [2024-07-13 10:16:14.156083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.156235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.156259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.425 qpair failed and we were unable to recover it. 00:30:08.425 [2024-07-13 10:16:14.156383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.156529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.156553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.425 qpair failed and we were unable to recover it. 00:30:08.425 [2024-07-13 10:16:14.156706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.156852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.156894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.425 qpair failed and we were unable to recover it. 00:30:08.425 [2024-07-13 10:16:14.157098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.157292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.157340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.425 qpair failed and we were unable to recover it. 00:30:08.425 [2024-07-13 10:16:14.157537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.157703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.157730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.425 qpair failed and we were unable to recover it. 00:30:08.425 [2024-07-13 10:16:14.157932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.158096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.158122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.425 qpair failed and we were unable to recover it. 00:30:08.425 [2024-07-13 10:16:14.158296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.158438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.158464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.425 qpair failed and we were unable to recover it. 00:30:08.425 [2024-07-13 10:16:14.158643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.158801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.158825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.425 qpair failed and we were unable to recover it. 00:30:08.425 [2024-07-13 10:16:14.158983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.159159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.159182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.425 qpair failed and we were unable to recover it. 00:30:08.425 [2024-07-13 10:16:14.159354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.159531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.159569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.425 qpair failed and we were unable to recover it. 00:30:08.425 [2024-07-13 10:16:14.159748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.159877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.159901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.425 qpair failed and we were unable to recover it. 00:30:08.425 [2024-07-13 10:16:14.160053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.160177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.160200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.425 qpair failed and we were unable to recover it. 00:30:08.425 [2024-07-13 10:16:14.160346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.160496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.160519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.425 qpair failed and we were unable to recover it. 00:30:08.425 [2024-07-13 10:16:14.160695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.160822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.160848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.425 qpair failed and we were unable to recover it. 00:30:08.425 [2024-07-13 10:16:14.161066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.161236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.161262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.425 qpair failed and we were unable to recover it. 00:30:08.425 [2024-07-13 10:16:14.161460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.161596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.161623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.425 qpair failed and we were unable to recover it. 00:30:08.425 [2024-07-13 10:16:14.161787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.161984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.162011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.425 qpair failed and we were unable to recover it. 00:30:08.425 [2024-07-13 10:16:14.162154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.162287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.162313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.425 qpair failed and we were unable to recover it. 00:30:08.425 [2024-07-13 10:16:14.162475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.162633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.162659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.425 qpair failed and we were unable to recover it. 00:30:08.425 [2024-07-13 10:16:14.162856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.163039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.163062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.425 qpair failed and we were unable to recover it. 00:30:08.425 [2024-07-13 10:16:14.163245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.163422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.163446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.425 qpair failed and we were unable to recover it. 00:30:08.425 [2024-07-13 10:16:14.163615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.163776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.163802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.425 qpair failed and we were unable to recover it. 00:30:08.425 [2024-07-13 10:16:14.163976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.164119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.164161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.425 qpair failed and we were unable to recover it. 00:30:08.425 [2024-07-13 10:16:14.164327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.164488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.425 [2024-07-13 10:16:14.164514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.425 qpair failed and we were unable to recover it. 00:30:08.425 [2024-07-13 10:16:14.164663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.164782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.164805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.426 qpair failed and we were unable to recover it. 00:30:08.426 [2024-07-13 10:16:14.164933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.165059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.165082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.426 qpair failed and we were unable to recover it. 00:30:08.426 [2024-07-13 10:16:14.165264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.165535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.165587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.426 qpair failed and we were unable to recover it. 00:30:08.426 [2024-07-13 10:16:14.165736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.165936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.165961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.426 qpair failed and we were unable to recover it. 00:30:08.426 [2024-07-13 10:16:14.166112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.166256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.166280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.426 qpair failed and we were unable to recover it. 00:30:08.426 [2024-07-13 10:16:14.166399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.166527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.166553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.426 qpair failed and we were unable to recover it. 00:30:08.426 [2024-07-13 10:16:14.166678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.166799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.166823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.426 qpair failed and we were unable to recover it. 00:30:08.426 [2024-07-13 10:16:14.167004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.167183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.167209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.426 qpair failed and we were unable to recover it. 00:30:08.426 [2024-07-13 10:16:14.167349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.167550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.167575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.426 qpair failed and we were unable to recover it. 00:30:08.426 [2024-07-13 10:16:14.167729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.167850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.167880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.426 qpair failed and we were unable to recover it. 00:30:08.426 [2024-07-13 10:16:14.168012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.168161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.168185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.426 qpair failed and we were unable to recover it. 00:30:08.426 [2024-07-13 10:16:14.168364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.168602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.168652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.426 qpair failed and we were unable to recover it. 00:30:08.426 [2024-07-13 10:16:14.168816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.168991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.169015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.426 qpair failed and we were unable to recover it. 00:30:08.426 [2024-07-13 10:16:14.169180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.169299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.169322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.426 qpair failed and we were unable to recover it. 00:30:08.426 [2024-07-13 10:16:14.169516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.169679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.169706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.426 qpair failed and we were unable to recover it. 00:30:08.426 [2024-07-13 10:16:14.169848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.170031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.170055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.426 qpair failed and we were unable to recover it. 00:30:08.426 [2024-07-13 10:16:14.170251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.170415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.170456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.426 qpair failed and we were unable to recover it. 00:30:08.426 [2024-07-13 10:16:14.170617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.170809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.170836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.426 qpair failed and we were unable to recover it. 00:30:08.426 [2024-07-13 10:16:14.171012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.171198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.171222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.426 qpair failed and we were unable to recover it. 00:30:08.426 [2024-07-13 10:16:14.171346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.171521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.171545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.426 qpair failed and we were unable to recover it. 00:30:08.426 [2024-07-13 10:16:14.171692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.171886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.171914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.426 qpair failed and we were unable to recover it. 00:30:08.426 [2024-07-13 10:16:14.172056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.172192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.172223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.426 qpair failed and we were unable to recover it. 00:30:08.426 [2024-07-13 10:16:14.172412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.172559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.172582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.426 qpair failed and we were unable to recover it. 00:30:08.426 [2024-07-13 10:16:14.172708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.172855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.172896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.426 qpair failed and we were unable to recover it. 00:30:08.426 [2024-07-13 10:16:14.173042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.173169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.173196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.426 qpair failed and we were unable to recover it. 00:30:08.426 [2024-07-13 10:16:14.173400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.173524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.173548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.426 qpair failed and we were unable to recover it. 00:30:08.426 [2024-07-13 10:16:14.173696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.173877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.173901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.426 qpair failed and we were unable to recover it. 00:30:08.426 [2024-07-13 10:16:14.174057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.174181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.174220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.426 qpair failed and we were unable to recover it. 00:30:08.426 [2024-07-13 10:16:14.174362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.174488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.174514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.426 qpair failed and we were unable to recover it. 00:30:08.426 [2024-07-13 10:16:14.174663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.174780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.174804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.426 qpair failed and we were unable to recover it. 00:30:08.426 [2024-07-13 10:16:14.174931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.175061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.175084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.426 qpair failed and we were unable to recover it. 00:30:08.426 [2024-07-13 10:16:14.175201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.175343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.175366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.426 qpair failed and we were unable to recover it. 00:30:08.426 [2024-07-13 10:16:14.175520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.175661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.426 [2024-07-13 10:16:14.175687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.426 qpair failed and we were unable to recover it. 00:30:08.426 [2024-07-13 10:16:14.175880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.176014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.176042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.427 qpair failed and we were unable to recover it. 00:30:08.427 [2024-07-13 10:16:14.176186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.176310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.176333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.427 qpair failed and we were unable to recover it. 00:30:08.427 [2024-07-13 10:16:14.176458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.176601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.176625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.427 qpair failed and we were unable to recover it. 00:30:08.427 [2024-07-13 10:16:14.176859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.177053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.177080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.427 qpair failed and we were unable to recover it. 00:30:08.427 [2024-07-13 10:16:14.177241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.177418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.177442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.427 qpair failed and we were unable to recover it. 00:30:08.427 [2024-07-13 10:16:14.177588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.177740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.177764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.427 qpair failed and we were unable to recover it. 00:30:08.427 [2024-07-13 10:16:14.177915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.178062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.178086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.427 qpair failed and we were unable to recover it. 00:30:08.427 [2024-07-13 10:16:14.178220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.178369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.178395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.427 qpair failed and we were unable to recover it. 00:30:08.427 [2024-07-13 10:16:14.178546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.178700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.178724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.427 qpair failed and we were unable to recover it. 00:30:08.427 [2024-07-13 10:16:14.178881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.179054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.179078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.427 qpair failed and we were unable to recover it. 00:30:08.427 [2024-07-13 10:16:14.179237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.179385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.179409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.427 qpair failed and we were unable to recover it. 00:30:08.427 [2024-07-13 10:16:14.179582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.179698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.179722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.427 qpair failed and we were unable to recover it. 00:30:08.427 [2024-07-13 10:16:14.179889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.180019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.180043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.427 qpair failed and we were unable to recover it. 00:30:08.427 [2024-07-13 10:16:14.180198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.180364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.180391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.427 qpair failed and we were unable to recover it. 00:30:08.427 [2024-07-13 10:16:14.180582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.180709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.180735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.427 qpair failed and we were unable to recover it. 00:30:08.427 [2024-07-13 10:16:14.180907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.181035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.181062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.427 qpair failed and we were unable to recover it. 00:30:08.427 [2024-07-13 10:16:14.181256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.181382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.181406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.427 qpair failed and we were unable to recover it. 00:30:08.427 [2024-07-13 10:16:14.181519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.181669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.181693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.427 qpair failed and we were unable to recover it. 00:30:08.427 [2024-07-13 10:16:14.181873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.182022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.182046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.427 qpair failed and we were unable to recover it. 00:30:08.427 [2024-07-13 10:16:14.182203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.182360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.182383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.427 qpair failed and we were unable to recover it. 00:30:08.427 [2024-07-13 10:16:14.182558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.182721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.182747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.427 qpair failed and we were unable to recover it. 00:30:08.427 [2024-07-13 10:16:14.182923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.183055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.183081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.427 qpair failed and we were unable to recover it. 00:30:08.427 [2024-07-13 10:16:14.183229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.183355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.183382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.427 qpair failed and we were unable to recover it. 00:30:08.427 [2024-07-13 10:16:14.183519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.183647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.183672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.427 qpair failed and we were unable to recover it. 00:30:08.427 [2024-07-13 10:16:14.183848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.184042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.184068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.427 qpair failed and we were unable to recover it. 00:30:08.427 [2024-07-13 10:16:14.184218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.184365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.184388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.427 qpair failed and we were unable to recover it. 00:30:08.427 [2024-07-13 10:16:14.184511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.184655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.184688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.427 qpair failed and we were unable to recover it. 00:30:08.427 [2024-07-13 10:16:14.184817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.184988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.185013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.427 qpair failed and we were unable to recover it. 00:30:08.427 [2024-07-13 10:16:14.185162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.427 [2024-07-13 10:16:14.185338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.428 [2024-07-13 10:16:14.185362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.428 qpair failed and we were unable to recover it. 00:30:08.428 [2024-07-13 10:16:14.185524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.428 [2024-07-13 10:16:14.185701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.428 [2024-07-13 10:16:14.185726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.428 qpair failed and we were unable to recover it. 00:30:08.428 [2024-07-13 10:16:14.185886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.428 [2024-07-13 10:16:14.186029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.428 [2024-07-13 10:16:14.186055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.428 qpair failed and we were unable to recover it. 00:30:08.428 [2024-07-13 10:16:14.186202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.428 [2024-07-13 10:16:14.186367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.428 [2024-07-13 10:16:14.186407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.428 qpair failed and we were unable to recover it. 00:30:08.428 [2024-07-13 10:16:14.186573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.428 [2024-07-13 10:16:14.186725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.428 [2024-07-13 10:16:14.186748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.428 qpair failed and we were unable to recover it. 00:30:08.428 [2024-07-13 10:16:14.186944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.428 [2024-07-13 10:16:14.187096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.428 [2024-07-13 10:16:14.187122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.428 qpair failed and we were unable to recover it. 00:30:08.428 [2024-07-13 10:16:14.187284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.428 [2024-07-13 10:16:14.187435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.428 [2024-07-13 10:16:14.187459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.428 qpair failed and we were unable to recover it. 00:30:08.428 [2024-07-13 10:16:14.187606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.428 [2024-07-13 10:16:14.187756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.428 [2024-07-13 10:16:14.187780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.428 qpair failed and we were unable to recover it. 00:30:08.428 [2024-07-13 10:16:14.187904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.428 [2024-07-13 10:16:14.188027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.428 [2024-07-13 10:16:14.188059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.428 qpair failed and we were unable to recover it. 00:30:08.428 [2024-07-13 10:16:14.188258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.428 [2024-07-13 10:16:14.188414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.428 [2024-07-13 10:16:14.188465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.428 qpair failed and we were unable to recover it. 00:30:08.428 [2024-07-13 10:16:14.188630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.428 [2024-07-13 10:16:14.188788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.428 [2024-07-13 10:16:14.188814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.428 qpair failed and we were unable to recover it. 00:30:08.428 [2024-07-13 10:16:14.188984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.710 [2024-07-13 10:16:14.189127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.710 [2024-07-13 10:16:14.189157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.710 qpair failed and we were unable to recover it. 00:30:08.710 [2024-07-13 10:16:14.189334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.710 [2024-07-13 10:16:14.189484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.710 [2024-07-13 10:16:14.189508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.711 qpair failed and we were unable to recover it. 00:30:08.711 [2024-07-13 10:16:14.189656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.189811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.189835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.711 qpair failed and we were unable to recover it. 00:30:08.711 [2024-07-13 10:16:14.189976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.190115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.190142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.711 qpair failed and we were unable to recover it. 00:30:08.711 [2024-07-13 10:16:14.190332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.190526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.190574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.711 qpair failed and we were unable to recover it. 00:30:08.711 [2024-07-13 10:16:14.190768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.190951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.190976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.711 qpair failed and we were unable to recover it. 00:30:08.711 [2024-07-13 10:16:14.191130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.191281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.191312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.711 qpair failed and we were unable to recover it. 00:30:08.711 [2024-07-13 10:16:14.191477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.191606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.191633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.711 qpair failed and we were unable to recover it. 00:30:08.711 [2024-07-13 10:16:14.191829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.192076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.192113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.711 qpair failed and we were unable to recover it. 00:30:08.711 [2024-07-13 10:16:14.192316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.192522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.192570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.711 qpair failed and we were unable to recover it. 00:30:08.711 [2024-07-13 10:16:14.192750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.192906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.192932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.711 qpair failed and we were unable to recover it. 00:30:08.711 [2024-07-13 10:16:14.193058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.193232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.193259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.711 qpair failed and we were unable to recover it. 00:30:08.711 [2024-07-13 10:16:14.193416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.193628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.193686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.711 qpair failed and we were unable to recover it. 00:30:08.711 [2024-07-13 10:16:14.193892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.194046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.194088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.711 qpair failed and we were unable to recover it. 00:30:08.711 [2024-07-13 10:16:14.194288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.194400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.194424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.711 qpair failed and we were unable to recover it. 00:30:08.711 [2024-07-13 10:16:14.194583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.194785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.194812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.711 qpair failed and we were unable to recover it. 00:30:08.711 [2024-07-13 10:16:14.194982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.195099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.195123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.711 qpair failed and we were unable to recover it. 00:30:08.711 [2024-07-13 10:16:14.195377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.195541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.195567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.711 qpair failed and we were unable to recover it. 00:30:08.711 [2024-07-13 10:16:14.195805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.195997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.196026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.711 qpair failed and we were unable to recover it. 00:30:08.711 [2024-07-13 10:16:14.196187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.196310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.196334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.711 qpair failed and we were unable to recover it. 00:30:08.711 [2024-07-13 10:16:14.196466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.196615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.196640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.711 qpair failed and we were unable to recover it. 00:30:08.711 [2024-07-13 10:16:14.196825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.196985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.197010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.711 qpair failed and we were unable to recover it. 00:30:08.711 [2024-07-13 10:16:14.197159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.197337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.197361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.711 qpair failed and we were unable to recover it. 00:30:08.711 [2024-07-13 10:16:14.197514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.197683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.197710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.711 qpair failed and we were unable to recover it. 00:30:08.711 [2024-07-13 10:16:14.197852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.198002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.198029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.711 qpair failed and we were unable to recover it. 00:30:08.711 [2024-07-13 10:16:14.198205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.198346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.198370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.711 qpair failed and we were unable to recover it. 00:30:08.711 [2024-07-13 10:16:14.198522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.198673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.198697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.711 qpair failed and we were unable to recover it. 00:30:08.711 [2024-07-13 10:16:14.198809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.198930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.198955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.711 qpair failed and we were unable to recover it. 00:30:08.711 [2024-07-13 10:16:14.199075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.199217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.711 [2024-07-13 10:16:14.199241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.712 qpair failed and we were unable to recover it. 00:30:08.712 [2024-07-13 10:16:14.199418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.199540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.199564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.712 qpair failed and we were unable to recover it. 00:30:08.712 [2024-07-13 10:16:14.199713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.199860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.199891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.712 qpair failed and we were unable to recover it. 00:30:08.712 [2024-07-13 10:16:14.200016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.200191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.200215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.712 qpair failed and we were unable to recover it. 00:30:08.712 [2024-07-13 10:16:14.200398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.200585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.200612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.712 qpair failed and we were unable to recover it. 00:30:08.712 [2024-07-13 10:16:14.200753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.200961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.200986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.712 qpair failed and we were unable to recover it. 00:30:08.712 [2024-07-13 10:16:14.201139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.201366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.201390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.712 qpair failed and we were unable to recover it. 00:30:08.712 [2024-07-13 10:16:14.201586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.201785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.201808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.712 qpair failed and we were unable to recover it. 00:30:08.712 [2024-07-13 10:16:14.201965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.202136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.202161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.712 qpair failed and we were unable to recover it. 00:30:08.712 [2024-07-13 10:16:14.202309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.202436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.202460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.712 qpair failed and we were unable to recover it. 00:30:08.712 [2024-07-13 10:16:14.202635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.202802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.202828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.712 qpair failed and we were unable to recover it. 00:30:08.712 [2024-07-13 10:16:14.203034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.203148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.203173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.712 qpair failed and we were unable to recover it. 00:30:08.712 [2024-07-13 10:16:14.203348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.203498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.203521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.712 qpair failed and we were unable to recover it. 00:30:08.712 [2024-07-13 10:16:14.203668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.203822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.203845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.712 qpair failed and we were unable to recover it. 00:30:08.712 [2024-07-13 10:16:14.204022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.204153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.204180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.712 qpair failed and we were unable to recover it. 00:30:08.712 [2024-07-13 10:16:14.204347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.204499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.204524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.712 qpair failed and we were unable to recover it. 00:30:08.712 [2024-07-13 10:16:14.204673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.204852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.204905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.712 qpair failed and we were unable to recover it. 00:30:08.712 [2024-07-13 10:16:14.205109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.205272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.205297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.712 qpair failed and we were unable to recover it. 00:30:08.712 [2024-07-13 10:16:14.205448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.205576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.205615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.712 qpair failed and we were unable to recover it. 00:30:08.712 [2024-07-13 10:16:14.205782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.205941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.205969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.712 qpair failed and we were unable to recover it. 00:30:08.712 [2024-07-13 10:16:14.206138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.206300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.206327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.712 qpair failed and we were unable to recover it. 00:30:08.712 [2024-07-13 10:16:14.206499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.206661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.206687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.712 qpair failed and we were unable to recover it. 00:30:08.712 [2024-07-13 10:16:14.206851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.206996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.207023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.712 qpair failed and we were unable to recover it. 00:30:08.712 [2024-07-13 10:16:14.207163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.207297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.207328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.712 qpair failed and we were unable to recover it. 00:30:08.712 [2024-07-13 10:16:14.207496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.207688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.207714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.712 qpair failed and we were unable to recover it. 00:30:08.712 [2024-07-13 10:16:14.207880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.208019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.208046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.712 qpair failed and we were unable to recover it. 00:30:08.712 [2024-07-13 10:16:14.208210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.208381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.208405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.712 qpair failed and we were unable to recover it. 00:30:08.712 [2024-07-13 10:16:14.208581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.208723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.208746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.712 qpair failed and we were unable to recover it. 00:30:08.712 [2024-07-13 10:16:14.208904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.209077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.712 [2024-07-13 10:16:14.209101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.712 qpair failed and we were unable to recover it. 00:30:08.713 [2024-07-13 10:16:14.209275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.209451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.209475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.713 qpair failed and we were unable to recover it. 00:30:08.713 [2024-07-13 10:16:14.209707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.209886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.209911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.713 qpair failed and we were unable to recover it. 00:30:08.713 [2024-07-13 10:16:14.210069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.210186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.210210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.713 qpair failed and we were unable to recover it. 00:30:08.713 [2024-07-13 10:16:14.210332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.210646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.210694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.713 qpair failed and we were unable to recover it. 00:30:08.713 [2024-07-13 10:16:14.210859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.211016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.211060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.713 qpair failed and we were unable to recover it. 00:30:08.713 [2024-07-13 10:16:14.211230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.211410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.211434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.713 qpair failed and we were unable to recover it. 00:30:08.713 [2024-07-13 10:16:14.211585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.211815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.211839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.713 qpair failed and we were unable to recover it. 00:30:08.713 [2024-07-13 10:16:14.211967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.212116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.212142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.713 qpair failed and we were unable to recover it. 00:30:08.713 [2024-07-13 10:16:14.212327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.212514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.212541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.713 qpair failed and we were unable to recover it. 00:30:08.713 [2024-07-13 10:16:14.212681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.212820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.212848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.713 qpair failed and we were unable to recover it. 00:30:08.713 [2024-07-13 10:16:14.213051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.213199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.213240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.713 qpair failed and we were unable to recover it. 00:30:08.713 [2024-07-13 10:16:14.213407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.213574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.213599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.713 qpair failed and we were unable to recover it. 00:30:08.713 [2024-07-13 10:16:14.213793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.213985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.214014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.713 qpair failed and we were unable to recover it. 00:30:08.713 [2024-07-13 10:16:14.214169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.214356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.214379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.713 qpair failed and we were unable to recover it. 00:30:08.713 [2024-07-13 10:16:14.214575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.214736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.214765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.713 qpair failed and we were unable to recover it. 00:30:08.713 [2024-07-13 10:16:14.214934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.215076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.215102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.713 qpair failed and we were unable to recover it. 00:30:08.713 [2024-07-13 10:16:14.215281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.215432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.215455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.713 qpair failed and we were unable to recover it. 00:30:08.713 [2024-07-13 10:16:14.215622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.215758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.215785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.713 qpair failed and we were unable to recover it. 00:30:08.713 [2024-07-13 10:16:14.215918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.216084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.216111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.713 qpair failed and we were unable to recover it. 00:30:08.713 [2024-07-13 10:16:14.216249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.216434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.216474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.713 qpair failed and we were unable to recover it. 00:30:08.713 [2024-07-13 10:16:14.216654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.216798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.216822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.713 qpair failed and we were unable to recover it. 00:30:08.713 [2024-07-13 10:16:14.217019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.217256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.217307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.713 qpair failed and we were unable to recover it. 00:30:08.713 [2024-07-13 10:16:14.217481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.217604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.217630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.713 qpair failed and we were unable to recover it. 00:30:08.713 [2024-07-13 10:16:14.217746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.217891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.217916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.713 qpair failed and we were unable to recover it. 00:30:08.713 [2024-07-13 10:16:14.218086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.218219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.218245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.713 qpair failed and we were unable to recover it. 00:30:08.713 [2024-07-13 10:16:14.218416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.218562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.218585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.713 qpair failed and we were unable to recover it. 00:30:08.713 [2024-07-13 10:16:14.218756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.218887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.218930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.713 qpair failed and we were unable to recover it. 00:30:08.713 [2024-07-13 10:16:14.219083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.713 [2024-07-13 10:16:14.219209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.219233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.714 qpair failed and we were unable to recover it. 00:30:08.714 [2024-07-13 10:16:14.219452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.219622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.219649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.714 qpair failed and we were unable to recover it. 00:30:08.714 [2024-07-13 10:16:14.219789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.219940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.219967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.714 qpair failed and we were unable to recover it. 00:30:08.714 [2024-07-13 10:16:14.220134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.220302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.220326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.714 qpair failed and we were unable to recover it. 00:30:08.714 [2024-07-13 10:16:14.220479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.220603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.220642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.714 qpair failed and we were unable to recover it. 00:30:08.714 [2024-07-13 10:16:14.220802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.220936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.220966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.714 qpair failed and we were unable to recover it. 00:30:08.714 [2024-07-13 10:16:14.221164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.221331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.221386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.714 qpair failed and we were unable to recover it. 00:30:08.714 [2024-07-13 10:16:14.221581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.221729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.221768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.714 qpair failed and we were unable to recover it. 00:30:08.714 [2024-07-13 10:16:14.221943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.222060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.222084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.714 qpair failed and we were unable to recover it. 00:30:08.714 [2024-07-13 10:16:14.222283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.222524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.222572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.714 qpair failed and we were unable to recover it. 00:30:08.714 [2024-07-13 10:16:14.222723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.222875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.222900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.714 qpair failed and we were unable to recover it. 00:30:08.714 [2024-07-13 10:16:14.223035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.223173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.223200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.714 qpair failed and we were unable to recover it. 00:30:08.714 [2024-07-13 10:16:14.223336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.223528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.223555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.714 qpair failed and we were unable to recover it. 00:30:08.714 [2024-07-13 10:16:14.223725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.223878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.223918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.714 qpair failed and we were unable to recover it. 00:30:08.714 [2024-07-13 10:16:14.224086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.224227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.224253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.714 qpair failed and we were unable to recover it. 00:30:08.714 [2024-07-13 10:16:14.224398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.224532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.224559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.714 qpair failed and we were unable to recover it. 00:30:08.714 [2024-07-13 10:16:14.224700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.224875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.224916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.714 qpair failed and we were unable to recover it. 00:30:08.714 [2024-07-13 10:16:14.225091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.225244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.225269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.714 qpair failed and we were unable to recover it. 00:30:08.714 [2024-07-13 10:16:14.225441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.225608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.225661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.714 qpair failed and we were unable to recover it. 00:30:08.714 [2024-07-13 10:16:14.225828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.225985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.226027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.714 qpair failed and we were unable to recover it. 00:30:08.714 [2024-07-13 10:16:14.226191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.226390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.226414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.714 qpair failed and we were unable to recover it. 00:30:08.714 [2024-07-13 10:16:14.226611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.226773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.226800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.714 qpair failed and we were unable to recover it. 00:30:08.714 [2024-07-13 10:16:14.226978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.227166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.227193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.714 qpair failed and we were unable to recover it. 00:30:08.714 [2024-07-13 10:16:14.227361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.227546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.227588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.714 qpair failed and we were unable to recover it. 00:30:08.714 [2024-07-13 10:16:14.227766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.227903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.227931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.714 qpair failed and we were unable to recover it. 00:30:08.714 [2024-07-13 10:16:14.228124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.228251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.228291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.714 qpair failed and we were unable to recover it. 00:30:08.714 [2024-07-13 10:16:14.228485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.228675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.228701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.714 qpair failed and we were unable to recover it. 00:30:08.714 [2024-07-13 10:16:14.228878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.229014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.229043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.714 qpair failed and we were unable to recover it. 00:30:08.714 [2024-07-13 10:16:14.229236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.229389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.229416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.714 qpair failed and we were unable to recover it. 00:30:08.714 [2024-07-13 10:16:14.229570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.229730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.714 [2024-07-13 10:16:14.229757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.715 qpair failed and we were unable to recover it. 00:30:08.715 [2024-07-13 10:16:14.229933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.230080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.230104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.715 qpair failed and we were unable to recover it. 00:30:08.715 [2024-07-13 10:16:14.230298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.230452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.230475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.715 qpair failed and we were unable to recover it. 00:30:08.715 [2024-07-13 10:16:14.230650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.230841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.230879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.715 qpair failed and we were unable to recover it. 00:30:08.715 [2024-07-13 10:16:14.231054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.231247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.231307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.715 qpair failed and we were unable to recover it. 00:30:08.715 [2024-07-13 10:16:14.231509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.231628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.231668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.715 qpair failed and we were unable to recover it. 00:30:08.715 [2024-07-13 10:16:14.231831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.232000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.232027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.715 qpair failed and we were unable to recover it. 00:30:08.715 [2024-07-13 10:16:14.232220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.232387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.232435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.715 qpair failed and we were unable to recover it. 00:30:08.715 [2024-07-13 10:16:14.232600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.232752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.232792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.715 qpair failed and we were unable to recover it. 00:30:08.715 [2024-07-13 10:16:14.232967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.233093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.233117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.715 qpair failed and we were unable to recover it. 00:30:08.715 [2024-07-13 10:16:14.233288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.233453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.233482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.715 qpair failed and we were unable to recover it. 00:30:08.715 [2024-07-13 10:16:14.233653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.233779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.233803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.715 qpair failed and we were unable to recover it. 00:30:08.715 [2024-07-13 10:16:14.234007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.234157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.234182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.715 qpair failed and we were unable to recover it. 00:30:08.715 [2024-07-13 10:16:14.234317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.234515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.234542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.715 qpair failed and we were unable to recover it. 00:30:08.715 [2024-07-13 10:16:14.234744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.234896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.234920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.715 qpair failed and we were unable to recover it. 00:30:08.715 [2024-07-13 10:16:14.235132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.235360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.235417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.715 qpair failed and we were unable to recover it. 00:30:08.715 [2024-07-13 10:16:14.235577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.235704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.235730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.715 qpair failed and we were unable to recover it. 00:30:08.715 [2024-07-13 10:16:14.235889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.236012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.236036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.715 qpair failed and we were unable to recover it. 00:30:08.715 [2024-07-13 10:16:14.236210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.236417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.236462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.715 qpair failed and we were unable to recover it. 00:30:08.715 [2024-07-13 10:16:14.236647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.236774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.236800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.715 qpair failed and we were unable to recover it. 00:30:08.715 [2024-07-13 10:16:14.237039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.237224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.237271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.715 qpair failed and we were unable to recover it. 00:30:08.715 [2024-07-13 10:16:14.237460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.237598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.237624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.715 qpair failed and we were unable to recover it. 00:30:08.715 [2024-07-13 10:16:14.237791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.237955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.715 [2024-07-13 10:16:14.237982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.715 qpair failed and we were unable to recover it. 00:30:08.715 [2024-07-13 10:16:14.238205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.238435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.238485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.716 qpair failed and we were unable to recover it. 00:30:08.716 [2024-07-13 10:16:14.238656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.238805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.238829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.716 qpair failed and we were unable to recover it. 00:30:08.716 [2024-07-13 10:16:14.239041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.239244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.239294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.716 qpair failed and we were unable to recover it. 00:30:08.716 [2024-07-13 10:16:14.239477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.239641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.239667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.716 qpair failed and we were unable to recover it. 00:30:08.716 [2024-07-13 10:16:14.239855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.240000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.240027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.716 qpair failed and we were unable to recover it. 00:30:08.716 [2024-07-13 10:16:14.240158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.240295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.240323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.716 qpair failed and we were unable to recover it. 00:30:08.716 [2024-07-13 10:16:14.240522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.240676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.240702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.716 qpair failed and we were unable to recover it. 00:30:08.716 [2024-07-13 10:16:14.240895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.241098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.241123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.716 qpair failed and we were unable to recover it. 00:30:08.716 [2024-07-13 10:16:14.241245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.241438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.241465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.716 qpair failed and we were unable to recover it. 00:30:08.716 [2024-07-13 10:16:14.241605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.241736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.241759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.716 qpair failed and we were unable to recover it. 00:30:08.716 [2024-07-13 10:16:14.241886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.242027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.242050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.716 qpair failed and we were unable to recover it. 00:30:08.716 [2024-07-13 10:16:14.242227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.242487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.242535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.716 qpair failed and we were unable to recover it. 00:30:08.716 [2024-07-13 10:16:14.242697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.242857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.242889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.716 qpair failed and we were unable to recover it. 00:30:08.716 [2024-07-13 10:16:14.243061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.243228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.243287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.716 qpair failed and we were unable to recover it. 00:30:08.716 [2024-07-13 10:16:14.243491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.243633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.243656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.716 qpair failed and we were unable to recover it. 00:30:08.716 [2024-07-13 10:16:14.243804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.243926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.243949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.716 qpair failed and we were unable to recover it. 00:30:08.716 [2024-07-13 10:16:14.244109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.244317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.244384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.716 qpair failed and we were unable to recover it. 00:30:08.716 [2024-07-13 10:16:14.244592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.244767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.244792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.716 qpair failed and we were unable to recover it. 00:30:08.716 [2024-07-13 10:16:14.244934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.245053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.245077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.716 qpair failed and we were unable to recover it. 00:30:08.716 [2024-07-13 10:16:14.245231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.245440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.245464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.716 qpair failed and we were unable to recover it. 00:30:08.716 [2024-07-13 10:16:14.245630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.245775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.245799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.716 qpair failed and we were unable to recover it. 00:30:08.716 [2024-07-13 10:16:14.245977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.246157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.246185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.716 qpair failed and we were unable to recover it. 00:30:08.716 [2024-07-13 10:16:14.246377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.246700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.246755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.716 qpair failed and we were unable to recover it. 00:30:08.716 [2024-07-13 10:16:14.246919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.247085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.247114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.716 qpair failed and we were unable to recover it. 00:30:08.716 [2024-07-13 10:16:14.247268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.247418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.247443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.716 qpair failed and we were unable to recover it. 00:30:08.716 [2024-07-13 10:16:14.247563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.247759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.247786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.716 qpair failed and we were unable to recover it. 00:30:08.716 [2024-07-13 10:16:14.247952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.248091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.248117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.716 qpair failed and we were unable to recover it. 00:30:08.716 [2024-07-13 10:16:14.248303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.248429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.248457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.716 qpair failed and we were unable to recover it. 00:30:08.716 [2024-07-13 10:16:14.248607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.248772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.716 [2024-07-13 10:16:14.248799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.716 qpair failed and we were unable to recover it. 00:30:08.717 [2024-07-13 10:16:14.248940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.249108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.249135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.717 qpair failed and we were unable to recover it. 00:30:08.717 [2024-07-13 10:16:14.249287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.249409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.249432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.717 qpair failed and we were unable to recover it. 00:30:08.717 [2024-07-13 10:16:14.249609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.249778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.249802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.717 qpair failed and we were unable to recover it. 00:30:08.717 [2024-07-13 10:16:14.249982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.250116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.250143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.717 qpair failed and we were unable to recover it. 00:30:08.717 [2024-07-13 10:16:14.250283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.250460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.250501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.717 qpair failed and we were unable to recover it. 00:30:08.717 [2024-07-13 10:16:14.250694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.250845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.250874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.717 qpair failed and we were unable to recover it. 00:30:08.717 [2024-07-13 10:16:14.251048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.251172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.251199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.717 qpair failed and we were unable to recover it. 00:30:08.717 [2024-07-13 10:16:14.251392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.251539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.251581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.717 qpair failed and we were unable to recover it. 00:30:08.717 [2024-07-13 10:16:14.251715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.251880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.251904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.717 qpair failed and we were unable to recover it. 00:30:08.717 [2024-07-13 10:16:14.252057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.252172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.252196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.717 qpair failed and we were unable to recover it. 00:30:08.717 [2024-07-13 10:16:14.252349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.252541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.252567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.717 qpair failed and we were unable to recover it. 00:30:08.717 [2024-07-13 10:16:14.252779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.252929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.252954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.717 qpair failed and we were unable to recover it. 00:30:08.717 [2024-07-13 10:16:14.253073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.253279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.253306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.717 qpair failed and we were unable to recover it. 00:30:08.717 [2024-07-13 10:16:14.253479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.253632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.253675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.717 qpair failed and we were unable to recover it. 00:30:08.717 [2024-07-13 10:16:14.253911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.254109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.254169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.717 qpair failed and we were unable to recover it. 00:30:08.717 [2024-07-13 10:16:14.254384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.254536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.254574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.717 qpair failed and we were unable to recover it. 00:30:08.717 [2024-07-13 10:16:14.254772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.254917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.254942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.717 qpair failed and we were unable to recover it. 00:30:08.717 [2024-07-13 10:16:14.255087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.255260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.255287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.717 qpair failed and we were unable to recover it. 00:30:08.717 [2024-07-13 10:16:14.255484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.255628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.255652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.717 qpair failed and we were unable to recover it. 00:30:08.717 [2024-07-13 10:16:14.255807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.255930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.255955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.717 qpair failed and we were unable to recover it. 00:30:08.717 [2024-07-13 10:16:14.256074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.256218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.256243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.717 qpair failed and we were unable to recover it. 00:30:08.717 [2024-07-13 10:16:14.256389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.256518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.256544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.717 qpair failed and we were unable to recover it. 00:30:08.717 [2024-07-13 10:16:14.256693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.256864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.256914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.717 qpair failed and we were unable to recover it. 00:30:08.717 [2024-07-13 10:16:14.257108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.257237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.257264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.717 qpair failed and we were unable to recover it. 00:30:08.717 [2024-07-13 10:16:14.257407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.257569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.257596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.717 qpair failed and we were unable to recover it. 00:30:08.717 [2024-07-13 10:16:14.257730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.257878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.257903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.717 qpair failed and we were unable to recover it. 00:30:08.717 [2024-07-13 10:16:14.258049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.258196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.258220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.717 qpair failed and we were unable to recover it. 00:30:08.717 [2024-07-13 10:16:14.258340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.258512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.258539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.717 qpair failed and we were unable to recover it. 00:30:08.717 [2024-07-13 10:16:14.258702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.258877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.717 [2024-07-13 10:16:14.258902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.717 qpair failed and we were unable to recover it. 00:30:08.717 [2024-07-13 10:16:14.259025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.259260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.259309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.718 qpair failed and we were unable to recover it. 00:30:08.718 [2024-07-13 10:16:14.259494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.259665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.259692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.718 qpair failed and we were unable to recover it. 00:30:08.718 [2024-07-13 10:16:14.259844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.259977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.260002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.718 qpair failed and we were unable to recover it. 00:30:08.718 [2024-07-13 10:16:14.260131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.260305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.260329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.718 qpair failed and we were unable to recover it. 00:30:08.718 [2024-07-13 10:16:14.260480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.260620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.260643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.718 qpair failed and we were unable to recover it. 00:30:08.718 [2024-07-13 10:16:14.260801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.260986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.261011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.718 qpair failed and we were unable to recover it. 00:30:08.718 [2024-07-13 10:16:14.261138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.261283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.261307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.718 qpair failed and we were unable to recover it. 00:30:08.718 [2024-07-13 10:16:14.261460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.261608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.261633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.718 qpair failed and we were unable to recover it. 00:30:08.718 [2024-07-13 10:16:14.261795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.261988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.262016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.718 qpair failed and we were unable to recover it. 00:30:08.718 [2024-07-13 10:16:14.262187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.262317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.262343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.718 qpair failed and we were unable to recover it. 00:30:08.718 [2024-07-13 10:16:14.262512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.262699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.262724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.718 qpair failed and we were unable to recover it. 00:30:08.718 [2024-07-13 10:16:14.262875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.263028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.263053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.718 qpair failed and we were unable to recover it. 00:30:08.718 [2024-07-13 10:16:14.263243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.263404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.263430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.718 qpair failed and we were unable to recover it. 00:30:08.718 [2024-07-13 10:16:14.263618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.263763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.263786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.718 qpair failed and we were unable to recover it. 00:30:08.718 [2024-07-13 10:16:14.263911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.264039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.264065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.718 qpair failed and we were unable to recover it. 00:30:08.718 [2024-07-13 10:16:14.264260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.264493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.264547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.718 qpair failed and we were unable to recover it. 00:30:08.718 [2024-07-13 10:16:14.264684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.264827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.264850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.718 qpair failed and we were unable to recover it. 00:30:08.718 [2024-07-13 10:16:14.265011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.265156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.265180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.718 qpair failed and we were unable to recover it. 00:30:08.718 [2024-07-13 10:16:14.265333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.265486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.265510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.718 qpair failed and we were unable to recover it. 00:30:08.718 [2024-07-13 10:16:14.265659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.265808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.265833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.718 qpair failed and we were unable to recover it. 00:30:08.718 [2024-07-13 10:16:14.265996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.266120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.266148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.718 qpair failed and we were unable to recover it. 00:30:08.718 [2024-07-13 10:16:14.266297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.266418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.266442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.718 qpair failed and we were unable to recover it. 00:30:08.718 [2024-07-13 10:16:14.266564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.266768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.266795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.718 qpair failed and we were unable to recover it. 00:30:08.718 [2024-07-13 10:16:14.267016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.267169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.267194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.718 qpair failed and we were unable to recover it. 00:30:08.718 [2024-07-13 10:16:14.267320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.267467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.267492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.718 qpair failed and we were unable to recover it. 00:30:08.718 [2024-07-13 10:16:14.267638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.267784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.267807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.718 qpair failed and we were unable to recover it. 00:30:08.718 [2024-07-13 10:16:14.267971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.268091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.268115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.718 qpair failed and we were unable to recover it. 00:30:08.718 [2024-07-13 10:16:14.268292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.268475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.268531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.718 qpair failed and we were unable to recover it. 00:30:08.718 [2024-07-13 10:16:14.268689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.268812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.268835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.718 qpair failed and we were unable to recover it. 00:30:08.718 [2024-07-13 10:16:14.268984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.269105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.718 [2024-07-13 10:16:14.269129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.719 qpair failed and we were unable to recover it. 00:30:08.719 [2024-07-13 10:16:14.269281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.269454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.269486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.719 qpair failed and we were unable to recover it. 00:30:08.719 [2024-07-13 10:16:14.269651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.269815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.269846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.719 qpair failed and we were unable to recover it. 00:30:08.719 [2024-07-13 10:16:14.269999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.270137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.270167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.719 qpair failed and we were unable to recover it. 00:30:08.719 [2024-07-13 10:16:14.270338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.270512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.270536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.719 qpair failed and we were unable to recover it. 00:30:08.719 [2024-07-13 10:16:14.270691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.270815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.270841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.719 qpair failed and we were unable to recover it. 00:30:08.719 [2024-07-13 10:16:14.270977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.271122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.271148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.719 qpair failed and we were unable to recover it. 00:30:08.719 [2024-07-13 10:16:14.271291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.271421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.271444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.719 qpair failed and we were unable to recover it. 00:30:08.719 [2024-07-13 10:16:14.271592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.271736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.271760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.719 qpair failed and we were unable to recover it. 00:30:08.719 [2024-07-13 10:16:14.271893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.272013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.272036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.719 qpair failed and we were unable to recover it. 00:30:08.719 [2024-07-13 10:16:14.272161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.272314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.272338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.719 qpair failed and we were unable to recover it. 00:30:08.719 [2024-07-13 10:16:14.272491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.272634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.272658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.719 qpair failed and we were unable to recover it. 00:30:08.719 [2024-07-13 10:16:14.272774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.272900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.272926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.719 qpair failed and we were unable to recover it. 00:30:08.719 [2024-07-13 10:16:14.273050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.273170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.273193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.719 qpair failed and we were unable to recover it. 00:30:08.719 [2024-07-13 10:16:14.273314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.273463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.273487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.719 qpair failed and we were unable to recover it. 00:30:08.719 [2024-07-13 10:16:14.273654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.273812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.273838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.719 qpair failed and we were unable to recover it. 00:30:08.719 [2024-07-13 10:16:14.273999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.274146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.274171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.719 qpair failed and we were unable to recover it. 00:30:08.719 [2024-07-13 10:16:14.274316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.274492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.274518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.719 qpair failed and we were unable to recover it. 00:30:08.719 [2024-07-13 10:16:14.274679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.274845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.274877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.719 qpair failed and we were unable to recover it. 00:30:08.719 [2024-07-13 10:16:14.275046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.275182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.275207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.719 qpair failed and we were unable to recover it. 00:30:08.719 [2024-07-13 10:16:14.275354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.275481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.275504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.719 qpair failed and we were unable to recover it. 00:30:08.719 [2024-07-13 10:16:14.275668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.275808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.275831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.719 qpair failed and we were unable to recover it. 00:30:08.719 [2024-07-13 10:16:14.275997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.276151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.276175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.719 qpair failed and we were unable to recover it. 00:30:08.719 [2024-07-13 10:16:14.276353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.276472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.276496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.719 qpair failed and we were unable to recover it. 00:30:08.719 [2024-07-13 10:16:14.276623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.276753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.276777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.719 qpair failed and we were unable to recover it. 00:30:08.719 [2024-07-13 10:16:14.276916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.277072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.277096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.719 qpair failed and we were unable to recover it. 00:30:08.719 [2024-07-13 10:16:14.277246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.277392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.277416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.719 qpair failed and we were unable to recover it. 00:30:08.719 [2024-07-13 10:16:14.277541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.277667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.277691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.719 qpair failed and we were unable to recover it. 00:30:08.719 [2024-07-13 10:16:14.277862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.278005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.278029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.719 qpair failed and we were unable to recover it. 00:30:08.719 [2024-07-13 10:16:14.278220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.278347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.719 [2024-07-13 10:16:14.278371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.719 qpair failed and we were unable to recover it. 00:30:08.720 [2024-07-13 10:16:14.278495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.278645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.278669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.720 qpair failed and we were unable to recover it. 00:30:08.720 [2024-07-13 10:16:14.278816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.278992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.279016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.720 qpair failed and we were unable to recover it. 00:30:08.720 [2024-07-13 10:16:14.279179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.279298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.279322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.720 qpair failed and we were unable to recover it. 00:30:08.720 [2024-07-13 10:16:14.279447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.279566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.279590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.720 qpair failed and we were unable to recover it. 00:30:08.720 [2024-07-13 10:16:14.279762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.279915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.279940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.720 qpair failed and we were unable to recover it. 00:30:08.720 [2024-07-13 10:16:14.280091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.280209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.280233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.720 qpair failed and we were unable to recover it. 00:30:08.720 [2024-07-13 10:16:14.280390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.280531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.280555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.720 qpair failed and we were unable to recover it. 00:30:08.720 [2024-07-13 10:16:14.280730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.280851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.280883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.720 qpair failed and we were unable to recover it. 00:30:08.720 [2024-07-13 10:16:14.281036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.281204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.281230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.720 qpair failed and we were unable to recover it. 00:30:08.720 [2024-07-13 10:16:14.281376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.281540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.281568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.720 qpair failed and we were unable to recover it. 00:30:08.720 [2024-07-13 10:16:14.281704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.281873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.281902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.720 qpair failed and we were unable to recover it. 00:30:08.720 [2024-07-13 10:16:14.282046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.282210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.282235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.720 qpair failed and we were unable to recover it. 00:30:08.720 [2024-07-13 10:16:14.282403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.282522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.282546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.720 qpair failed and we were unable to recover it. 00:30:08.720 [2024-07-13 10:16:14.282698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.282848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.282879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.720 qpair failed and we were unable to recover it. 00:30:08.720 [2024-07-13 10:16:14.283014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.283135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.283160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.720 qpair failed and we were unable to recover it. 00:30:08.720 [2024-07-13 10:16:14.283335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.283449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.283472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.720 qpair failed and we were unable to recover it. 00:30:08.720 [2024-07-13 10:16:14.283601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.283780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.283804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.720 qpair failed and we were unable to recover it. 00:30:08.720 [2024-07-13 10:16:14.283950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.284070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.284094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.720 qpair failed and we were unable to recover it. 00:30:08.720 [2024-07-13 10:16:14.284243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.284391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.284416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.720 qpair failed and we were unable to recover it. 00:30:08.720 [2024-07-13 10:16:14.284541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.284686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.284710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.720 qpair failed and we were unable to recover it. 00:30:08.720 [2024-07-13 10:16:14.284836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.284979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.285004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.720 qpair failed and we were unable to recover it. 00:30:08.720 [2024-07-13 10:16:14.285126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.285244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.720 [2024-07-13 10:16:14.285268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.720 qpair failed and we were unable to recover it. 00:30:08.721 [2024-07-13 10:16:14.285399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.285548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.285575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.721 qpair failed and we were unable to recover it. 00:30:08.721 [2024-07-13 10:16:14.285694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.285819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.285842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.721 qpair failed and we were unable to recover it. 00:30:08.721 [2024-07-13 10:16:14.285983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.286134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.286159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.721 qpair failed and we were unable to recover it. 00:30:08.721 [2024-07-13 10:16:14.286285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.286424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.286450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.721 qpair failed and we were unable to recover it. 00:30:08.721 [2024-07-13 10:16:14.286629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.286747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.286771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.721 qpair failed and we were unable to recover it. 00:30:08.721 [2024-07-13 10:16:14.286914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.287063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.287088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.721 qpair failed and we were unable to recover it. 00:30:08.721 [2024-07-13 10:16:14.287238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.287352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.287376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.721 qpair failed and we were unable to recover it. 00:30:08.721 [2024-07-13 10:16:14.287524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.287676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.287701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.721 qpair failed and we were unable to recover it. 00:30:08.721 [2024-07-13 10:16:14.287831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.287990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.288014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.721 qpair failed and we were unable to recover it. 00:30:08.721 [2024-07-13 10:16:14.288145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.288267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.288291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.721 qpair failed and we were unable to recover it. 00:30:08.721 [2024-07-13 10:16:14.288466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.288614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.288641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.721 qpair failed and we were unable to recover it. 00:30:08.721 [2024-07-13 10:16:14.288774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.288927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.288951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.721 qpair failed and we were unable to recover it. 00:30:08.721 [2024-07-13 10:16:14.289086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.289206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.289229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.721 qpair failed and we were unable to recover it. 00:30:08.721 [2024-07-13 10:16:14.289379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.289525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.289548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.721 qpair failed and we were unable to recover it. 00:30:08.721 [2024-07-13 10:16:14.289674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.289854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.289885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.721 qpair failed and we were unable to recover it. 00:30:08.721 [2024-07-13 10:16:14.290027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.290191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.290217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.721 qpair failed and we were unable to recover it. 00:30:08.721 [2024-07-13 10:16:14.290418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.290610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.290634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.721 qpair failed and we were unable to recover it. 00:30:08.721 [2024-07-13 10:16:14.290815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.290936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.290960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.721 qpair failed and we were unable to recover it. 00:30:08.721 [2024-07-13 10:16:14.291121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.291262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.291287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.721 qpair failed and we were unable to recover it. 00:30:08.721 [2024-07-13 10:16:14.291412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.291564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.291588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.721 qpair failed and we were unable to recover it. 00:30:08.721 [2024-07-13 10:16:14.291711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.291860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.291891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.721 qpair failed and we were unable to recover it. 00:30:08.721 [2024-07-13 10:16:14.292036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.292162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.292191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.721 qpair failed and we were unable to recover it. 00:30:08.721 [2024-07-13 10:16:14.292374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.292492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.292516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.721 qpair failed and we were unable to recover it. 00:30:08.721 [2024-07-13 10:16:14.292665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.292789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.292813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.721 qpair failed and we were unable to recover it. 00:30:08.721 [2024-07-13 10:16:14.292941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.293059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.293083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.721 qpair failed and we were unable to recover it. 00:30:08.721 [2024-07-13 10:16:14.293238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.293405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.293429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.721 qpair failed and we were unable to recover it. 00:30:08.721 [2024-07-13 10:16:14.293577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.293729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.293754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.721 qpair failed and we were unable to recover it. 00:30:08.721 [2024-07-13 10:16:14.293912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.294061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.294085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.721 qpair failed and we were unable to recover it. 00:30:08.721 [2024-07-13 10:16:14.294230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.721 [2024-07-13 10:16:14.294448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.294504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.722 qpair failed and we were unable to recover it. 00:30:08.722 [2024-07-13 10:16:14.294705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.294861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.294892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.722 qpair failed and we were unable to recover it. 00:30:08.722 [2024-07-13 10:16:14.295018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.295154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.295181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.722 qpair failed and we were unable to recover it. 00:30:08.722 [2024-07-13 10:16:14.295343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.295531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.295556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.722 qpair failed and we were unable to recover it. 00:30:08.722 [2024-07-13 10:16:14.295703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.295834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.295858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.722 qpair failed and we were unable to recover it. 00:30:08.722 [2024-07-13 10:16:14.296020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.296162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.296189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.722 qpair failed and we were unable to recover it. 00:30:08.722 [2024-07-13 10:16:14.296348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.296511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.296538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.722 qpair failed and we were unable to recover it. 00:30:08.722 [2024-07-13 10:16:14.296725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.296895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.296921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.722 qpair failed and we were unable to recover it. 00:30:08.722 [2024-07-13 10:16:14.297066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.297226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.297266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.722 qpair failed and we were unable to recover it. 00:30:08.722 [2024-07-13 10:16:14.297455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.297630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.297658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.722 qpair failed and we were unable to recover it. 00:30:08.722 [2024-07-13 10:16:14.297832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.297961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.298002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.722 qpair failed and we were unable to recover it. 00:30:08.722 [2024-07-13 10:16:14.298136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.298300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.298327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.722 qpair failed and we were unable to recover it. 00:30:08.722 [2024-07-13 10:16:14.298493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.298667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.298695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.722 qpair failed and we were unable to recover it. 00:30:08.722 [2024-07-13 10:16:14.298896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.299074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.299102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.722 qpair failed and we were unable to recover it. 00:30:08.722 [2024-07-13 10:16:14.299268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.299427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.299454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.722 qpair failed and we were unable to recover it. 00:30:08.722 [2024-07-13 10:16:14.299632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.299747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.299772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.722 qpair failed and we were unable to recover it. 00:30:08.722 [2024-07-13 10:16:14.299968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.300105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.300133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.722 qpair failed and we were unable to recover it. 00:30:08.722 [2024-07-13 10:16:14.300314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.300464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.300506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.722 qpair failed and we were unable to recover it. 00:30:08.722 [2024-07-13 10:16:14.300705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.300853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.300886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.722 qpair failed and we were unable to recover it. 00:30:08.722 [2024-07-13 10:16:14.301035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.301191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.301218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.722 qpair failed and we were unable to recover it. 00:30:08.722 [2024-07-13 10:16:14.301383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.301531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.301558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.722 qpair failed and we were unable to recover it. 00:30:08.722 [2024-07-13 10:16:14.301681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.301826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.301850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.722 qpair failed and we were unable to recover it. 00:30:08.722 [2024-07-13 10:16:14.301972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.302099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.302123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.722 qpair failed and we were unable to recover it. 00:30:08.722 [2024-07-13 10:16:14.302278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.302430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.302461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.722 qpair failed and we were unable to recover it. 00:30:08.722 [2024-07-13 10:16:14.302673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.302828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.302854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.722 qpair failed and we were unable to recover it. 00:30:08.722 [2024-07-13 10:16:14.303007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.303125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.303165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.722 qpair failed and we were unable to recover it. 00:30:08.722 [2024-07-13 10:16:14.303337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.303455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.303478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.722 qpair failed and we were unable to recover it. 00:30:08.722 [2024-07-13 10:16:14.303624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.303800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.303826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.722 qpair failed and we were unable to recover it. 00:30:08.722 [2024-07-13 10:16:14.304004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.304140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.722 [2024-07-13 10:16:14.304167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.722 qpair failed and we were unable to recover it. 00:30:08.722 [2024-07-13 10:16:14.304313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.304459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.304482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.723 qpair failed and we were unable to recover it. 00:30:08.723 [2024-07-13 10:16:14.304633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.304754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.304778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.723 qpair failed and we were unable to recover it. 00:30:08.723 [2024-07-13 10:16:14.304933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.305084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.305110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.723 qpair failed and we were unable to recover it. 00:30:08.723 [2024-07-13 10:16:14.305286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.305480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.305507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.723 qpair failed and we were unable to recover it. 00:30:08.723 [2024-07-13 10:16:14.305645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.305768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.305791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.723 qpair failed and we were unable to recover it. 00:30:08.723 [2024-07-13 10:16:14.305949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.306108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.306134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.723 qpair failed and we were unable to recover it. 00:30:08.723 [2024-07-13 10:16:14.306301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.306475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.306499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.723 qpair failed and we were unable to recover it. 00:30:08.723 [2024-07-13 10:16:14.306648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.306793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.306816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.723 qpair failed and we were unable to recover it. 00:30:08.723 [2024-07-13 10:16:14.306945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.307095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.307119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.723 qpair failed and we were unable to recover it. 00:30:08.723 [2024-07-13 10:16:14.307300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.307468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.307495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.723 qpair failed and we were unable to recover it. 00:30:08.723 [2024-07-13 10:16:14.307662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.307828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.307855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.723 qpair failed and we were unable to recover it. 00:30:08.723 [2024-07-13 10:16:14.308009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.308183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.308213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.723 qpair failed and we were unable to recover it. 00:30:08.723 [2024-07-13 10:16:14.308395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.308573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.308631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.723 qpair failed and we were unable to recover it. 00:30:08.723 [2024-07-13 10:16:14.308791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.308918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.308942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.723 qpair failed and we were unable to recover it. 00:30:08.723 [2024-07-13 10:16:14.309087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.309326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.309386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.723 qpair failed and we were unable to recover it. 00:30:08.723 [2024-07-13 10:16:14.309650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.309830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.309857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.723 qpair failed and we were unable to recover it. 00:30:08.723 [2024-07-13 10:16:14.310019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.310171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.310195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.723 qpair failed and we were unable to recover it. 00:30:08.723 [2024-07-13 10:16:14.310370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.310558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.310603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.723 qpair failed and we were unable to recover it. 00:30:08.723 [2024-07-13 10:16:14.310787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.310910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.310934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.723 qpair failed and we were unable to recover it. 00:30:08.723 [2024-07-13 10:16:14.311077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.311253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.311283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.723 qpair failed and we were unable to recover it. 00:30:08.723 [2024-07-13 10:16:14.311476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.311639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.311665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.723 qpair failed and we were unable to recover it. 00:30:08.723 [2024-07-13 10:16:14.311851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.311994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.312024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.723 qpair failed and we were unable to recover it. 00:30:08.723 [2024-07-13 10:16:14.312200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.312352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.312377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.723 qpair failed and we were unable to recover it. 00:30:08.723 [2024-07-13 10:16:14.312557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.312719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.312744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.723 qpair failed and we were unable to recover it. 00:30:08.723 [2024-07-13 10:16:14.312902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.313031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.313054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.723 qpair failed and we were unable to recover it. 00:30:08.723 [2024-07-13 10:16:14.313211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.313339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.313366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.723 qpair failed and we were unable to recover it. 00:30:08.723 [2024-07-13 10:16:14.313510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.313688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.313712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.723 qpair failed and we were unable to recover it. 00:30:08.723 [2024-07-13 10:16:14.313889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.314048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.314074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.723 qpair failed and we were unable to recover it. 00:30:08.723 [2024-07-13 10:16:14.314217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.314367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.314391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.723 qpair failed and we were unable to recover it. 00:30:08.723 [2024-07-13 10:16:14.314564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.314751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.723 [2024-07-13 10:16:14.314778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.724 qpair failed and we were unable to recover it. 00:30:08.724 [2024-07-13 10:16:14.314920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.315090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.315114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.724 qpair failed and we were unable to recover it. 00:30:08.724 [2024-07-13 10:16:14.315290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.315491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.315516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.724 qpair failed and we were unable to recover it. 00:30:08.724 [2024-07-13 10:16:14.315701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.315837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.315876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.724 qpair failed and we were unable to recover it. 00:30:08.724 [2024-07-13 10:16:14.316035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.316176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.316203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.724 qpair failed and we were unable to recover it. 00:30:08.724 [2024-07-13 10:16:14.316376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.316535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.316559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.724 qpair failed and we were unable to recover it. 00:30:08.724 [2024-07-13 10:16:14.316710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.316857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.316936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.724 qpair failed and we were unable to recover it. 00:30:08.724 [2024-07-13 10:16:14.317113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.317262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.317302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.724 qpair failed and we were unable to recover it. 00:30:08.724 [2024-07-13 10:16:14.317452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.317585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.317611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.724 qpair failed and we were unable to recover it. 00:30:08.724 [2024-07-13 10:16:14.317797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.317948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.317973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.724 qpair failed and we were unable to recover it. 00:30:08.724 [2024-07-13 10:16:14.318132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.318279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.318303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.724 qpair failed and we were unable to recover it. 00:30:08.724 [2024-07-13 10:16:14.318479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.318618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.318644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.724 qpair failed and we were unable to recover it. 00:30:08.724 [2024-07-13 10:16:14.318835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.319024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.319049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.724 qpair failed and we were unable to recover it. 00:30:08.724 [2024-07-13 10:16:14.319180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.319323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.319348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.724 qpair failed and we were unable to recover it. 00:30:08.724 [2024-07-13 10:16:14.319508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.319654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.319680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.724 qpair failed and we were unable to recover it. 00:30:08.724 [2024-07-13 10:16:14.319851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.319991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.320015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.724 qpair failed and we were unable to recover it. 00:30:08.724 [2024-07-13 10:16:14.320181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.320304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.320332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.724 qpair failed and we were unable to recover it. 00:30:08.724 [2024-07-13 10:16:14.320450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.320634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.320658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.724 qpair failed and we were unable to recover it. 00:30:08.724 [2024-07-13 10:16:14.320803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.321001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.321028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.724 qpair failed and we were unable to recover it. 00:30:08.724 [2024-07-13 10:16:14.321183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.321342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.321366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.724 qpair failed and we were unable to recover it. 00:30:08.724 [2024-07-13 10:16:14.321517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.321640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.321662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.724 qpair failed and we were unable to recover it. 00:30:08.724 [2024-07-13 10:16:14.321856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.322000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.322026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.724 qpair failed and we were unable to recover it. 00:30:08.724 [2024-07-13 10:16:14.322186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.322370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.322414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.724 qpair failed and we were unable to recover it. 00:30:08.724 [2024-07-13 10:16:14.322592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.322764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.322787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.724 qpair failed and we were unable to recover it. 00:30:08.724 [2024-07-13 10:16:14.322950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.323111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.724 [2024-07-13 10:16:14.323138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.725 qpair failed and we were unable to recover it. 00:30:08.725 [2024-07-13 10:16:14.323330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.323510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.323539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.725 qpair failed and we were unable to recover it. 00:30:08.725 [2024-07-13 10:16:14.323722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.323922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.323950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.725 qpair failed and we were unable to recover it. 00:30:08.725 [2024-07-13 10:16:14.324124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.324313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.324339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.725 qpair failed and we were unable to recover it. 00:30:08.725 [2024-07-13 10:16:14.324498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.324652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.324679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.725 qpair failed and we were unable to recover it. 00:30:08.725 [2024-07-13 10:16:14.324815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.324985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.325012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.725 qpair failed and we were unable to recover it. 00:30:08.725 [2024-07-13 10:16:14.325179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.325351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.325377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.725 qpair failed and we were unable to recover it. 00:30:08.725 [2024-07-13 10:16:14.325517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.325667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.325706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.725 qpair failed and we were unable to recover it. 00:30:08.725 [2024-07-13 10:16:14.325902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.326039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.326066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.725 qpair failed and we were unable to recover it. 00:30:08.725 [2024-07-13 10:16:14.326206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.326366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.326391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.725 qpair failed and we were unable to recover it. 00:30:08.725 [2024-07-13 10:16:14.326550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.326760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.326798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.725 qpair failed and we were unable to recover it. 00:30:08.725 [2024-07-13 10:16:14.326970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.327125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.327165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.725 qpair failed and we were unable to recover it. 00:30:08.725 [2024-07-13 10:16:14.327312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.327471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.327497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.725 qpair failed and we were unable to recover it. 00:30:08.725 [2024-07-13 10:16:14.327656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.327822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.327849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.725 qpair failed and we were unable to recover it. 00:30:08.725 [2024-07-13 10:16:14.328049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.328200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.328229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.725 qpair failed and we were unable to recover it. 00:30:08.725 [2024-07-13 10:16:14.328416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.328579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.328609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.725 qpair failed and we were unable to recover it. 00:30:08.725 [2024-07-13 10:16:14.328816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.329002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.329029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.725 qpair failed and we were unable to recover it. 00:30:08.725 [2024-07-13 10:16:14.329195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.329320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.329346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.725 qpair failed and we were unable to recover it. 00:30:08.725 [2024-07-13 10:16:14.329487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.329686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.329712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.725 qpair failed and we were unable to recover it. 00:30:08.725 [2024-07-13 10:16:14.329886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.330011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.330034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.725 qpair failed and we were unable to recover it. 00:30:08.725 [2024-07-13 10:16:14.330256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.330402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.330442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.725 qpair failed and we were unable to recover it. 00:30:08.725 [2024-07-13 10:16:14.330638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.330798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.330824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.725 qpair failed and we were unable to recover it. 00:30:08.725 [2024-07-13 10:16:14.330980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.331117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.331144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.725 qpair failed and we were unable to recover it. 00:30:08.725 [2024-07-13 10:16:14.331284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.331465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.331506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.725 qpair failed and we were unable to recover it. 00:30:08.725 [2024-07-13 10:16:14.331666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.331833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.331860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.725 qpair failed and we were unable to recover it. 00:30:08.725 [2024-07-13 10:16:14.332029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.332179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.332202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.725 qpair failed and we were unable to recover it. 00:30:08.725 [2024-07-13 10:16:14.332349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.332481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.332506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.725 qpair failed and we were unable to recover it. 00:30:08.725 [2024-07-13 10:16:14.332681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.332850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.332891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.725 qpair failed and we were unable to recover it. 00:30:08.725 [2024-07-13 10:16:14.333053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.333214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.333240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.725 qpair failed and we were unable to recover it. 00:30:08.725 [2024-07-13 10:16:14.333381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.725 [2024-07-13 10:16:14.333563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.333593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.726 qpair failed and we were unable to recover it. 00:30:08.726 [2024-07-13 10:16:14.333810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.334000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.334027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.726 qpair failed and we were unable to recover it. 00:30:08.726 [2024-07-13 10:16:14.334221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.334347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.334370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.726 qpair failed and we were unable to recover it. 00:30:08.726 [2024-07-13 10:16:14.334567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.334732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.334758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.726 qpair failed and we were unable to recover it. 00:30:08.726 [2024-07-13 10:16:14.334925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.335098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.335126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.726 qpair failed and we were unable to recover it. 00:30:08.726 [2024-07-13 10:16:14.335266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.335444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.335469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.726 qpair failed and we were unable to recover it. 00:30:08.726 [2024-07-13 10:16:14.335603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.335754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.335794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.726 qpair failed and we were unable to recover it. 00:30:08.726 [2024-07-13 10:16:14.335942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.336119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.336142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.726 qpair failed and we were unable to recover it. 00:30:08.726 [2024-07-13 10:16:14.336291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.336414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.336439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.726 qpair failed and we were unable to recover it. 00:30:08.726 [2024-07-13 10:16:14.336614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.336775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.336800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.726 qpair failed and we were unable to recover it. 00:30:08.726 [2024-07-13 10:16:14.336973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.337123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.337166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.726 qpair failed and we were unable to recover it. 00:30:08.726 [2024-07-13 10:16:14.337355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.337492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.337519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.726 qpair failed and we were unable to recover it. 00:30:08.726 [2024-07-13 10:16:14.337695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.337873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.337916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.726 qpair failed and we were unable to recover it. 00:30:08.726 [2024-07-13 10:16:14.338046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.338186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.338213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.726 qpair failed and we were unable to recover it. 00:30:08.726 [2024-07-13 10:16:14.338375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.338548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.338594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.726 qpair failed and we were unable to recover it. 00:30:08.726 [2024-07-13 10:16:14.338786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.338946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.338974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.726 qpair failed and we were unable to recover it. 00:30:08.726 [2024-07-13 10:16:14.339148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.339302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.339326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.726 qpair failed and we were unable to recover it. 00:30:08.726 [2024-07-13 10:16:14.339462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.339628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.339654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.726 qpair failed and we were unable to recover it. 00:30:08.726 [2024-07-13 10:16:14.339828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.339982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.340033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.726 qpair failed and we were unable to recover it. 00:30:08.726 [2024-07-13 10:16:14.340189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.340396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.340442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.726 qpair failed and we were unable to recover it. 00:30:08.726 [2024-07-13 10:16:14.340584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.340712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.340737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.726 qpair failed and we were unable to recover it. 00:30:08.726 [2024-07-13 10:16:14.340904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.341043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.341071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.726 qpair failed and we were unable to recover it. 00:30:08.726 [2024-07-13 10:16:14.341220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.341398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.341440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.726 qpair failed and we were unable to recover it. 00:30:08.726 [2024-07-13 10:16:14.341648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.341774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.341797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.726 qpair failed and we were unable to recover it. 00:30:08.726 [2024-07-13 10:16:14.341941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.342066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.342095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.726 qpair failed and we were unable to recover it. 00:30:08.726 [2024-07-13 10:16:14.342247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.342457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.342502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.726 qpair failed and we were unable to recover it. 00:30:08.726 [2024-07-13 10:16:14.342665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.342886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.342915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.726 qpair failed and we were unable to recover it. 00:30:08.726 [2024-07-13 10:16:14.343089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.343207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.343231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.726 qpair failed and we were unable to recover it. 00:30:08.726 [2024-07-13 10:16:14.343405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.343598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.343625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.726 qpair failed and we were unable to recover it. 00:30:08.726 [2024-07-13 10:16:14.343789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.726 [2024-07-13 10:16:14.343986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.344011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.727 qpair failed and we were unable to recover it. 00:30:08.727 [2024-07-13 10:16:14.344137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.344256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.344280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.727 qpair failed and we were unable to recover it. 00:30:08.727 [2024-07-13 10:16:14.344392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.344589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.344616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.727 qpair failed and we were unable to recover it. 00:30:08.727 [2024-07-13 10:16:14.344812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.344979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.345003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.727 qpair failed and we were unable to recover it. 00:30:08.727 [2024-07-13 10:16:14.345151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.345287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.345314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.727 qpair failed and we were unable to recover it. 00:30:08.727 [2024-07-13 10:16:14.345485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.345636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.345660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.727 qpair failed and we were unable to recover it. 00:30:08.727 [2024-07-13 10:16:14.345823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.345995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.346022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.727 qpair failed and we were unable to recover it. 00:30:08.727 [2024-07-13 10:16:14.346189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.346335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.346359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.727 qpair failed and we were unable to recover it. 00:30:08.727 [2024-07-13 10:16:14.346540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.346740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.346763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.727 qpair failed and we were unable to recover it. 00:30:08.727 [2024-07-13 10:16:14.346893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.347008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.347032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.727 qpair failed and we were unable to recover it. 00:30:08.727 [2024-07-13 10:16:14.347233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.347522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.347578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.727 qpair failed and we were unable to recover it. 00:30:08.727 [2024-07-13 10:16:14.347753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.347912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.347939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.727 qpair failed and we were unable to recover it. 00:30:08.727 [2024-07-13 10:16:14.348148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.348297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.348351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.727 qpair failed and we were unable to recover it. 00:30:08.727 [2024-07-13 10:16:14.348529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.348653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.348677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.727 qpair failed and we were unable to recover it. 00:30:08.727 [2024-07-13 10:16:14.348834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.349020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.349048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.727 qpair failed and we were unable to recover it. 00:30:08.727 [2024-07-13 10:16:14.349192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.349397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.349448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.727 qpair failed and we were unable to recover it. 00:30:08.727 [2024-07-13 10:16:14.349616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.349797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.349821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.727 qpair failed and we were unable to recover it. 00:30:08.727 [2024-07-13 10:16:14.349950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.350094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.350117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.727 qpair failed and we were unable to recover it. 00:30:08.727 [2024-07-13 10:16:14.350308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.350463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.350489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.727 qpair failed and we were unable to recover it. 00:30:08.727 [2024-07-13 10:16:14.350689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.350847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.350892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.727 qpair failed and we were unable to recover it. 00:30:08.727 [2024-07-13 10:16:14.351062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.351236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.351260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.727 qpair failed and we were unable to recover it. 00:30:08.727 [2024-07-13 10:16:14.351444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.351596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.351621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.727 qpair failed and we were unable to recover it. 00:30:08.727 [2024-07-13 10:16:14.351800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.351946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.351974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.727 qpair failed and we were unable to recover it. 00:30:08.727 [2024-07-13 10:16:14.352116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.352256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.352285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.727 qpair failed and we were unable to recover it. 00:30:08.727 [2024-07-13 10:16:14.352462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.352638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.352662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.727 qpair failed and we were unable to recover it. 00:30:08.727 [2024-07-13 10:16:14.352826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.353007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.353032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.727 qpair failed and we were unable to recover it. 00:30:08.727 [2024-07-13 10:16:14.353219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.353425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.353483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.727 qpair failed and we were unable to recover it. 00:30:08.727 [2024-07-13 10:16:14.353615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.353793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.353818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.727 qpair failed and we were unable to recover it. 00:30:08.727 [2024-07-13 10:16:14.353931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.354083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.354107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.727 qpair failed and we were unable to recover it. 00:30:08.727 [2024-07-13 10:16:14.354266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.727 [2024-07-13 10:16:14.354388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.354413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.728 qpair failed and we were unable to recover it. 00:30:08.728 [2024-07-13 10:16:14.354628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.354791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.354817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.728 qpair failed and we were unable to recover it. 00:30:08.728 [2024-07-13 10:16:14.355010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.355160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.355185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.728 qpair failed and we were unable to recover it. 00:30:08.728 [2024-07-13 10:16:14.355362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.355521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.355547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.728 qpair failed and we were unable to recover it. 00:30:08.728 [2024-07-13 10:16:14.355686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.355861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.355893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.728 qpair failed and we were unable to recover it. 00:30:08.728 [2024-07-13 10:16:14.356025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.356172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.356196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.728 qpair failed and we were unable to recover it. 00:30:08.728 [2024-07-13 10:16:14.356345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.356459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.356483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.728 qpair failed and we were unable to recover it. 00:30:08.728 [2024-07-13 10:16:14.356628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.356812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.356837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.728 qpair failed and we were unable to recover it. 00:30:08.728 [2024-07-13 10:16:14.356988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.357130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.357171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.728 qpair failed and we were unable to recover it. 00:30:08.728 [2024-07-13 10:16:14.357342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.357489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.357513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.728 qpair failed and we were unable to recover it. 00:30:08.728 [2024-07-13 10:16:14.357677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.357831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.357857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.728 qpair failed and we were unable to recover it. 00:30:08.728 [2024-07-13 10:16:14.358037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.358163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.358187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.728 qpair failed and we were unable to recover it. 00:30:08.728 [2024-07-13 10:16:14.358336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.358530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.358557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.728 qpair failed and we were unable to recover it. 00:30:08.728 [2024-07-13 10:16:14.358739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.358888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.358914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.728 qpair failed and we were unable to recover it. 00:30:08.728 [2024-07-13 10:16:14.359067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.359234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.359261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.728 qpair failed and we were unable to recover it. 00:30:08.728 [2024-07-13 10:16:14.359395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.359559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.359586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.728 qpair failed and we were unable to recover it. 00:30:08.728 [2024-07-13 10:16:14.359745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.359949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.359974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.728 qpair failed and we were unable to recover it. 00:30:08.728 [2024-07-13 10:16:14.360121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.360295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.360326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.728 qpair failed and we were unable to recover it. 00:30:08.728 [2024-07-13 10:16:14.360519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.360699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.360726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.728 qpair failed and we were unable to recover it. 00:30:08.728 [2024-07-13 10:16:14.360890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.361053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.361078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.728 qpair failed and we were unable to recover it. 00:30:08.728 [2024-07-13 10:16:14.361260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.361379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.361403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.728 qpair failed and we were unable to recover it. 00:30:08.728 [2024-07-13 10:16:14.361625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.361754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.361780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.728 qpair failed and we were unable to recover it. 00:30:08.728 [2024-07-13 10:16:14.361915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.362089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.362115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.728 qpair failed and we were unable to recover it. 00:30:08.728 [2024-07-13 10:16:14.362228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.362382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.362405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.728 qpair failed and we were unable to recover it. 00:30:08.728 [2024-07-13 10:16:14.362589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.362772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.362815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.728 qpair failed and we were unable to recover it. 00:30:08.728 [2024-07-13 10:16:14.362961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.363161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.363187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.728 qpair failed and we were unable to recover it. 00:30:08.728 [2024-07-13 10:16:14.363346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.363512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.363539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.728 qpair failed and we were unable to recover it. 00:30:08.728 [2024-07-13 10:16:14.363713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.363853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.363888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.728 qpair failed and we were unable to recover it. 00:30:08.728 [2024-07-13 10:16:14.364045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.364194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.364218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.728 qpair failed and we were unable to recover it. 00:30:08.728 [2024-07-13 10:16:14.364461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.728 [2024-07-13 10:16:14.364670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.364697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.729 qpair failed and we were unable to recover it. 00:30:08.729 [2024-07-13 10:16:14.364833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.365029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.365057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.729 qpair failed and we were unable to recover it. 00:30:08.729 [2024-07-13 10:16:14.365220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.365379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.365406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.729 qpair failed and we were unable to recover it. 00:30:08.729 [2024-07-13 10:16:14.365588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.365754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.365780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.729 qpair failed and we were unable to recover it. 00:30:08.729 [2024-07-13 10:16:14.365960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.366082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.366106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.729 qpair failed and we were unable to recover it. 00:30:08.729 [2024-07-13 10:16:14.366318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.366489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.366515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.729 qpair failed and we were unable to recover it. 00:30:08.729 [2024-07-13 10:16:14.366661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.366828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.366854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.729 qpair failed and we were unable to recover it. 00:30:08.729 [2024-07-13 10:16:14.367024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.367200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.367223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.729 qpair failed and we were unable to recover it. 00:30:08.729 [2024-07-13 10:16:14.367450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.367588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.367616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.729 qpair failed and we were unable to recover it. 00:30:08.729 [2024-07-13 10:16:14.367814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.367936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.367961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.729 qpair failed and we were unable to recover it. 00:30:08.729 [2024-07-13 10:16:14.368135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.368277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.368304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.729 qpair failed and we were unable to recover it. 00:30:08.729 [2024-07-13 10:16:14.368449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.368594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.368619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.729 qpair failed and we were unable to recover it. 00:30:08.729 [2024-07-13 10:16:14.368770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.368935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.368961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.729 qpair failed and we were unable to recover it. 00:30:08.729 [2024-07-13 10:16:14.369114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.369240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.369263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.729 qpair failed and we were unable to recover it. 00:30:08.729 [2024-07-13 10:16:14.369402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.369534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.369563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.729 qpair failed and we were unable to recover it. 00:30:08.729 [2024-07-13 10:16:14.369711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.369891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.369917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.729 qpair failed and we were unable to recover it. 00:30:08.729 [2024-07-13 10:16:14.370098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.370353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.370403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.729 qpair failed and we were unable to recover it. 00:30:08.729 [2024-07-13 10:16:14.370601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.370787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.370814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.729 qpair failed and we were unable to recover it. 00:30:08.729 [2024-07-13 10:16:14.370960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.371088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.371115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.729 qpair failed and we were unable to recover it. 00:30:08.729 [2024-07-13 10:16:14.371311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.371442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.371465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.729 qpair failed and we were unable to recover it. 00:30:08.729 [2024-07-13 10:16:14.371648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.371819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.371861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.729 qpair failed and we were unable to recover it. 00:30:08.729 [2024-07-13 10:16:14.372009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.372196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.372223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.729 qpair failed and we were unable to recover it. 00:30:08.729 [2024-07-13 10:16:14.372371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.372608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.372657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.729 qpair failed and we were unable to recover it. 00:30:08.729 [2024-07-13 10:16:14.372852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.372987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.373030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.729 qpair failed and we were unable to recover it. 00:30:08.729 [2024-07-13 10:16:14.373227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.373455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.729 [2024-07-13 10:16:14.373501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.729 qpair failed and we were unable to recover it. 00:30:08.730 [2024-07-13 10:16:14.373667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.373805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.373831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.730 qpair failed and we were unable to recover it. 00:30:08.730 [2024-07-13 10:16:14.374018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.374150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.374174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.730 qpair failed and we were unable to recover it. 00:30:08.730 [2024-07-13 10:16:14.374299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.374490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.374514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.730 qpair failed and we were unable to recover it. 00:30:08.730 [2024-07-13 10:16:14.374695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.374852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.374899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.730 qpair failed and we were unable to recover it. 00:30:08.730 [2024-07-13 10:16:14.375073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.375237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.375265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.730 qpair failed and we were unable to recover it. 00:30:08.730 [2024-07-13 10:16:14.375401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.375575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.375599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.730 qpair failed and we were unable to recover it. 00:30:08.730 [2024-07-13 10:16:14.375746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.375876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.375901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.730 qpair failed and we were unable to recover it. 00:30:08.730 [2024-07-13 10:16:14.376094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.376246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.376270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.730 qpair failed and we were unable to recover it. 00:30:08.730 [2024-07-13 10:16:14.376429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.376590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.376617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.730 qpair failed and we were unable to recover it. 00:30:08.730 [2024-07-13 10:16:14.376810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.376971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.376999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.730 qpair failed and we were unable to recover it. 00:30:08.730 [2024-07-13 10:16:14.377169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.377347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.377374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.730 qpair failed and we were unable to recover it. 00:30:08.730 [2024-07-13 10:16:14.377567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.377766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.377791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.730 qpair failed and we were unable to recover it. 00:30:08.730 [2024-07-13 10:16:14.377948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.378091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.378116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.730 qpair failed and we were unable to recover it. 00:30:08.730 [2024-07-13 10:16:14.378277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.378478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.378530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.730 qpair failed and we were unable to recover it. 00:30:08.730 [2024-07-13 10:16:14.378675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.378825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.378854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.730 qpair failed and we were unable to recover it. 00:30:08.730 [2024-07-13 10:16:14.379052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.379195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.379218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.730 qpair failed and we were unable to recover it. 00:30:08.730 [2024-07-13 10:16:14.379363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.379529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.379559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.730 qpair failed and we were unable to recover it. 00:30:08.730 [2024-07-13 10:16:14.379729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.379898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.379938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.730 qpair failed and we were unable to recover it. 00:30:08.730 [2024-07-13 10:16:14.380092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.380245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.380269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.730 qpair failed and we were unable to recover it. 00:30:08.730 [2024-07-13 10:16:14.380420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.380608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.380634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.730 qpair failed and we were unable to recover it. 00:30:08.730 [2024-07-13 10:16:14.380799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.381008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.381034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.730 qpair failed and we were unable to recover it. 00:30:08.730 [2024-07-13 10:16:14.381165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.381319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.381348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.730 qpair failed and we were unable to recover it. 00:30:08.730 [2024-07-13 10:16:14.381473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.381627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.381650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.730 qpair failed and we were unable to recover it. 00:30:08.730 [2024-07-13 10:16:14.381819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.381991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.382019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.730 qpair failed and we were unable to recover it. 00:30:08.730 [2024-07-13 10:16:14.382183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.382303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.382327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.730 qpair failed and we were unable to recover it. 00:30:08.730 [2024-07-13 10:16:14.382465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.382601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.382627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.730 qpair failed and we were unable to recover it. 00:30:08.730 [2024-07-13 10:16:14.382774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.382939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.382963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.730 qpair failed and we were unable to recover it. 00:30:08.730 [2024-07-13 10:16:14.383134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.383301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.383326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.730 qpair failed and we were unable to recover it. 00:30:08.730 [2024-07-13 10:16:14.383452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.383574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.383597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.730 qpair failed and we were unable to recover it. 00:30:08.730 [2024-07-13 10:16:14.383795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.730 [2024-07-13 10:16:14.384028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.384055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.731 qpair failed and we were unable to recover it. 00:30:08.731 [2024-07-13 10:16:14.384252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.384406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.384436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.731 qpair failed and we were unable to recover it. 00:30:08.731 [2024-07-13 10:16:14.384618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.384765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.384792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.731 qpair failed and we were unable to recover it. 00:30:08.731 [2024-07-13 10:16:14.384995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.385143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.385185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.731 qpair failed and we were unable to recover it. 00:30:08.731 [2024-07-13 10:16:14.385361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.385510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.385555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.731 qpair failed and we were unable to recover it. 00:30:08.731 [2024-07-13 10:16:14.385773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.385943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.385970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.731 qpair failed and we were unable to recover it. 00:30:08.731 [2024-07-13 10:16:14.386151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.386303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.386327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.731 qpair failed and we were unable to recover it. 00:30:08.731 [2024-07-13 10:16:14.386476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.386645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.386672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.731 qpair failed and we were unable to recover it. 00:30:08.731 [2024-07-13 10:16:14.386873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.387029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.387055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.731 qpair failed and we were unable to recover it. 00:30:08.731 [2024-07-13 10:16:14.387202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.387354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.387378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.731 qpair failed and we were unable to recover it. 00:30:08.731 [2024-07-13 10:16:14.387528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.387691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.387718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.731 qpair failed and we were unable to recover it. 00:30:08.731 [2024-07-13 10:16:14.387885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.388067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.388091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.731 qpair failed and we were unable to recover it. 00:30:08.731 [2024-07-13 10:16:14.388263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.388410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.388439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.731 qpair failed and we were unable to recover it. 00:30:08.731 [2024-07-13 10:16:14.388616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.388764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.388805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.731 qpair failed and we were unable to recover it. 00:30:08.731 [2024-07-13 10:16:14.388986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.389126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.389153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.731 qpair failed and we were unable to recover it. 00:30:08.731 [2024-07-13 10:16:14.389322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.389494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.389521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.731 qpair failed and we were unable to recover it. 00:30:08.731 [2024-07-13 10:16:14.389692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.389824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.389851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.731 qpair failed and we were unable to recover it. 00:30:08.731 [2024-07-13 10:16:14.390031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.390176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.390215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.731 qpair failed and we were unable to recover it. 00:30:08.731 [2024-07-13 10:16:14.390406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.390654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.390704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.731 qpair failed and we were unable to recover it. 00:30:08.731 [2024-07-13 10:16:14.390906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.391036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.391063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.731 qpair failed and we were unable to recover it. 00:30:08.731 [2024-07-13 10:16:14.391259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.391456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.391505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.731 qpair failed and we were unable to recover it. 00:30:08.731 [2024-07-13 10:16:14.391687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.391889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.391918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.731 qpair failed and we were unable to recover it. 00:30:08.731 [2024-07-13 10:16:14.392062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.392217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.392241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.731 qpair failed and we were unable to recover it. 00:30:08.731 [2024-07-13 10:16:14.392394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.392556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.392581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.731 qpair failed and we were unable to recover it. 00:30:08.731 [2024-07-13 10:16:14.392756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.392944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.392971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.731 qpair failed and we were unable to recover it. 00:30:08.731 [2024-07-13 10:16:14.393118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.393244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.393267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.731 qpair failed and we were unable to recover it. 00:30:08.731 [2024-07-13 10:16:14.393441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.393577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.393603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.731 qpair failed and we were unable to recover it. 00:30:08.731 [2024-07-13 10:16:14.393786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.393938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.393964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.731 qpair failed and we were unable to recover it. 00:30:08.731 [2024-07-13 10:16:14.394114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.394243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.394270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.731 qpair failed and we were unable to recover it. 00:30:08.731 [2024-07-13 10:16:14.394471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.394588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.731 [2024-07-13 10:16:14.394628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.732 qpair failed and we were unable to recover it. 00:30:08.732 [2024-07-13 10:16:14.394797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.394958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.394986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.732 qpair failed and we were unable to recover it. 00:30:08.732 [2024-07-13 10:16:14.395177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.395331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.395358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.732 qpair failed and we were unable to recover it. 00:30:08.732 [2024-07-13 10:16:14.395528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.395700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.395726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.732 qpair failed and we were unable to recover it. 00:30:08.732 [2024-07-13 10:16:14.395897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.396028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.396052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.732 qpair failed and we were unable to recover it. 00:30:08.732 [2024-07-13 10:16:14.396242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.396482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.396533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.732 qpair failed and we were unable to recover it. 00:30:08.732 [2024-07-13 10:16:14.396743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.396905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.396932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.732 qpair failed and we were unable to recover it. 00:30:08.732 [2024-07-13 10:16:14.397091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.397237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.397264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.732 qpair failed and we were unable to recover it. 00:30:08.732 [2024-07-13 10:16:14.397419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.397543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.397582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.732 qpair failed and we were unable to recover it. 00:30:08.732 [2024-07-13 10:16:14.397747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.397881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.397909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.732 qpair failed and we were unable to recover it. 00:30:08.732 [2024-07-13 10:16:14.398100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.398307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.398359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.732 qpair failed and we were unable to recover it. 00:30:08.732 [2024-07-13 10:16:14.398496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.398663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.398690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.732 qpair failed and we were unable to recover it. 00:30:08.732 [2024-07-13 10:16:14.398890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.399060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.399087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.732 qpair failed and we were unable to recover it. 00:30:08.732 [2024-07-13 10:16:14.399263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.399525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.399573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.732 qpair failed and we were unable to recover it. 00:30:08.732 [2024-07-13 10:16:14.399778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.399944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.399972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.732 qpair failed and we were unable to recover it. 00:30:08.732 [2024-07-13 10:16:14.400137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.400331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.400354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.732 qpair failed and we were unable to recover it. 00:30:08.732 [2024-07-13 10:16:14.400474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.400658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.400698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.732 qpair failed and we were unable to recover it. 00:30:08.732 [2024-07-13 10:16:14.400879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.401027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.401056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.732 qpair failed and we were unable to recover it. 00:30:08.732 [2024-07-13 10:16:14.401230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.401423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.401449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.732 qpair failed and we were unable to recover it. 00:30:08.732 [2024-07-13 10:16:14.401597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.401735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.401762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.732 qpair failed and we were unable to recover it. 00:30:08.732 [2024-07-13 10:16:14.401964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.402092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.402116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.732 qpair failed and we were unable to recover it. 00:30:08.732 [2024-07-13 10:16:14.402245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.402392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.402415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.732 qpair failed and we were unable to recover it. 00:30:08.732 [2024-07-13 10:16:14.402531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.402734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.402761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.732 qpair failed and we were unable to recover it. 00:30:08.732 [2024-07-13 10:16:14.402934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.403086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.403111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.732 qpair failed and we were unable to recover it. 00:30:08.732 [2024-07-13 10:16:14.403237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.403409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.403450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.732 qpair failed and we were unable to recover it. 00:30:08.732 [2024-07-13 10:16:14.403654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.403782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.403806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.732 qpair failed and we were unable to recover it. 00:30:08.732 [2024-07-13 10:16:14.404024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.404143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.404184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.732 qpair failed and we were unable to recover it. 00:30:08.732 [2024-07-13 10:16:14.404348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.404550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.404603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.732 qpair failed and we were unable to recover it. 00:30:08.732 [2024-07-13 10:16:14.404805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.404968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.732 [2024-07-13 10:16:14.404993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.732 qpair failed and we were unable to recover it. 00:30:08.732 [2024-07-13 10:16:14.405167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.405413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.405471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.733 qpair failed and we were unable to recover it. 00:30:08.733 [2024-07-13 10:16:14.405644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.405807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.405834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.733 qpair failed and we were unable to recover it. 00:30:08.733 [2024-07-13 10:16:14.406004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.406141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.406168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.733 qpair failed and we were unable to recover it. 00:30:08.733 [2024-07-13 10:16:14.406314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.406487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.406527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.733 qpair failed and we were unable to recover it. 00:30:08.733 [2024-07-13 10:16:14.406664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.406807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.406834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.733 qpair failed and we were unable to recover it. 00:30:08.733 [2024-07-13 10:16:14.407034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.407159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.407199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.733 qpair failed and we were unable to recover it. 00:30:08.733 [2024-07-13 10:16:14.407391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.407558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.407582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.733 qpair failed and we were unable to recover it. 00:30:08.733 [2024-07-13 10:16:14.407711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.407887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.407913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.733 qpair failed and we were unable to recover it. 00:30:08.733 [2024-07-13 10:16:14.408096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.408302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.408327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.733 qpair failed and we were unable to recover it. 00:30:08.733 [2024-07-13 10:16:14.408456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.408692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.408743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.733 qpair failed and we were unable to recover it. 00:30:08.733 [2024-07-13 10:16:14.408936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.409075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.409101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.733 qpair failed and we were unable to recover it. 00:30:08.733 [2024-07-13 10:16:14.409275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.409429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.409453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.733 qpair failed and we were unable to recover it. 00:30:08.733 [2024-07-13 10:16:14.409661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.409826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.409852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.733 qpair failed and we were unable to recover it. 00:30:08.733 [2024-07-13 10:16:14.410004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.410151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.410178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.733 qpair failed and we were unable to recover it. 00:30:08.733 [2024-07-13 10:16:14.410352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.410480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.410506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.733 qpair failed and we were unable to recover it. 00:30:08.733 [2024-07-13 10:16:14.410636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.410837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.410863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.733 qpair failed and we were unable to recover it. 00:30:08.733 [2024-07-13 10:16:14.411020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.411194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.411218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.733 qpair failed and we were unable to recover it. 00:30:08.733 [2024-07-13 10:16:14.411363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.411516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.411542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.733 qpair failed and we were unable to recover it. 00:30:08.733 [2024-07-13 10:16:14.411740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.411877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.411904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.733 qpair failed and we were unable to recover it. 00:30:08.733 [2024-07-13 10:16:14.412076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.412226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.412268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.733 qpair failed and we were unable to recover it. 00:30:08.733 [2024-07-13 10:16:14.412477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.412600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.412625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.733 qpair failed and we were unable to recover it. 00:30:08.733 [2024-07-13 10:16:14.412789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.413012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.413062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.733 qpair failed and we were unable to recover it. 00:30:08.733 [2024-07-13 10:16:14.413223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.413386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.413411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.733 qpair failed and we were unable to recover it. 00:30:08.733 [2024-07-13 10:16:14.413558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.413696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.413720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.733 qpair failed and we were unable to recover it. 00:30:08.733 [2024-07-13 10:16:14.413890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.414155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.414180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.733 qpair failed and we were unable to recover it. 00:30:08.733 [2024-07-13 10:16:14.414329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.414468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.414495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.733 qpair failed and we were unable to recover it. 00:30:08.733 [2024-07-13 10:16:14.414660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.414790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.414816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.733 qpair failed and we were unable to recover it. 00:30:08.733 [2024-07-13 10:16:14.414958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.415091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.415116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.733 qpair failed and we were unable to recover it. 00:30:08.733 [2024-07-13 10:16:14.415327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.415520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.415547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.733 qpair failed and we were unable to recover it. 00:30:08.733 [2024-07-13 10:16:14.415735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.733 [2024-07-13 10:16:14.415881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.415908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.734 qpair failed and we were unable to recover it. 00:30:08.734 [2024-07-13 10:16:14.416071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.416234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.416260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.734 qpair failed and we were unable to recover it. 00:30:08.734 [2024-07-13 10:16:14.416436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.416563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.416589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.734 qpair failed and we were unable to recover it. 00:30:08.734 [2024-07-13 10:16:14.416757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.416925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.416953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.734 qpair failed and we were unable to recover it. 00:30:08.734 [2024-07-13 10:16:14.417143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.417284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.417310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.734 qpair failed and we were unable to recover it. 00:30:08.734 [2024-07-13 10:16:14.417481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.417645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.417672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.734 qpair failed and we were unable to recover it. 00:30:08.734 [2024-07-13 10:16:14.417844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.418023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.418050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.734 qpair failed and we were unable to recover it. 00:30:08.734 [2024-07-13 10:16:14.418193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.418358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.418386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.734 qpair failed and we were unable to recover it. 00:30:08.734 [2024-07-13 10:16:14.418549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.418721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.418746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.734 qpair failed and we were unable to recover it. 00:30:08.734 [2024-07-13 10:16:14.418878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.419067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.419093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.734 qpair failed and we were unable to recover it. 00:30:08.734 [2024-07-13 10:16:14.419290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.419532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.419595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.734 qpair failed and we were unable to recover it. 00:30:08.734 [2024-07-13 10:16:14.419740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.419908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.419933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.734 qpair failed and we were unable to recover it. 00:30:08.734 [2024-07-13 10:16:14.420144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.420309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.420365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.734 qpair failed and we were unable to recover it. 00:30:08.734 [2024-07-13 10:16:14.420531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.420658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.420684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.734 qpair failed and we were unable to recover it. 00:30:08.734 [2024-07-13 10:16:14.420874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.420998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.421022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.734 qpair failed and we were unable to recover it. 00:30:08.734 [2024-07-13 10:16:14.421239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.421497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.421552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.734 qpair failed and we were unable to recover it. 00:30:08.734 [2024-07-13 10:16:14.421740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.421901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.421930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.734 qpair failed and we were unable to recover it. 00:30:08.734 [2024-07-13 10:16:14.422102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.422347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.422398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.734 qpair failed and we were unable to recover it. 00:30:08.734 [2024-07-13 10:16:14.422564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.422711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.422750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.734 qpair failed and we were unable to recover it. 00:30:08.734 [2024-07-13 10:16:14.422945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.423130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.423189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.734 qpair failed and we were unable to recover it. 00:30:08.734 [2024-07-13 10:16:14.423353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.423487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.423513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.734 qpair failed and we were unable to recover it. 00:30:08.734 [2024-07-13 10:16:14.423718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.423947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.423975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.734 qpair failed and we were unable to recover it. 00:30:08.734 [2024-07-13 10:16:14.424117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.424292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.424331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.734 qpair failed and we were unable to recover it. 00:30:08.734 [2024-07-13 10:16:14.424519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.424713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.424740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.734 qpair failed and we were unable to recover it. 00:30:08.734 [2024-07-13 10:16:14.424903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.734 [2024-07-13 10:16:14.425067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.425093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.735 qpair failed and we were unable to recover it. 00:30:08.735 [2024-07-13 10:16:14.425264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.425456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.425481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.735 qpair failed and we were unable to recover it. 00:30:08.735 [2024-07-13 10:16:14.425665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.425811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.425835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.735 qpair failed and we were unable to recover it. 00:30:08.735 [2024-07-13 10:16:14.426023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.426178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.426239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.735 qpair failed and we were unable to recover it. 00:30:08.735 [2024-07-13 10:16:14.426404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.426540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.426568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.735 qpair failed and we were unable to recover it. 00:30:08.735 [2024-07-13 10:16:14.426731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.426921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.426948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.735 qpair failed and we were unable to recover it. 00:30:08.735 [2024-07-13 10:16:14.427086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.427250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.427274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.735 qpair failed and we were unable to recover it. 00:30:08.735 [2024-07-13 10:16:14.427460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.427658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.427681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.735 qpair failed and we were unable to recover it. 00:30:08.735 [2024-07-13 10:16:14.427826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.428016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.428044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.735 qpair failed and we were unable to recover it. 00:30:08.735 [2024-07-13 10:16:14.428191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.428348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.428374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.735 qpair failed and we were unable to recover it. 00:30:08.735 [2024-07-13 10:16:14.428549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.428695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.428735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.735 qpair failed and we were unable to recover it. 00:30:08.735 [2024-07-13 10:16:14.428875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.429035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.429059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.735 qpair failed and we were unable to recover it. 00:30:08.735 [2024-07-13 10:16:14.429226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.429398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.429421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.735 qpair failed and we were unable to recover it. 00:30:08.735 [2024-07-13 10:16:14.429532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.429725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.429752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.735 qpair failed and we were unable to recover it. 00:30:08.735 [2024-07-13 10:16:14.429921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.430043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.430068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.735 qpair failed and we were unable to recover it. 00:30:08.735 [2024-07-13 10:16:14.430230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.430430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.430457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.735 qpair failed and we were unable to recover it. 00:30:08.735 [2024-07-13 10:16:14.430622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.430760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.430786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.735 qpair failed and we were unable to recover it. 00:30:08.735 [2024-07-13 10:16:14.430951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.431139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.431165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.735 qpair failed and we were unable to recover it. 00:30:08.735 [2024-07-13 10:16:14.431375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.431541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.431568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.735 qpair failed and we were unable to recover it. 00:30:08.735 [2024-07-13 10:16:14.431727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.431929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.431956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.735 qpair failed and we were unable to recover it. 00:30:08.735 [2024-07-13 10:16:14.432119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.432314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.432362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.735 qpair failed and we were unable to recover it. 00:30:08.735 [2024-07-13 10:16:14.432525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.432725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.432748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.735 qpair failed and we were unable to recover it. 00:30:08.735 [2024-07-13 10:16:14.432876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.433012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.433037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.735 qpair failed and we were unable to recover it. 00:30:08.735 [2024-07-13 10:16:14.433230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.433501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.433553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.735 qpair failed and we were unable to recover it. 00:30:08.735 [2024-07-13 10:16:14.433691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.433854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.433892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.735 qpair failed and we were unable to recover it. 00:30:08.735 [2024-07-13 10:16:14.434060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.434228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.434254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.735 qpair failed and we were unable to recover it. 00:30:08.735 [2024-07-13 10:16:14.434430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.434556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.434595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.735 qpair failed and we were unable to recover it. 00:30:08.735 [2024-07-13 10:16:14.434729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.434911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.434936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.735 qpair failed and we were unable to recover it. 00:30:08.735 [2024-07-13 10:16:14.435127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.435321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.735 [2024-07-13 10:16:14.435345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.735 qpair failed and we were unable to recover it. 00:30:08.735 [2024-07-13 10:16:14.435542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.435710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.435737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.736 qpair failed and we were unable to recover it. 00:30:08.736 [2024-07-13 10:16:14.435908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.436026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.436051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.736 qpair failed and we were unable to recover it. 00:30:08.736 [2024-07-13 10:16:14.436269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.436418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.436441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.736 qpair failed and we were unable to recover it. 00:30:08.736 [2024-07-13 10:16:14.436602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.436765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.436792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.736 qpair failed and we were unable to recover it. 00:30:08.736 [2024-07-13 10:16:14.436984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.437155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.437179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.736 qpair failed and we were unable to recover it. 00:30:08.736 [2024-07-13 10:16:14.437313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.437463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.437505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.736 qpair failed and we were unable to recover it. 00:30:08.736 [2024-07-13 10:16:14.437672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.437838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.437873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.736 qpair failed and we were unable to recover it. 00:30:08.736 [2024-07-13 10:16:14.438019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.438190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.438214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.736 qpair failed and we were unable to recover it. 00:30:08.736 [2024-07-13 10:16:14.438363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.438513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.438541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.736 qpair failed and we were unable to recover it. 00:30:08.736 [2024-07-13 10:16:14.438711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.438876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.438904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.736 qpair failed and we were unable to recover it. 00:30:08.736 [2024-07-13 10:16:14.439075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.439349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.439400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.736 qpair failed and we were unable to recover it. 00:30:08.736 [2024-07-13 10:16:14.439564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.439733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.439759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.736 qpair failed and we were unable to recover it. 00:30:08.736 [2024-07-13 10:16:14.439962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.440163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.440189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.736 qpair failed and we were unable to recover it. 00:30:08.736 [2024-07-13 10:16:14.440383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.440535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.440558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.736 qpair failed and we were unable to recover it. 00:30:08.736 [2024-07-13 10:16:14.440706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.440847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.440879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.736 qpair failed and we were unable to recover it. 00:30:08.736 [2024-07-13 10:16:14.441051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.441209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.441236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.736 qpair failed and we were unable to recover it. 00:30:08.736 [2024-07-13 10:16:14.441430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.441607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.441631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.736 qpair failed and we were unable to recover it. 00:30:08.736 [2024-07-13 10:16:14.441785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.441912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.441937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.736 qpair failed and we were unable to recover it. 00:30:08.736 [2024-07-13 10:16:14.442068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.442253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.442279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.736 qpair failed and we were unable to recover it. 00:30:08.736 [2024-07-13 10:16:14.442445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.442640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.442664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.736 qpair failed and we were unable to recover it. 00:30:08.736 [2024-07-13 10:16:14.442835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.443021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.443049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.736 qpair failed and we were unable to recover it. 00:30:08.736 [2024-07-13 10:16:14.443247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.443391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.443432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.736 qpair failed and we were unable to recover it. 00:30:08.736 [2024-07-13 10:16:14.443673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.443874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.443902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.736 qpair failed and we were unable to recover it. 00:30:08.736 [2024-07-13 10:16:14.444067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.444233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.444259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.736 qpair failed and we were unable to recover it. 00:30:08.736 [2024-07-13 10:16:14.444424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.444599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.444623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.736 qpair failed and we were unable to recover it. 00:30:08.736 [2024-07-13 10:16:14.444773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.444896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.444938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.736 qpair failed and we were unable to recover it. 00:30:08.736 [2024-07-13 10:16:14.445141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.445286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.445310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.736 qpair failed and we were unable to recover it. 00:30:08.736 [2024-07-13 10:16:14.445478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.445646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.445673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.736 qpair failed and we were unable to recover it. 00:30:08.736 [2024-07-13 10:16:14.445812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.445948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.736 [2024-07-13 10:16:14.445976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.736 qpair failed and we were unable to recover it. 00:30:08.737 [2024-07-13 10:16:14.446161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.446308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.446349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.737 qpair failed and we were unable to recover it. 00:30:08.737 [2024-07-13 10:16:14.446568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.446701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.446728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.737 qpair failed and we were unable to recover it. 00:30:08.737 [2024-07-13 10:16:14.446925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.447102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.447144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.737 qpair failed and we were unable to recover it. 00:30:08.737 [2024-07-13 10:16:14.447273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.447429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.447456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.737 qpair failed and we were unable to recover it. 00:30:08.737 [2024-07-13 10:16:14.447603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.447749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.447773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.737 qpair failed and we were unable to recover it. 00:30:08.737 [2024-07-13 10:16:14.447950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.448114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.448142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.737 qpair failed and we were unable to recover it. 00:30:08.737 [2024-07-13 10:16:14.448342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.448458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.448482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.737 qpair failed and we were unable to recover it. 00:30:08.737 [2024-07-13 10:16:14.448630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.448793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.448819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.737 qpair failed and we were unable to recover it. 00:30:08.737 [2024-07-13 10:16:14.448961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.449113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.449138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.737 qpair failed and we were unable to recover it. 00:30:08.737 [2024-07-13 10:16:14.449265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.449400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.449427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.737 qpair failed and we were unable to recover it. 00:30:08.737 [2024-07-13 10:16:14.449588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.449743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.449767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.737 qpair failed and we were unable to recover it. 00:30:08.737 [2024-07-13 10:16:14.449883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.450070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.450095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.737 qpair failed and we were unable to recover it. 00:30:08.737 [2024-07-13 10:16:14.450247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.450391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.450432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.737 qpair failed and we were unable to recover it. 00:30:08.737 [2024-07-13 10:16:14.450591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.450767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.450794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.737 qpair failed and we were unable to recover it. 00:30:08.737 [2024-07-13 10:16:14.450940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.451065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.451089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.737 qpair failed and we were unable to recover it. 00:30:08.737 [2024-07-13 10:16:14.451255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.451406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.451433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.737 qpair failed and we were unable to recover it. 00:30:08.737 [2024-07-13 10:16:14.451570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.451715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.451754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.737 qpair failed and we were unable to recover it. 00:30:08.737 [2024-07-13 10:16:14.451894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.452030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.452057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.737 qpair failed and we were unable to recover it. 00:30:08.737 [2024-07-13 10:16:14.452220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.452382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.452410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.737 qpair failed and we were unable to recover it. 00:30:08.737 [2024-07-13 10:16:14.452556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.452729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.452753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.737 qpair failed and we were unable to recover it. 00:30:08.737 [2024-07-13 10:16:14.452900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.453097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.453125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.737 qpair failed and we were unable to recover it. 00:30:08.737 [2024-07-13 10:16:14.453337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.453481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.453505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.737 qpair failed and we were unable to recover it. 00:30:08.737 [2024-07-13 10:16:14.453696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.453834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.453862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.737 qpair failed and we were unable to recover it. 00:30:08.737 [2024-07-13 10:16:14.454032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.454169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.454195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.737 qpair failed and we were unable to recover it. 00:30:08.737 [2024-07-13 10:16:14.454335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.454487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.454510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.737 qpair failed and we were unable to recover it. 00:30:08.737 [2024-07-13 10:16:14.454656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.454781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.454804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.737 qpair failed and we were unable to recover it. 00:30:08.737 [2024-07-13 10:16:14.454928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.455101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.455127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.737 qpair failed and we were unable to recover it. 00:30:08.737 [2024-07-13 10:16:14.455295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.455430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.455459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.737 qpair failed and we were unable to recover it. 00:30:08.737 [2024-07-13 10:16:14.455619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.737 [2024-07-13 10:16:14.455813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.455839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.738 qpair failed and we were unable to recover it. 00:30:08.738 [2024-07-13 10:16:14.456045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.456171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.456195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.738 qpair failed and we were unable to recover it. 00:30:08.738 [2024-07-13 10:16:14.456371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.456630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.456687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.738 qpair failed and we were unable to recover it. 00:30:08.738 [2024-07-13 10:16:14.456852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.457024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.457052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.738 qpair failed and we were unable to recover it. 00:30:08.738 [2024-07-13 10:16:14.457200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.457321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.457345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.738 qpair failed and we were unable to recover it. 00:30:08.738 [2024-07-13 10:16:14.457586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.457764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.457788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.738 qpair failed and we were unable to recover it. 00:30:08.738 [2024-07-13 10:16:14.458021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.458143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.458166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.738 qpair failed and we were unable to recover it. 00:30:08.738 [2024-07-13 10:16:14.458291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.458406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.458430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.738 qpair failed and we were unable to recover it. 00:30:08.738 [2024-07-13 10:16:14.458584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.458731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.458755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.738 qpair failed and we were unable to recover it. 00:30:08.738 [2024-07-13 10:16:14.458909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.459039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.459064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.738 qpair failed and we were unable to recover it. 00:30:08.738 [2024-07-13 10:16:14.459236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.459394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.459420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.738 qpair failed and we were unable to recover it. 00:30:08.738 [2024-07-13 10:16:14.459610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.459742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.459769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.738 qpair failed and we were unable to recover it. 00:30:08.738 [2024-07-13 10:16:14.459946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.460091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.460118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.738 qpair failed and we were unable to recover it. 00:30:08.738 [2024-07-13 10:16:14.460302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.460533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.460584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.738 qpair failed and we were unable to recover it. 00:30:08.738 [2024-07-13 10:16:14.460752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.460939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.460966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.738 qpair failed and we were unable to recover it. 00:30:08.738 [2024-07-13 10:16:14.461102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.461277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.461303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.738 qpair failed and we were unable to recover it. 00:30:08.738 [2024-07-13 10:16:14.461502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.461627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.461650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.738 qpair failed and we were unable to recover it. 00:30:08.738 [2024-07-13 10:16:14.461779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.461931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.461956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.738 qpair failed and we were unable to recover it. 00:30:08.738 [2024-07-13 10:16:14.462111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.462261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.462285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.738 qpair failed and we were unable to recover it. 00:30:08.738 [2024-07-13 10:16:14.462467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.462641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.462666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.738 qpair failed and we were unable to recover it. 00:30:08.738 [2024-07-13 10:16:14.462815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.462966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.463008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.738 qpair failed and we were unable to recover it. 00:30:08.738 [2024-07-13 10:16:14.463178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.463323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.463350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.738 qpair failed and we were unable to recover it. 00:30:08.738 [2024-07-13 10:16:14.463534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.463710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.463735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.738 qpair failed and we were unable to recover it. 00:30:08.738 [2024-07-13 10:16:14.463887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.464088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.464115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.738 qpair failed and we were unable to recover it. 00:30:08.738 [2024-07-13 10:16:14.464284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.464456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.738 [2024-07-13 10:16:14.464497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.739 qpair failed and we were unable to recover it. 00:30:08.739 [2024-07-13 10:16:14.464662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.464819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.464845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.739 qpair failed and we were unable to recover it. 00:30:08.739 [2024-07-13 10:16:14.465025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.465278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.465334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.739 qpair failed and we were unable to recover it. 00:30:08.739 [2024-07-13 10:16:14.465534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.465697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.465723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.739 qpair failed and we were unable to recover it. 00:30:08.739 [2024-07-13 10:16:14.465922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.466089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.466115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.739 qpair failed and we were unable to recover it. 00:30:08.739 [2024-07-13 10:16:14.466325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.466502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.466542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.739 qpair failed and we were unable to recover it. 00:30:08.739 [2024-07-13 10:16:14.466724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.466877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.466901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.739 qpair failed and we were unable to recover it. 00:30:08.739 [2024-07-13 10:16:14.467022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.467174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.467197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.739 qpair failed and we were unable to recover it. 00:30:08.739 [2024-07-13 10:16:14.467405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.467529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.467553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.739 qpair failed and we were unable to recover it. 00:30:08.739 [2024-07-13 10:16:14.467694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.467874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.467901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.739 qpair failed and we were unable to recover it. 00:30:08.739 [2024-07-13 10:16:14.468061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.468302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.468355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.739 qpair failed and we were unable to recover it. 00:30:08.739 [2024-07-13 10:16:14.468533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.468685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.468709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.739 qpair failed and we were unable to recover it. 00:30:08.739 [2024-07-13 10:16:14.468879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.469040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.469063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.739 qpair failed and we were unable to recover it. 00:30:08.739 [2024-07-13 10:16:14.469207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.469377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.469427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.739 qpair failed and we were unable to recover it. 00:30:08.739 [2024-07-13 10:16:14.469583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.469742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.469767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.739 qpair failed and we were unable to recover it. 00:30:08.739 [2024-07-13 10:16:14.469930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.470104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.470131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.739 qpair failed and we were unable to recover it. 00:30:08.739 [2024-07-13 10:16:14.470304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.470430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.470453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.739 qpair failed and we were unable to recover it. 00:30:08.739 [2024-07-13 10:16:14.470603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.470752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.470778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.739 qpair failed and we were unable to recover it. 00:30:08.739 [2024-07-13 10:16:14.470943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.471093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.471120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.739 qpair failed and we were unable to recover it. 00:30:08.739 [2024-07-13 10:16:14.471260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.471439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.471463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.739 qpair failed and we were unable to recover it. 00:30:08.739 [2024-07-13 10:16:14.471584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.471706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.471730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.739 qpair failed and we were unable to recover it. 00:30:08.739 [2024-07-13 10:16:14.471877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.472015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.472041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.739 qpair failed and we were unable to recover it. 00:30:08.739 [2024-07-13 10:16:14.472202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.472371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.472395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.739 qpair failed and we were unable to recover it. 00:30:08.739 [2024-07-13 10:16:14.472554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.472727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.472753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.739 qpair failed and we were unable to recover it. 00:30:08.739 [2024-07-13 10:16:14.472955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.473107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.473132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.739 qpair failed and we were unable to recover it. 00:30:08.739 [2024-07-13 10:16:14.473343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.473570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.473619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.739 qpair failed and we were unable to recover it. 00:30:08.739 [2024-07-13 10:16:14.473753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.473946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.473973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.739 qpair failed and we were unable to recover it. 00:30:08.739 [2024-07-13 10:16:14.474162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.474354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.474378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.739 qpair failed and we were unable to recover it. 00:30:08.739 [2024-07-13 10:16:14.474549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.474699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.474722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.739 qpair failed and we were unable to recover it. 00:30:08.739 [2024-07-13 10:16:14.474848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.475055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.739 [2024-07-13 10:16:14.475086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.739 qpair failed and we were unable to recover it. 00:30:08.739 [2024-07-13 10:16:14.475252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.475450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.475499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.740 qpair failed and we were unable to recover it. 00:30:08.740 [2024-07-13 10:16:14.475668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.475858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.475892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.740 qpair failed and we were unable to recover it. 00:30:08.740 [2024-07-13 10:16:14.476039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.476202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.476226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.740 qpair failed and we were unable to recover it. 00:30:08.740 [2024-07-13 10:16:14.476425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.476706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.476757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.740 qpair failed and we were unable to recover it. 00:30:08.740 [2024-07-13 10:16:14.476915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.477070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.477094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.740 qpair failed and we were unable to recover it. 00:30:08.740 [2024-07-13 10:16:14.477288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.477475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.477529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.740 qpair failed and we were unable to recover it. 00:30:08.740 [2024-07-13 10:16:14.477724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.477877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.477902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.740 qpair failed and we were unable to recover it. 00:30:08.740 [2024-07-13 10:16:14.478084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.478322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.478377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.740 qpair failed and we were unable to recover it. 00:30:08.740 [2024-07-13 10:16:14.478523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.478698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.478722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.740 qpair failed and we were unable to recover it. 00:30:08.740 [2024-07-13 10:16:14.478902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.479118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.479170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.740 qpair failed and we were unable to recover it. 00:30:08.740 [2024-07-13 10:16:14.479342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.479469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.479492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.740 qpair failed and we were unable to recover it. 00:30:08.740 [2024-07-13 10:16:14.479641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.479762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.479786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.740 qpair failed and we were unable to recover it. 00:30:08.740 [2024-07-13 10:16:14.479937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.480105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.480132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.740 qpair failed and we were unable to recover it. 00:30:08.740 [2024-07-13 10:16:14.480310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.480432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.480455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.740 qpair failed and we were unable to recover it. 00:30:08.740 [2024-07-13 10:16:14.480629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.480779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.480802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.740 qpair failed and we were unable to recover it. 00:30:08.740 [2024-07-13 10:16:14.481000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.481120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.481143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.740 qpair failed and we were unable to recover it. 00:30:08.740 [2024-07-13 10:16:14.481314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.481519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.481543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.740 qpair failed and we were unable to recover it. 00:30:08.740 [2024-07-13 10:16:14.481711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.481879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.481905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.740 qpair failed and we were unable to recover it. 00:30:08.740 [2024-07-13 10:16:14.482060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.482212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.482252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.740 qpair failed and we were unable to recover it. 00:30:08.740 [2024-07-13 10:16:14.482483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.482660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.482686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.740 qpair failed and we were unable to recover it. 00:30:08.740 [2024-07-13 10:16:14.482862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.483032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.483060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.740 qpair failed and we were unable to recover it. 00:30:08.740 [2024-07-13 10:16:14.483242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.483429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.483455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.740 qpair failed and we were unable to recover it. 00:30:08.740 [2024-07-13 10:16:14.483598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.483744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.483768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.740 qpair failed and we were unable to recover it. 00:30:08.740 [2024-07-13 10:16:14.483953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.484087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.484112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.740 qpair failed and we were unable to recover it. 00:30:08.740 [2024-07-13 10:16:14.484300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.484459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.484513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.740 qpair failed and we were unable to recover it. 00:30:08.740 [2024-07-13 10:16:14.484666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.484814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.484838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.740 qpair failed and we were unable to recover it. 00:30:08.740 [2024-07-13 10:16:14.484988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.485135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.485175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.740 qpair failed and we were unable to recover it. 00:30:08.740 [2024-07-13 10:16:14.485337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.485557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.485613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.740 qpair failed and we were unable to recover it. 00:30:08.740 [2024-07-13 10:16:14.485818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.740 [2024-07-13 10:16:14.485941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.485966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.741 qpair failed and we were unable to recover it. 00:30:08.741 [2024-07-13 10:16:14.486109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.486307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.486331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.741 qpair failed and we were unable to recover it. 00:30:08.741 [2024-07-13 10:16:14.486464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.486596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.486621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.741 qpair failed and we were unable to recover it. 00:30:08.741 [2024-07-13 10:16:14.486796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.486998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.487023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.741 qpair failed and we were unable to recover it. 00:30:08.741 [2024-07-13 10:16:14.487196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.487312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.487336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.741 qpair failed and we were unable to recover it. 00:30:08.741 [2024-07-13 10:16:14.487464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.487631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.487658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.741 qpair failed and we were unable to recover it. 00:30:08.741 [2024-07-13 10:16:14.487821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.487982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.488011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.741 qpair failed and we were unable to recover it. 00:30:08.741 [2024-07-13 10:16:14.488179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.488291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.488315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.741 qpair failed and we were unable to recover it. 00:30:08.741 [2024-07-13 10:16:14.488490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.488660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.488687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.741 qpair failed and we were unable to recover it. 00:30:08.741 [2024-07-13 10:16:14.488845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.489038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.489062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.741 qpair failed and we were unable to recover it. 00:30:08.741 [2024-07-13 10:16:14.489182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.489362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.489403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.741 qpair failed and we were unable to recover it. 00:30:08.741 [2024-07-13 10:16:14.489674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.489890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.489922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.741 qpair failed and we were unable to recover it. 00:30:08.741 [2024-07-13 10:16:14.490088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.490227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.490254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.741 qpair failed and we were unable to recover it. 00:30:08.741 [2024-07-13 10:16:14.490442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.490627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.490679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.741 qpair failed and we were unable to recover it. 00:30:08.741 [2024-07-13 10:16:14.490842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.491004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.491046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.741 qpair failed and we were unable to recover it. 00:30:08.741 [2024-07-13 10:16:14.491211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.491472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.491523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.741 qpair failed and we were unable to recover it. 00:30:08.741 [2024-07-13 10:16:14.491645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.491836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.491863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.741 qpair failed and we were unable to recover it. 00:30:08.741 [2024-07-13 10:16:14.492044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.492280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.492329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.741 qpair failed and we were unable to recover it. 00:30:08.741 [2024-07-13 10:16:14.492497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.492643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.492683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.741 qpair failed and we were unable to recover it. 00:30:08.741 [2024-07-13 10:16:14.492851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.492996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.493023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.741 qpair failed and we were unable to recover it. 00:30:08.741 [2024-07-13 10:16:14.493188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.493375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.493402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.741 qpair failed and we were unable to recover it. 00:30:08.741 [2024-07-13 10:16:14.493564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.493729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.493755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.741 qpair failed and we were unable to recover it. 00:30:08.741 [2024-07-13 10:16:14.493927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.494055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.494080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.741 qpair failed and we were unable to recover it. 00:30:08.741 [2024-07-13 10:16:14.494235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.494479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.494529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.741 qpair failed and we were unable to recover it. 00:30:08.741 [2024-07-13 10:16:14.494721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.494965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.494993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.741 qpair failed and we were unable to recover it. 00:30:08.741 [2024-07-13 10:16:14.495160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.495327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.495355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.741 qpair failed and we were unable to recover it. 00:30:08.741 [2024-07-13 10:16:14.495528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.495653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.495677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.741 qpair failed and we were unable to recover it. 00:30:08.741 [2024-07-13 10:16:14.495891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.496101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.496149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.741 qpair failed and we were unable to recover it. 00:30:08.741 [2024-07-13 10:16:14.496304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.496490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.496517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.741 qpair failed and we were unable to recover it. 00:30:08.741 [2024-07-13 10:16:14.496656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.496820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.741 [2024-07-13 10:16:14.496847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.741 qpair failed and we were unable to recover it. 00:30:08.742 [2024-07-13 10:16:14.497033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.497186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.497211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.742 qpair failed and we were unable to recover it. 00:30:08.742 [2024-07-13 10:16:14.497356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.497539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.497564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.742 qpair failed and we were unable to recover it. 00:30:08.742 [2024-07-13 10:16:14.497708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.497855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.497896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.742 qpair failed and we were unable to recover it. 00:30:08.742 [2024-07-13 10:16:14.498069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.498237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.498264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.742 qpair failed and we were unable to recover it. 00:30:08.742 [2024-07-13 10:16:14.498439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.498584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.498608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.742 qpair failed and we were unable to recover it. 00:30:08.742 [2024-07-13 10:16:14.498832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.498988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.499012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.742 qpair failed and we were unable to recover it. 00:30:08.742 [2024-07-13 10:16:14.499209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.499440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.499494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.742 qpair failed and we were unable to recover it. 00:30:08.742 [2024-07-13 10:16:14.499663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.499824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.499853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.742 qpair failed and we were unable to recover it. 00:30:08.742 [2024-07-13 10:16:14.500058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.500189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.500214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.742 qpair failed and we were unable to recover it. 00:30:08.742 [2024-07-13 10:16:14.500361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.500511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.500535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.742 qpair failed and we were unable to recover it. 00:30:08.742 [2024-07-13 10:16:14.500704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.500913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.500941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.742 qpair failed and we were unable to recover it. 00:30:08.742 [2024-07-13 10:16:14.501131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.501350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.501408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.742 qpair failed and we were unable to recover it. 00:30:08.742 [2024-07-13 10:16:14.501559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.501710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.501734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.742 qpair failed and we were unable to recover it. 00:30:08.742 [2024-07-13 10:16:14.501948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.502162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.502207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.742 qpair failed and we were unable to recover it. 00:30:08.742 [2024-07-13 10:16:14.502362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.502538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.502573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.742 qpair failed and we were unable to recover it. 00:30:08.742 [2024-07-13 10:16:14.502736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.502930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.502959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.742 qpair failed and we were unable to recover it. 00:30:08.742 [2024-07-13 10:16:14.503128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.503300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.503324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.742 qpair failed and we were unable to recover it. 00:30:08.742 [2024-07-13 10:16:14.503462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.503648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.503673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.742 qpair failed and we were unable to recover it. 00:30:08.742 [2024-07-13 10:16:14.503804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.503952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.503977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.742 qpair failed and we were unable to recover it. 00:30:08.742 [2024-07-13 10:16:14.504096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.504265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.504292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.742 qpair failed and we were unable to recover it. 00:30:08.742 [2024-07-13 10:16:14.504467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.504643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.504674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.742 qpair failed and we were unable to recover it. 00:30:08.742 [2024-07-13 10:16:14.504826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.504983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:08.742 [2024-07-13 10:16:14.505012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:08.742 qpair failed and we were unable to recover it. 00:30:09.029 [2024-07-13 10:16:14.505151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.029 [2024-07-13 10:16:14.505282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.029 [2024-07-13 10:16:14.505310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.029 qpair failed and we were unable to recover it. 00:30:09.029 [2024-07-13 10:16:14.505466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.029 [2024-07-13 10:16:14.505625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.029 [2024-07-13 10:16:14.505651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.029 qpair failed and we were unable to recover it. 00:30:09.029 [2024-07-13 10:16:14.505852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.029 [2024-07-13 10:16:14.506019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.029 [2024-07-13 10:16:14.506060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.029 qpair failed and we were unable to recover it. 00:30:09.029 [2024-07-13 10:16:14.506208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.029 [2024-07-13 10:16:14.506352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.029 [2024-07-13 10:16:14.506378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.029 qpair failed and we were unable to recover it. 00:30:09.029 [2024-07-13 10:16:14.506538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.029 [2024-07-13 10:16:14.506702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.029 [2024-07-13 10:16:14.506731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.029 qpair failed and we were unable to recover it. 00:30:09.029 [2024-07-13 10:16:14.506924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.029 [2024-07-13 10:16:14.507060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.029 [2024-07-13 10:16:14.507087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.029 qpair failed and we were unable to recover it. 00:30:09.029 [2024-07-13 10:16:14.507277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.507409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.507437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.030 qpair failed and we were unable to recover it. 00:30:09.030 [2024-07-13 10:16:14.507597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.507804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.507831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.030 qpair failed and we were unable to recover it. 00:30:09.030 [2024-07-13 10:16:14.507966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.508114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.508144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.030 qpair failed and we were unable to recover it. 00:30:09.030 [2024-07-13 10:16:14.508355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.508484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.508508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.030 qpair failed and we were unable to recover it. 00:30:09.030 [2024-07-13 10:16:14.508658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.508839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.508873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.030 qpair failed and we were unable to recover it. 00:30:09.030 [2024-07-13 10:16:14.509066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.509252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.509277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.030 qpair failed and we were unable to recover it. 00:30:09.030 [2024-07-13 10:16:14.509425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.509558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.509584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.030 qpair failed and we were unable to recover it. 00:30:09.030 [2024-07-13 10:16:14.509727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.509904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.509929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.030 qpair failed and we were unable to recover it. 00:30:09.030 [2024-07-13 10:16:14.510106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.510284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.510308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.030 qpair failed and we were unable to recover it. 00:30:09.030 [2024-07-13 10:16:14.510446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.510592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.510616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.030 qpair failed and we were unable to recover it. 00:30:09.030 [2024-07-13 10:16:14.510737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.510859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.510890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.030 qpair failed and we were unable to recover it. 00:30:09.030 [2024-07-13 10:16:14.511043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.511233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.511259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.030 qpair failed and we were unable to recover it. 00:30:09.030 [2024-07-13 10:16:14.511401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.511532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.511560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.030 qpair failed and we were unable to recover it. 00:30:09.030 [2024-07-13 10:16:14.511732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.511853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.511898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.030 qpair failed and we were unable to recover it. 00:30:09.030 [2024-07-13 10:16:14.512032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.512150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.512174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.030 qpair failed and we were unable to recover it. 00:30:09.030 [2024-07-13 10:16:14.512320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.512451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.512474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.030 qpair failed and we were unable to recover it. 00:30:09.030 [2024-07-13 10:16:14.512686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.512841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.512873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.030 qpair failed and we were unable to recover it. 00:30:09.030 [2024-07-13 10:16:14.513035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.513163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.513187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.030 qpair failed and we were unable to recover it. 00:30:09.030 [2024-07-13 10:16:14.513310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.513439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.513463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.030 qpair failed and we were unable to recover it. 00:30:09.030 [2024-07-13 10:16:14.513584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.513729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.513752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.030 qpair failed and we were unable to recover it. 00:30:09.030 [2024-07-13 10:16:14.513884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.514033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.514075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.030 qpair failed and we were unable to recover it. 00:30:09.030 [2024-07-13 10:16:14.514220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.514373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.514397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.030 qpair failed and we were unable to recover it. 00:30:09.030 [2024-07-13 10:16:14.514576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.514724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.514747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.030 qpair failed and we were unable to recover it. 00:30:09.030 [2024-07-13 10:16:14.514894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.515062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.515087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.030 qpair failed and we were unable to recover it. 00:30:09.030 [2024-07-13 10:16:14.515323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.515492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.515520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.030 qpair failed and we were unable to recover it. 00:30:09.030 [2024-07-13 10:16:14.515687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.515859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.515925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.030 qpair failed and we were unable to recover it. 00:30:09.030 [2024-07-13 10:16:14.516110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.516299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.516328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.030 qpair failed and we were unable to recover it. 00:30:09.030 [2024-07-13 10:16:14.516500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.516672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.516701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.030 qpair failed and we were unable to recover it. 00:30:09.030 [2024-07-13 10:16:14.516886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.517046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.517087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.030 qpair failed and we were unable to recover it. 00:30:09.030 [2024-07-13 10:16:14.517294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.517451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.517476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.030 qpair failed and we were unable to recover it. 00:30:09.030 [2024-07-13 10:16:14.517657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.030 [2024-07-13 10:16:14.517785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.517810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.031 qpair failed and we were unable to recover it. 00:30:09.031 [2024-07-13 10:16:14.518011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.518152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.518180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.031 qpair failed and we were unable to recover it. 00:30:09.031 [2024-07-13 10:16:14.518361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.518560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.518588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.031 qpair failed and we were unable to recover it. 00:30:09.031 [2024-07-13 10:16:14.518794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.518950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.518976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.031 qpair failed and we were unable to recover it. 00:30:09.031 [2024-07-13 10:16:14.519159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.519333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.519362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.031 qpair failed and we were unable to recover it. 00:30:09.031 [2024-07-13 10:16:14.519530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.519708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.519741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.031 qpair failed and we were unable to recover it. 00:30:09.031 [2024-07-13 10:16:14.520878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.521081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.521110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.031 qpair failed and we were unable to recover it. 00:30:09.031 [2024-07-13 10:16:14.521273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.521430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.521455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.031 qpair failed and we were unable to recover it. 00:30:09.031 [2024-07-13 10:16:14.521613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.521772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.521798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.031 qpair failed and we were unable to recover it. 00:30:09.031 [2024-07-13 10:16:14.521979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.522142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.522171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.031 qpair failed and we were unable to recover it. 00:30:09.031 [2024-07-13 10:16:14.522350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.522541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.522566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.031 qpair failed and we were unable to recover it. 00:30:09.031 [2024-07-13 10:16:14.522723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.522854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.522888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.031 qpair failed and we were unable to recover it. 00:30:09.031 [2024-07-13 10:16:14.523025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.523201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.523227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.031 qpair failed and we were unable to recover it. 00:30:09.031 [2024-07-13 10:16:14.523412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.525899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.525933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.031 qpair failed and we were unable to recover it. 00:30:09.031 [2024-07-13 10:16:14.526122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.526259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.526284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.031 qpair failed and we were unable to recover it. 00:30:09.031 [2024-07-13 10:16:14.526469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.526600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.526629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.031 qpair failed and we were unable to recover it. 00:30:09.031 [2024-07-13 10:16:14.526784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.526938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.526964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.031 qpair failed and we were unable to recover it. 00:30:09.031 [2024-07-13 10:16:14.527177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.527339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.527365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.031 qpair failed and we were unable to recover it. 00:30:09.031 [2024-07-13 10:16:14.527492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.527626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.527651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.031 qpair failed and we were unable to recover it. 00:30:09.031 [2024-07-13 10:16:14.527806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.527980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.528009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.031 qpair failed and we were unable to recover it. 00:30:09.031 [2024-07-13 10:16:14.528179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.528349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.528377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.031 qpair failed and we were unable to recover it. 00:30:09.031 [2024-07-13 10:16:14.528567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.528689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.528714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.031 qpair failed and we were unable to recover it. 00:30:09.031 [2024-07-13 10:16:14.528874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.529068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.529092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.031 qpair failed and we were unable to recover it. 00:30:09.031 [2024-07-13 10:16:14.529287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.529411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.529436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.031 qpair failed and we were unable to recover it. 00:30:09.031 [2024-07-13 10:16:14.529588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.529741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.529766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.031 qpair failed and we were unable to recover it. 00:30:09.031 [2024-07-13 10:16:14.529923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.530108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.530141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.031 qpair failed and we were unable to recover it. 00:30:09.031 [2024-07-13 10:16:14.530341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.530517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.530545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.031 qpair failed and we were unable to recover it. 00:30:09.031 [2024-07-13 10:16:14.530705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.530853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.530885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.031 qpair failed and we were unable to recover it. 00:30:09.031 [2024-07-13 10:16:14.531055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.531186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.531211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.031 qpair failed and we were unable to recover it. 00:30:09.031 [2024-07-13 10:16:14.531350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.531567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.031 [2024-07-13 10:16:14.531593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.031 qpair failed and we were unable to recover it. 00:30:09.031 [2024-07-13 10:16:14.534880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.535066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.535094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.032 qpair failed and we were unable to recover it. 00:30:09.032 [2024-07-13 10:16:14.535297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.535421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.535446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.032 qpair failed and we were unable to recover it. 00:30:09.032 [2024-07-13 10:16:14.535604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.535740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.535784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.032 qpair failed and we were unable to recover it. 00:30:09.032 [2024-07-13 10:16:14.535981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.536108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.536133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.032 qpair failed and we were unable to recover it. 00:30:09.032 [2024-07-13 10:16:14.536343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.536523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.536565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.032 qpair failed and we were unable to recover it. 00:30:09.032 [2024-07-13 10:16:14.536756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.536881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.536917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.032 qpair failed and we were unable to recover it. 00:30:09.032 [2024-07-13 10:16:14.537060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.537194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.537219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.032 qpair failed and we were unable to recover it. 00:30:09.032 [2024-07-13 10:16:14.537370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.537498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.537524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.032 qpair failed and we were unable to recover it. 00:30:09.032 [2024-07-13 10:16:14.537680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.537802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.537827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.032 qpair failed and we were unable to recover it. 00:30:09.032 [2024-07-13 10:16:14.538025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.538180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.538209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.032 qpair failed and we were unable to recover it. 00:30:09.032 [2024-07-13 10:16:14.538360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.538529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.538557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.032 qpair failed and we were unable to recover it. 00:30:09.032 [2024-07-13 10:16:14.538694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.538873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.538901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.032 qpair failed and we were unable to recover it. 00:30:09.032 [2024-07-13 10:16:14.539056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.539218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.539243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.032 qpair failed and we were unable to recover it. 00:30:09.032 [2024-07-13 10:16:14.539426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.539549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.539574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.032 qpair failed and we were unable to recover it. 00:30:09.032 [2024-07-13 10:16:14.539730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.539922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.539948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.032 qpair failed and we were unable to recover it. 00:30:09.032 [2024-07-13 10:16:14.540101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.540292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.540320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.032 qpair failed and we were unable to recover it. 00:30:09.032 [2024-07-13 10:16:14.540505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.540677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.540704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.032 qpair failed and we were unable to recover it. 00:30:09.032 [2024-07-13 10:16:14.540891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.541048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.541073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.032 qpair failed and we were unable to recover it. 00:30:09.032 [2024-07-13 10:16:14.541248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.541371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.541396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.032 qpair failed and we were unable to recover it. 00:30:09.032 [2024-07-13 10:16:14.541553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.541717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.541742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.032 qpair failed and we were unable to recover it. 00:30:09.032 [2024-07-13 10:16:14.541926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.542102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.542130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.032 qpair failed and we were unable to recover it. 00:30:09.032 [2024-07-13 10:16:14.544881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.545095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.545133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.032 qpair failed and we were unable to recover it. 00:30:09.032 [2024-07-13 10:16:14.545318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.545518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.545546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.032 qpair failed and we were unable to recover it. 00:30:09.032 [2024-07-13 10:16:14.545727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.545921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.545946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.032 qpair failed and we were unable to recover it. 00:30:09.032 [2024-07-13 10:16:14.546109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.546265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.546291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.032 qpair failed and we were unable to recover it. 00:30:09.032 [2024-07-13 10:16:14.546466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.546641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.546668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.032 qpair failed and we were unable to recover it. 00:30:09.032 [2024-07-13 10:16:14.546881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.547061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.547088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.032 qpair failed and we were unable to recover it. 00:30:09.032 [2024-07-13 10:16:14.547260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.547435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.547464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.032 qpair failed and we were unable to recover it. 00:30:09.032 [2024-07-13 10:16:14.547636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.547816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.547842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.032 qpair failed and we were unable to recover it. 00:30:09.032 [2024-07-13 10:16:14.548007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.548199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.032 [2024-07-13 10:16:14.548225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.032 qpair failed and we were unable to recover it. 00:30:09.032 [2024-07-13 10:16:14.548363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.548518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.548543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.033 qpair failed and we were unable to recover it. 00:30:09.033 [2024-07-13 10:16:14.548720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.548905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.548932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.033 qpair failed and we were unable to recover it. 00:30:09.033 [2024-07-13 10:16:14.549086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.549220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.549249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.033 qpair failed and we were unable to recover it. 00:30:09.033 [2024-07-13 10:16:14.549403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.549533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.549558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.033 qpair failed and we were unable to recover it. 00:30:09.033 [2024-07-13 10:16:14.549703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.549853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.549900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.033 qpair failed and we were unable to recover it. 00:30:09.033 [2024-07-13 10:16:14.550070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.550207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.550245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.033 qpair failed and we were unable to recover it. 00:30:09.033 [2024-07-13 10:16:14.550419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.550554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.550583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.033 qpair failed and we were unable to recover it. 00:30:09.033 [2024-07-13 10:16:14.550773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.550918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.550944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.033 qpair failed and we were unable to recover it. 00:30:09.033 [2024-07-13 10:16:14.551081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.551224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.551250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.033 qpair failed and we were unable to recover it. 00:30:09.033 [2024-07-13 10:16:14.553880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.554096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.554124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.033 qpair failed and we were unable to recover it. 00:30:09.033 [2024-07-13 10:16:14.554299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.554500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.554528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.033 qpair failed and we were unable to recover it. 00:30:09.033 [2024-07-13 10:16:14.554683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.554849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.554886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.033 qpair failed and we were unable to recover it. 00:30:09.033 [2024-07-13 10:16:14.555116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.555272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.555297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.033 qpair failed and we were unable to recover it. 00:30:09.033 [2024-07-13 10:16:14.555453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.555630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.555655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.033 qpair failed and we were unable to recover it. 00:30:09.033 [2024-07-13 10:16:14.555830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.556030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.556056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.033 qpair failed and we were unable to recover it. 00:30:09.033 [2024-07-13 10:16:14.556240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.556390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.556418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.033 qpair failed and we were unable to recover it. 00:30:09.033 [2024-07-13 10:16:14.556612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.556804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.556829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.033 qpair failed and we were unable to recover it. 00:30:09.033 [2024-07-13 10:16:14.557022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.557180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.557205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.033 qpair failed and we were unable to recover it. 00:30:09.033 [2024-07-13 10:16:14.557364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.557494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.557519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.033 qpair failed and we were unable to recover it. 00:30:09.033 [2024-07-13 10:16:14.557705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.557937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.557964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.033 qpair failed and we were unable to recover it. 00:30:09.033 [2024-07-13 10:16:14.558121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.558302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.558327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.033 qpair failed and we were unable to recover it. 00:30:09.033 [2024-07-13 10:16:14.558461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.558612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.558637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.033 qpair failed and we were unable to recover it. 00:30:09.033 [2024-07-13 10:16:14.558812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.559006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.559034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.033 qpair failed and we were unable to recover it. 00:30:09.033 [2024-07-13 10:16:14.559195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.559355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.559380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.033 qpair failed and we were unable to recover it. 00:30:09.033 [2024-07-13 10:16:14.559562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.559756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.559783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.033 qpair failed and we were unable to recover it. 00:30:09.033 [2024-07-13 10:16:14.559938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.560137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.560165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.033 qpair failed and we were unable to recover it. 00:30:09.033 [2024-07-13 10:16:14.562885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.563094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.563124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.033 qpair failed and we were unable to recover it. 00:30:09.033 [2024-07-13 10:16:14.563305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.563536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.563566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.033 qpair failed and we were unable to recover it. 00:30:09.033 [2024-07-13 10:16:14.563747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.563917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.563946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.033 qpair failed and we were unable to recover it. 00:30:09.033 [2024-07-13 10:16:14.564113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.564315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.564343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.033 qpair failed and we were unable to recover it. 00:30:09.033 [2024-07-13 10:16:14.564481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.033 [2024-07-13 10:16:14.564640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.564669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.034 qpair failed and we were unable to recover it. 00:30:09.034 [2024-07-13 10:16:14.564878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.565011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.565037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.034 qpair failed and we were unable to recover it. 00:30:09.034 [2024-07-13 10:16:14.565195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.565381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.565411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.034 qpair failed and we were unable to recover it. 00:30:09.034 [2024-07-13 10:16:14.565581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.565721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.565751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.034 qpair failed and we were unable to recover it. 00:30:09.034 [2024-07-13 10:16:14.565945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.566130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.566156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.034 qpair failed and we were unable to recover it. 00:30:09.034 [2024-07-13 10:16:14.566304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.566429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.566456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.034 qpair failed and we were unable to recover it. 00:30:09.034 [2024-07-13 10:16:14.566640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.566809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.566839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.034 qpair failed and we were unable to recover it. 00:30:09.034 [2024-07-13 10:16:14.567068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.567242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.567270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.034 qpair failed and we were unable to recover it. 00:30:09.034 [2024-07-13 10:16:14.567456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.567583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.567609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.034 qpair failed and we were unable to recover it. 00:30:09.034 [2024-07-13 10:16:14.567789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.567975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.568001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.034 qpair failed and we were unable to recover it. 00:30:09.034 [2024-07-13 10:16:14.568154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.568302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.568327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.034 qpair failed and we were unable to recover it. 00:30:09.034 [2024-07-13 10:16:14.568487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.568613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.568639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.034 qpair failed and we were unable to recover it. 00:30:09.034 [2024-07-13 10:16:14.568777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.568946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.568974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.034 qpair failed and we were unable to recover it. 00:30:09.034 [2024-07-13 10:16:14.569113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.569269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.569293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.034 qpair failed and we were unable to recover it. 00:30:09.034 [2024-07-13 10:16:14.569421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.569563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.569587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.034 qpair failed and we were unable to recover it. 00:30:09.034 [2024-07-13 10:16:14.569739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.569892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.569917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.034 qpair failed and we were unable to recover it. 00:30:09.034 [2024-07-13 10:16:14.570048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.570262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.570322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.034 qpair failed and we were unable to recover it. 00:30:09.034 [2024-07-13 10:16:14.570495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.570649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.570673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.034 qpair failed and we were unable to recover it. 00:30:09.034 [2024-07-13 10:16:14.570823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.570953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.570978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.034 qpair failed and we were unable to recover it. 00:30:09.034 [2024-07-13 10:16:14.571141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.571349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.571400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.034 qpair failed and we were unable to recover it. 00:30:09.034 [2024-07-13 10:16:14.571567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.571730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.571758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.034 qpair failed and we were unable to recover it. 00:30:09.034 [2024-07-13 10:16:14.571936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.572093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.572117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.034 qpair failed and we were unable to recover it. 00:30:09.034 [2024-07-13 10:16:14.572302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.572455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.572479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.034 qpair failed and we were unable to recover it. 00:30:09.034 [2024-07-13 10:16:14.572603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.572794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.572822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.034 qpair failed and we were unable to recover it. 00:30:09.034 [2024-07-13 10:16:14.572974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.034 [2024-07-13 10:16:14.573128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.573153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.035 qpair failed and we were unable to recover it. 00:30:09.035 [2024-07-13 10:16:14.573305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.573453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.573477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.035 qpair failed and we were unable to recover it. 00:30:09.035 [2024-07-13 10:16:14.573631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.573850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.573885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.035 qpair failed and we were unable to recover it. 00:30:09.035 [2024-07-13 10:16:14.574035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.574281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.574331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.035 qpair failed and we were unable to recover it. 00:30:09.035 [2024-07-13 10:16:14.574470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.574658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.574685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.035 qpair failed and we were unable to recover it. 00:30:09.035 [2024-07-13 10:16:14.574825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.575013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.575039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.035 qpair failed and we were unable to recover it. 00:30:09.035 [2024-07-13 10:16:14.575170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.575320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.575345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.035 qpair failed and we were unable to recover it. 00:30:09.035 [2024-07-13 10:16:14.575498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.575677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.575701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.035 qpair failed and we were unable to recover it. 00:30:09.035 [2024-07-13 10:16:14.575851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.576017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.576042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.035 qpair failed and we were unable to recover it. 00:30:09.035 [2024-07-13 10:16:14.576195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.576320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.576345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.035 qpair failed and we were unable to recover it. 00:30:09.035 [2024-07-13 10:16:14.576471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.576646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.576671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.035 qpair failed and we were unable to recover it. 00:30:09.035 [2024-07-13 10:16:14.576884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.577042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.577067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.035 qpair failed and we were unable to recover it. 00:30:09.035 [2024-07-13 10:16:14.577218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.577350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.577375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.035 qpair failed and we were unable to recover it. 00:30:09.035 [2024-07-13 10:16:14.577560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.577692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.577720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.035 qpair failed and we were unable to recover it. 00:30:09.035 [2024-07-13 10:16:14.577925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.578079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.578104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.035 qpair failed and we were unable to recover it. 00:30:09.035 [2024-07-13 10:16:14.578252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.578427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.578456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.035 qpair failed and we were unable to recover it. 00:30:09.035 [2024-07-13 10:16:14.578651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.578791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.578820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.035 qpair failed and we were unable to recover it. 00:30:09.035 [2024-07-13 10:16:14.579023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.579177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.579201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.035 qpair failed and we were unable to recover it. 00:30:09.035 [2024-07-13 10:16:14.579376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.579509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.579533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.035 qpair failed and we were unable to recover it. 00:30:09.035 [2024-07-13 10:16:14.579650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.579765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.579790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.035 qpair failed and we were unable to recover it. 00:30:09.035 [2024-07-13 10:16:14.579913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.580036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.580062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.035 qpair failed and we were unable to recover it. 00:30:09.035 [2024-07-13 10:16:14.580187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.580322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.580348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.035 qpair failed and we were unable to recover it. 00:30:09.035 [2024-07-13 10:16:14.580497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.580651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.580676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.035 qpair failed and we were unable to recover it. 00:30:09.035 [2024-07-13 10:16:14.580856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.581011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.581036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.035 qpair failed and we were unable to recover it. 00:30:09.035 [2024-07-13 10:16:14.581152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.581303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.581327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.035 qpair failed and we were unable to recover it. 00:30:09.035 [2024-07-13 10:16:14.581487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.581617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.581641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.035 qpair failed and we were unable to recover it. 00:30:09.035 [2024-07-13 10:16:14.581824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.582031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.582059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.035 qpair failed and we were unable to recover it. 00:30:09.035 [2024-07-13 10:16:14.582217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.582383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.582410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.035 qpair failed and we were unable to recover it. 00:30:09.035 [2024-07-13 10:16:14.582548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.582754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.582779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.035 qpair failed and we were unable to recover it. 00:30:09.035 [2024-07-13 10:16:14.582914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.583038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.583062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.035 qpair failed and we were unable to recover it. 00:30:09.035 [2024-07-13 10:16:14.583244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.583368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.035 [2024-07-13 10:16:14.583392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.036 qpair failed and we were unable to recover it. 00:30:09.036 [2024-07-13 10:16:14.583524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.583708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.583736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.036 qpair failed and we were unable to recover it. 00:30:09.036 [2024-07-13 10:16:14.583930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.584133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.584165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.036 qpair failed and we were unable to recover it. 00:30:09.036 [2024-07-13 10:16:14.584365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.584494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.584520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.036 qpair failed and we were unable to recover it. 00:30:09.036 [2024-07-13 10:16:14.584646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.584772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.584797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.036 qpair failed and we were unable to recover it. 00:30:09.036 [2024-07-13 10:16:14.584928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.585097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.585123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.036 qpair failed and we were unable to recover it. 00:30:09.036 [2024-07-13 10:16:14.585263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.585399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.585428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.036 qpair failed and we were unable to recover it. 00:30:09.036 [2024-07-13 10:16:14.585579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.585727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.585752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.036 qpair failed and we were unable to recover it. 00:30:09.036 [2024-07-13 10:16:14.585932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.586051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.586075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.036 qpair failed and we were unable to recover it. 00:30:09.036 [2024-07-13 10:16:14.586236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.586413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.586437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.036 qpair failed and we were unable to recover it. 00:30:09.036 [2024-07-13 10:16:14.586585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.586734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.586761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.036 qpair failed and we were unable to recover it. 00:30:09.036 [2024-07-13 10:16:14.586904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.587036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.587062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.036 qpair failed and we were unable to recover it. 00:30:09.036 [2024-07-13 10:16:14.587181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.587328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.587358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.036 qpair failed and we were unable to recover it. 00:30:09.036 [2024-07-13 10:16:14.587506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.587653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.587677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.036 qpair failed and we were unable to recover it. 00:30:09.036 [2024-07-13 10:16:14.587826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.587981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.588006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.036 qpair failed and we were unable to recover it. 00:30:09.036 [2024-07-13 10:16:14.588158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.588305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.588330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.036 qpair failed and we were unable to recover it. 00:30:09.036 [2024-07-13 10:16:14.588539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.588707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.588735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.036 qpair failed and we were unable to recover it. 00:30:09.036 [2024-07-13 10:16:14.588917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.589083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.589110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.036 qpair failed and we were unable to recover it. 00:30:09.036 [2024-07-13 10:16:14.589302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.589535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.589585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.036 qpair failed and we were unable to recover it. 00:30:09.036 [2024-07-13 10:16:14.589779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.589907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.589932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.036 qpair failed and we were unable to recover it. 00:30:09.036 [2024-07-13 10:16:14.590126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.590310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.590366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.036 qpair failed and we were unable to recover it. 00:30:09.036 [2024-07-13 10:16:14.590560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.590740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.590767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.036 qpair failed and we were unable to recover it. 00:30:09.036 [2024-07-13 10:16:14.590912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.591095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.591124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.036 qpair failed and we were unable to recover it. 00:30:09.036 [2024-07-13 10:16:14.591276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.591438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.591463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.036 qpair failed and we were unable to recover it. 00:30:09.036 [2024-07-13 10:16:14.591636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.591800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.591826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.036 qpair failed and we were unable to recover it. 00:30:09.036 [2024-07-13 10:16:14.591969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.592112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.592140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.036 qpair failed and we were unable to recover it. 00:30:09.036 [2024-07-13 10:16:14.592304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.592544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.592594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.036 qpair failed and we were unable to recover it. 00:30:09.036 [2024-07-13 10:16:14.592776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.592977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.593005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.036 qpair failed and we were unable to recover it. 00:30:09.036 [2024-07-13 10:16:14.593151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.593298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.593325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.036 qpair failed and we were unable to recover it. 00:30:09.036 [2024-07-13 10:16:14.593530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.593718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.593745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.036 qpair failed and we were unable to recover it. 00:30:09.036 [2024-07-13 10:16:14.593919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.594043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.036 [2024-07-13 10:16:14.594067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.036 qpair failed and we were unable to recover it. 00:30:09.037 [2024-07-13 10:16:14.594220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.594366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.594390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.037 qpair failed and we were unable to recover it. 00:30:09.037 [2024-07-13 10:16:14.594542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.594664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.594694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.037 qpair failed and we were unable to recover it. 00:30:09.037 [2024-07-13 10:16:14.594849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.595047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.595073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.037 qpair failed and we were unable to recover it. 00:30:09.037 [2024-07-13 10:16:14.595227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.595438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.595488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.037 qpair failed and we were unable to recover it. 00:30:09.037 [2024-07-13 10:16:14.595683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.595807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.595831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.037 qpair failed and we were unable to recover it. 00:30:09.037 [2024-07-13 10:16:14.595969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.596105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.596129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.037 qpair failed and we were unable to recover it. 00:30:09.037 [2024-07-13 10:16:14.596279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.596431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.596457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.037 qpair failed and we were unable to recover it. 00:30:09.037 [2024-07-13 10:16:14.596577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.596729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.596752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.037 qpair failed and we were unable to recover it. 00:30:09.037 [2024-07-13 10:16:14.596917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.597063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.597087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.037 qpair failed and we were unable to recover it. 00:30:09.037 [2024-07-13 10:16:14.597216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.597391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.597431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.037 qpair failed and we were unable to recover it. 00:30:09.037 [2024-07-13 10:16:14.597608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.597755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.597779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.037 qpair failed and we were unable to recover it. 00:30:09.037 [2024-07-13 10:16:14.597926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.598093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.598120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.037 qpair failed and we were unable to recover it. 00:30:09.037 [2024-07-13 10:16:14.598303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.598454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.598478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.037 qpair failed and we were unable to recover it. 00:30:09.037 [2024-07-13 10:16:14.598627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.598756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.598780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.037 qpair failed and we were unable to recover it. 00:30:09.037 [2024-07-13 10:16:14.598957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.599085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.599109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.037 qpair failed and we were unable to recover it. 00:30:09.037 [2024-07-13 10:16:14.599279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.599393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.599418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.037 qpair failed and we were unable to recover it. 00:30:09.037 [2024-07-13 10:16:14.599566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.599691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.599715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.037 qpair failed and we were unable to recover it. 00:30:09.037 [2024-07-13 10:16:14.599873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.600050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.600074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.037 qpair failed and we were unable to recover it. 00:30:09.037 [2024-07-13 10:16:14.600205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.600354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.600378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.037 qpair failed and we were unable to recover it. 00:30:09.037 [2024-07-13 10:16:14.600542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.600688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.600712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.037 qpair failed and we were unable to recover it. 00:30:09.037 [2024-07-13 10:16:14.600859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.601059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.601082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.037 qpair failed and we were unable to recover it. 00:30:09.037 [2024-07-13 10:16:14.601233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.601382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.601423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.037 qpair failed and we were unable to recover it. 00:30:09.037 [2024-07-13 10:16:14.601675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.601861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.601895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.037 qpair failed and we were unable to recover it. 00:30:09.037 [2024-07-13 10:16:14.602060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.602259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.602309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.037 qpair failed and we were unable to recover it. 00:30:09.037 [2024-07-13 10:16:14.602485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.602639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.602663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.037 qpair failed and we were unable to recover it. 00:30:09.037 [2024-07-13 10:16:14.602816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.602972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.602998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.037 qpair failed and we were unable to recover it. 00:30:09.037 [2024-07-13 10:16:14.603126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.603253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.603280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.037 qpair failed and we were unable to recover it. 00:30:09.037 [2024-07-13 10:16:14.603526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.603739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.603766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.037 qpair failed and we were unable to recover it. 00:30:09.037 [2024-07-13 10:16:14.603936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.604079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.604105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.037 qpair failed and we were unable to recover it. 00:30:09.037 [2024-07-13 10:16:14.604249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.604401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.037 [2024-07-13 10:16:14.604426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.037 qpair failed and we were unable to recover it. 00:30:09.038 [2024-07-13 10:16:14.604551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.604721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.604748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.038 qpair failed and we were unable to recover it. 00:30:09.038 [2024-07-13 10:16:14.604912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.605042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.605068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.038 qpair failed and we were unable to recover it. 00:30:09.038 [2024-07-13 10:16:14.605212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.605369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.605395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.038 qpair failed and we were unable to recover it. 00:30:09.038 [2024-07-13 10:16:14.605586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.605756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.605783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.038 qpair failed and we were unable to recover it. 00:30:09.038 [2024-07-13 10:16:14.605911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.606078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.606105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.038 qpair failed and we were unable to recover it. 00:30:09.038 [2024-07-13 10:16:14.606370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.606587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.606646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.038 qpair failed and we were unable to recover it. 00:30:09.038 [2024-07-13 10:16:14.606815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.606958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.606986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.038 qpair failed and we were unable to recover it. 00:30:09.038 [2024-07-13 10:16:14.607161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.607316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.607341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.038 qpair failed and we were unable to recover it. 00:30:09.038 [2024-07-13 10:16:14.607495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.607621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.607645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.038 qpair failed and we were unable to recover it. 00:30:09.038 [2024-07-13 10:16:14.607823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.607973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.607998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.038 qpair failed and we were unable to recover it. 00:30:09.038 [2024-07-13 10:16:14.608143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.608322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.608349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.038 qpair failed and we were unable to recover it. 00:30:09.038 [2024-07-13 10:16:14.608498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.608646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.608670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.038 qpair failed and we were unable to recover it. 00:30:09.038 [2024-07-13 10:16:14.608828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.608990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.609017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.038 qpair failed and we were unable to recover it. 00:30:09.038 [2024-07-13 10:16:14.609181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.609359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.609385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.038 qpair failed and we were unable to recover it. 00:30:09.038 [2024-07-13 10:16:14.609547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.609719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.609745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.038 qpair failed and we were unable to recover it. 00:30:09.038 [2024-07-13 10:16:14.609938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.610085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.610110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.038 qpair failed and we were unable to recover it. 00:30:09.038 [2024-07-13 10:16:14.610240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.610391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.610415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.038 qpair failed and we were unable to recover it. 00:30:09.038 [2024-07-13 10:16:14.610566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.610702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.610729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.038 qpair failed and we were unable to recover it. 00:30:09.038 [2024-07-13 10:16:14.610921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.611086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.611113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.038 qpair failed and we were unable to recover it. 00:30:09.038 [2024-07-13 10:16:14.611285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.611437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.611461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.038 qpair failed and we were unable to recover it. 00:30:09.038 [2024-07-13 10:16:14.611610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.611734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.611757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.038 qpair failed and we were unable to recover it. 00:30:09.038 [2024-07-13 10:16:14.611915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.612063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.612090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.038 qpair failed and we were unable to recover it. 00:30:09.038 [2024-07-13 10:16:14.612277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.612445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.612472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.038 qpair failed and we were unable to recover it. 00:30:09.038 [2024-07-13 10:16:14.612661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.612786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.038 [2024-07-13 10:16:14.612810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.038 qpair failed and we were unable to recover it. 00:30:09.038 [2024-07-13 10:16:14.612942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.613064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.613088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.039 qpair failed and we were unable to recover it. 00:30:09.039 [2024-07-13 10:16:14.613260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.613458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.613482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.039 qpair failed and we were unable to recover it. 00:30:09.039 [2024-07-13 10:16:14.613612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.613786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.613810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.039 qpair failed and we were unable to recover it. 00:30:09.039 [2024-07-13 10:16:14.613960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.614083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.614107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.039 qpair failed and we were unable to recover it. 00:30:09.039 [2024-07-13 10:16:14.614256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.614381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.614405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.039 qpair failed and we were unable to recover it. 00:30:09.039 [2024-07-13 10:16:14.614597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.614795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.614823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.039 qpair failed and we were unable to recover it. 00:30:09.039 [2024-07-13 10:16:14.614997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.615147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.615171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.039 qpair failed and we were unable to recover it. 00:30:09.039 [2024-07-13 10:16:14.615345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.615468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.615492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.039 qpair failed and we were unable to recover it. 00:30:09.039 [2024-07-13 10:16:14.615644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.615814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.615840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.039 qpair failed and we were unable to recover it. 00:30:09.039 [2024-07-13 10:16:14.616016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.616156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.616183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.039 qpair failed and we were unable to recover it. 00:30:09.039 [2024-07-13 10:16:14.616355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.616532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.616557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.039 qpair failed and we were unable to recover it. 00:30:09.039 [2024-07-13 10:16:14.616705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.616846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.616900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.039 qpair failed and we were unable to recover it. 00:30:09.039 [2024-07-13 10:16:14.617035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.617160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.617185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.039 qpair failed and we were unable to recover it. 00:30:09.039 [2024-07-13 10:16:14.617340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.617470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.617495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.039 qpair failed and we were unable to recover it. 00:30:09.039 [2024-07-13 10:16:14.617650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.617818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.617842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.039 qpair failed and we were unable to recover it. 00:30:09.039 [2024-07-13 10:16:14.617984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.618135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.618176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.039 qpair failed and we were unable to recover it. 00:30:09.039 [2024-07-13 10:16:14.618350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.618597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.618622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.039 qpair failed and we were unable to recover it. 00:30:09.039 [2024-07-13 10:16:14.618778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.618902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.618926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.039 qpair failed and we were unable to recover it. 00:30:09.039 [2024-07-13 10:16:14.619057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.619215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.619240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.039 qpair failed and we were unable to recover it. 00:30:09.039 [2024-07-13 10:16:14.619392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.619537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.619577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.039 qpair failed and we were unable to recover it. 00:30:09.039 [2024-07-13 10:16:14.619720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.619933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.619958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.039 qpair failed and we were unable to recover it. 00:30:09.039 [2024-07-13 10:16:14.620107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.620235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.620260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.039 qpair failed and we were unable to recover it. 00:30:09.039 [2024-07-13 10:16:14.620389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.620536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.620561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.039 qpair failed and we were unable to recover it. 00:30:09.039 [2024-07-13 10:16:14.620712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.620884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.620913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.039 qpair failed and we were unable to recover it. 00:30:09.039 [2024-07-13 10:16:14.621075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.621213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.621239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.039 qpair failed and we were unable to recover it. 00:30:09.039 [2024-07-13 10:16:14.621430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.621649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.621677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.039 qpair failed and we were unable to recover it. 00:30:09.039 [2024-07-13 10:16:14.621841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.622037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.622065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.039 qpair failed and we were unable to recover it. 00:30:09.039 [2024-07-13 10:16:14.622240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.622395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.622421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.039 qpair failed and we were unable to recover it. 00:30:09.039 [2024-07-13 10:16:14.622579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.622749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.622775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.039 qpair failed and we were unable to recover it. 00:30:09.039 [2024-07-13 10:16:14.622964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.623141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.623166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.039 qpair failed and we were unable to recover it. 00:30:09.039 [2024-07-13 10:16:14.623315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.039 [2024-07-13 10:16:14.623464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.623488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.040 qpair failed and we were unable to recover it. 00:30:09.040 [2024-07-13 10:16:14.623614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.623765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.623790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.040 qpair failed and we were unable to recover it. 00:30:09.040 [2024-07-13 10:16:14.623946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.624101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.624128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.040 qpair failed and we were unable to recover it. 00:30:09.040 [2024-07-13 10:16:14.624298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.624432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.624460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.040 qpair failed and we were unable to recover it. 00:30:09.040 [2024-07-13 10:16:14.624652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.624822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.624848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.040 qpair failed and we were unable to recover it. 00:30:09.040 [2024-07-13 10:16:14.625032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.625185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.625210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.040 qpair failed and we were unable to recover it. 00:30:09.040 [2024-07-13 10:16:14.625336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.625488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.625515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.040 qpair failed and we were unable to recover it. 00:30:09.040 [2024-07-13 10:16:14.625715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.625940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.625968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.040 qpair failed and we were unable to recover it. 00:30:09.040 [2024-07-13 10:16:14.626166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.626319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.626358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.040 qpair failed and we were unable to recover it. 00:30:09.040 [2024-07-13 10:16:14.626528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.626677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.626701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.040 qpair failed and we were unable to recover it. 00:30:09.040 [2024-07-13 10:16:14.626852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.627008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.627033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.040 qpair failed and we were unable to recover it. 00:30:09.040 [2024-07-13 10:16:14.627185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.627369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.627402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.040 qpair failed and we were unable to recover it. 00:30:09.040 [2024-07-13 10:16:14.627575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.627731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.627758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.040 qpair failed and we were unable to recover it. 00:30:09.040 [2024-07-13 10:16:14.627913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.628063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.628087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.040 qpair failed and we were unable to recover it. 00:30:09.040 [2024-07-13 10:16:14.628238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.628413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.628437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.040 qpair failed and we were unable to recover it. 00:30:09.040 [2024-07-13 10:16:14.628586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.628779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.628807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.040 qpair failed and we were unable to recover it. 00:30:09.040 [2024-07-13 10:16:14.628974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.629121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.629146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.040 qpair failed and we were unable to recover it. 00:30:09.040 [2024-07-13 10:16:14.629318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.629472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.629495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.040 qpair failed and we were unable to recover it. 00:30:09.040 [2024-07-13 10:16:14.629645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.629818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.629844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.040 qpair failed and we were unable to recover it. 00:30:09.040 [2024-07-13 10:16:14.630040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.630215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.630242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.040 qpair failed and we were unable to recover it. 00:30:09.040 [2024-07-13 10:16:14.630405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.630580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.630606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.040 qpair failed and we were unable to recover it. 00:30:09.040 [2024-07-13 10:16:14.630780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.630945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.630973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.040 qpair failed and we were unable to recover it. 00:30:09.040 [2024-07-13 10:16:14.631159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.631427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.631472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.040 qpair failed and we were unable to recover it. 00:30:09.040 [2024-07-13 10:16:14.631640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.631802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.631829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.040 qpair failed and we were unable to recover it. 00:30:09.040 [2024-07-13 10:16:14.632010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.632163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.632189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.040 qpair failed and we were unable to recover it. 00:30:09.040 [2024-07-13 10:16:14.632402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.632578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.632603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.040 qpair failed and we were unable to recover it. 00:30:09.040 [2024-07-13 10:16:14.632728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.632917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.632943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.040 qpair failed and we were unable to recover it. 00:30:09.040 [2024-07-13 10:16:14.633091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.633218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.633243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.040 qpair failed and we were unable to recover it. 00:30:09.040 [2024-07-13 10:16:14.633439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.633634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.633661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.040 qpair failed and we were unable to recover it. 00:30:09.040 [2024-07-13 10:16:14.633807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.633960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.633986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.040 qpair failed and we were unable to recover it. 00:30:09.040 [2024-07-13 10:16:14.634173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.634338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.040 [2024-07-13 10:16:14.634364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.041 qpair failed and we were unable to recover it. 00:30:09.041 [2024-07-13 10:16:14.634537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.634688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.634712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.041 qpair failed and we were unable to recover it. 00:30:09.041 [2024-07-13 10:16:14.634860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.634984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.635009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.041 qpair failed and we were unable to recover it. 00:30:09.041 [2024-07-13 10:16:14.635167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.635318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.635342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.041 qpair failed and we were unable to recover it. 00:30:09.041 [2024-07-13 10:16:14.635465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.635610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.635633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.041 qpair failed and we were unable to recover it. 00:30:09.041 [2024-07-13 10:16:14.635827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.635991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.636019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.041 qpair failed and we were unable to recover it. 00:30:09.041 [2024-07-13 10:16:14.636209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.636336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.636364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.041 qpair failed and we were unable to recover it. 00:30:09.041 [2024-07-13 10:16:14.636572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.636718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.636742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.041 qpair failed and we were unable to recover it. 00:30:09.041 [2024-07-13 10:16:14.636861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.637015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.637039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.041 qpair failed and we were unable to recover it. 00:30:09.041 [2024-07-13 10:16:14.637218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.637366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.637390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.041 qpair failed and we were unable to recover it. 00:30:09.041 [2024-07-13 10:16:14.637517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.637697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.637721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.041 qpair failed and we were unable to recover it. 00:30:09.041 [2024-07-13 10:16:14.637878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.638065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.638090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.041 qpair failed and we were unable to recover it. 00:30:09.041 [2024-07-13 10:16:14.638218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.638471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.638496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.041 qpair failed and we were unable to recover it. 00:30:09.041 [2024-07-13 10:16:14.638673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.638823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.638847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.041 qpair failed and we were unable to recover it. 00:30:09.041 [2024-07-13 10:16:14.639037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.639195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.639222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.041 qpair failed and we were unable to recover it. 00:30:09.041 [2024-07-13 10:16:14.639363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.639475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.639500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.041 qpair failed and we were unable to recover it. 00:30:09.041 [2024-07-13 10:16:14.639665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.639805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.639831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.041 qpair failed and we were unable to recover it. 00:30:09.041 [2024-07-13 10:16:14.640033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.640175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.640201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.041 qpair failed and we were unable to recover it. 00:30:09.041 [2024-07-13 10:16:14.640363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.640589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.640645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.041 qpair failed and we were unable to recover it. 00:30:09.041 [2024-07-13 10:16:14.640828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.640989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.641032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.041 qpair failed and we were unable to recover it. 00:30:09.041 [2024-07-13 10:16:14.641185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.641337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.641362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.041 qpair failed and we were unable to recover it. 00:30:09.041 [2024-07-13 10:16:14.641512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.641696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.641720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.041 qpair failed and we were unable to recover it. 00:30:09.041 [2024-07-13 10:16:14.641845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.641977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.642002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.041 qpair failed and we were unable to recover it. 00:30:09.041 [2024-07-13 10:16:14.642157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.642306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.642330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.041 qpair failed and we were unable to recover it. 00:30:09.041 [2024-07-13 10:16:14.642486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.642610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.642634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.041 qpair failed and we were unable to recover it. 00:30:09.041 [2024-07-13 10:16:14.642784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.642920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.642945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.041 qpair failed and we were unable to recover it. 00:30:09.041 [2024-07-13 10:16:14.643094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.643340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.643397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.041 qpair failed and we were unable to recover it. 00:30:09.041 [2024-07-13 10:16:14.643567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.643754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.643782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.041 qpair failed and we were unable to recover it. 00:30:09.041 [2024-07-13 10:16:14.643957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.644106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.644134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.041 qpair failed and we were unable to recover it. 00:30:09.041 [2024-07-13 10:16:14.644288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.644402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.644426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.041 qpair failed and we were unable to recover it. 00:30:09.041 [2024-07-13 10:16:14.644554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.644708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.041 [2024-07-13 10:16:14.644735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.041 qpair failed and we were unable to recover it. 00:30:09.041 [2024-07-13 10:16:14.644932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.645116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.645140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.042 qpair failed and we were unable to recover it. 00:30:09.042 [2024-07-13 10:16:14.645291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.645463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.645486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.042 qpair failed and we were unable to recover it. 00:30:09.042 [2024-07-13 10:16:14.645649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.645862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.645896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.042 qpair failed and we were unable to recover it. 00:30:09.042 [2024-07-13 10:16:14.646034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.646193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.646220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.042 qpair failed and we were unable to recover it. 00:30:09.042 [2024-07-13 10:16:14.646366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.646493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.646517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.042 qpair failed and we were unable to recover it. 00:30:09.042 [2024-07-13 10:16:14.646694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.646843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.646875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.042 qpair failed and we were unable to recover it. 00:30:09.042 [2024-07-13 10:16:14.647035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.647174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.647202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.042 qpair failed and we were unable to recover it. 00:30:09.042 [2024-07-13 10:16:14.647342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.647496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.647524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.042 qpair failed and we were unable to recover it. 00:30:09.042 [2024-07-13 10:16:14.647677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.647852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.647882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.042 qpair failed and we were unable to recover it. 00:30:09.042 [2024-07-13 10:16:14.648034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.648174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.648201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.042 qpair failed and we were unable to recover it. 00:30:09.042 [2024-07-13 10:16:14.648368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.648510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.648538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.042 qpair failed and we were unable to recover it. 00:30:09.042 [2024-07-13 10:16:14.648703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.648888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.648916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.042 qpair failed and we were unable to recover it. 00:30:09.042 [2024-07-13 10:16:14.649110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.649257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.649281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.042 qpair failed and we were unable to recover it. 00:30:09.042 [2024-07-13 10:16:14.649427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.649579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.649603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.042 qpair failed and we were unable to recover it. 00:30:09.042 [2024-07-13 10:16:14.649785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.649928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.649954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.042 qpair failed and we were unable to recover it. 00:30:09.042 [2024-07-13 10:16:14.650106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.650231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.650256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.042 qpair failed and we were unable to recover it. 00:30:09.042 [2024-07-13 10:16:14.650438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.650581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.650606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.042 qpair failed and we were unable to recover it. 00:30:09.042 [2024-07-13 10:16:14.650790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.650913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.650943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.042 qpair failed and we were unable to recover it. 00:30:09.042 [2024-07-13 10:16:14.651099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.651311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.651361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.042 qpair failed and we were unable to recover it. 00:30:09.042 [2024-07-13 10:16:14.651507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.651667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.651694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.042 qpair failed and we were unable to recover it. 00:30:09.042 [2024-07-13 10:16:14.651861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.652019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.652043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.042 qpair failed and we were unable to recover it. 00:30:09.042 [2024-07-13 10:16:14.652200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.652402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.652429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.042 qpair failed and we were unable to recover it. 00:30:09.042 [2024-07-13 10:16:14.652591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.652766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.652791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.042 qpair failed and we were unable to recover it. 00:30:09.042 [2024-07-13 10:16:14.652949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.653100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.653140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.042 qpair failed and we were unable to recover it. 00:30:09.042 [2024-07-13 10:16:14.653308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.653431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.653457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.042 qpair failed and we were unable to recover it. 00:30:09.042 [2024-07-13 10:16:14.653606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.653810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.042 [2024-07-13 10:16:14.653837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.042 qpair failed and we were unable to recover it. 00:30:09.043 [2024-07-13 10:16:14.654018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.654183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.654246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.043 qpair failed and we were unable to recover it. 00:30:09.043 [2024-07-13 10:16:14.654434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.654660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.654710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.043 qpair failed and we were unable to recover it. 00:30:09.043 [2024-07-13 10:16:14.654858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.655044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.655069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.043 qpair failed and we were unable to recover it. 00:30:09.043 [2024-07-13 10:16:14.655198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.655328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.655352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.043 qpair failed and we were unable to recover it. 00:30:09.043 [2024-07-13 10:16:14.655529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.655674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.655701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.043 qpair failed and we were unable to recover it. 00:30:09.043 [2024-07-13 10:16:14.655833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.656038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.656066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.043 qpair failed and we were unable to recover it. 00:30:09.043 [2024-07-13 10:16:14.656239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.656393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.656418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.043 qpair failed and we were unable to recover it. 00:30:09.043 [2024-07-13 10:16:14.656542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.656719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.656743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.043 qpair failed and we were unable to recover it. 00:30:09.043 [2024-07-13 10:16:14.656899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.657051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.657075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.043 qpair failed and we were unable to recover it. 00:30:09.043 [2024-07-13 10:16:14.657269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.657419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.657444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.043 qpair failed and we were unable to recover it. 00:30:09.043 [2024-07-13 10:16:14.657568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.657716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.657741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.043 qpair failed and we were unable to recover it. 00:30:09.043 [2024-07-13 10:16:14.657878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.658054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.658078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.043 qpair failed and we were unable to recover it. 00:30:09.043 [2024-07-13 10:16:14.658232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.658398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.658423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.043 qpair failed and we were unable to recover it. 00:30:09.043 [2024-07-13 10:16:14.658632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.658801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.658828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.043 qpair failed and we were unable to recover it. 00:30:09.043 [2024-07-13 10:16:14.659007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.659155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.659178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.043 qpair failed and we were unable to recover it. 00:30:09.043 [2024-07-13 10:16:14.659328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.659476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.659501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.043 qpair failed and we were unable to recover it. 00:30:09.043 [2024-07-13 10:16:14.659678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.659842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.659875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.043 qpair failed and we were unable to recover it. 00:30:09.043 [2024-07-13 10:16:14.660045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.660198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.660223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.043 qpair failed and we were unable to recover it. 00:30:09.043 [2024-07-13 10:16:14.660377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.660498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.660522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.043 qpair failed and we were unable to recover it. 00:30:09.043 [2024-07-13 10:16:14.660700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.660862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.660899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.043 qpair failed and we were unable to recover it. 00:30:09.043 [2024-07-13 10:16:14.661095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.661222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.661249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.043 qpair failed and we were unable to recover it. 00:30:09.043 [2024-07-13 10:16:14.661416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.661578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.661605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.043 qpair failed and we were unable to recover it. 00:30:09.043 [2024-07-13 10:16:14.661772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.661939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.661964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.043 qpair failed and we were unable to recover it. 00:30:09.043 [2024-07-13 10:16:14.662113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.662308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.662362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.043 qpair failed and we were unable to recover it. 00:30:09.043 [2024-07-13 10:16:14.662516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.662666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.662691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.043 qpair failed and we were unable to recover it. 00:30:09.043 [2024-07-13 10:16:14.662847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.663011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.663036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.043 qpair failed and we were unable to recover it. 00:30:09.043 [2024-07-13 10:16:14.663214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.663390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.663417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.043 qpair failed and we were unable to recover it. 00:30:09.043 [2024-07-13 10:16:14.663601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.663792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.663821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.043 qpair failed and we were unable to recover it. 00:30:09.043 [2024-07-13 10:16:14.663984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.664107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.664132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.043 qpair failed and we were unable to recover it. 00:30:09.043 [2024-07-13 10:16:14.664288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.664495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.043 [2024-07-13 10:16:14.664543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.043 qpair failed and we were unable to recover it. 00:30:09.044 [2024-07-13 10:16:14.664733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.664909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.664934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.044 qpair failed and we were unable to recover it. 00:30:09.044 [2024-07-13 10:16:14.665084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.665248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.665273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.044 qpair failed and we were unable to recover it. 00:30:09.044 [2024-07-13 10:16:14.665452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.665590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.665618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.044 qpair failed and we were unable to recover it. 00:30:09.044 [2024-07-13 10:16:14.665777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.665909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.665937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.044 qpair failed and we were unable to recover it. 00:30:09.044 [2024-07-13 10:16:14.666104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.666233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.666257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.044 qpair failed and we were unable to recover it. 00:30:09.044 [2024-07-13 10:16:14.666438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.666625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.666652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.044 qpair failed and we were unable to recover it. 00:30:09.044 [2024-07-13 10:16:14.666825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.667003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.667031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.044 qpair failed and we were unable to recover it. 00:30:09.044 [2024-07-13 10:16:14.667197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.667358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.667385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.044 qpair failed and we were unable to recover it. 00:30:09.044 [2024-07-13 10:16:14.667564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.667755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.667783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.044 qpair failed and we were unable to recover it. 00:30:09.044 [2024-07-13 10:16:14.667951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.668120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.668147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.044 qpair failed and we were unable to recover it. 00:30:09.044 [2024-07-13 10:16:14.668314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.668464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.668491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.044 qpair failed and we were unable to recover it. 00:30:09.044 [2024-07-13 10:16:14.668642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.668829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.668854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.044 qpair failed and we were unable to recover it. 00:30:09.044 [2024-07-13 10:16:14.669022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.669206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.669231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.044 qpair failed and we were unable to recover it. 00:30:09.044 [2024-07-13 10:16:14.669387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.669608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.669635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.044 qpair failed and we were unable to recover it. 00:30:09.044 [2024-07-13 10:16:14.669797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.669964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.669994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.044 qpair failed and we were unable to recover it. 00:30:09.044 [2024-07-13 10:16:14.670187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.670396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.670445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.044 qpair failed and we were unable to recover it. 00:30:09.044 [2024-07-13 10:16:14.670590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.670776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.670800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.044 qpair failed and we were unable to recover it. 00:30:09.044 [2024-07-13 10:16:14.670959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.671122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.671150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.044 qpair failed and we were unable to recover it. 00:30:09.044 [2024-07-13 10:16:14.671294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.671435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.671461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.044 qpair failed and we were unable to recover it. 00:30:09.044 [2024-07-13 10:16:14.671618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.671785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.671812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.044 qpair failed and we were unable to recover it. 00:30:09.044 [2024-07-13 10:16:14.671955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.672131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.672156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.044 qpair failed and we were unable to recover it. 00:30:09.044 [2024-07-13 10:16:14.672309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.672462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.672485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.044 qpair failed and we were unable to recover it. 00:30:09.044 [2024-07-13 10:16:14.672609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.672740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.672764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.044 qpair failed and we were unable to recover it. 00:30:09.044 [2024-07-13 10:16:14.672889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.673028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.673054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.044 qpair failed and we were unable to recover it. 00:30:09.044 [2024-07-13 10:16:14.673229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.673379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.673418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.044 qpair failed and we were unable to recover it. 00:30:09.044 [2024-07-13 10:16:14.673553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.673704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.673728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.044 qpair failed and we were unable to recover it. 00:30:09.044 [2024-07-13 10:16:14.673907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.674034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.674059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.044 qpair failed and we were unable to recover it. 00:30:09.044 [2024-07-13 10:16:14.674185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.674337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.674361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.044 qpair failed and we were unable to recover it. 00:30:09.044 [2024-07-13 10:16:14.674515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.674691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.674715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.044 qpair failed and we were unable to recover it. 00:30:09.044 [2024-07-13 10:16:14.674874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.675026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.044 [2024-07-13 10:16:14.675051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.044 qpair failed and we were unable to recover it. 00:30:09.044 [2024-07-13 10:16:14.675174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.675319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.675343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.045 qpair failed and we were unable to recover it. 00:30:09.045 [2024-07-13 10:16:14.675493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.675681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.675707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.045 qpair failed and we were unable to recover it. 00:30:09.045 [2024-07-13 10:16:14.675882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.676035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.676060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.045 qpair failed and we were unable to recover it. 00:30:09.045 [2024-07-13 10:16:14.676238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.676383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.676408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.045 qpair failed and we were unable to recover it. 00:30:09.045 [2024-07-13 10:16:14.676533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.676700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.676723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.045 qpair failed and we were unable to recover it. 00:30:09.045 [2024-07-13 10:16:14.676895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.677041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.677068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.045 qpair failed and we were unable to recover it. 00:30:09.045 [2024-07-13 10:16:14.677233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.677361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.677386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.045 qpair failed and we were unable to recover it. 00:30:09.045 [2024-07-13 10:16:14.677542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.677691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.677715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.045 qpair failed and we were unable to recover it. 00:30:09.045 [2024-07-13 10:16:14.677856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.677988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.678012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.045 qpair failed and we were unable to recover it. 00:30:09.045 [2024-07-13 10:16:14.678209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.678394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.678442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.045 qpair failed and we were unable to recover it. 00:30:09.045 [2024-07-13 10:16:14.678613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.678786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.678810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.045 qpair failed and we were unable to recover it. 00:30:09.045 [2024-07-13 10:16:14.678967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.679093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.679117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.045 qpair failed and we were unable to recover it. 00:30:09.045 [2024-07-13 10:16:14.679248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.679398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.679440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.045 qpair failed and we were unable to recover it. 00:30:09.045 [2024-07-13 10:16:14.679636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.679788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.679813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.045 qpair failed and we were unable to recover it. 00:30:09.045 [2024-07-13 10:16:14.679969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.680117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.680142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.045 qpair failed and we were unable to recover it. 00:30:09.045 [2024-07-13 10:16:14.680265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.680422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.680447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.045 qpair failed and we were unable to recover it. 00:30:09.045 [2024-07-13 10:16:14.680642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.680808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.680835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.045 qpair failed and we were unable to recover it. 00:30:09.045 [2024-07-13 10:16:14.681042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.681194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.681219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.045 qpair failed and we were unable to recover it. 00:30:09.045 [2024-07-13 10:16:14.681394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.681540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.681565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.045 qpair failed and we were unable to recover it. 00:30:09.045 [2024-07-13 10:16:14.681754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.681905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.681931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.045 qpair failed and we were unable to recover it. 00:30:09.045 [2024-07-13 10:16:14.682054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.682206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.682231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.045 qpair failed and we were unable to recover it. 00:30:09.045 [2024-07-13 10:16:14.682355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.682536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.682561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.045 qpair failed and we were unable to recover it. 00:30:09.045 [2024-07-13 10:16:14.682707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.682861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.682894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.045 qpair failed and we were unable to recover it. 00:30:09.045 [2024-07-13 10:16:14.683065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.683243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.683268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.045 qpair failed and we were unable to recover it. 00:30:09.045 [2024-07-13 10:16:14.683423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.683574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.683598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.045 qpair failed and we were unable to recover it. 00:30:09.045 [2024-07-13 10:16:14.683777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.683954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.683980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.045 qpair failed and we were unable to recover it. 00:30:09.045 [2024-07-13 10:16:14.684127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.684257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.684281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.045 qpair failed and we were unable to recover it. 00:30:09.045 [2024-07-13 10:16:14.684446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.684601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.684624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.045 qpair failed and we were unable to recover it. 00:30:09.045 [2024-07-13 10:16:14.684800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.684984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.685009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.045 qpair failed and we were unable to recover it. 00:30:09.045 [2024-07-13 10:16:14.685129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.685280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.685305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.045 qpair failed and we were unable to recover it. 00:30:09.045 [2024-07-13 10:16:14.685449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.045 [2024-07-13 10:16:14.685598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.685622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.046 qpair failed and we were unable to recover it. 00:30:09.046 [2024-07-13 10:16:14.685792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.685936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.685964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.046 qpair failed and we were unable to recover it. 00:30:09.046 [2024-07-13 10:16:14.686096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.686232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.686260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.046 qpair failed and we were unable to recover it. 00:30:09.046 [2024-07-13 10:16:14.686425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.686563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.686591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.046 qpair failed and we were unable to recover it. 00:30:09.046 [2024-07-13 10:16:14.686758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.686912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.686936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.046 qpair failed and we were unable to recover it. 00:30:09.046 [2024-07-13 10:16:14.687060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.687210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.687234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.046 qpair failed and we were unable to recover it. 00:30:09.046 [2024-07-13 10:16:14.687388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.687509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.687534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.046 qpair failed and we were unable to recover it. 00:30:09.046 [2024-07-13 10:16:14.687656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.687804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.687830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.046 qpair failed and we were unable to recover it. 00:30:09.046 [2024-07-13 10:16:14.687989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.688162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.688186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.046 qpair failed and we were unable to recover it. 00:30:09.046 [2024-07-13 10:16:14.688394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.688614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.688642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.046 qpair failed and we were unable to recover it. 00:30:09.046 [2024-07-13 10:16:14.688812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.688990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.689015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.046 qpair failed and we were unable to recover it. 00:30:09.046 [2024-07-13 10:16:14.689158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.689299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.689326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.046 qpair failed and we were unable to recover it. 00:30:09.046 [2024-07-13 10:16:14.689475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.689632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.689658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.046 qpair failed and we were unable to recover it. 00:30:09.046 [2024-07-13 10:16:14.689834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.689993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.690018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.046 qpair failed and we were unable to recover it. 00:30:09.046 [2024-07-13 10:16:14.690179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.690342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.690370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.046 qpair failed and we were unable to recover it. 00:30:09.046 [2024-07-13 10:16:14.690530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.690664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.690690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.046 qpair failed and we were unable to recover it. 00:30:09.046 [2024-07-13 10:16:14.690832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.690965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.690989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.046 qpair failed and we were unable to recover it. 00:30:09.046 [2024-07-13 10:16:14.691117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.691265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.691290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.046 qpair failed and we were unable to recover it. 00:30:09.046 [2024-07-13 10:16:14.691467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.691589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.691613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.046 qpair failed and we were unable to recover it. 00:30:09.046 [2024-07-13 10:16:14.691764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.691939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.691966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.046 qpair failed and we were unable to recover it. 00:30:09.046 [2024-07-13 10:16:14.692138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.692283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.692307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.046 qpair failed and we were unable to recover it. 00:30:09.046 [2024-07-13 10:16:14.692437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.692588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.692611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.046 qpair failed and we were unable to recover it. 00:30:09.046 [2024-07-13 10:16:14.692785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.692974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.693004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.046 qpair failed and we were unable to recover it. 00:30:09.046 [2024-07-13 10:16:14.693177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.693390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.693440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.046 qpair failed and we were unable to recover it. 00:30:09.046 [2024-07-13 10:16:14.693586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.693736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.693761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.046 qpair failed and we were unable to recover it. 00:30:09.046 [2024-07-13 10:16:14.693891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.694038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.694062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.046 qpair failed and we were unable to recover it. 00:30:09.046 [2024-07-13 10:16:14.694211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.694383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.694406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.046 qpair failed and we were unable to recover it. 00:30:09.046 [2024-07-13 10:16:14.694554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.694740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.694764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.046 qpair failed and we were unable to recover it. 00:30:09.046 [2024-07-13 10:16:14.694891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.695068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.695092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.046 qpair failed and we were unable to recover it. 00:30:09.046 [2024-07-13 10:16:14.695225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.695391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.695440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.046 qpair failed and we were unable to recover it. 00:30:09.046 [2024-07-13 10:16:14.695601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.695765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.046 [2024-07-13 10:16:14.695791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.046 qpair failed and we were unable to recover it. 00:30:09.047 [2024-07-13 10:16:14.695961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.696144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.696169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.047 qpair failed and we were unable to recover it. 00:30:09.047 [2024-07-13 10:16:14.696318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.696492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.696520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.047 qpair failed and we were unable to recover it. 00:30:09.047 [2024-07-13 10:16:14.696649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.696768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.696792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.047 qpair failed and we were unable to recover it. 00:30:09.047 [2024-07-13 10:16:14.696944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.697124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.697148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.047 qpair failed and we were unable to recover it. 00:30:09.047 [2024-07-13 10:16:14.697337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.697488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.697513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.047 qpair failed and we were unable to recover it. 00:30:09.047 [2024-07-13 10:16:14.697636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.697788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.697812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.047 qpair failed and we were unable to recover it. 00:30:09.047 [2024-07-13 10:16:14.697966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.698112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.698137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.047 qpair failed and we were unable to recover it. 00:30:09.047 [2024-07-13 10:16:14.698340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.698516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.698539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.047 qpair failed and we were unable to recover it. 00:30:09.047 [2024-07-13 10:16:14.698690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.698872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.698897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.047 qpair failed and we were unable to recover it. 00:30:09.047 [2024-07-13 10:16:14.699024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.699166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.699190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.047 qpair failed and we were unable to recover it. 00:30:09.047 [2024-07-13 10:16:14.699337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.699507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.699535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.047 qpair failed and we were unable to recover it. 00:30:09.047 [2024-07-13 10:16:14.699700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.699855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.699902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.047 qpair failed and we were unable to recover it. 00:30:09.047 [2024-07-13 10:16:14.700094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.700224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.700251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.047 qpair failed and we were unable to recover it. 00:30:09.047 [2024-07-13 10:16:14.700421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.700543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.700567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.047 qpair failed and we were unable to recover it. 00:30:09.047 [2024-07-13 10:16:14.700716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.700915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.700945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.047 qpair failed and we were unable to recover it. 00:30:09.047 [2024-07-13 10:16:14.701108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.701284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.701311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.047 qpair failed and we were unable to recover it. 00:30:09.047 [2024-07-13 10:16:14.701450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.701605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.701633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.047 qpair failed and we were unable to recover it. 00:30:09.047 [2024-07-13 10:16:14.701803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.701953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.701978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.047 qpair failed and we were unable to recover it. 00:30:09.047 [2024-07-13 10:16:14.702156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.702301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.702325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.047 qpair failed and we were unable to recover it. 00:30:09.047 [2024-07-13 10:16:14.702450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.702601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.702625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.047 qpair failed and we were unable to recover it. 00:30:09.047 [2024-07-13 10:16:14.702832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.703005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.703033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.047 qpair failed and we were unable to recover it. 00:30:09.047 [2024-07-13 10:16:14.703203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.703449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.703482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.047 qpair failed and we were unable to recover it. 00:30:09.047 [2024-07-13 10:16:14.703748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.703963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.703991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.047 qpair failed and we were unable to recover it. 00:30:09.047 [2024-07-13 10:16:14.704139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.704274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.704301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.047 qpair failed and we were unable to recover it. 00:30:09.047 [2024-07-13 10:16:14.704463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.704651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.704679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.047 qpair failed and we were unable to recover it. 00:30:09.047 [2024-07-13 10:16:14.704918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.705062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.047 [2024-07-13 10:16:14.705087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.048 qpair failed and we were unable to recover it. 00:30:09.048 [2024-07-13 10:16:14.705236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.705415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.705442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.048 qpair failed and we were unable to recover it. 00:30:09.048 [2024-07-13 10:16:14.705601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.705762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.705790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.048 qpair failed and we were unable to recover it. 00:30:09.048 [2024-07-13 10:16:14.705958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.706148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.706173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.048 qpair failed and we were unable to recover it. 00:30:09.048 [2024-07-13 10:16:14.706352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.706478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.706502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.048 qpair failed and we were unable to recover it. 00:30:09.048 [2024-07-13 10:16:14.706652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.706814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.706841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.048 qpair failed and we were unable to recover it. 00:30:09.048 [2024-07-13 10:16:14.707014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.707140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.707165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.048 qpair failed and we were unable to recover it. 00:30:09.048 [2024-07-13 10:16:14.707331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.707485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.707509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.048 qpair failed and we were unable to recover it. 00:30:09.048 [2024-07-13 10:16:14.707634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.707779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.707804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.048 qpair failed and we were unable to recover it. 00:30:09.048 [2024-07-13 10:16:14.707938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.708179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.708233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.048 qpair failed and we were unable to recover it. 00:30:09.048 [2024-07-13 10:16:14.708428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.708665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.708714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.048 qpair failed and we were unable to recover it. 00:30:09.048 [2024-07-13 10:16:14.708959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.709174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.709232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.048 qpair failed and we were unable to recover it. 00:30:09.048 [2024-07-13 10:16:14.709413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.709572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.709596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.048 qpair failed and we were unable to recover it. 00:30:09.048 [2024-07-13 10:16:14.709747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.709899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.709926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.048 qpair failed and we were unable to recover it. 00:30:09.048 [2024-07-13 10:16:14.710103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.710255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.710281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.048 qpair failed and we were unable to recover it. 00:30:09.048 [2024-07-13 10:16:14.710431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.710576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.710601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.048 qpair failed and we were unable to recover it. 00:30:09.048 [2024-07-13 10:16:14.710775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.710892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.710917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.048 qpair failed and we were unable to recover it. 00:30:09.048 [2024-07-13 10:16:14.711079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.711238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.711262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.048 qpair failed and we were unable to recover it. 00:30:09.048 [2024-07-13 10:16:14.711385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.711552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.711579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.048 qpair failed and we were unable to recover it. 00:30:09.048 [2024-07-13 10:16:14.711710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.711849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.711885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.048 qpair failed and we were unable to recover it. 00:30:09.048 [2024-07-13 10:16:14.712037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.712164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.712189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.048 qpair failed and we were unable to recover it. 00:30:09.048 [2024-07-13 10:16:14.712332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.712450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.712475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.048 qpair failed and we were unable to recover it. 00:30:09.048 [2024-07-13 10:16:14.712601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.712752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.712776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.048 qpair failed and we were unable to recover it. 00:30:09.048 [2024-07-13 10:16:14.712953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.713128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.713153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.048 qpair failed and we were unable to recover it. 00:30:09.048 [2024-07-13 10:16:14.713302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.713453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.713478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.048 qpair failed and we were unable to recover it. 00:30:09.048 [2024-07-13 10:16:14.713654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.713768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.713809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.048 qpair failed and we were unable to recover it. 00:30:09.048 [2024-07-13 10:16:14.713984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.714178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.714206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.048 qpair failed and we were unable to recover it. 00:30:09.048 [2024-07-13 10:16:14.714349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.714487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.714516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.048 qpair failed and we were unable to recover it. 00:30:09.048 [2024-07-13 10:16:14.714713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.714902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.714928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.048 qpair failed and we were unable to recover it. 00:30:09.048 [2024-07-13 10:16:14.715058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.715202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.715253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.048 qpair failed and we were unable to recover it. 00:30:09.048 [2024-07-13 10:16:14.715438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.715589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.048 [2024-07-13 10:16:14.715613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.048 qpair failed and we were unable to recover it. 00:30:09.048 [2024-07-13 10:16:14.715761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.715955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.715984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.049 qpair failed and we were unable to recover it. 00:30:09.049 [2024-07-13 10:16:14.716136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.716311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.716335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.049 qpair failed and we were unable to recover it. 00:30:09.049 [2024-07-13 10:16:14.716490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.716668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.716698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.049 qpair failed and we were unable to recover it. 00:30:09.049 [2024-07-13 10:16:14.716849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.717008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.717032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.049 qpair failed and we were unable to recover it. 00:30:09.049 [2024-07-13 10:16:14.717205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.717329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.717355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.049 qpair failed and we were unable to recover it. 00:30:09.049 [2024-07-13 10:16:14.717485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.717632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.717657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.049 qpair failed and we were unable to recover it. 00:30:09.049 [2024-07-13 10:16:14.717875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.718034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.718062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.049 qpair failed and we were unable to recover it. 00:30:09.049 [2024-07-13 10:16:14.718256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.718395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.718422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.049 qpair failed and we were unable to recover it. 00:30:09.049 [2024-07-13 10:16:14.718587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.718776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.718803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.049 qpair failed and we were unable to recover it. 00:30:09.049 [2024-07-13 10:16:14.718953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.719100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.719141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.049 qpair failed and we were unable to recover it. 00:30:09.049 [2024-07-13 10:16:14.719375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.719576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.719601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.049 qpair failed and we were unable to recover it. 00:30:09.049 [2024-07-13 10:16:14.719752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.719906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.719932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.049 qpair failed and we were unable to recover it. 00:30:09.049 [2024-07-13 10:16:14.720108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.720295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.720321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.049 qpair failed and we were unable to recover it. 00:30:09.049 [2024-07-13 10:16:14.720493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.720610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.720633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.049 qpair failed and we were unable to recover it. 00:30:09.049 [2024-07-13 10:16:14.720793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.720970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.720995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.049 qpair failed and we were unable to recover it. 00:30:09.049 [2024-07-13 10:16:14.721118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.721285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.721310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.049 qpair failed and we were unable to recover it. 00:30:09.049 [2024-07-13 10:16:14.721435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.721587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.721612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.049 qpair failed and we were unable to recover it. 00:30:09.049 [2024-07-13 10:16:14.721784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.721981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.722006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.049 qpair failed and we were unable to recover it. 00:30:09.049 [2024-07-13 10:16:14.722162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.722284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.722308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.049 qpair failed and we were unable to recover it. 00:30:09.049 [2024-07-13 10:16:14.722459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.722602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.722629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.049 qpair failed and we were unable to recover it. 00:30:09.049 [2024-07-13 10:16:14.722832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.723012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.723036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.049 qpair failed and we were unable to recover it. 00:30:09.049 [2024-07-13 10:16:14.723212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.723337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.723361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.049 qpair failed and we were unable to recover it. 00:30:09.049 [2024-07-13 10:16:14.723486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.723634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.723659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.049 qpair failed and we were unable to recover it. 00:30:09.049 [2024-07-13 10:16:14.723813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.723973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.724000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.049 qpair failed and we were unable to recover it. 00:30:09.049 [2024-07-13 10:16:14.724168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.724326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.724352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.049 qpair failed and we were unable to recover it. 00:30:09.049 [2024-07-13 10:16:14.724499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.724654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.724678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.049 qpair failed and we were unable to recover it. 00:30:09.049 [2024-07-13 10:16:14.724837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.724997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.725022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.049 qpair failed and we were unable to recover it. 00:30:09.049 [2024-07-13 10:16:14.725174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.725354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.725378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.049 qpair failed and we were unable to recover it. 00:30:09.049 [2024-07-13 10:16:14.725502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.725625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.725649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.049 qpair failed and we were unable to recover it. 00:30:09.049 [2024-07-13 10:16:14.725798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.725951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.725992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.049 qpair failed and we were unable to recover it. 00:30:09.049 [2024-07-13 10:16:14.726182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.049 [2024-07-13 10:16:14.726487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.726535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.050 qpair failed and we were unable to recover it. 00:30:09.050 [2024-07-13 10:16:14.726701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.726839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.726873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.050 qpair failed and we were unable to recover it. 00:30:09.050 [2024-07-13 10:16:14.727040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.727178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.727204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.050 qpair failed and we were unable to recover it. 00:30:09.050 [2024-07-13 10:16:14.727375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.727504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.727546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.050 qpair failed and we were unable to recover it. 00:30:09.050 [2024-07-13 10:16:14.727717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.727894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.727920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.050 qpair failed and we were unable to recover it. 00:30:09.050 [2024-07-13 10:16:14.728072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.728295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.728345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.050 qpair failed and we were unable to recover it. 00:30:09.050 [2024-07-13 10:16:14.728519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.728679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.728705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.050 qpair failed and we were unable to recover it. 00:30:09.050 [2024-07-13 10:16:14.728880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.729029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.729053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.050 qpair failed and we were unable to recover it. 00:30:09.050 [2024-07-13 10:16:14.729201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.729327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.729352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.050 qpair failed and we were unable to recover it. 00:30:09.050 [2024-07-13 10:16:14.729496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.729641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.729665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.050 qpair failed and we were unable to recover it. 00:30:09.050 [2024-07-13 10:16:14.729791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.729935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.729960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.050 qpair failed and we were unable to recover it. 00:30:09.050 [2024-07-13 10:16:14.730170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.730379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.730426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.050 qpair failed and we were unable to recover it. 00:30:09.050 [2024-07-13 10:16:14.730648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.730841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.730876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.050 qpair failed and we were unable to recover it. 00:30:09.050 [2024-07-13 10:16:14.731023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.731153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.731178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.050 qpair failed and we were unable to recover it. 00:30:09.050 [2024-07-13 10:16:14.731299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.731420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.731443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.050 qpair failed and we were unable to recover it. 00:30:09.050 [2024-07-13 10:16:14.731668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.731839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.731864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.050 qpair failed and we were unable to recover it. 00:30:09.050 [2024-07-13 10:16:14.731996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.732119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.732143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.050 qpair failed and we were unable to recover it. 00:30:09.050 [2024-07-13 10:16:14.732323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.732446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.732469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.050 qpair failed and we were unable to recover it. 00:30:09.050 [2024-07-13 10:16:14.732683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.732829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.732854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.050 qpair failed and we were unable to recover it. 00:30:09.050 [2024-07-13 10:16:14.733058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.733204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.733228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.050 qpair failed and we were unable to recover it. 00:30:09.050 [2024-07-13 10:16:14.733357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.733506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.733529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.050 qpair failed and we were unable to recover it. 00:30:09.050 [2024-07-13 10:16:14.733710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.733848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.733879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.050 qpair failed and we were unable to recover it. 00:30:09.050 [2024-07-13 10:16:14.734072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.734282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.734331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.050 qpair failed and we were unable to recover it. 00:30:09.050 [2024-07-13 10:16:14.734473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.734628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.734653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.050 qpair failed and we were unable to recover it. 00:30:09.050 [2024-07-13 10:16:14.734809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.734939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.734965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.050 qpair failed and we were unable to recover it. 00:30:09.050 [2024-07-13 10:16:14.735088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.735248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.735274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.050 qpair failed and we were unable to recover it. 00:30:09.050 [2024-07-13 10:16:14.735413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.735553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.735579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.050 qpair failed and we were unable to recover it. 00:30:09.050 [2024-07-13 10:16:14.735756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.735909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.735934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.050 qpair failed and we were unable to recover it. 00:30:09.050 [2024-07-13 10:16:14.736112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.736292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.736317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.050 qpair failed and we were unable to recover it. 00:30:09.050 [2024-07-13 10:16:14.736495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.736660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.736689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.050 qpair failed and we were unable to recover it. 00:30:09.050 [2024-07-13 10:16:14.736852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.737024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.050 [2024-07-13 10:16:14.737051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.050 qpair failed and we were unable to recover it. 00:30:09.051 [2024-07-13 10:16:14.737219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.737333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.737359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.051 qpair failed and we were unable to recover it. 00:30:09.051 [2024-07-13 10:16:14.737489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.737664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.737687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.051 qpair failed and we were unable to recover it. 00:30:09.051 [2024-07-13 10:16:14.737838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.738008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.738035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.051 qpair failed and we were unable to recover it. 00:30:09.051 [2024-07-13 10:16:14.738183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.738374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.738401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.051 qpair failed and we were unable to recover it. 00:30:09.051 [2024-07-13 10:16:14.738572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.738731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.738756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.051 qpair failed and we were unable to recover it. 00:30:09.051 [2024-07-13 10:16:14.738895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.739062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.739090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.051 qpair failed and we were unable to recover it. 00:30:09.051 [2024-07-13 10:16:14.739256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.739443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.739496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.051 qpair failed and we were unable to recover it. 00:30:09.051 [2024-07-13 10:16:14.739659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.739802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.739829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.051 qpair failed and we were unable to recover it. 00:30:09.051 [2024-07-13 10:16:14.740011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.740161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.740185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.051 qpair failed and we were unable to recover it. 00:30:09.051 [2024-07-13 10:16:14.740367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.740492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.740516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.051 qpair failed and we were unable to recover it. 00:30:09.051 [2024-07-13 10:16:14.740668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.740835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.740860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.051 qpair failed and we were unable to recover it. 00:30:09.051 [2024-07-13 10:16:14.741054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.741206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.741230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.051 qpair failed and we were unable to recover it. 00:30:09.051 [2024-07-13 10:16:14.741358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.741511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.741535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.051 qpair failed and we were unable to recover it. 00:30:09.051 [2024-07-13 10:16:14.741685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.741836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.741861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.051 qpair failed and we were unable to recover it. 00:30:09.051 [2024-07-13 10:16:14.742024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.742176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.742201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.051 qpair failed and we were unable to recover it. 00:30:09.051 [2024-07-13 10:16:14.742329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.742536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.742563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.051 qpair failed and we were unable to recover it. 00:30:09.051 [2024-07-13 10:16:14.742728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.742905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.742931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.051 qpair failed and we were unable to recover it. 00:30:09.051 [2024-07-13 10:16:14.743107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.743234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.743258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.051 qpair failed and we were unable to recover it. 00:30:09.051 [2024-07-13 10:16:14.743438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.743567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.743590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.051 qpair failed and we were unable to recover it. 00:30:09.051 [2024-07-13 10:16:14.743720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.743891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.743919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.051 qpair failed and we were unable to recover it. 00:30:09.051 [2024-07-13 10:16:14.744114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.744258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.744283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.051 qpair failed and we were unable to recover it. 00:30:09.051 [2024-07-13 10:16:14.744432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.744579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.744603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.051 qpair failed and we were unable to recover it. 00:30:09.051 [2024-07-13 10:16:14.744754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.744946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.744972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.051 qpair failed and we were unable to recover it. 00:30:09.051 [2024-07-13 10:16:14.745158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.745387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.745437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.051 qpair failed and we were unable to recover it. 00:30:09.051 [2024-07-13 10:16:14.745618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.745744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.745769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.051 qpair failed and we were unable to recover it. 00:30:09.051 [2024-07-13 10:16:14.745926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.746070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.051 [2024-07-13 10:16:14.746095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.052 qpair failed and we were unable to recover it. 00:30:09.052 [2024-07-13 10:16:14.746262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.746447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.746505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.052 qpair failed and we were unable to recover it. 00:30:09.052 [2024-07-13 10:16:14.746698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.746878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.746906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.052 qpair failed and we were unable to recover it. 00:30:09.052 [2024-07-13 10:16:14.747102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.747250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.747275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.052 qpair failed and we were unable to recover it. 00:30:09.052 [2024-07-13 10:16:14.747455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.747622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.747651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.052 qpair failed and we were unable to recover it. 00:30:09.052 [2024-07-13 10:16:14.747842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.748030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.748057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.052 qpair failed and we were unable to recover it. 00:30:09.052 [2024-07-13 10:16:14.748210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.748328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.748353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.052 qpair failed and we were unable to recover it. 00:30:09.052 [2024-07-13 10:16:14.748506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.748686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.748710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.052 qpair failed and we were unable to recover it. 00:30:09.052 [2024-07-13 10:16:14.748903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.749043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.749071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.052 qpair failed and we were unable to recover it. 00:30:09.052 [2024-07-13 10:16:14.749209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.749377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.749406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.052 qpair failed and we were unable to recover it. 00:30:09.052 [2024-07-13 10:16:14.749566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.749730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.749762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.052 qpair failed and we were unable to recover it. 00:30:09.052 [2024-07-13 10:16:14.749931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.750109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.750151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.052 qpair failed and we were unable to recover it. 00:30:09.052 [2024-07-13 10:16:14.750349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.750589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.750637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.052 qpair failed and we were unable to recover it. 00:30:09.052 [2024-07-13 10:16:14.750806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.750961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.750987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.052 qpair failed and we were unable to recover it. 00:30:09.052 [2024-07-13 10:16:14.751140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.751327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.751368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.052 qpair failed and we were unable to recover it. 00:30:09.052 [2024-07-13 10:16:14.751556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.751726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.751751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.052 qpair failed and we were unable to recover it. 00:30:09.052 [2024-07-13 10:16:14.751907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.752060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.752085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.052 qpair failed and we were unable to recover it. 00:30:09.052 [2024-07-13 10:16:14.752236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.752412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.752471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.052 qpair failed and we were unable to recover it. 00:30:09.052 [2024-07-13 10:16:14.752655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.752809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.752837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.052 qpair failed and we were unable to recover it. 00:30:09.052 [2024-07-13 10:16:14.753048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.753223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.753247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.052 qpair failed and we were unable to recover it. 00:30:09.052 [2024-07-13 10:16:14.753397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.753557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.753585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.052 qpair failed and we were unable to recover it. 00:30:09.052 [2024-07-13 10:16:14.753714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.753890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.753916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.052 qpair failed and we were unable to recover it. 00:30:09.052 [2024-07-13 10:16:14.754112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.754254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.754278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.052 qpair failed and we were unable to recover it. 00:30:09.052 [2024-07-13 10:16:14.754431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.754591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.754616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.052 qpair failed and we were unable to recover it. 00:30:09.052 [2024-07-13 10:16:14.754740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.754965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.755008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.052 qpair failed and we were unable to recover it. 00:30:09.052 [2024-07-13 10:16:14.755148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.755347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.755374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.052 qpair failed and we were unable to recover it. 00:30:09.052 [2024-07-13 10:16:14.755536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.755680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.755708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.052 qpair failed and we were unable to recover it. 00:30:09.052 [2024-07-13 10:16:14.755852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.756037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.756063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.052 qpair failed and we were unable to recover it. 00:30:09.052 [2024-07-13 10:16:14.756185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.756337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.756362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.052 qpair failed and we were unable to recover it. 00:30:09.052 [2024-07-13 10:16:14.756517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.756694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.756720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.052 qpair failed and we were unable to recover it. 00:30:09.052 [2024-07-13 10:16:14.756877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.757045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.052 [2024-07-13 10:16:14.757077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.052 qpair failed and we were unable to recover it. 00:30:09.052 [2024-07-13 10:16:14.757233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.757385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.757411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.053 qpair failed and we were unable to recover it. 00:30:09.053 [2024-07-13 10:16:14.757610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.757770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.757798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.053 qpair failed and we were unable to recover it. 00:30:09.053 [2024-07-13 10:16:14.757997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.758141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.758169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.053 qpair failed and we were unable to recover it. 00:30:09.053 [2024-07-13 10:16:14.758318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.758494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.758518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.053 qpair failed and we were unable to recover it. 00:30:09.053 [2024-07-13 10:16:14.758670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.758818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.758842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.053 qpair failed and we were unable to recover it. 00:30:09.053 [2024-07-13 10:16:14.758988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.759106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.759130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.053 qpair failed and we were unable to recover it. 00:30:09.053 [2024-07-13 10:16:14.759274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.759422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.759446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.053 qpair failed and we were unable to recover it. 00:30:09.053 [2024-07-13 10:16:14.761014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.761229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.761255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.053 qpair failed and we were unable to recover it. 00:30:09.053 [2024-07-13 10:16:14.761441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.761565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.761589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.053 qpair failed and we were unable to recover it. 00:30:09.053 [2024-07-13 10:16:14.761729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.761931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.761961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.053 qpair failed and we were unable to recover it. 00:30:09.053 [2024-07-13 10:16:14.762113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.762239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.762264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.053 qpair failed and we were unable to recover it. 00:30:09.053 [2024-07-13 10:16:14.762418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.762595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.762619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.053 qpair failed and we were unable to recover it. 00:30:09.053 [2024-07-13 10:16:14.762744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.762877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.762902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.053 qpair failed and we were unable to recover it. 00:30:09.053 [2024-07-13 10:16:14.763077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.763272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.763300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.053 qpair failed and we were unable to recover it. 00:30:09.053 [2024-07-13 10:16:14.763462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.763613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.763637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.053 qpair failed and we were unable to recover it. 00:30:09.053 [2024-07-13 10:16:14.763788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.763967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.763993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.053 qpair failed and we were unable to recover it. 00:30:09.053 [2024-07-13 10:16:14.764118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.764290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.764317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.053 qpair failed and we were unable to recover it. 00:30:09.053 [2024-07-13 10:16:14.764441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.764597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.764636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.053 qpair failed and we were unable to recover it. 00:30:09.053 [2024-07-13 10:16:14.764798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.764986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.765014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.053 qpair failed and we were unable to recover it. 00:30:09.053 [2024-07-13 10:16:14.765180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.765386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.765434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.053 qpair failed and we were unable to recover it. 00:30:09.053 [2024-07-13 10:16:14.765611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.765766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.765791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.053 qpair failed and we were unable to recover it. 00:30:09.053 [2024-07-13 10:16:14.765941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.766065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.766090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.053 qpair failed and we were unable to recover it. 00:30:09.053 [2024-07-13 10:16:14.766287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.766474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.766523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.053 qpair failed and we were unable to recover it. 00:30:09.053 [2024-07-13 10:16:14.766691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.766835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.766861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.053 qpair failed and we were unable to recover it. 00:30:09.053 [2024-07-13 10:16:14.767007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.767159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.767183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.053 qpair failed and we were unable to recover it. 00:30:09.053 [2024-07-13 10:16:14.767355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.767530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.767556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.053 qpair failed and we were unable to recover it. 00:30:09.053 [2024-07-13 10:16:14.767678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.767798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.767822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.053 qpair failed and we were unable to recover it. 00:30:09.053 [2024-07-13 10:16:14.767953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.768103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.768128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.053 qpair failed and we were unable to recover it. 00:30:09.053 [2024-07-13 10:16:14.768272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.768426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.768453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.053 qpair failed and we were unable to recover it. 00:30:09.053 [2024-07-13 10:16:14.768611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.768739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.768764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.053 qpair failed and we were unable to recover it. 00:30:09.053 [2024-07-13 10:16:14.768946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.053 [2024-07-13 10:16:14.769119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.769162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.054 qpair failed and we were unable to recover it. 00:30:09.054 [2024-07-13 10:16:14.769336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.769463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.769487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.054 qpair failed and we were unable to recover it. 00:30:09.054 [2024-07-13 10:16:14.769617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.769805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.769832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.054 qpair failed and we were unable to recover it. 00:30:09.054 [2024-07-13 10:16:14.770017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.770183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.770211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.054 qpair failed and we were unable to recover it. 00:30:09.054 [2024-07-13 10:16:14.770347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.770510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.770537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.054 qpair failed and we were unable to recover it. 00:30:09.054 [2024-07-13 10:16:14.770665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.770819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.770843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.054 qpair failed and we were unable to recover it. 00:30:09.054 [2024-07-13 10:16:14.770993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.771140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.771181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.054 qpair failed and we were unable to recover it. 00:30:09.054 [2024-07-13 10:16:14.771356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.771532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.771576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.054 qpair failed and we were unable to recover it. 00:30:09.054 [2024-07-13 10:16:14.771740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.771914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.771942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.054 qpair failed and we were unable to recover it. 00:30:09.054 [2024-07-13 10:16:14.772126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.772321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.772345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.054 qpair failed and we were unable to recover it. 00:30:09.054 [2024-07-13 10:16:14.772529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.772704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.772729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.054 qpair failed and we were unable to recover it. 00:30:09.054 [2024-07-13 10:16:14.772882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.773007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.773031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.054 qpair failed and we were unable to recover it. 00:30:09.054 [2024-07-13 10:16:14.773233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.773379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.773404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.054 qpair failed and we were unable to recover it. 00:30:09.054 [2024-07-13 10:16:14.773557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.773741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.773765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.054 qpair failed and we were unable to recover it. 00:30:09.054 [2024-07-13 10:16:14.773943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.774069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.774093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.054 qpair failed and we were unable to recover it. 00:30:09.054 [2024-07-13 10:16:14.774324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.774582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.774607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.054 qpair failed and we were unable to recover it. 00:30:09.054 [2024-07-13 10:16:14.774758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.774907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.774932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.054 qpair failed and we were unable to recover it. 00:30:09.054 [2024-07-13 10:16:14.775057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.775218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.775243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.054 qpair failed and we were unable to recover it. 00:30:09.054 [2024-07-13 10:16:14.775367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.775514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.775537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.054 qpair failed and we were unable to recover it. 00:30:09.054 [2024-07-13 10:16:14.775665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.775842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.775902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.054 qpair failed and we were unable to recover it. 00:30:09.054 [2024-07-13 10:16:14.776054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.776207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.776232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.054 qpair failed and we were unable to recover it. 00:30:09.054 [2024-07-13 10:16:14.776359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.776512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.776535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.054 qpair failed and we were unable to recover it. 00:30:09.054 [2024-07-13 10:16:14.776690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.776840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.776864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.054 qpair failed and we were unable to recover it. 00:30:09.054 [2024-07-13 10:16:14.777027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.777182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.777223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.054 qpair failed and we were unable to recover it. 00:30:09.054 [2024-07-13 10:16:14.777352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.777511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.777538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.054 qpair failed and we were unable to recover it. 00:30:09.054 [2024-07-13 10:16:14.777674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.777802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.777829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.054 qpair failed and we were unable to recover it. 00:30:09.054 [2024-07-13 10:16:14.777998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.778159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.778183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.054 qpair failed and we were unable to recover it. 00:30:09.054 [2024-07-13 10:16:14.778335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.778481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.778507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.054 qpair failed and we were unable to recover it. 00:30:09.054 [2024-07-13 10:16:14.778654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.778796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.778824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.054 qpair failed and we were unable to recover it. 00:30:09.054 [2024-07-13 10:16:14.779035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.779164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.779188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.054 qpair failed and we were unable to recover it. 00:30:09.054 [2024-07-13 10:16:14.779309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.779482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.054 [2024-07-13 10:16:14.779507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.055 qpair failed and we were unable to recover it. 00:30:09.055 [2024-07-13 10:16:14.779635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.779783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.779808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.055 qpair failed and we were unable to recover it. 00:30:09.055 [2024-07-13 10:16:14.780000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.780151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.780176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.055 qpair failed and we were unable to recover it. 00:30:09.055 [2024-07-13 10:16:14.780303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.780473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.780500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.055 qpair failed and we were unable to recover it. 00:30:09.055 [2024-07-13 10:16:14.780671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.780828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.780852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.055 qpair failed and we were unable to recover it. 00:30:09.055 [2024-07-13 10:16:14.780990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.781107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.781131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.055 qpair failed and we were unable to recover it. 00:30:09.055 [2024-07-13 10:16:14.781292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.781487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.781515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.055 qpair failed and we were unable to recover it. 00:30:09.055 [2024-07-13 10:16:14.781690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.781854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.781890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.055 qpair failed and we were unable to recover it. 00:30:09.055 [2024-07-13 10:16:14.782040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.782230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.782255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.055 qpair failed and we were unable to recover it. 00:30:09.055 [2024-07-13 10:16:14.782382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.782501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.782526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.055 qpair failed and we were unable to recover it. 00:30:09.055 [2024-07-13 10:16:14.782682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.782848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.782883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.055 qpair failed and we were unable to recover it. 00:30:09.055 [2024-07-13 10:16:14.783042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.783219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.783248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.055 qpair failed and we were unable to recover it. 00:30:09.055 [2024-07-13 10:16:14.783461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.783581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.783606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.055 qpair failed and we were unable to recover it. 00:30:09.055 [2024-07-13 10:16:14.783738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.783929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.783954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.055 qpair failed and we were unable to recover it. 00:30:09.055 [2024-07-13 10:16:14.784105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.784235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.784274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.055 qpair failed and we were unable to recover it. 00:30:09.055 [2024-07-13 10:16:14.784410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.784544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.784572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.055 qpair failed and we were unable to recover it. 00:30:09.055 [2024-07-13 10:16:14.784712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.784861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.784893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.055 qpair failed and we were unable to recover it. 00:30:09.055 [2024-07-13 10:16:14.785025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.785226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.785254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.055 qpair failed and we were unable to recover it. 00:30:09.055 [2024-07-13 10:16:14.785451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.785662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.785706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.055 qpair failed and we were unable to recover it. 00:30:09.055 [2024-07-13 10:16:14.785875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.786018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.786045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.055 qpair failed and we were unable to recover it. 00:30:09.055 [2024-07-13 10:16:14.786243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.786388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.786414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.055 qpair failed and we were unable to recover it. 00:30:09.055 [2024-07-13 10:16:14.786620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.786774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.786800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.055 qpair failed and we were unable to recover it. 00:30:09.055 [2024-07-13 10:16:14.786939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.787116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.787141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.055 qpair failed and we were unable to recover it. 00:30:09.055 [2024-07-13 10:16:14.787277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.787425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.787450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.055 qpair failed and we were unable to recover it. 00:30:09.055 [2024-07-13 10:16:14.787597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.787747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.787772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.055 qpair failed and we were unable to recover it. 00:30:09.055 [2024-07-13 10:16:14.787932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.788111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.788135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.055 qpair failed and we were unable to recover it. 00:30:09.055 [2024-07-13 10:16:14.788253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.788380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.055 [2024-07-13 10:16:14.788404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.056 qpair failed and we were unable to recover it. 00:30:09.056 [2024-07-13 10:16:14.788523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.788652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.788676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.056 qpair failed and we were unable to recover it. 00:30:09.056 [2024-07-13 10:16:14.788830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.788990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.789015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.056 qpair failed and we were unable to recover it. 00:30:09.056 [2024-07-13 10:16:14.789146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.789305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.789330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.056 qpair failed and we were unable to recover it. 00:30:09.056 [2024-07-13 10:16:14.789479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.789627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.789652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.056 qpair failed and we were unable to recover it. 00:30:09.056 [2024-07-13 10:16:14.789806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.790002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.790030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.056 qpair failed and we were unable to recover it. 00:30:09.056 [2024-07-13 10:16:14.790202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.790325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.790350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.056 qpair failed and we were unable to recover it. 00:30:09.056 [2024-07-13 10:16:14.790485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.790598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.790621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.056 qpair failed and we were unable to recover it. 00:30:09.056 [2024-07-13 10:16:14.790761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.790934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.790964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.056 qpair failed and we were unable to recover it. 00:30:09.056 [2024-07-13 10:16:14.791153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.791294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.791322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.056 qpair failed and we were unable to recover it. 00:30:09.056 [2024-07-13 10:16:14.791469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.791627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.791652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.056 qpair failed and we were unable to recover it. 00:30:09.056 [2024-07-13 10:16:14.791780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.791906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.791932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.056 qpair failed and we were unable to recover it. 00:30:09.056 [2024-07-13 10:16:14.792107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.792250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.792275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.056 qpair failed and we were unable to recover it. 00:30:09.056 [2024-07-13 10:16:14.792431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.792563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.792587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.056 qpair failed and we were unable to recover it. 00:30:09.056 [2024-07-13 10:16:14.792709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.792834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.792858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.056 qpair failed and we were unable to recover it. 00:30:09.056 [2024-07-13 10:16:14.793030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.793218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.793245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.056 qpair failed and we were unable to recover it. 00:30:09.056 [2024-07-13 10:16:14.793401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.793583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.793634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.056 qpair failed and we were unable to recover it. 00:30:09.056 [2024-07-13 10:16:14.793798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.793925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.793954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.056 qpair failed and we were unable to recover it. 00:30:09.056 [2024-07-13 10:16:14.794123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.794238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.794262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.056 qpair failed and we were unable to recover it. 00:30:09.056 [2024-07-13 10:16:14.794394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.794570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.794595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.056 qpair failed and we were unable to recover it. 00:30:09.056 [2024-07-13 10:16:14.794712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.794838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.794863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.056 qpair failed and we were unable to recover it. 00:30:09.056 [2024-07-13 10:16:14.795034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.795184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.795209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.056 qpair failed and we were unable to recover it. 00:30:09.056 [2024-07-13 10:16:14.795335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.795488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.795512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.056 qpair failed and we were unable to recover it. 00:30:09.056 [2024-07-13 10:16:14.795636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.795778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.795803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.056 qpair failed and we were unable to recover it. 00:30:09.056 [2024-07-13 10:16:14.795927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.796090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.796115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.056 qpair failed and we were unable to recover it. 00:30:09.056 [2024-07-13 10:16:14.796265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.796393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.796420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.056 qpair failed and we were unable to recover it. 00:30:09.056 [2024-07-13 10:16:14.796569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.796742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.796766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.056 qpair failed and we were unable to recover it. 00:30:09.056 [2024-07-13 10:16:14.796932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.797055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.797079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.056 qpair failed and we were unable to recover it. 00:30:09.056 [2024-07-13 10:16:14.797257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.797378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.797404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.056 qpair failed and we were unable to recover it. 00:30:09.056 [2024-07-13 10:16:14.797556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.797692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.797717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.056 qpair failed and we were unable to recover it. 00:30:09.056 [2024-07-13 10:16:14.797900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.056 [2024-07-13 10:16:14.798033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.798060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.057 qpair failed and we were unable to recover it. 00:30:09.057 [2024-07-13 10:16:14.798236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.798437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.798481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.057 qpair failed and we were unable to recover it. 00:30:09.057 [2024-07-13 10:16:14.798643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.798810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.798837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.057 qpair failed and we were unable to recover it. 00:30:09.057 [2024-07-13 10:16:14.799018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.799166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.799192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.057 qpair failed and we were unable to recover it. 00:30:09.057 [2024-07-13 10:16:14.799336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.799515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.799540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.057 qpair failed and we were unable to recover it. 00:30:09.057 [2024-07-13 10:16:14.799689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.799841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.799874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.057 qpair failed and we were unable to recover it. 00:30:09.057 [2024-07-13 10:16:14.800024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.800192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.800220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.057 qpair failed and we were unable to recover it. 00:30:09.057 [2024-07-13 10:16:14.800383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.800529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.800556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.057 qpair failed and we were unable to recover it. 00:30:09.057 [2024-07-13 10:16:14.800718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.800872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.800899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.057 qpair failed and we were unable to recover it. 00:30:09.057 [2024-07-13 10:16:14.801026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.801155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.801179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.057 qpair failed and we were unable to recover it. 00:30:09.057 [2024-07-13 10:16:14.801330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.801500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.801527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.057 qpair failed and we were unable to recover it. 00:30:09.057 [2024-07-13 10:16:14.801667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.801801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.801828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.057 qpair failed and we were unable to recover it. 00:30:09.057 [2024-07-13 10:16:14.801990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.802144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.802169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.057 qpair failed and we were unable to recover it. 00:30:09.057 [2024-07-13 10:16:14.802349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.802503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.802546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.057 qpair failed and we were unable to recover it. 00:30:09.057 [2024-07-13 10:16:14.802696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.802851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.802898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.057 qpair failed and we were unable to recover it. 00:30:09.057 [2024-07-13 10:16:14.803052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.803207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.803231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.057 qpair failed and we were unable to recover it. 00:30:09.057 [2024-07-13 10:16:14.803371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.803523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.803547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.057 qpair failed and we were unable to recover it. 00:30:09.057 [2024-07-13 10:16:14.803698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.803861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.803898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.057 qpair failed and we were unable to recover it. 00:30:09.057 [2024-07-13 10:16:14.804052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.804207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.804233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.057 qpair failed and we were unable to recover it. 00:30:09.057 [2024-07-13 10:16:14.804386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.804510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.804535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.057 qpair failed and we were unable to recover it. 00:30:09.057 [2024-07-13 10:16:14.804688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.804837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.804889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.057 qpair failed and we were unable to recover it. 00:30:09.057 [2024-07-13 10:16:14.805029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.805194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.805221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.057 qpair failed and we were unable to recover it. 00:30:09.057 [2024-07-13 10:16:14.805361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.805511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.805536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.057 qpair failed and we were unable to recover it. 00:30:09.057 [2024-07-13 10:16:14.805716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.805875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.805901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.057 qpair failed and we were unable to recover it. 00:30:09.057 [2024-07-13 10:16:14.806089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.806245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.806274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.057 qpair failed and we were unable to recover it. 00:30:09.057 [2024-07-13 10:16:14.806447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.806598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.806622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.057 qpair failed and we were unable to recover it. 00:30:09.057 [2024-07-13 10:16:14.806774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.806899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.806926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.057 qpair failed and we were unable to recover it. 00:30:09.057 [2024-07-13 10:16:14.807052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.807219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.807246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.057 qpair failed and we were unable to recover it. 00:30:09.057 [2024-07-13 10:16:14.807421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.807579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.807604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.057 qpair failed and we were unable to recover it. 00:30:09.057 [2024-07-13 10:16:14.807759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.807908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.807950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.057 qpair failed and we were unable to recover it. 00:30:09.057 [2024-07-13 10:16:14.808081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.808251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.057 [2024-07-13 10:16:14.808278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.057 qpair failed and we were unable to recover it. 00:30:09.058 [2024-07-13 10:16:14.808479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.808621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.808645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.058 qpair failed and we were unable to recover it. 00:30:09.058 [2024-07-13 10:16:14.808767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.808912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.808938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.058 qpair failed and we were unable to recover it. 00:30:09.058 [2024-07-13 10:16:14.809100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.809263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.809288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.058 qpair failed and we were unable to recover it. 00:30:09.058 [2024-07-13 10:16:14.809475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.809592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.809620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.058 qpair failed and we were unable to recover it. 00:30:09.058 [2024-07-13 10:16:14.809769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.809919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.809944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.058 qpair failed and we were unable to recover it. 00:30:09.058 [2024-07-13 10:16:14.810120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.810245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.810270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.058 qpair failed and we were unable to recover it. 00:30:09.058 [2024-07-13 10:16:14.810416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.810532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.810556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.058 qpair failed and we were unable to recover it. 00:30:09.058 [2024-07-13 10:16:14.810715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.810900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.810927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.058 qpair failed and we were unable to recover it. 00:30:09.058 [2024-07-13 10:16:14.811142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.811311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.811335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.058 qpair failed and we were unable to recover it. 00:30:09.058 [2024-07-13 10:16:14.811484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.811607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.811631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.058 qpair failed and we were unable to recover it. 00:30:09.058 [2024-07-13 10:16:14.811788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.811946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.811971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.058 qpair failed and we were unable to recover it. 00:30:09.058 [2024-07-13 10:16:14.812115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.812264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.812289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.058 qpair failed and we were unable to recover it. 00:30:09.058 [2024-07-13 10:16:14.812440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.812564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.812588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.058 qpair failed and we were unable to recover it. 00:30:09.058 [2024-07-13 10:16:14.812738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.812928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.812957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.058 qpair failed and we were unable to recover it. 00:30:09.058 [2024-07-13 10:16:14.813107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.813287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.813314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.058 qpair failed and we were unable to recover it. 00:30:09.058 [2024-07-13 10:16:14.813477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.813598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.813625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.058 qpair failed and we were unable to recover it. 00:30:09.058 [2024-07-13 10:16:14.813755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.813899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.813927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.058 qpair failed and we were unable to recover it. 00:30:09.058 [2024-07-13 10:16:14.814073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.814240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.814266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.058 qpair failed and we were unable to recover it. 00:30:09.058 [2024-07-13 10:16:14.814415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.814562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.814588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.058 qpair failed and we were unable to recover it. 00:30:09.058 [2024-07-13 10:16:14.814711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.814829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.814853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.058 qpair failed and we were unable to recover it. 00:30:09.058 [2024-07-13 10:16:14.815005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.815133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.815160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.058 qpair failed and we were unable to recover it. 00:30:09.058 [2024-07-13 10:16:14.815322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.815465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.815490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.058 qpair failed and we were unable to recover it. 00:30:09.058 [2024-07-13 10:16:14.815644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.815774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.815798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.058 qpair failed and we were unable to recover it. 00:30:09.058 [2024-07-13 10:16:14.815951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.816102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.816131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.058 qpair failed and we were unable to recover it. 00:30:09.058 [2024-07-13 10:16:14.816254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.816430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.816455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.058 qpair failed and we were unable to recover it. 00:30:09.058 [2024-07-13 10:16:14.816580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.816722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.816746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.058 qpair failed and we were unable to recover it. 00:30:09.058 [2024-07-13 10:16:14.816871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.817002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.817026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.058 qpair failed and we were unable to recover it. 00:30:09.058 [2024-07-13 10:16:14.817167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.817313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.817355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.058 qpair failed and we were unable to recover it. 00:30:09.058 [2024-07-13 10:16:14.817521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.817710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.817736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.058 qpair failed and we were unable to recover it. 00:30:09.058 [2024-07-13 10:16:14.817912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.818038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.058 [2024-07-13 10:16:14.818063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.058 qpair failed and we were unable to recover it. 00:30:09.058 [2024-07-13 10:16:14.818212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.059 [2024-07-13 10:16:14.818330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.059 [2024-07-13 10:16:14.818355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.059 qpair failed and we were unable to recover it. 00:30:09.059 [2024-07-13 10:16:14.818485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.059 [2024-07-13 10:16:14.818633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.059 [2024-07-13 10:16:14.818658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.059 qpair failed and we were unable to recover it. 00:30:09.059 [2024-07-13 10:16:14.818774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.059 [2024-07-13 10:16:14.818932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.059 [2024-07-13 10:16:14.818957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.059 qpair failed and we were unable to recover it. 00:30:09.059 [2024-07-13 10:16:14.819086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.059 [2024-07-13 10:16:14.819237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.059 [2024-07-13 10:16:14.819277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.059 qpair failed and we were unable to recover it. 00:30:09.059 [2024-07-13 10:16:14.819450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.059 [2024-07-13 10:16:14.819590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.059 [2024-07-13 10:16:14.819617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.059 qpair failed and we were unable to recover it. 00:30:09.059 [2024-07-13 10:16:14.819754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.059 [2024-07-13 10:16:14.819941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.059 [2024-07-13 10:16:14.819970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.059 qpair failed and we were unable to recover it. 00:30:09.059 [2024-07-13 10:16:14.820102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.059 [2024-07-13 10:16:14.820277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.337 [2024-07-13 10:16:14.820305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.337 qpair failed and we were unable to recover it. 00:30:09.337 [2024-07-13 10:16:14.820478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.337 [2024-07-13 10:16:14.820624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.337 [2024-07-13 10:16:14.820649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.338 qpair failed and we were unable to recover it. 00:30:09.338 [2024-07-13 10:16:14.820843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.821054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.821080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.338 qpair failed and we were unable to recover it. 00:30:09.338 [2024-07-13 10:16:14.821239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.821386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.821410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.338 qpair failed and we were unable to recover it. 00:30:09.338 [2024-07-13 10:16:14.821573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.821734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.821761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.338 qpair failed and we were unable to recover it. 00:30:09.338 [2024-07-13 10:16:14.821941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.822081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.822105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.338 qpair failed and we were unable to recover it. 00:30:09.338 [2024-07-13 10:16:14.822252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.822369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.822393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.338 qpair failed and we were unable to recover it. 00:30:09.338 [2024-07-13 10:16:14.822606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.822737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.822764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.338 qpair failed and we were unable to recover it. 00:30:09.338 [2024-07-13 10:16:14.822905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.823067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.823092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.338 qpair failed and we were unable to recover it. 00:30:09.338 [2024-07-13 10:16:14.823247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.823399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.823424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.338 qpair failed and we were unable to recover it. 00:30:09.338 [2024-07-13 10:16:14.823550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.823697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.823722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.338 qpair failed and we were unable to recover it. 00:30:09.338 [2024-07-13 10:16:14.823851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.824007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.824032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.338 qpair failed and we were unable to recover it. 00:30:09.338 [2024-07-13 10:16:14.824160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.824313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.824337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.338 qpair failed and we were unable to recover it. 00:30:09.338 [2024-07-13 10:16:14.824516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.824685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.824711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.338 qpair failed and we were unable to recover it. 00:30:09.338 [2024-07-13 10:16:14.824878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.825053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.825078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.338 qpair failed and we were unable to recover it. 00:30:09.338 [2024-07-13 10:16:14.825272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.825449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.825476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.338 qpair failed and we were unable to recover it. 00:30:09.338 [2024-07-13 10:16:14.825630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.825787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.825815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.338 qpair failed and we were unable to recover it. 00:30:09.338 [2024-07-13 10:16:14.825993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.826148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.826191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.338 qpair failed and we were unable to recover it. 00:30:09.338 [2024-07-13 10:16:14.826354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.826513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.826538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.338 qpair failed and we were unable to recover it. 00:30:09.338 [2024-07-13 10:16:14.826687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.826889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.826935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.338 qpair failed and we were unable to recover it. 00:30:09.338 [2024-07-13 10:16:14.827150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.827296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.827320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.338 qpair failed and we were unable to recover it. 00:30:09.338 [2024-07-13 10:16:14.827465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.827619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.827659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.338 qpair failed and we were unable to recover it. 00:30:09.338 [2024-07-13 10:16:14.827781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.827941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.827966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.338 qpair failed and we were unable to recover it. 00:30:09.338 [2024-07-13 10:16:14.828152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.828290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.828316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.338 qpair failed and we were unable to recover it. 00:30:09.338 [2024-07-13 10:16:14.828469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.828594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.828619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.338 qpair failed and we were unable to recover it. 00:30:09.338 [2024-07-13 10:16:14.828789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.828917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.828943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.338 qpair failed and we were unable to recover it. 00:30:09.338 [2024-07-13 10:16:14.829084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.829274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.829298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.338 qpair failed and we were unable to recover it. 00:30:09.338 [2024-07-13 10:16:14.829422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.829626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.829651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.338 qpair failed and we were unable to recover it. 00:30:09.338 [2024-07-13 10:16:14.829805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.830000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.830026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.338 qpair failed and we were unable to recover it. 00:30:09.338 [2024-07-13 10:16:14.830179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.830344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.830369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.338 qpair failed and we were unable to recover it. 00:30:09.338 [2024-07-13 10:16:14.830501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.830652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.830677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.338 qpair failed and we were unable to recover it. 00:30:09.338 [2024-07-13 10:16:14.830847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.338 [2024-07-13 10:16:14.830996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.831022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.339 qpair failed and we were unable to recover it. 00:30:09.339 [2024-07-13 10:16:14.831175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.831325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.831350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.339 qpair failed and we were unable to recover it. 00:30:09.339 [2024-07-13 10:16:14.831506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.831626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.831651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.339 qpair failed and we were unable to recover it. 00:30:09.339 [2024-07-13 10:16:14.831800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.831948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.831974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.339 qpair failed and we were unable to recover it. 00:30:09.339 [2024-07-13 10:16:14.832128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.832279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.832304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.339 qpair failed and we were unable to recover it. 00:30:09.339 [2024-07-13 10:16:14.832455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.832604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.832629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.339 qpair failed and we were unable to recover it. 00:30:09.339 [2024-07-13 10:16:14.832764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.832944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.832970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.339 qpair failed and we were unable to recover it. 00:30:09.339 [2024-07-13 10:16:14.833098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.833226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.833252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.339 qpair failed and we were unable to recover it. 00:30:09.339 [2024-07-13 10:16:14.833382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.833533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.833558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.339 qpair failed and we were unable to recover it. 00:30:09.339 [2024-07-13 10:16:14.833733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.833877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.833902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.339 qpair failed and we were unable to recover it. 00:30:09.339 [2024-07-13 10:16:14.834023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.834150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.834177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.339 qpair failed and we were unable to recover it. 00:30:09.339 [2024-07-13 10:16:14.834329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.834481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.834505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.339 qpair failed and we were unable to recover it. 00:30:09.339 [2024-07-13 10:16:14.834655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.834802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.834827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.339 qpair failed and we were unable to recover it. 00:30:09.339 [2024-07-13 10:16:14.834955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.835082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.835107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.339 qpair failed and we were unable to recover it. 00:30:09.339 [2024-07-13 10:16:14.835233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.835353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.835378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.339 qpair failed and we were unable to recover it. 00:30:09.339 [2024-07-13 10:16:14.835536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.835697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.835721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.339 qpair failed and we were unable to recover it. 00:30:09.339 [2024-07-13 10:16:14.835842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.835981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.836006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.339 qpair failed and we were unable to recover it. 00:30:09.339 [2024-07-13 10:16:14.836136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.836321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.836346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.339 qpair failed and we were unable to recover it. 00:30:09.339 [2024-07-13 10:16:14.836525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.836692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.836716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.339 qpair failed and we were unable to recover it. 00:30:09.339 [2024-07-13 10:16:14.836844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.836999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.837024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.339 qpair failed and we were unable to recover it. 00:30:09.339 [2024-07-13 10:16:14.837199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.837346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.837371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.339 qpair failed and we were unable to recover it. 00:30:09.339 [2024-07-13 10:16:14.837501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.837652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.837677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.339 qpair failed and we were unable to recover it. 00:30:09.339 [2024-07-13 10:16:14.837830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.837965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.837990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.339 qpair failed and we were unable to recover it. 00:30:09.339 [2024-07-13 10:16:14.838143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.838290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.838315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.339 qpair failed and we were unable to recover it. 00:30:09.339 [2024-07-13 10:16:14.838438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.838610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.838635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.339 qpair failed and we were unable to recover it. 00:30:09.339 [2024-07-13 10:16:14.838791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.838977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.839003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.339 qpair failed and we were unable to recover it. 00:30:09.339 [2024-07-13 10:16:14.839126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.839303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.839328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.339 qpair failed and we were unable to recover it. 00:30:09.339 [2024-07-13 10:16:14.839498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.839649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.839675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.339 qpair failed and we were unable to recover it. 00:30:09.339 [2024-07-13 10:16:14.839830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.839987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.840013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.339 qpair failed and we were unable to recover it. 00:30:09.339 [2024-07-13 10:16:14.840168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.840341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.840366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.339 qpair failed and we were unable to recover it. 00:30:09.339 [2024-07-13 10:16:14.840515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.339 [2024-07-13 10:16:14.840636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.840661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.340 qpair failed and we were unable to recover it. 00:30:09.340 [2024-07-13 10:16:14.840816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.840991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.841017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.340 qpair failed and we were unable to recover it. 00:30:09.340 [2024-07-13 10:16:14.841176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.841333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.841357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.340 qpair failed and we were unable to recover it. 00:30:09.340 [2024-07-13 10:16:14.841535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.841686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.841711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.340 qpair failed and we were unable to recover it. 00:30:09.340 [2024-07-13 10:16:14.841861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.841997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.842022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.340 qpair failed and we were unable to recover it. 00:30:09.340 [2024-07-13 10:16:14.842178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.842337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.842362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.340 qpair failed and we were unable to recover it. 00:30:09.340 [2024-07-13 10:16:14.842512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.842666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.842691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.340 qpair failed and we were unable to recover it. 00:30:09.340 [2024-07-13 10:16:14.842850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.842976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.843003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.340 qpair failed and we were unable to recover it. 00:30:09.340 [2024-07-13 10:16:14.843124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.843283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.843308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.340 qpair failed and we were unable to recover it. 00:30:09.340 [2024-07-13 10:16:14.843462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.843641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.843665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.340 qpair failed and we were unable to recover it. 00:30:09.340 [2024-07-13 10:16:14.843808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.843928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.843954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.340 qpair failed and we were unable to recover it. 00:30:09.340 [2024-07-13 10:16:14.844129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.844279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.844304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.340 qpair failed and we were unable to recover it. 00:30:09.340 [2024-07-13 10:16:14.844480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.844627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.844651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.340 qpair failed and we were unable to recover it. 00:30:09.340 [2024-07-13 10:16:14.844802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.844949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.844975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.340 qpair failed and we were unable to recover it. 00:30:09.340 [2024-07-13 10:16:14.845130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.845301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.845325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.340 qpair failed and we were unable to recover it. 00:30:09.340 [2024-07-13 10:16:14.845476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.845630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.845654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.340 qpair failed and we were unable to recover it. 00:30:09.340 [2024-07-13 10:16:14.845779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.845902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.845927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.340 qpair failed and we were unable to recover it. 00:30:09.340 [2024-07-13 10:16:14.846057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.846221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.846247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.340 qpair failed and we were unable to recover it. 00:30:09.340 [2024-07-13 10:16:14.846366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.846484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.846510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.340 qpair failed and we were unable to recover it. 00:30:09.340 [2024-07-13 10:16:14.846637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.846781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.846806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.340 qpair failed and we were unable to recover it. 00:30:09.340 [2024-07-13 10:16:14.846957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.847134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.847159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.340 qpair failed and we were unable to recover it. 00:30:09.340 [2024-07-13 10:16:14.847334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.847454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.847479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.340 qpair failed and we were unable to recover it. 00:30:09.340 [2024-07-13 10:16:14.847652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.847773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.847798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.340 qpair failed and we were unable to recover it. 00:30:09.340 [2024-07-13 10:16:14.847973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.848122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.848147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.340 qpair failed and we were unable to recover it. 00:30:09.340 [2024-07-13 10:16:14.848297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.848441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.848466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.340 qpair failed and we were unable to recover it. 00:30:09.340 [2024-07-13 10:16:14.848587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.848710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.848735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.340 qpair failed and we were unable to recover it. 00:30:09.340 [2024-07-13 10:16:14.848882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.849058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.849082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.340 qpair failed and we were unable to recover it. 00:30:09.340 [2024-07-13 10:16:14.849205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.849357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.849382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.340 qpair failed and we were unable to recover it. 00:30:09.340 [2024-07-13 10:16:14.849552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.849725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.849750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.340 qpair failed and we were unable to recover it. 00:30:09.340 [2024-07-13 10:16:14.849896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.850020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.850045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.340 qpair failed and we were unable to recover it. 00:30:09.340 [2024-07-13 10:16:14.850189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.850362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.340 [2024-07-13 10:16:14.850386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.341 qpair failed and we were unable to recover it. 00:30:09.341 [2024-07-13 10:16:14.850513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.850689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.850713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.341 qpair failed and we were unable to recover it. 00:30:09.341 [2024-07-13 10:16:14.850839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.850964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.850989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.341 qpair failed and we were unable to recover it. 00:30:09.341 [2024-07-13 10:16:14.851175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.851323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.851347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.341 qpair failed and we were unable to recover it. 00:30:09.341 [2024-07-13 10:16:14.851496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.851647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.851672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.341 qpair failed and we were unable to recover it. 00:30:09.341 [2024-07-13 10:16:14.851825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.851960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.851986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.341 qpair failed and we were unable to recover it. 00:30:09.341 [2024-07-13 10:16:14.852110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.852263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.852287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.341 qpair failed and we were unable to recover it. 00:30:09.341 [2024-07-13 10:16:14.852415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.852542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.852568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.341 qpair failed and we were unable to recover it. 00:30:09.341 [2024-07-13 10:16:14.852718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.852900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.852926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.341 qpair failed and we were unable to recover it. 00:30:09.341 [2024-07-13 10:16:14.853049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.853171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.853198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.341 qpair failed and we were unable to recover it. 00:30:09.341 [2024-07-13 10:16:14.853350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.853478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.853503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.341 qpair failed and we were unable to recover it. 00:30:09.341 [2024-07-13 10:16:14.853657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.853806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.853830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.341 qpair failed and we were unable to recover it. 00:30:09.341 [2024-07-13 10:16:14.853965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.854113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.854137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.341 qpair failed and we were unable to recover it. 00:30:09.341 [2024-07-13 10:16:14.854314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.854435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.854460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.341 qpair failed and we were unable to recover it. 00:30:09.341 [2024-07-13 10:16:14.854582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.854706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.854730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.341 qpair failed and we were unable to recover it. 00:30:09.341 [2024-07-13 10:16:14.854855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.854983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.855008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.341 qpair failed and we were unable to recover it. 00:30:09.341 [2024-07-13 10:16:14.855125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.855249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.855274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.341 qpair failed and we were unable to recover it. 00:30:09.341 [2024-07-13 10:16:14.855426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.855568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.855597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.341 qpair failed and we were unable to recover it. 00:30:09.341 [2024-07-13 10:16:14.855775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.855892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.855917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.341 qpair failed and we were unable to recover it. 00:30:09.341 [2024-07-13 10:16:14.856040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.856160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.856185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.341 qpair failed and we were unable to recover it. 00:30:09.341 [2024-07-13 10:16:14.856363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.856513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.856538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.341 qpair failed and we were unable to recover it. 00:30:09.341 [2024-07-13 10:16:14.856656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.856802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.856826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.341 qpair failed and we were unable to recover it. 00:30:09.341 [2024-07-13 10:16:14.856984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.857134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.857159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.341 qpair failed and we were unable to recover it. 00:30:09.341 [2024-07-13 10:16:14.857282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.857435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.857459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.341 qpair failed and we were unable to recover it. 00:30:09.341 [2024-07-13 10:16:14.857575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.857694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.857719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.341 qpair failed and we were unable to recover it. 00:30:09.341 [2024-07-13 10:16:14.857846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.857977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.858002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.341 qpair failed and we were unable to recover it. 00:30:09.341 [2024-07-13 10:16:14.858150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.858297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.858321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.341 qpair failed and we were unable to recover it. 00:30:09.341 [2024-07-13 10:16:14.858475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.858624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.858653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.341 qpair failed and we were unable to recover it. 00:30:09.341 [2024-07-13 10:16:14.858800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.858916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.858941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.341 qpair failed and we were unable to recover it. 00:30:09.341 [2024-07-13 10:16:14.859089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.859207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.859234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.341 qpair failed and we were unable to recover it. 00:30:09.341 [2024-07-13 10:16:14.859359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.859506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.341 [2024-07-13 10:16:14.859531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.341 qpair failed and we were unable to recover it. 00:30:09.341 [2024-07-13 10:16:14.859707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.859830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.859854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.342 qpair failed and we were unable to recover it. 00:30:09.342 [2024-07-13 10:16:14.860053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.860172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.860197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.342 qpair failed and we were unable to recover it. 00:30:09.342 [2024-07-13 10:16:14.860312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.860455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.860480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.342 qpair failed and we were unable to recover it. 00:30:09.342 [2024-07-13 10:16:14.860655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.860783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.860808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.342 qpair failed and we were unable to recover it. 00:30:09.342 [2024-07-13 10:16:14.860982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.861102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.861127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.342 qpair failed and we were unable to recover it. 00:30:09.342 [2024-07-13 10:16:14.861275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.861422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.861446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.342 qpair failed and we were unable to recover it. 00:30:09.342 [2024-07-13 10:16:14.861595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.861743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.861772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.342 qpair failed and we were unable to recover it. 00:30:09.342 [2024-07-13 10:16:14.861918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.862071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.862095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.342 qpair failed and we were unable to recover it. 00:30:09.342 [2024-07-13 10:16:14.862218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.862342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.862367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.342 qpair failed and we were unable to recover it. 00:30:09.342 [2024-07-13 10:16:14.862516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.862641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.862665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.342 qpair failed and we were unable to recover it. 00:30:09.342 [2024-07-13 10:16:14.862823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.862959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.862985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.342 qpair failed and we were unable to recover it. 00:30:09.342 [2024-07-13 10:16:14.863134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.863284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.863310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.342 qpair failed and we were unable to recover it. 00:30:09.342 [2024-07-13 10:16:14.863437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.863617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.863641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.342 qpair failed and we were unable to recover it. 00:30:09.342 [2024-07-13 10:16:14.863769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.863917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.863943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.342 qpair failed and we were unable to recover it. 00:30:09.342 [2024-07-13 10:16:14.864092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.864248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.864274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.342 qpair failed and we were unable to recover it. 00:30:09.342 [2024-07-13 10:16:14.864427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.864602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.864627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.342 qpair failed and we were unable to recover it. 00:30:09.342 [2024-07-13 10:16:14.864787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.864968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.864997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.342 qpair failed and we were unable to recover it. 00:30:09.342 [2024-07-13 10:16:14.865119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.865267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.865292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.342 qpair failed and we were unable to recover it. 00:30:09.342 [2024-07-13 10:16:14.865434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.865562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.865588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.342 qpair failed and we were unable to recover it. 00:30:09.342 [2024-07-13 10:16:14.865735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.865880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.865905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.342 qpair failed and we were unable to recover it. 00:30:09.342 [2024-07-13 10:16:14.866037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.866191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.866216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.342 qpair failed and we were unable to recover it. 00:30:09.342 [2024-07-13 10:16:14.866345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.866470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.866494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.342 qpair failed and we were unable to recover it. 00:30:09.342 [2024-07-13 10:16:14.866621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.866796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.866820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.342 qpair failed and we were unable to recover it. 00:30:09.342 [2024-07-13 10:16:14.866972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.867098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.342 [2024-07-13 10:16:14.867123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.342 qpair failed and we were unable to recover it. 00:30:09.342 [2024-07-13 10:16:14.867276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.867389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.867413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.343 qpair failed and we were unable to recover it. 00:30:09.343 [2024-07-13 10:16:14.867533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.867685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.867710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.343 qpair failed and we were unable to recover it. 00:30:09.343 [2024-07-13 10:16:14.867857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.868012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.868037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.343 qpair failed and we were unable to recover it. 00:30:09.343 [2024-07-13 10:16:14.868195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.868343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.868368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.343 qpair failed and we were unable to recover it. 00:30:09.343 [2024-07-13 10:16:14.868546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.868663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.868687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.343 qpair failed and we were unable to recover it. 00:30:09.343 [2024-07-13 10:16:14.868837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.869015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.869041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.343 qpair failed and we were unable to recover it. 00:30:09.343 [2024-07-13 10:16:14.869210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.869354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.869379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.343 qpair failed and we were unable to recover it. 00:30:09.343 [2024-07-13 10:16:14.869525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.869670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.869694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.343 qpair failed and we were unable to recover it. 00:30:09.343 [2024-07-13 10:16:14.869838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.869997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.870022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.343 qpair failed and we were unable to recover it. 00:30:09.343 [2024-07-13 10:16:14.870141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.870293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.870319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.343 qpair failed and we were unable to recover it. 00:30:09.343 [2024-07-13 10:16:14.870457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.870583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.870609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.343 qpair failed and we were unable to recover it. 00:30:09.343 [2024-07-13 10:16:14.870759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.870913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.870939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.343 qpair failed and we were unable to recover it. 00:30:09.343 [2024-07-13 10:16:14.871092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.871268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.871292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.343 qpair failed and we were unable to recover it. 00:30:09.343 [2024-07-13 10:16:14.871447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.871599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.871623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.343 qpair failed and we were unable to recover it. 00:30:09.343 [2024-07-13 10:16:14.871773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.871911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.871937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.343 qpair failed and we were unable to recover it. 00:30:09.343 [2024-07-13 10:16:14.872085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.872201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.872225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.343 qpair failed and we were unable to recover it. 00:30:09.343 [2024-07-13 10:16:14.872351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.872502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.872528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.343 qpair failed and we were unable to recover it. 00:30:09.343 [2024-07-13 10:16:14.872682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.872861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.872892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.343 qpair failed and we were unable to recover it. 00:30:09.343 [2024-07-13 10:16:14.873021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.873175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.873200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.343 qpair failed and we were unable to recover it. 00:30:09.343 [2024-07-13 10:16:14.873354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.873527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.873552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.343 qpair failed and we were unable to recover it. 00:30:09.343 [2024-07-13 10:16:14.873690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.873840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.873870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.343 qpair failed and we were unable to recover it. 00:30:09.343 [2024-07-13 10:16:14.874007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.874125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.874149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.343 qpair failed and we were unable to recover it. 00:30:09.343 [2024-07-13 10:16:14.874303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.874451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.874476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.343 qpair failed and we were unable to recover it. 00:30:09.343 [2024-07-13 10:16:14.874650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.874796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.874820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.343 qpair failed and we were unable to recover it. 00:30:09.343 [2024-07-13 10:16:14.874940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.875075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.875100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.343 qpair failed and we were unable to recover it. 00:30:09.343 [2024-07-13 10:16:14.875252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.875423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.875447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.343 qpair failed and we were unable to recover it. 00:30:09.343 [2024-07-13 10:16:14.875621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.875796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.875820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.343 qpair failed and we were unable to recover it. 00:30:09.343 [2024-07-13 10:16:14.875941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.876126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.876151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.343 qpair failed and we were unable to recover it. 00:30:09.343 [2024-07-13 10:16:14.876291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.876435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.876460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.343 qpair failed and we were unable to recover it. 00:30:09.343 [2024-07-13 10:16:14.876609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.876735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.876760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.343 qpair failed and we were unable to recover it. 00:30:09.343 [2024-07-13 10:16:14.876925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.343 [2024-07-13 10:16:14.877076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.877101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.344 qpair failed and we were unable to recover it. 00:30:09.344 [2024-07-13 10:16:14.877231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.877382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.877407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.344 qpair failed and we were unable to recover it. 00:30:09.344 [2024-07-13 10:16:14.877560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.877730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.877754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.344 qpair failed and we were unable to recover it. 00:30:09.344 [2024-07-13 10:16:14.877907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.878028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.878053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.344 qpair failed and we were unable to recover it. 00:30:09.344 [2024-07-13 10:16:14.878200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.878375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.878400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.344 qpair failed and we were unable to recover it. 00:30:09.344 [2024-07-13 10:16:14.878551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.878676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.878702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.344 qpair failed and we were unable to recover it. 00:30:09.344 [2024-07-13 10:16:14.878831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.878952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.878977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.344 qpair failed and we were unable to recover it. 00:30:09.344 [2024-07-13 10:16:14.879137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.879286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.879310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.344 qpair failed and we were unable to recover it. 00:30:09.344 [2024-07-13 10:16:14.879459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.879609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.879634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.344 qpair failed and we were unable to recover it. 00:30:09.344 [2024-07-13 10:16:14.879783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.879909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.879935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.344 qpair failed and we were unable to recover it. 00:30:09.344 [2024-07-13 10:16:14.880094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.880212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.880237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.344 qpair failed and we were unable to recover it. 00:30:09.344 [2024-07-13 10:16:14.880410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.880556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.880580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.344 qpair failed and we were unable to recover it. 00:30:09.344 [2024-07-13 10:16:14.880706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.880824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.880849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.344 qpair failed and we were unable to recover it. 00:30:09.344 [2024-07-13 10:16:14.881015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.881176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.881201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.344 qpair failed and we were unable to recover it. 00:30:09.344 [2024-07-13 10:16:14.881337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.881457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.881482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.344 qpair failed and we were unable to recover it. 00:30:09.344 [2024-07-13 10:16:14.881633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.881758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.881782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.344 qpair failed and we were unable to recover it. 00:30:09.344 [2024-07-13 10:16:14.881928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.882077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.882102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.344 qpair failed and we were unable to recover it. 00:30:09.344 [2024-07-13 10:16:14.882227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.882350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.882375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.344 qpair failed and we were unable to recover it. 00:30:09.344 [2024-07-13 10:16:14.882523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.882650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.882676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.344 qpair failed and we were unable to recover it. 00:30:09.344 [2024-07-13 10:16:14.882807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.882958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.882983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.344 qpair failed and we were unable to recover it. 00:30:09.344 [2024-07-13 10:16:14.883118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.883263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.883287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.344 qpair failed and we were unable to recover it. 00:30:09.344 [2024-07-13 10:16:14.883407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.883538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.883563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.344 qpair failed and we were unable to recover it. 00:30:09.344 [2024-07-13 10:16:14.883748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.883898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.883923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.344 qpair failed and we were unable to recover it. 00:30:09.344 [2024-07-13 10:16:14.884082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.884216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.884241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.344 qpair failed and we were unable to recover it. 00:30:09.344 [2024-07-13 10:16:14.884389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.884563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.884588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.344 qpair failed and we were unable to recover it. 00:30:09.344 [2024-07-13 10:16:14.884740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.884886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.884911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.344 qpair failed and we were unable to recover it. 00:30:09.344 [2024-07-13 10:16:14.885063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.885208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.885233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.344 qpair failed and we were unable to recover it. 00:30:09.344 [2024-07-13 10:16:14.885356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.885498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.885522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.344 qpair failed and we were unable to recover it. 00:30:09.344 [2024-07-13 10:16:14.885672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.885819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.885844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.344 qpair failed and we were unable to recover it. 00:30:09.344 [2024-07-13 10:16:14.886005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.886124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.886150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.344 qpair failed and we were unable to recover it. 00:30:09.344 [2024-07-13 10:16:14.886307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.886434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.344 [2024-07-13 10:16:14.886460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.344 qpair failed and we were unable to recover it. 00:30:09.345 [2024-07-13 10:16:14.886610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.886762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.886786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.345 qpair failed and we were unable to recover it. 00:30:09.345 [2024-07-13 10:16:14.886910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.887060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.887084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.345 qpair failed and we were unable to recover it. 00:30:09.345 [2024-07-13 10:16:14.887210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.887336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.887360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.345 qpair failed and we were unable to recover it. 00:30:09.345 [2024-07-13 10:16:14.887489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.887638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.887663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.345 qpair failed and we were unable to recover it. 00:30:09.345 [2024-07-13 10:16:14.887807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.887937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.887962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.345 qpair failed and we were unable to recover it. 00:30:09.345 [2024-07-13 10:16:14.888114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.888238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.888263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.345 qpair failed and we were unable to recover it. 00:30:09.345 [2024-07-13 10:16:14.888408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.888524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.888549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.345 qpair failed and we were unable to recover it. 00:30:09.345 [2024-07-13 10:16:14.888673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.888822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.888846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.345 qpair failed and we were unable to recover it. 00:30:09.345 [2024-07-13 10:16:14.888968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.889095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.889119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.345 qpair failed and we were unable to recover it. 00:30:09.345 [2024-07-13 10:16:14.889237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.889352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.889377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.345 qpair failed and we were unable to recover it. 00:30:09.345 [2024-07-13 10:16:14.889522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.889674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.889699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.345 qpair failed and we were unable to recover it. 00:30:09.345 [2024-07-13 10:16:14.889828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.889977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.890002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.345 qpair failed and we were unable to recover it. 00:30:09.345 [2024-07-13 10:16:14.890161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.890317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.890341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.345 qpair failed and we were unable to recover it. 00:30:09.345 [2024-07-13 10:16:14.890493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.890618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.890643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.345 qpair failed and we were unable to recover it. 00:30:09.345 [2024-07-13 10:16:14.890797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.890951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.890976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.345 qpair failed and we were unable to recover it. 00:30:09.345 [2024-07-13 10:16:14.891108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.891227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.891252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.345 qpair failed and we were unable to recover it. 00:30:09.345 [2024-07-13 10:16:14.891400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.891549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.891574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.345 qpair failed and we were unable to recover it. 00:30:09.345 [2024-07-13 10:16:14.891728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.891874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.891898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.345 qpair failed and we were unable to recover it. 00:30:09.345 [2024-07-13 10:16:14.892021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.892146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.892170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.345 qpair failed and we were unable to recover it. 00:30:09.345 [2024-07-13 10:16:14.892292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.892451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.892476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.345 qpair failed and we were unable to recover it. 00:30:09.345 [2024-07-13 10:16:14.892621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.892737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.892761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.345 qpair failed and we were unable to recover it. 00:30:09.345 [2024-07-13 10:16:14.892936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.893078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.893103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.345 qpair failed and we were unable to recover it. 00:30:09.345 [2024-07-13 10:16:14.893234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.893366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.893391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.345 qpair failed and we were unable to recover it. 00:30:09.345 [2024-07-13 10:16:14.893537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.893709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.893733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.345 qpair failed and we were unable to recover it. 00:30:09.345 [2024-07-13 10:16:14.893880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.894031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.894055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.345 qpair failed and we were unable to recover it. 00:30:09.345 [2024-07-13 10:16:14.894174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.894292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.894316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.345 qpair failed and we were unable to recover it. 00:30:09.345 [2024-07-13 10:16:14.894467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.894586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.894610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.345 qpair failed and we were unable to recover it. 00:30:09.345 [2024-07-13 10:16:14.894738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.894885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.894911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.345 qpair failed and we were unable to recover it. 00:30:09.345 [2024-07-13 10:16:14.895066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.895191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.895216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.345 qpair failed and we were unable to recover it. 00:30:09.345 [2024-07-13 10:16:14.895368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.895539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.345 [2024-07-13 10:16:14.895563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.345 qpair failed and we were unable to recover it. 00:30:09.345 [2024-07-13 10:16:14.895688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.895838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.895863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.346 qpair failed and we were unable to recover it. 00:30:09.346 [2024-07-13 10:16:14.895993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.896113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.896139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.346 qpair failed and we were unable to recover it. 00:30:09.346 [2024-07-13 10:16:14.896253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.896406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.896432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.346 qpair failed and we were unable to recover it. 00:30:09.346 [2024-07-13 10:16:14.896586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.896764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.896789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.346 qpair failed and we were unable to recover it. 00:30:09.346 [2024-07-13 10:16:14.896931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.897064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.897088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.346 qpair failed and we were unable to recover it. 00:30:09.346 [2024-07-13 10:16:14.897241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.897363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.897388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.346 qpair failed and we were unable to recover it. 00:30:09.346 [2024-07-13 10:16:14.897505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.897679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.897703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.346 qpair failed and we were unable to recover it. 00:30:09.346 [2024-07-13 10:16:14.897827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.898013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.898038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.346 qpair failed and we were unable to recover it. 00:30:09.346 [2024-07-13 10:16:14.898191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.898315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.898340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.346 qpair failed and we were unable to recover it. 00:30:09.346 [2024-07-13 10:16:14.898514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.898687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.898712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.346 qpair failed and we were unable to recover it. 00:30:09.346 [2024-07-13 10:16:14.898890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.899017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.899043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.346 qpair failed and we were unable to recover it. 00:30:09.346 [2024-07-13 10:16:14.899224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.899347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.899372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.346 qpair failed and we were unable to recover it. 00:30:09.346 [2024-07-13 10:16:14.899555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.899715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.899740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.346 qpair failed and we were unable to recover it. 00:30:09.346 [2024-07-13 10:16:14.899925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.900048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.900074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.346 qpair failed and we were unable to recover it. 00:30:09.346 [2024-07-13 10:16:14.900254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.900379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.900405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.346 qpair failed and we were unable to recover it. 00:30:09.346 [2024-07-13 10:16:14.900587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.900770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.900794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.346 qpair failed and we were unable to recover it. 00:30:09.346 [2024-07-13 10:16:14.900941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.901073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.901098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.346 qpair failed and we were unable to recover it. 00:30:09.346 [2024-07-13 10:16:14.901264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.901417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.901443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.346 qpair failed and we were unable to recover it. 00:30:09.346 [2024-07-13 10:16:14.901598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.901772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.901796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.346 qpair failed and we were unable to recover it. 00:30:09.346 [2024-07-13 10:16:14.901951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.902077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.902103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.346 qpair failed and we were unable to recover it. 00:30:09.346 [2024-07-13 10:16:14.902262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.902415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.902440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.346 qpair failed and we were unable to recover it. 00:30:09.346 [2024-07-13 10:16:14.902590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.902743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.902767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.346 qpair failed and we were unable to recover it. 00:30:09.346 [2024-07-13 10:16:14.902918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.903049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.903074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.346 qpair failed and we were unable to recover it. 00:30:09.346 [2024-07-13 10:16:14.903219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.903348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.903374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.346 qpair failed and we were unable to recover it. 00:30:09.346 [2024-07-13 10:16:14.903554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.903695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.903720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.346 qpair failed and we were unable to recover it. 00:30:09.346 [2024-07-13 10:16:14.903900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.904019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.346 [2024-07-13 10:16:14.904045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.346 qpair failed and we were unable to recover it. 00:30:09.347 [2024-07-13 10:16:14.904195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.904348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.904372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.347 qpair failed and we were unable to recover it. 00:30:09.347 [2024-07-13 10:16:14.904516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.904638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.904662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.347 qpair failed and we were unable to recover it. 00:30:09.347 [2024-07-13 10:16:14.904812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.904940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.904965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.347 qpair failed and we were unable to recover it. 00:30:09.347 [2024-07-13 10:16:14.905123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.905248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.905273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.347 qpair failed and we were unable to recover it. 00:30:09.347 [2024-07-13 10:16:14.905400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.905516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.905541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.347 qpair failed and we were unable to recover it. 00:30:09.347 [2024-07-13 10:16:14.905689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.905839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.905863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.347 qpair failed and we were unable to recover it. 00:30:09.347 [2024-07-13 10:16:14.906024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.906171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.906199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.347 qpair failed and we were unable to recover it. 00:30:09.347 [2024-07-13 10:16:14.906332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.906457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.906483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.347 qpair failed and we were unable to recover it. 00:30:09.347 [2024-07-13 10:16:14.906662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.906785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.906809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.347 qpair failed and we were unable to recover it. 00:30:09.347 [2024-07-13 10:16:14.906934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.907059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.907084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.347 qpair failed and we were unable to recover it. 00:30:09.347 [2024-07-13 10:16:14.907239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.907391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.907417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.347 qpair failed and we were unable to recover it. 00:30:09.347 [2024-07-13 10:16:14.907568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.907711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.907735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.347 qpair failed and we were unable to recover it. 00:30:09.347 [2024-07-13 10:16:14.907892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.908025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.908050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.347 qpair failed and we were unable to recover it. 00:30:09.347 [2024-07-13 10:16:14.908203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.908353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.908378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.347 qpair failed and we were unable to recover it. 00:30:09.347 [2024-07-13 10:16:14.908561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.908687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.908712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.347 qpair failed and we were unable to recover it. 00:30:09.347 [2024-07-13 10:16:14.908877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.909005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.909029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.347 qpair failed and we were unable to recover it. 00:30:09.347 [2024-07-13 10:16:14.909200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.909327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.909356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.347 qpair failed and we were unable to recover it. 00:30:09.347 [2024-07-13 10:16:14.909514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.909665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.909691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.347 qpair failed and we were unable to recover it. 00:30:09.347 [2024-07-13 10:16:14.909875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.910024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.910049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.347 qpair failed and we were unable to recover it. 00:30:09.347 [2024-07-13 10:16:14.910201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.910322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.910347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.347 qpair failed and we were unable to recover it. 00:30:09.347 [2024-07-13 10:16:14.910504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.910680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.910704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.347 qpair failed and we were unable to recover it. 00:30:09.347 [2024-07-13 10:16:14.910824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.910957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.910983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.347 qpair failed and we were unable to recover it. 00:30:09.347 [2024-07-13 10:16:14.911135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.911281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.911306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.347 qpair failed and we were unable to recover it. 00:30:09.347 [2024-07-13 10:16:14.911431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.911554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.911581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.347 qpair failed and we were unable to recover it. 00:30:09.347 [2024-07-13 10:16:14.911760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.911908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.911933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.347 qpair failed and we were unable to recover it. 00:30:09.347 [2024-07-13 10:16:14.912084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.912233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.912257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.347 qpair failed and we were unable to recover it. 00:30:09.347 [2024-07-13 10:16:14.912387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.912539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.912568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.347 qpair failed and we were unable to recover it. 00:30:09.347 [2024-07-13 10:16:14.912691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.912836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.912860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.347 qpair failed and we were unable to recover it. 00:30:09.347 [2024-07-13 10:16:14.913014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.913141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.913166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.347 qpair failed and we were unable to recover it. 00:30:09.347 [2024-07-13 10:16:14.913350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.913499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.913524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.347 qpair failed and we were unable to recover it. 00:30:09.347 [2024-07-13 10:16:14.913649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.347 [2024-07-13 10:16:14.913794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.913818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.348 qpair failed and we were unable to recover it. 00:30:09.348 [2024-07-13 10:16:14.913967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.914117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.914142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.348 qpair failed and we were unable to recover it. 00:30:09.348 [2024-07-13 10:16:14.914289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.914465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.914490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.348 qpair failed and we were unable to recover it. 00:30:09.348 [2024-07-13 10:16:14.914610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.914761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.914786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.348 qpair failed and we were unable to recover it. 00:30:09.348 [2024-07-13 10:16:14.914931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.915083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.915108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.348 qpair failed and we were unable to recover it. 00:30:09.348 [2024-07-13 10:16:14.915260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.915388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.915414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.348 qpair failed and we were unable to recover it. 00:30:09.348 [2024-07-13 10:16:14.915593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.915738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.915767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.348 qpair failed and we were unable to recover it. 00:30:09.348 [2024-07-13 10:16:14.915941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.916085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.916110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.348 qpair failed and we were unable to recover it. 00:30:09.348 [2024-07-13 10:16:14.916272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.916399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.916424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.348 qpair failed and we were unable to recover it. 00:30:09.348 [2024-07-13 10:16:14.916553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.916683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.916708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.348 qpair failed and we were unable to recover it. 00:30:09.348 [2024-07-13 10:16:14.916885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.917039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.917064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.348 qpair failed and we were unable to recover it. 00:30:09.348 [2024-07-13 10:16:14.917208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.917386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.917412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.348 qpair failed and we were unable to recover it. 00:30:09.348 [2024-07-13 10:16:14.917587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.917761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.917785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.348 qpair failed and we were unable to recover it. 00:30:09.348 [2024-07-13 10:16:14.917901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.918051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.918076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.348 qpair failed and we were unable to recover it. 00:30:09.348 [2024-07-13 10:16:14.918221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.918347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.918371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.348 qpair failed and we were unable to recover it. 00:30:09.348 [2024-07-13 10:16:14.918513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.918687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.918712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.348 qpair failed and we were unable to recover it. 00:30:09.348 [2024-07-13 10:16:14.918872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.919027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.919052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.348 qpair failed and we were unable to recover it. 00:30:09.348 [2024-07-13 10:16:14.919187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.919336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.919361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.348 qpair failed and we were unable to recover it. 00:30:09.348 [2024-07-13 10:16:14.919509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.919632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.919658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.348 qpair failed and we were unable to recover it. 00:30:09.348 [2024-07-13 10:16:14.919840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.920011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.920036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.348 qpair failed and we were unable to recover it. 00:30:09.348 [2024-07-13 10:16:14.920162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.920310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.920334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.348 qpair failed and we were unable to recover it. 00:30:09.348 [2024-07-13 10:16:14.920481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.920627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.920652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.348 qpair failed and we were unable to recover it. 00:30:09.348 [2024-07-13 10:16:14.920771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.920897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.920923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.348 qpair failed and we were unable to recover it. 00:30:09.348 [2024-07-13 10:16:14.921075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.921262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.921287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.348 qpair failed and we were unable to recover it. 00:30:09.348 [2024-07-13 10:16:14.921431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.921554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.921579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.348 qpair failed and we were unable to recover it. 00:30:09.348 [2024-07-13 10:16:14.921726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.921875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.921901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.348 qpair failed and we were unable to recover it. 00:30:09.348 [2024-07-13 10:16:14.922021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.922182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.922207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.348 qpair failed and we were unable to recover it. 00:30:09.348 [2024-07-13 10:16:14.922361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.922511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.922536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.348 qpair failed and we were unable to recover it. 00:30:09.348 [2024-07-13 10:16:14.922687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.922836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.922861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.348 qpair failed and we were unable to recover it. 00:30:09.348 [2024-07-13 10:16:14.922992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.923112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.923137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.348 qpair failed and we were unable to recover it. 00:30:09.348 [2024-07-13 10:16:14.923298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.923449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.348 [2024-07-13 10:16:14.923474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.349 qpair failed and we were unable to recover it. 00:30:09.349 [2024-07-13 10:16:14.923651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.923800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.923825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.349 qpair failed and we were unable to recover it. 00:30:09.349 [2024-07-13 10:16:14.923964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.924144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.924168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.349 qpair failed and we were unable to recover it. 00:30:09.349 [2024-07-13 10:16:14.924287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.924441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.924465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.349 qpair failed and we were unable to recover it. 00:30:09.349 [2024-07-13 10:16:14.924616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.924750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.924775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.349 qpair failed and we were unable to recover it. 00:30:09.349 [2024-07-13 10:16:14.924934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.925086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.925111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.349 qpair failed and we were unable to recover it. 00:30:09.349 [2024-07-13 10:16:14.925224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.925374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.925399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.349 qpair failed and we were unable to recover it. 00:30:09.349 [2024-07-13 10:16:14.925553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.925673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.925698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.349 qpair failed and we were unable to recover it. 00:30:09.349 [2024-07-13 10:16:14.925842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.925997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.926022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.349 qpair failed and we were unable to recover it. 00:30:09.349 [2024-07-13 10:16:14.926175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.926322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.926347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.349 qpair failed and we were unable to recover it. 00:30:09.349 [2024-07-13 10:16:14.926505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.926625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.926649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.349 qpair failed and we were unable to recover it. 00:30:09.349 [2024-07-13 10:16:14.926779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.926919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.926945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.349 qpair failed and we were unable to recover it. 00:30:09.349 [2024-07-13 10:16:14.927078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.927253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.927277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.349 qpair failed and we were unable to recover it. 00:30:09.349 [2024-07-13 10:16:14.927403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.927553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.927578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.349 qpair failed and we were unable to recover it. 00:30:09.349 [2024-07-13 10:16:14.927723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.927902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.927927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.349 qpair failed and we were unable to recover it. 00:30:09.349 [2024-07-13 10:16:14.928046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.928197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.928221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.349 qpair failed and we were unable to recover it. 00:30:09.349 [2024-07-13 10:16:14.928342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.928488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.928513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.349 qpair failed and we were unable to recover it. 00:30:09.349 [2024-07-13 10:16:14.928636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.928811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.928836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.349 qpair failed and we were unable to recover it. 00:30:09.349 [2024-07-13 10:16:14.928972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.929120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.929144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.349 qpair failed and we were unable to recover it. 00:30:09.349 [2024-07-13 10:16:14.929293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.929414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.929439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.349 qpair failed and we were unable to recover it. 00:30:09.349 [2024-07-13 10:16:14.929592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.929742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.929767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.349 qpair failed and we were unable to recover it. 00:30:09.349 [2024-07-13 10:16:14.929903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.930050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.930075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.349 qpair failed and we were unable to recover it. 00:30:09.349 [2024-07-13 10:16:14.930225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.930398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.930423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.349 qpair failed and we were unable to recover it. 00:30:09.349 [2024-07-13 10:16:14.930575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.930719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.930744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.349 qpair failed and we were unable to recover it. 00:30:09.349 [2024-07-13 10:16:14.930892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.931036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.931061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.349 qpair failed and we were unable to recover it. 00:30:09.349 [2024-07-13 10:16:14.931187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.931334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.931358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.349 qpair failed and we were unable to recover it. 00:30:09.349 [2024-07-13 10:16:14.931482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.931597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.931622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.349 qpair failed and we were unable to recover it. 00:30:09.349 [2024-07-13 10:16:14.931781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.931961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.931986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.349 qpair failed and we were unable to recover it. 00:30:09.349 [2024-07-13 10:16:14.932104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.932235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.932260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.349 qpair failed and we were unable to recover it. 00:30:09.349 [2024-07-13 10:16:14.932387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.932542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.932567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.349 qpair failed and we were unable to recover it. 00:30:09.349 [2024-07-13 10:16:14.932724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.932901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.349 [2024-07-13 10:16:14.932927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.349 qpair failed and we were unable to recover it. 00:30:09.350 [2024-07-13 10:16:14.933076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.933203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.933227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.350 qpair failed and we were unable to recover it. 00:30:09.350 [2024-07-13 10:16:14.933380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.933499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.933524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.350 qpair failed and we were unable to recover it. 00:30:09.350 [2024-07-13 10:16:14.933678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.933826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.933851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.350 qpair failed and we were unable to recover it. 00:30:09.350 [2024-07-13 10:16:14.934035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.934208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.934233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.350 qpair failed and we were unable to recover it. 00:30:09.350 [2024-07-13 10:16:14.934382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.934551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.934575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.350 qpair failed and we were unable to recover it. 00:30:09.350 [2024-07-13 10:16:14.934756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.934908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.934934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.350 qpair failed and we were unable to recover it. 00:30:09.350 [2024-07-13 10:16:14.935079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.935220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.935245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.350 qpair failed and we were unable to recover it. 00:30:09.350 [2024-07-13 10:16:14.935374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.935518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.935543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.350 qpair failed and we were unable to recover it. 00:30:09.350 [2024-07-13 10:16:14.935724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.935844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.935873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.350 qpair failed and we were unable to recover it. 00:30:09.350 [2024-07-13 10:16:14.936002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.936150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.936174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.350 qpair failed and we were unable to recover it. 00:30:09.350 [2024-07-13 10:16:14.936328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.936476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.936500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.350 qpair failed and we were unable to recover it. 00:30:09.350 [2024-07-13 10:16:14.936651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.936779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.936805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.350 qpair failed and we were unable to recover it. 00:30:09.350 [2024-07-13 10:16:14.936952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.937129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.937154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.350 qpair failed and we were unable to recover it. 00:30:09.350 [2024-07-13 10:16:14.937303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.937428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.937453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.350 qpair failed and we were unable to recover it. 00:30:09.350 [2024-07-13 10:16:14.937604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.937761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.937786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.350 qpair failed and we were unable to recover it. 00:30:09.350 [2024-07-13 10:16:14.937945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.938072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.938097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.350 qpair failed and we were unable to recover it. 00:30:09.350 [2024-07-13 10:16:14.938232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.938407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.938431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.350 qpair failed and we were unable to recover it. 00:30:09.350 [2024-07-13 10:16:14.938585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.938738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.938763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.350 qpair failed and we were unable to recover it. 00:30:09.350 [2024-07-13 10:16:14.938885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.939009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.939035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.350 qpair failed and we were unable to recover it. 00:30:09.350 [2024-07-13 10:16:14.939165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.939318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.939342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.350 qpair failed and we were unable to recover it. 00:30:09.350 [2024-07-13 10:16:14.939519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.939674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.939698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.350 qpair failed and we were unable to recover it. 00:30:09.350 [2024-07-13 10:16:14.939850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.940036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.940061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.350 qpair failed and we were unable to recover it. 00:30:09.350 [2024-07-13 10:16:14.940220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.940335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.940359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.350 qpair failed and we were unable to recover it. 00:30:09.350 [2024-07-13 10:16:14.940513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.940663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.940688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.350 qpair failed and we were unable to recover it. 00:30:09.350 [2024-07-13 10:16:14.940837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.940958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.940983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.350 qpair failed and we were unable to recover it. 00:30:09.350 [2024-07-13 10:16:14.941137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.941285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.941309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.350 qpair failed and we were unable to recover it. 00:30:09.350 [2024-07-13 10:16:14.941465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.941595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.941621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.350 qpair failed and we were unable to recover it. 00:30:09.350 [2024-07-13 10:16:14.941802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.941924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.350 [2024-07-13 10:16:14.941951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.351 qpair failed and we were unable to recover it. 00:30:09.351 [2024-07-13 10:16:14.942097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.942222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.942247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.351 qpair failed and we were unable to recover it. 00:30:09.351 [2024-07-13 10:16:14.942400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.942548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.942572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.351 qpair failed and we were unable to recover it. 00:30:09.351 [2024-07-13 10:16:14.942695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.942839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.942864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.351 qpair failed and we were unable to recover it. 00:30:09.351 [2024-07-13 10:16:14.943000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.943155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.943180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.351 qpair failed and we were unable to recover it. 00:30:09.351 [2024-07-13 10:16:14.943353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.943517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.943542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.351 qpair failed and we were unable to recover it. 00:30:09.351 [2024-07-13 10:16:14.943696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.943843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.943874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.351 qpair failed and we were unable to recover it. 00:30:09.351 [2024-07-13 10:16:14.943998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.944121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.944146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.351 qpair failed and we were unable to recover it. 00:30:09.351 [2024-07-13 10:16:14.944269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.944412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.944437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.351 qpair failed and we were unable to recover it. 00:30:09.351 [2024-07-13 10:16:14.944589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.944740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.944765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.351 qpair failed and we were unable to recover it. 00:30:09.351 [2024-07-13 10:16:14.944917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.945042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.945067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.351 qpair failed and we were unable to recover it. 00:30:09.351 [2024-07-13 10:16:14.945248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.945394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.945418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.351 qpair failed and we were unable to recover it. 00:30:09.351 [2024-07-13 10:16:14.945562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.945712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.945739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.351 qpair failed and we were unable to recover it. 00:30:09.351 [2024-07-13 10:16:14.945864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.946019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.946045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.351 qpair failed and we were unable to recover it. 00:30:09.351 [2024-07-13 10:16:14.946209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.946357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.946382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.351 qpair failed and we were unable to recover it. 00:30:09.351 [2024-07-13 10:16:14.946532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.946682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.946707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.351 qpair failed and we were unable to recover it. 00:30:09.351 [2024-07-13 10:16:14.946861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.946983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.947007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.351 qpair failed and we were unable to recover it. 00:30:09.351 [2024-07-13 10:16:14.947126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.947254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.947279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.351 qpair failed and we were unable to recover it. 00:30:09.351 [2024-07-13 10:16:14.947397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.947550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.947575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.351 qpair failed and we were unable to recover it. 00:30:09.351 [2024-07-13 10:16:14.947724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.947902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.947927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.351 qpair failed and we were unable to recover it. 00:30:09.351 [2024-07-13 10:16:14.948086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.948238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.948264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.351 qpair failed and we were unable to recover it. 00:30:09.351 [2024-07-13 10:16:14.948411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.948558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.948582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.351 qpair failed and we were unable to recover it. 00:30:09.351 [2024-07-13 10:16:14.948734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.948888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.948915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.351 qpair failed and we were unable to recover it. 00:30:09.351 [2024-07-13 10:16:14.949062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.949210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.949234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.351 qpair failed and we were unable to recover it. 00:30:09.351 [2024-07-13 10:16:14.949358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.949539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.949563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.351 qpair failed and we were unable to recover it. 00:30:09.351 [2024-07-13 10:16:14.949681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.949819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.949843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.351 qpair failed and we were unable to recover it. 00:30:09.351 [2024-07-13 10:16:14.949980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.950131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.950156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.351 qpair failed and we were unable to recover it. 00:30:09.351 [2024-07-13 10:16:14.950332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.950471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.950496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.351 qpair failed and we were unable to recover it. 00:30:09.351 [2024-07-13 10:16:14.950664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.950819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.351 [2024-07-13 10:16:14.950843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.351 qpair failed and we were unable to recover it. 00:30:09.352 [2024-07-13 10:16:14.950998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.951131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.951155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.352 qpair failed and we were unable to recover it. 00:30:09.352 [2024-07-13 10:16:14.951307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.951450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.951475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.352 qpair failed and we were unable to recover it. 00:30:09.352 [2024-07-13 10:16:14.951622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.951768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.951793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.352 qpair failed and we were unable to recover it. 00:30:09.352 [2024-07-13 10:16:14.951908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.952060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.952085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.352 qpair failed and we were unable to recover it. 00:30:09.352 [2024-07-13 10:16:14.952246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.952389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.952413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.352 qpair failed and we were unable to recover it. 00:30:09.352 [2024-07-13 10:16:14.952543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.952715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.952739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.352 qpair failed and we were unable to recover it. 00:30:09.352 [2024-07-13 10:16:14.952893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.953044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.953069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.352 qpair failed and we were unable to recover it. 00:30:09.352 [2024-07-13 10:16:14.953225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.953377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.953403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.352 qpair failed and we were unable to recover it. 00:30:09.352 [2024-07-13 10:16:14.953580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.953733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.953757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.352 qpair failed and we were unable to recover it. 00:30:09.352 [2024-07-13 10:16:14.953880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.954029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.954053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.352 qpair failed and we were unable to recover it. 00:30:09.352 [2024-07-13 10:16:14.954199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.954318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.954342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.352 qpair failed and we were unable to recover it. 00:30:09.352 [2024-07-13 10:16:14.954456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.954602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.954627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.352 qpair failed and we were unable to recover it. 00:30:09.352 [2024-07-13 10:16:14.954800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.954910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.954935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.352 qpair failed and we were unable to recover it. 00:30:09.352 [2024-07-13 10:16:14.955109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.955230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.955255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.352 qpair failed and we were unable to recover it. 00:30:09.352 [2024-07-13 10:16:14.955427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.955605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.955629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.352 qpair failed and we were unable to recover it. 00:30:09.352 [2024-07-13 10:16:14.955782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.955934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.955959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.352 qpair failed and we were unable to recover it. 00:30:09.352 [2024-07-13 10:16:14.956139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.956257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.956282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.352 qpair failed and we were unable to recover it. 00:30:09.352 [2024-07-13 10:16:14.956408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.956524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.956548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.352 qpair failed and we were unable to recover it. 00:30:09.352 [2024-07-13 10:16:14.956672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.956795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.956820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.352 qpair failed and we were unable to recover it. 00:30:09.352 [2024-07-13 10:16:14.956944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.957102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.957127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.352 qpair failed and we were unable to recover it. 00:30:09.352 [2024-07-13 10:16:14.957279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.957401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.957430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.352 qpair failed and we were unable to recover it. 00:30:09.352 [2024-07-13 10:16:14.957562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.957684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.957708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.352 qpair failed and we were unable to recover it. 00:30:09.352 [2024-07-13 10:16:14.957834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.957995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.958021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.352 qpair failed and we were unable to recover it. 00:30:09.352 [2024-07-13 10:16:14.958149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.958272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.958296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.352 qpair failed and we were unable to recover it. 00:30:09.352 [2024-07-13 10:16:14.958448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.958596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.958620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.352 qpair failed and we were unable to recover it. 00:30:09.352 [2024-07-13 10:16:14.958781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.958903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.958929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.352 qpair failed and we were unable to recover it. 00:30:09.352 [2024-07-13 10:16:14.959105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.959285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.959309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.352 qpair failed and we were unable to recover it. 00:30:09.352 [2024-07-13 10:16:14.959449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.959599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.959625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.352 qpair failed and we were unable to recover it. 00:30:09.352 [2024-07-13 10:16:14.959745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.959890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.959916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.352 qpair failed and we were unable to recover it. 00:30:09.352 [2024-07-13 10:16:14.960045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.960196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.960221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.352 qpair failed and we were unable to recover it. 00:30:09.352 [2024-07-13 10:16:14.960371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.352 [2024-07-13 10:16:14.960522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.960551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.353 qpair failed and we were unable to recover it. 00:30:09.353 [2024-07-13 10:16:14.960693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.960816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.960841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.353 qpair failed and we were unable to recover it. 00:30:09.353 [2024-07-13 10:16:14.960995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.961145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.961170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.353 qpair failed and we were unable to recover it. 00:30:09.353 [2024-07-13 10:16:14.961303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.961453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.961478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.353 qpair failed and we were unable to recover it. 00:30:09.353 [2024-07-13 10:16:14.961626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.961742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.961766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.353 qpair failed and we were unable to recover it. 00:30:09.353 [2024-07-13 10:16:14.961894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.962077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.962102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.353 qpair failed and we were unable to recover it. 00:30:09.353 [2024-07-13 10:16:14.962229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.962355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.962379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.353 qpair failed and we were unable to recover it. 00:30:09.353 [2024-07-13 10:16:14.962522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.962670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.962694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.353 qpair failed and we were unable to recover it. 00:30:09.353 [2024-07-13 10:16:14.962845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.962984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.963009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.353 qpair failed and we were unable to recover it. 00:30:09.353 [2024-07-13 10:16:14.963158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.963314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.963339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.353 qpair failed and we were unable to recover it. 00:30:09.353 [2024-07-13 10:16:14.963465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.963625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.963655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.353 qpair failed and we were unable to recover it. 00:30:09.353 [2024-07-13 10:16:14.963776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.963907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.963933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.353 qpair failed and we were unable to recover it. 00:30:09.353 [2024-07-13 10:16:14.964050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.964229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.964254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.353 qpair failed and we were unable to recover it. 00:30:09.353 [2024-07-13 10:16:14.964379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.964530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.964554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.353 qpair failed and we were unable to recover it. 00:30:09.353 [2024-07-13 10:16:14.964708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.964829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.964853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.353 qpair failed and we were unable to recover it. 00:30:09.353 [2024-07-13 10:16:14.965016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.965164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.965189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.353 qpair failed and we were unable to recover it. 00:30:09.353 [2024-07-13 10:16:14.965310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.965486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.965511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.353 qpair failed and we were unable to recover it. 00:30:09.353 [2024-07-13 10:16:14.965667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.965792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.965816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.353 qpair failed and we were unable to recover it. 00:30:09.353 [2024-07-13 10:16:14.965995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.966141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.966165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.353 qpair failed and we were unable to recover it. 00:30:09.353 [2024-07-13 10:16:14.966280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.966429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.966453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.353 qpair failed and we were unable to recover it. 00:30:09.353 [2024-07-13 10:16:14.966576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.966742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.966771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.353 qpair failed and we were unable to recover it. 00:30:09.353 [2024-07-13 10:16:14.966919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.967066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.967092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.353 qpair failed and we were unable to recover it. 00:30:09.353 [2024-07-13 10:16:14.967244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.967367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.967393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.353 qpair failed and we were unable to recover it. 00:30:09.353 [2024-07-13 10:16:14.967546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.967699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.967723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.353 qpair failed and we were unable to recover it. 00:30:09.353 [2024-07-13 10:16:14.967879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.968029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.968054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.353 qpair failed and we were unable to recover it. 00:30:09.353 [2024-07-13 10:16:14.968183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.968330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.968354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.353 qpair failed and we were unable to recover it. 00:30:09.353 [2024-07-13 10:16:14.968482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.968604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.968630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.353 qpair failed and we were unable to recover it. 00:30:09.353 [2024-07-13 10:16:14.968784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.968934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.968960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.353 qpair failed and we were unable to recover it. 00:30:09.353 [2024-07-13 10:16:14.969114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.969264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.969288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.353 qpair failed and we were unable to recover it. 00:30:09.353 [2024-07-13 10:16:14.969450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.969577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.969601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.353 qpair failed and we were unable to recover it. 00:30:09.353 [2024-07-13 10:16:14.969718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.969851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.353 [2024-07-13 10:16:14.969881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.354 qpair failed and we were unable to recover it. 00:30:09.354 [2024-07-13 10:16:14.970008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.970154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.970179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.354 qpair failed and we were unable to recover it. 00:30:09.354 [2024-07-13 10:16:14.970330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.970486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.970511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.354 qpair failed and we were unable to recover it. 00:30:09.354 [2024-07-13 10:16:14.970636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.970782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.970807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.354 qpair failed and we were unable to recover it. 00:30:09.354 [2024-07-13 10:16:14.970935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.971061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.971087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.354 qpair failed and we were unable to recover it. 00:30:09.354 [2024-07-13 10:16:14.971234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.971413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.971438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.354 qpair failed and we were unable to recover it. 00:30:09.354 [2024-07-13 10:16:14.971554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.971703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.971728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.354 qpair failed and we were unable to recover it. 00:30:09.354 [2024-07-13 10:16:14.971891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.972039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.972064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.354 qpair failed and we were unable to recover it. 00:30:09.354 [2024-07-13 10:16:14.972183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.972359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.972384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.354 qpair failed and we were unable to recover it. 00:30:09.354 [2024-07-13 10:16:14.972510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.972628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.972653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.354 qpair failed and we were unable to recover it. 00:30:09.354 [2024-07-13 10:16:14.972826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.972979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.973004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.354 qpair failed and we were unable to recover it. 00:30:09.354 [2024-07-13 10:16:14.973156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.973282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.973307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.354 qpair failed and we were unable to recover it. 00:30:09.354 [2024-07-13 10:16:14.973434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.973553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.973578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.354 qpair failed and we were unable to recover it. 00:30:09.354 [2024-07-13 10:16:14.973753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.973872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.973897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.354 qpair failed and we were unable to recover it. 00:30:09.354 [2024-07-13 10:16:14.974020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.974148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.974173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.354 qpair failed and we were unable to recover it. 00:30:09.354 [2024-07-13 10:16:14.974291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.974443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.974467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.354 qpair failed and we were unable to recover it. 00:30:09.354 [2024-07-13 10:16:14.974585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.974713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.974738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.354 qpair failed and we were unable to recover it. 00:30:09.354 [2024-07-13 10:16:14.974892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.975011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.975036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.354 qpair failed and we were unable to recover it. 00:30:09.354 [2024-07-13 10:16:14.975186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.975336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.975360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.354 qpair failed and we were unable to recover it. 00:30:09.354 [2024-07-13 10:16:14.975505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.975659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.975683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.354 qpair failed and we were unable to recover it. 00:30:09.354 [2024-07-13 10:16:14.975854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.976009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.976033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.354 qpair failed and we were unable to recover it. 00:30:09.354 [2024-07-13 10:16:14.976157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.976275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.976299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.354 qpair failed and we were unable to recover it. 00:30:09.354 [2024-07-13 10:16:14.976424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.976569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.976595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.354 qpair failed and we were unable to recover it. 00:30:09.354 [2024-07-13 10:16:14.976747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.976899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.976925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.354 qpair failed and we were unable to recover it. 00:30:09.354 [2024-07-13 10:16:14.977075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.977202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.977226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.354 qpair failed and we were unable to recover it. 00:30:09.354 [2024-07-13 10:16:14.977343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.977460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.977486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.354 qpair failed and we were unable to recover it. 00:30:09.354 [2024-07-13 10:16:14.977615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.977787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.977812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.354 qpair failed and we were unable to recover it. 00:30:09.354 [2024-07-13 10:16:14.977965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.978123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.978147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.354 qpair failed and we were unable to recover it. 00:30:09.354 [2024-07-13 10:16:14.978303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.978425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.978449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.354 qpair failed and we were unable to recover it. 00:30:09.354 [2024-07-13 10:16:14.978575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.978745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.978769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.354 qpair failed and we were unable to recover it. 00:30:09.354 [2024-07-13 10:16:14.978893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.979015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.354 [2024-07-13 10:16:14.979039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.354 qpair failed and we were unable to recover it. 00:30:09.354 [2024-07-13 10:16:14.979173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.979319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.979343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.355 qpair failed and we were unable to recover it. 00:30:09.355 [2024-07-13 10:16:14.979497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.979650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.979674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.355 qpair failed and we were unable to recover it. 00:30:09.355 [2024-07-13 10:16:14.979817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.979934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.979958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.355 qpair failed and we were unable to recover it. 00:30:09.355 [2024-07-13 10:16:14.980113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.980293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.980317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.355 qpair failed and we were unable to recover it. 00:30:09.355 [2024-07-13 10:16:14.980444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.980596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.980620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.355 qpair failed and we were unable to recover it. 00:30:09.355 [2024-07-13 10:16:14.980742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.980888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.980913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.355 qpair failed and we were unable to recover it. 00:30:09.355 [2024-07-13 10:16:14.981092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.981209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.981233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.355 qpair failed and we were unable to recover it. 00:30:09.355 [2024-07-13 10:16:14.981378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.981504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.981529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.355 qpair failed and we were unable to recover it. 00:30:09.355 [2024-07-13 10:16:14.981688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.981840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.981870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.355 qpair failed and we were unable to recover it. 00:30:09.355 [2024-07-13 10:16:14.982024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.982151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.982176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.355 qpair failed and we were unable to recover it. 00:30:09.355 [2024-07-13 10:16:14.982330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.982501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.982525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.355 qpair failed and we were unable to recover it. 00:30:09.355 [2024-07-13 10:16:14.982696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.982818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.982842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.355 qpair failed and we were unable to recover it. 00:30:09.355 [2024-07-13 10:16:14.982966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.983089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.983113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.355 qpair failed and we were unable to recover it. 00:30:09.355 [2024-07-13 10:16:14.983263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.983382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.983407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.355 qpair failed and we were unable to recover it. 00:30:09.355 [2024-07-13 10:16:14.983560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.983690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.983715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.355 qpair failed and we were unable to recover it. 00:30:09.355 [2024-07-13 10:16:14.983871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.984018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.984042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.355 qpair failed and we were unable to recover it. 00:30:09.355 [2024-07-13 10:16:14.984194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.984367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.984391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.355 qpair failed and we were unable to recover it. 00:30:09.355 [2024-07-13 10:16:14.984506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.984656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.984681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.355 qpair failed and we were unable to recover it. 00:30:09.355 [2024-07-13 10:16:14.984833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.984966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.984991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.355 qpair failed and we were unable to recover it. 00:30:09.355 [2024-07-13 10:16:14.985111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.985238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.985262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.355 qpair failed and we were unable to recover it. 00:30:09.355 [2024-07-13 10:16:14.985415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.985591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.985615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.355 qpair failed and we were unable to recover it. 00:30:09.355 [2024-07-13 10:16:14.985744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.985886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.985916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.355 qpair failed and we were unable to recover it. 00:30:09.355 [2024-07-13 10:16:14.986068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.986186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.986211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.355 qpair failed and we were unable to recover it. 00:30:09.355 [2024-07-13 10:16:14.986362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.986513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.986538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.355 qpair failed and we were unable to recover it. 00:30:09.355 [2024-07-13 10:16:14.986658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.986808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.986833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.355 qpair failed and we were unable to recover it. 00:30:09.355 [2024-07-13 10:16:14.986993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.355 [2024-07-13 10:16:14.987114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.987139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.356 qpair failed and we were unable to recover it. 00:30:09.356 [2024-07-13 10:16:14.987259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.987414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.987439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.356 qpair failed and we were unable to recover it. 00:30:09.356 [2024-07-13 10:16:14.987558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.987733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.987758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.356 qpair failed and we were unable to recover it. 00:30:09.356 [2024-07-13 10:16:14.987915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.988034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.988060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.356 qpair failed and we were unable to recover it. 00:30:09.356 [2024-07-13 10:16:14.988216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.988393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.988418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.356 qpair failed and we were unable to recover it. 00:30:09.356 [2024-07-13 10:16:14.988601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.988717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.988741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.356 qpair failed and we were unable to recover it. 00:30:09.356 [2024-07-13 10:16:14.988873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.989046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.989070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.356 qpair failed and we were unable to recover it. 00:30:09.356 [2024-07-13 10:16:14.989193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.989333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.989357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.356 qpair failed and we were unable to recover it. 00:30:09.356 [2024-07-13 10:16:14.989481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.989632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.989656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.356 qpair failed and we were unable to recover it. 00:30:09.356 [2024-07-13 10:16:14.989804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.989938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.989963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.356 qpair failed and we were unable to recover it. 00:30:09.356 [2024-07-13 10:16:14.990141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.990292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.990317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.356 qpair failed and we were unable to recover it. 00:30:09.356 [2024-07-13 10:16:14.990465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.990624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.990648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.356 qpair failed and we were unable to recover it. 00:30:09.356 [2024-07-13 10:16:14.990794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.990936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.990961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.356 qpair failed and we were unable to recover it. 00:30:09.356 [2024-07-13 10:16:14.991141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.991264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.991291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.356 qpair failed and we were unable to recover it. 00:30:09.356 [2024-07-13 10:16:14.991469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.991595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.991619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.356 qpair failed and we were unable to recover it. 00:30:09.356 [2024-07-13 10:16:14.991791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.991949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.991975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.356 qpair failed and we were unable to recover it. 00:30:09.356 [2024-07-13 10:16:14.992128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.992255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.992282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.356 qpair failed and we were unable to recover it. 00:30:09.356 [2024-07-13 10:16:14.992437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.992561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.992585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.356 qpair failed and we were unable to recover it. 00:30:09.356 [2024-07-13 10:16:14.992709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.992832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.992856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.356 qpair failed and we were unable to recover it. 00:30:09.356 [2024-07-13 10:16:14.992993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.993118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.993142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.356 qpair failed and we were unable to recover it. 00:30:09.356 [2024-07-13 10:16:14.993294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.993420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.993444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.356 qpair failed and we were unable to recover it. 00:30:09.356 [2024-07-13 10:16:14.993564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.993692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.993718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.356 qpair failed and we were unable to recover it. 00:30:09.356 [2024-07-13 10:16:14.993846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.993971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.993996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.356 qpair failed and we were unable to recover it. 00:30:09.356 [2024-07-13 10:16:14.994147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.994270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.994295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.356 qpair failed and we were unable to recover it. 00:30:09.356 [2024-07-13 10:16:14.994463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.994610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.994635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.356 qpair failed and we were unable to recover it. 00:30:09.356 [2024-07-13 10:16:14.994793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.994928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.994953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.356 qpair failed and we were unable to recover it. 00:30:09.356 [2024-07-13 10:16:14.995112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.995269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.995294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.356 qpair failed and we were unable to recover it. 00:30:09.356 [2024-07-13 10:16:14.995418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.995574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.995599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.356 qpair failed and we were unable to recover it. 00:30:09.356 [2024-07-13 10:16:14.995779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.995933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.995959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.356 qpair failed and we were unable to recover it. 00:30:09.356 [2024-07-13 10:16:14.996094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.996245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.356 [2024-07-13 10:16:14.996270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.356 qpair failed and we were unable to recover it. 00:30:09.356 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 2941765 Killed "${NVMF_APP[@]}" "$@" 00:30:09.356 [2024-07-13 10:16:14.996419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:14.996595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:14.996620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.357 qpair failed and we were unable to recover it. 00:30:09.357 10:16:14 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:30:09.357 [2024-07-13 10:16:14.996781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 10:16:14 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:30:09.357 [2024-07-13 10:16:14.996931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:14.996956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.357 qpair failed and we were unable to recover it. 00:30:09.357 10:16:14 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:09.357 10:16:14 -- common/autotest_common.sh@712 -- # xtrace_disable 00:30:09.357 [2024-07-13 10:16:14.997138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 10:16:14 -- common/autotest_common.sh@10 -- # set +x 00:30:09.357 [2024-07-13 10:16:14.997264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:14.997289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.357 qpair failed and we were unable to recover it. 00:30:09.357 [2024-07-13 10:16:14.997405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:14.997556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:14.997581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.357 qpair failed and we were unable to recover it. 00:30:09.357 [2024-07-13 10:16:14.997723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:14.997844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:14.997876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.357 qpair failed and we were unable to recover it. 00:30:09.357 [2024-07-13 10:16:14.998034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:14.998185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:14.998212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.357 qpair failed and we were unable to recover it. 00:30:09.357 [2024-07-13 10:16:14.998388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:14.998503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:14.998528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.357 qpair failed and we were unable to recover it. 00:30:09.357 [2024-07-13 10:16:14.998652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:14.998809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:14.998834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.357 qpair failed and we were unable to recover it. 00:30:09.357 [2024-07-13 10:16:14.998993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:14.999143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:14.999168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.357 qpair failed and we were unable to recover it. 00:30:09.357 [2024-07-13 10:16:14.999303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:14.999459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:14.999484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.357 qpair failed and we were unable to recover it. 00:30:09.357 [2024-07-13 10:16:14.999633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:14.999811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:14.999836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.357 qpair failed and we were unable to recover it. 00:30:09.357 [2024-07-13 10:16:14.999992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:15.000122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:15.000147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.357 qpair failed and we were unable to recover it. 00:30:09.357 [2024-07-13 10:16:15.000270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:15.000392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:15.000418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.357 qpair failed and we were unable to recover it. 00:30:09.357 [2024-07-13 10:16:15.000603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:15.000740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:15.000765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.357 qpair failed and we were unable to recover it. 00:30:09.357 [2024-07-13 10:16:15.000889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:15.001053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:15.001078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.357 qpair failed and we were unable to recover it. 00:30:09.357 [2024-07-13 10:16:15.001230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:15.001380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:15.001405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.357 qpair failed and we were unable to recover it. 00:30:09.357 [2024-07-13 10:16:15.001558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 10:16:15 -- nvmf/common.sh@469 -- # nvmfpid=2942344 00:30:09.357 [2024-07-13 10:16:15.001706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:15.001740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.357 qpair failed and we were unable to recover it. 00:30:09.357 [2024-07-13 10:16:15.001918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 10:16:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:30:09.357 10:16:15 -- nvmf/common.sh@470 -- # waitforlisten 2942344 00:30:09.357 [2024-07-13 10:16:15.002067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:15.002092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.357 qpair failed and we were unable to recover it. 00:30:09.357 10:16:15 -- common/autotest_common.sh@819 -- # '[' -z 2942344 ']' 00:30:09.357 [2024-07-13 10:16:15.002243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 10:16:15 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:09.357 [2024-07-13 10:16:15.002372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:15.002398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.357 qpair failed and we were unable to recover it. 00:30:09.357 10:16:15 -- common/autotest_common.sh@824 -- # local max_retries=100 00:30:09.357 [2024-07-13 10:16:15.002543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 10:16:15 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:09.357 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:09.357 [2024-07-13 10:16:15.002696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:15.002722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.357 qpair failed and we were unable to recover it. 00:30:09.357 10:16:15 -- common/autotest_common.sh@828 -- # xtrace_disable 00:30:09.357 [2024-07-13 10:16:15.002848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 10:16:15 -- common/autotest_common.sh@10 -- # set +x 00:30:09.357 [2024-07-13 10:16:15.003001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:15.003028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.357 qpair failed and we were unable to recover it. 00:30:09.357 [2024-07-13 10:16:15.003206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:15.003329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:15.003354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.357 qpair failed and we were unable to recover it. 00:30:09.357 [2024-07-13 10:16:15.003536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:15.003719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:15.003743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.357 qpair failed and we were unable to recover it. 00:30:09.357 [2024-07-13 10:16:15.003904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:15.004069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:15.004096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.357 qpair failed and we were unable to recover it. 00:30:09.357 [2024-07-13 10:16:15.004239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:15.004360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:15.004387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.357 qpair failed and we were unable to recover it. 00:30:09.357 [2024-07-13 10:16:15.004537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:15.004713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:15.004737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.357 qpair failed and we were unable to recover it. 00:30:09.357 [2024-07-13 10:16:15.004917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:15.005095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:15.005119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.357 qpair failed and we were unable to recover it. 00:30:09.357 [2024-07-13 10:16:15.005269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.357 [2024-07-13 10:16:15.005391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.005416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.358 qpair failed and we were unable to recover it. 00:30:09.358 [2024-07-13 10:16:15.005598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.005722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.005748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.358 qpair failed and we were unable to recover it. 00:30:09.358 [2024-07-13 10:16:15.005903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.006055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.006081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.358 qpair failed and we were unable to recover it. 00:30:09.358 [2024-07-13 10:16:15.006234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.006384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.006409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.358 qpair failed and we were unable to recover it. 00:30:09.358 [2024-07-13 10:16:15.006564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.006715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.006741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.358 qpair failed and we were unable to recover it. 00:30:09.358 [2024-07-13 10:16:15.006893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.007024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.007050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.358 qpair failed and we were unable to recover it. 00:30:09.358 [2024-07-13 10:16:15.007199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.007317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.007342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.358 qpair failed and we were unable to recover it. 00:30:09.358 [2024-07-13 10:16:15.007519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.007670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.007695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.358 qpair failed and we were unable to recover it. 00:30:09.358 [2024-07-13 10:16:15.007818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.007946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.007972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.358 qpair failed and we were unable to recover it. 00:30:09.358 [2024-07-13 10:16:15.008135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.008283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.008309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.358 qpair failed and we were unable to recover it. 00:30:09.358 [2024-07-13 10:16:15.008467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.008607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.008631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.358 qpair failed and we were unable to recover it. 00:30:09.358 [2024-07-13 10:16:15.008753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.008878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.008904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.358 qpair failed and we were unable to recover it. 00:30:09.358 [2024-07-13 10:16:15.009034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.009154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.009179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.358 qpair failed and we were unable to recover it. 00:30:09.358 [2024-07-13 10:16:15.009306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.009430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.009455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.358 qpair failed and we were unable to recover it. 00:30:09.358 [2024-07-13 10:16:15.009625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.009744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.009769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.358 qpair failed and we were unable to recover it. 00:30:09.358 [2024-07-13 10:16:15.009917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.010075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.010101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.358 qpair failed and we were unable to recover it. 00:30:09.358 [2024-07-13 10:16:15.010225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.010372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.010397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.358 qpair failed and we were unable to recover it. 00:30:09.358 [2024-07-13 10:16:15.010548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.010706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.010731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.358 qpair failed and we were unable to recover it. 00:30:09.358 [2024-07-13 10:16:15.010853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.011005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.011030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.358 qpair failed and we were unable to recover it. 00:30:09.358 [2024-07-13 10:16:15.011184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.011304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.011329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.358 qpair failed and we were unable to recover it. 00:30:09.358 [2024-07-13 10:16:15.011472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.011620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.011645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.358 qpair failed and we were unable to recover it. 00:30:09.358 [2024-07-13 10:16:15.011797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.011962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.011988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.358 qpair failed and we were unable to recover it. 00:30:09.358 [2024-07-13 10:16:15.012139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.012262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.012286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.358 qpair failed and we were unable to recover it. 00:30:09.358 [2024-07-13 10:16:15.012405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.012524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.012550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.358 qpair failed and we were unable to recover it. 00:30:09.358 [2024-07-13 10:16:15.012703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.012852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.012901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.358 qpair failed and we were unable to recover it. 00:30:09.358 [2024-07-13 10:16:15.013030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.013205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.013230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.358 qpair failed and we were unable to recover it. 00:30:09.358 [2024-07-13 10:16:15.013377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.013524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.013550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.358 qpair failed and we were unable to recover it. 00:30:09.358 [2024-07-13 10:16:15.013680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.013804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.013829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.358 qpair failed and we were unable to recover it. 00:30:09.358 [2024-07-13 10:16:15.013992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.014113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.014140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.358 qpair failed and we were unable to recover it. 00:30:09.358 [2024-07-13 10:16:15.014273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.014457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.014483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.358 qpair failed and we were unable to recover it. 00:30:09.358 [2024-07-13 10:16:15.014608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.014753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.358 [2024-07-13 10:16:15.014779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.359 qpair failed and we were unable to recover it. 00:30:09.359 [2024-07-13 10:16:15.014901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.015073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.015098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.359 qpair failed and we were unable to recover it. 00:30:09.359 [2024-07-13 10:16:15.015222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.015400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.015424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.359 qpair failed and we were unable to recover it. 00:30:09.359 [2024-07-13 10:16:15.015581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.015704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.015730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.359 qpair failed and we were unable to recover it. 00:30:09.359 [2024-07-13 10:16:15.015876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.016000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.016025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.359 qpair failed and we were unable to recover it. 00:30:09.359 [2024-07-13 10:16:15.016145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.016267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.016297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.359 qpair failed and we were unable to recover it. 00:30:09.359 [2024-07-13 10:16:15.016455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.016574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.016599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.359 qpair failed and we were unable to recover it. 00:30:09.359 [2024-07-13 10:16:15.016742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.016892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.016918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.359 qpair failed and we were unable to recover it. 00:30:09.359 [2024-07-13 10:16:15.017052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.017168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.017193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.359 qpair failed and we were unable to recover it. 00:30:09.359 [2024-07-13 10:16:15.017344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.017463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.017487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.359 qpair failed and we were unable to recover it. 00:30:09.359 [2024-07-13 10:16:15.017619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.017744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.017769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.359 qpair failed and we were unable to recover it. 00:30:09.359 [2024-07-13 10:16:15.017921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.018070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.018095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.359 qpair failed and we were unable to recover it. 00:30:09.359 [2024-07-13 10:16:15.018221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.018370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.018395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.359 qpair failed and we were unable to recover it. 00:30:09.359 [2024-07-13 10:16:15.018543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.018670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.018694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.359 qpair failed and we were unable to recover it. 00:30:09.359 [2024-07-13 10:16:15.018877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.019027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.019052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.359 qpair failed and we were unable to recover it. 00:30:09.359 [2024-07-13 10:16:15.019174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.019299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.019328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.359 qpair failed and we were unable to recover it. 00:30:09.359 [2024-07-13 10:16:15.019450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.019573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.019598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.359 qpair failed and we were unable to recover it. 00:30:09.359 [2024-07-13 10:16:15.019748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.019894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.019920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.359 qpair failed and we were unable to recover it. 00:30:09.359 [2024-07-13 10:16:15.020103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.020223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.020248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.359 qpair failed and we were unable to recover it. 00:30:09.359 [2024-07-13 10:16:15.020366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.020515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.020540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.359 qpair failed and we were unable to recover it. 00:30:09.359 [2024-07-13 10:16:15.020657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.020803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.020828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.359 qpair failed and we were unable to recover it. 00:30:09.359 [2024-07-13 10:16:15.020962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.021117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.021143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.359 qpair failed and we were unable to recover it. 00:30:09.359 [2024-07-13 10:16:15.021287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.021444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.021469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.359 qpair failed and we were unable to recover it. 00:30:09.359 [2024-07-13 10:16:15.021620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.021771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.021796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.359 qpair failed and we were unable to recover it. 00:30:09.359 [2024-07-13 10:16:15.021950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.022095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.022120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.359 qpair failed and we were unable to recover it. 00:30:09.359 [2024-07-13 10:16:15.022275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.022401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.022431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.359 qpair failed and we were unable to recover it. 00:30:09.359 [2024-07-13 10:16:15.022586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.359 [2024-07-13 10:16:15.022707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.022732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.360 qpair failed and we were unable to recover it. 00:30:09.360 [2024-07-13 10:16:15.022857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.022982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.023007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.360 qpair failed and we were unable to recover it. 00:30:09.360 [2024-07-13 10:16:15.023134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.023290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.023315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.360 qpair failed and we were unable to recover it. 00:30:09.360 [2024-07-13 10:16:15.023496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.023628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.023652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.360 qpair failed and we were unable to recover it. 00:30:09.360 [2024-07-13 10:16:15.023808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.023982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.024007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.360 qpair failed and we were unable to recover it. 00:30:09.360 [2024-07-13 10:16:15.024141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.024291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.024317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.360 qpair failed and we were unable to recover it. 00:30:09.360 [2024-07-13 10:16:15.024441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.024574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.024598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.360 qpair failed and we were unable to recover it. 00:30:09.360 [2024-07-13 10:16:15.024752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.024915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.024941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.360 qpair failed and we were unable to recover it. 00:30:09.360 [2024-07-13 10:16:15.025095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.025281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.025306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.360 qpair failed and we were unable to recover it. 00:30:09.360 [2024-07-13 10:16:15.025456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.025632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.025661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.360 qpair failed and we were unable to recover it. 00:30:09.360 [2024-07-13 10:16:15.025779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.025934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.025959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.360 qpair failed and we were unable to recover it. 00:30:09.360 [2024-07-13 10:16:15.026095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.026251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.026283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.360 qpair failed and we were unable to recover it. 00:30:09.360 [2024-07-13 10:16:15.026433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.026553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.026578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.360 qpair failed and we were unable to recover it. 00:30:09.360 [2024-07-13 10:16:15.026732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.026853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.026887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.360 qpair failed and we were unable to recover it. 00:30:09.360 [2024-07-13 10:16:15.027040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.027207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.027231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.360 qpair failed and we were unable to recover it. 00:30:09.360 [2024-07-13 10:16:15.027391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.027526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.027551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.360 qpair failed and we were unable to recover it. 00:30:09.360 [2024-07-13 10:16:15.027708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.027883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.027908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.360 qpair failed and we were unable to recover it. 00:30:09.360 [2024-07-13 10:16:15.028051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.028197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.028221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.360 qpair failed and we were unable to recover it. 00:30:09.360 [2024-07-13 10:16:15.028380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.028500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.028524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.360 qpair failed and we were unable to recover it. 00:30:09.360 [2024-07-13 10:16:15.028679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.028852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.028888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.360 qpair failed and we were unable to recover it. 00:30:09.360 [2024-07-13 10:16:15.029015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.029169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.029194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.360 qpair failed and we were unable to recover it. 00:30:09.360 [2024-07-13 10:16:15.029350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.029496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.029521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.360 qpair failed and we were unable to recover it. 00:30:09.360 [2024-07-13 10:16:15.029699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.029849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.029883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.360 qpair failed and we were unable to recover it. 00:30:09.360 [2024-07-13 10:16:15.030016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.030144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.030177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.360 qpair failed and we were unable to recover it. 00:30:09.360 [2024-07-13 10:16:15.030337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.030488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.030513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.360 qpair failed and we were unable to recover it. 00:30:09.360 [2024-07-13 10:16:15.030655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.030810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.030835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.360 qpair failed and we were unable to recover it. 00:30:09.360 [2024-07-13 10:16:15.030969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.031094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.031119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.360 qpair failed and we were unable to recover it. 00:30:09.360 [2024-07-13 10:16:15.031241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.031368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.031392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.360 qpair failed and we were unable to recover it. 00:30:09.360 [2024-07-13 10:16:15.031557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.031705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.031730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.360 qpair failed and we were unable to recover it. 00:30:09.360 [2024-07-13 10:16:15.031854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.032031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.032057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.360 qpair failed and we were unable to recover it. 00:30:09.360 [2024-07-13 10:16:15.032219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.032369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.360 [2024-07-13 10:16:15.032393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.360 qpair failed and we were unable to recover it. 00:30:09.361 [2024-07-13 10:16:15.032546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.032695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.032720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.361 qpair failed and we were unable to recover it. 00:30:09.361 [2024-07-13 10:16:15.032843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.032975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.033000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.361 qpair failed and we were unable to recover it. 00:30:09.361 [2024-07-13 10:16:15.033153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.033337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.033362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.361 qpair failed and we were unable to recover it. 00:30:09.361 [2024-07-13 10:16:15.033520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.033666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.033691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.361 qpair failed and we were unable to recover it. 00:30:09.361 [2024-07-13 10:16:15.033873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.034030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.034055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.361 qpair failed and we were unable to recover it. 00:30:09.361 [2024-07-13 10:16:15.034221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.034351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.034376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.361 qpair failed and we were unable to recover it. 00:30:09.361 [2024-07-13 10:16:15.034526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.034645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.034670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.361 qpair failed and we were unable to recover it. 00:30:09.361 [2024-07-13 10:16:15.034790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.034940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.034967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.361 qpair failed and we were unable to recover it. 00:30:09.361 [2024-07-13 10:16:15.035122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.035250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.035274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.361 qpair failed and we were unable to recover it. 00:30:09.361 [2024-07-13 10:16:15.035427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.035550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.035574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.361 qpair failed and we were unable to recover it. 00:30:09.361 [2024-07-13 10:16:15.035726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.035904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.035929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.361 qpair failed and we were unable to recover it. 00:30:09.361 [2024-07-13 10:16:15.036104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.036275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.036301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.361 qpair failed and we were unable to recover it. 00:30:09.361 [2024-07-13 10:16:15.036478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.036649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.036673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.361 qpair failed and we were unable to recover it. 00:30:09.361 [2024-07-13 10:16:15.036812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.036976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.037002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.361 qpair failed and we were unable to recover it. 00:30:09.361 [2024-07-13 10:16:15.037179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.037295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.037321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.361 qpair failed and we were unable to recover it. 00:30:09.361 [2024-07-13 10:16:15.037451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.037602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.037627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.361 qpair failed and we were unable to recover it. 00:30:09.361 [2024-07-13 10:16:15.037784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.037914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.037939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.361 qpair failed and we were unable to recover it. 00:30:09.361 [2024-07-13 10:16:15.038086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.038224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.038248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.361 qpair failed and we were unable to recover it. 00:30:09.361 [2024-07-13 10:16:15.038376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.038527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.038552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.361 qpair failed and we were unable to recover it. 00:30:09.361 [2024-07-13 10:16:15.038676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.038829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.038854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.361 qpair failed and we were unable to recover it. 00:30:09.361 [2024-07-13 10:16:15.039022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.039143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.039168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.361 qpair failed and we were unable to recover it. 00:30:09.361 [2024-07-13 10:16:15.039314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.039493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.039518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.361 qpair failed and we were unable to recover it. 00:30:09.361 [2024-07-13 10:16:15.039666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.039783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.039808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.361 qpair failed and we were unable to recover it. 00:30:09.361 [2024-07-13 10:16:15.039947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.040075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.040100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.361 qpair failed and we were unable to recover it. 00:30:09.361 [2024-07-13 10:16:15.040230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.040378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.040403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.361 qpair failed and we were unable to recover it. 00:30:09.361 [2024-07-13 10:16:15.040575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.040696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.040721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.361 qpair failed and we were unable to recover it. 00:30:09.361 [2024-07-13 10:16:15.040839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.041006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.041032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.361 qpair failed and we were unable to recover it. 00:30:09.361 [2024-07-13 10:16:15.041182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.041337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.041362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.361 qpair failed and we were unable to recover it. 00:30:09.361 [2024-07-13 10:16:15.041513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.041668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.041693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.361 qpair failed and we were unable to recover it. 00:30:09.361 [2024-07-13 10:16:15.041811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.041953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.041980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.361 qpair failed and we were unable to recover it. 00:30:09.361 [2024-07-13 10:16:15.042141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.361 [2024-07-13 10:16:15.042259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.042284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.362 qpair failed and we were unable to recover it. 00:30:09.362 [2024-07-13 10:16:15.042435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.042612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.042637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.362 qpair failed and we were unable to recover it. 00:30:09.362 [2024-07-13 10:16:15.042764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.042919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.042944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.362 qpair failed and we were unable to recover it. 00:30:09.362 [2024-07-13 10:16:15.043129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.043253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.043277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.362 qpair failed and we were unable to recover it. 00:30:09.362 [2024-07-13 10:16:15.043427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.043565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.043591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.362 qpair failed and we were unable to recover it. 00:30:09.362 [2024-07-13 10:16:15.043765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.043889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.043915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.362 qpair failed and we were unable to recover it. 00:30:09.362 [2024-07-13 10:16:15.044072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.044232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.044257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.362 qpair failed and we were unable to recover it. 00:30:09.362 [2024-07-13 10:16:15.044383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.044558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.044582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.362 qpair failed and we were unable to recover it. 00:30:09.362 [2024-07-13 10:16:15.044730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.044878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.044904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.362 qpair failed and we were unable to recover it. 00:30:09.362 [2024-07-13 10:16:15.045062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.045184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.045209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.362 qpair failed and we were unable to recover it. 00:30:09.362 [2024-07-13 10:16:15.045360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.045484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.045509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.362 qpair failed and we were unable to recover it. 00:30:09.362 [2024-07-13 10:16:15.045653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.045804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.045805] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:30:09.362 [2024-07-13 10:16:15.045829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.362 qpair failed and we were unable to recover it. 00:30:09.362 [2024-07-13 10:16:15.045901] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:09.362 [2024-07-13 10:16:15.045964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.046078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.046102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.362 qpair failed and we were unable to recover it. 00:30:09.362 [2024-07-13 10:16:15.046294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.046421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.046445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.362 qpair failed and we were unable to recover it. 00:30:09.362 [2024-07-13 10:16:15.046574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.046752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.046777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.362 qpair failed and we were unable to recover it. 00:30:09.362 [2024-07-13 10:16:15.046942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.047094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.047118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.362 qpair failed and we were unable to recover it. 00:30:09.362 [2024-07-13 10:16:15.047268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.047426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.047450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.362 qpair failed and we were unable to recover it. 00:30:09.362 [2024-07-13 10:16:15.047599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.047726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.047752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.362 qpair failed and we were unable to recover it. 00:30:09.362 [2024-07-13 10:16:15.047939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.048060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.048085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.362 qpair failed and we were unable to recover it. 00:30:09.362 [2024-07-13 10:16:15.048247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.048371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.048396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.362 qpair failed and we were unable to recover it. 00:30:09.362 [2024-07-13 10:16:15.048542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.048693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.048718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.362 qpair failed and we were unable to recover it. 00:30:09.362 [2024-07-13 10:16:15.048875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.049000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.049026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.362 qpair failed and we were unable to recover it. 00:30:09.362 [2024-07-13 10:16:15.049181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.049303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.049328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.362 qpair failed and we were unable to recover it. 00:30:09.362 [2024-07-13 10:16:15.049452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.049579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.049605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.362 qpair failed and we were unable to recover it. 00:30:09.362 [2024-07-13 10:16:15.049757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.049935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.049961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.362 qpair failed and we were unable to recover it. 00:30:09.362 [2024-07-13 10:16:15.050102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.050257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.050282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.362 qpair failed and we were unable to recover it. 00:30:09.362 [2024-07-13 10:16:15.050456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.050606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.050631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.362 qpair failed and we were unable to recover it. 00:30:09.362 [2024-07-13 10:16:15.050749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.050897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.050923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.362 qpair failed and we were unable to recover it. 00:30:09.362 [2024-07-13 10:16:15.051076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.051239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.051264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.362 qpair failed and we were unable to recover it. 00:30:09.362 [2024-07-13 10:16:15.051417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.051572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.362 [2024-07-13 10:16:15.051597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.362 qpair failed and we were unable to recover it. 00:30:09.363 [2024-07-13 10:16:15.051759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.051908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.051935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.363 qpair failed and we were unable to recover it. 00:30:09.363 [2024-07-13 10:16:15.052083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.052237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.052262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.363 qpair failed and we were unable to recover it. 00:30:09.363 [2024-07-13 10:16:15.052384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.052499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.052524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.363 qpair failed and we were unable to recover it. 00:30:09.363 [2024-07-13 10:16:15.052648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.052801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.052826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.363 qpair failed and we were unable to recover it. 00:30:09.363 [2024-07-13 10:16:15.052978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.053113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.053138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.363 qpair failed and we were unable to recover it. 00:30:09.363 [2024-07-13 10:16:15.053291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.053436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.053461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.363 qpair failed and we were unable to recover it. 00:30:09.363 [2024-07-13 10:16:15.053580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.053726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.053750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.363 qpair failed and we were unable to recover it. 00:30:09.363 [2024-07-13 10:16:15.053897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.054080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.054104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.363 qpair failed and we were unable to recover it. 00:30:09.363 [2024-07-13 10:16:15.054265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.054440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.054465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.363 qpair failed and we were unable to recover it. 00:30:09.363 [2024-07-13 10:16:15.054618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.054791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.054816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.363 qpair failed and we were unable to recover it. 00:30:09.363 [2024-07-13 10:16:15.054954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.055083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.055108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.363 qpair failed and we were unable to recover it. 00:30:09.363 [2024-07-13 10:16:15.055258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.055436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.055460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.363 qpair failed and we were unable to recover it. 00:30:09.363 [2024-07-13 10:16:15.055617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.055766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.055791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.363 qpair failed and we were unable to recover it. 00:30:09.363 [2024-07-13 10:16:15.055963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.056112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.056138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.363 qpair failed and we were unable to recover it. 00:30:09.363 [2024-07-13 10:16:15.056300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.056444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.056469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.363 qpair failed and we were unable to recover it. 00:30:09.363 [2024-07-13 10:16:15.056623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.056764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.056789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.363 qpair failed and we were unable to recover it. 00:30:09.363 [2024-07-13 10:16:15.056925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.057119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.057146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.363 qpair failed and we were unable to recover it. 00:30:09.363 [2024-07-13 10:16:15.057266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.057405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.057441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.363 qpair failed and we were unable to recover it. 00:30:09.363 [2024-07-13 10:16:15.057563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.057715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.057754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.363 qpair failed and we were unable to recover it. 00:30:09.363 [2024-07-13 10:16:15.057887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.058034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.058059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.363 qpair failed and we were unable to recover it. 00:30:09.363 [2024-07-13 10:16:15.058216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.058337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.058361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.363 qpair failed and we were unable to recover it. 00:30:09.363 [2024-07-13 10:16:15.058512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.058665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.058689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.363 qpair failed and we were unable to recover it. 00:30:09.363 [2024-07-13 10:16:15.058842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.059025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.059051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.363 qpair failed and we were unable to recover it. 00:30:09.363 [2024-07-13 10:16:15.059201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.059326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.059350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.363 qpair failed and we were unable to recover it. 00:30:09.363 [2024-07-13 10:16:15.059504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.059660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.059686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.363 qpair failed and we were unable to recover it. 00:30:09.363 [2024-07-13 10:16:15.059839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.059998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.060024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.363 qpair failed and we were unable to recover it. 00:30:09.363 [2024-07-13 10:16:15.060176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.060300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.060324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.363 qpair failed and we were unable to recover it. 00:30:09.363 [2024-07-13 10:16:15.060450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.060570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.060594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.363 qpair failed and we were unable to recover it. 00:30:09.363 [2024-07-13 10:16:15.060750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.060881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.363 [2024-07-13 10:16:15.060912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.364 qpair failed and we were unable to recover it. 00:30:09.364 [2024-07-13 10:16:15.061061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.061238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.061263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.364 qpair failed and we were unable to recover it. 00:30:09.364 [2024-07-13 10:16:15.061415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.061565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.061591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.364 qpair failed and we were unable to recover it. 00:30:09.364 [2024-07-13 10:16:15.061746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.061908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.061934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.364 qpair failed and we were unable to recover it. 00:30:09.364 [2024-07-13 10:16:15.062065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.062229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.062254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.364 qpair failed and we were unable to recover it. 00:30:09.364 [2024-07-13 10:16:15.062375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.062500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.062527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.364 qpair failed and we were unable to recover it. 00:30:09.364 [2024-07-13 10:16:15.062713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.062870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.062896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.364 qpair failed and we were unable to recover it. 00:30:09.364 [2024-07-13 10:16:15.063043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.063224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.063248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.364 qpair failed and we were unable to recover it. 00:30:09.364 [2024-07-13 10:16:15.063398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.063523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.063548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.364 qpair failed and we were unable to recover it. 00:30:09.364 [2024-07-13 10:16:15.063670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.063818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.063843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.364 qpair failed and we were unable to recover it. 00:30:09.364 [2024-07-13 10:16:15.063989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.064143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.064172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.364 qpair failed and we were unable to recover it. 00:30:09.364 [2024-07-13 10:16:15.064293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.064430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.064454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.364 qpair failed and we were unable to recover it. 00:30:09.364 [2024-07-13 10:16:15.064605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.064756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.064781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.364 qpair failed and we were unable to recover it. 00:30:09.364 [2024-07-13 10:16:15.064930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.065066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.065091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.364 qpair failed and we were unable to recover it. 00:30:09.364 [2024-07-13 10:16:15.065244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.065368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.065392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.364 qpair failed and we were unable to recover it. 00:30:09.364 [2024-07-13 10:16:15.065570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.065729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.065754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.364 qpair failed and we were unable to recover it. 00:30:09.364 [2024-07-13 10:16:15.065909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.066037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.066062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.364 qpair failed and we were unable to recover it. 00:30:09.364 [2024-07-13 10:16:15.066216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.066386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.066411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.364 qpair failed and we were unable to recover it. 00:30:09.364 [2024-07-13 10:16:15.066538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.066670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.066695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.364 qpair failed and we were unable to recover it. 00:30:09.364 [2024-07-13 10:16:15.066822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.066977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.067003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.364 qpair failed and we were unable to recover it. 00:30:09.364 [2024-07-13 10:16:15.067126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.067282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.067313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.364 qpair failed and we were unable to recover it. 00:30:09.364 [2024-07-13 10:16:15.067495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.067675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.067700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.364 qpair failed and we were unable to recover it. 00:30:09.364 [2024-07-13 10:16:15.067858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.068014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.068039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.364 qpair failed and we were unable to recover it. 00:30:09.364 [2024-07-13 10:16:15.068166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.068342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.068367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.364 qpair failed and we were unable to recover it. 00:30:09.364 [2024-07-13 10:16:15.068518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.068666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.068691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.364 qpair failed and we were unable to recover it. 00:30:09.364 [2024-07-13 10:16:15.068812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.068969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.068995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.364 qpair failed and we were unable to recover it. 00:30:09.364 [2024-07-13 10:16:15.069163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.069314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.069339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.364 qpair failed and we were unable to recover it. 00:30:09.364 [2024-07-13 10:16:15.069522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.069702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.364 [2024-07-13 10:16:15.069727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.365 qpair failed and we were unable to recover it. 00:30:09.365 [2024-07-13 10:16:15.069879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.070031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.070056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.365 qpair failed and we were unable to recover it. 00:30:09.365 [2024-07-13 10:16:15.070181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.070302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.070327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.365 qpair failed and we were unable to recover it. 00:30:09.365 [2024-07-13 10:16:15.070449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.070626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.070651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.365 qpair failed and we were unable to recover it. 00:30:09.365 [2024-07-13 10:16:15.070817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.070973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.070998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.365 qpair failed and we were unable to recover it. 00:30:09.365 [2024-07-13 10:16:15.071150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.071276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.071302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.365 qpair failed and we were unable to recover it. 00:30:09.365 [2024-07-13 10:16:15.071484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.071638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.071662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.365 qpair failed and we were unable to recover it. 00:30:09.365 [2024-07-13 10:16:15.071811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.071954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.071980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.365 qpair failed and we were unable to recover it. 00:30:09.365 [2024-07-13 10:16:15.072102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.072280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.072304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.365 qpair failed and we were unable to recover it. 00:30:09.365 [2024-07-13 10:16:15.072484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.072603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.072630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.365 qpair failed and we were unable to recover it. 00:30:09.365 [2024-07-13 10:16:15.072780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.072971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.072996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.365 qpair failed and we were unable to recover it. 00:30:09.365 [2024-07-13 10:16:15.073122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.073281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.073307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.365 qpair failed and we were unable to recover it. 00:30:09.365 [2024-07-13 10:16:15.073461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.073640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.073665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.365 qpair failed and we were unable to recover it. 00:30:09.365 [2024-07-13 10:16:15.073813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.073952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.073978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.365 qpair failed and we were unable to recover it. 00:30:09.365 [2024-07-13 10:16:15.074109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.074259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.074286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.365 qpair failed and we were unable to recover it. 00:30:09.365 [2024-07-13 10:16:15.074438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.074602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.074627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.365 qpair failed and we were unable to recover it. 00:30:09.365 [2024-07-13 10:16:15.074778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.074940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.074966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.365 qpair failed and we were unable to recover it. 00:30:09.365 [2024-07-13 10:16:15.075119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.075293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.075318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.365 qpair failed and we were unable to recover it. 00:30:09.365 [2024-07-13 10:16:15.075445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.075594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.075619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.365 qpair failed and we were unable to recover it. 00:30:09.365 [2024-07-13 10:16:15.075746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.075875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.075900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.365 qpair failed and we were unable to recover it. 00:30:09.365 [2024-07-13 10:16:15.076046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.076189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.076214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.365 qpair failed and we were unable to recover it. 00:30:09.365 [2024-07-13 10:16:15.076387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.076563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.076588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.365 qpair failed and we were unable to recover it. 00:30:09.365 [2024-07-13 10:16:15.076736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.076890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.076917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.365 qpair failed and we were unable to recover it. 00:30:09.365 [2024-07-13 10:16:15.077046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.077202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.077227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.365 qpair failed and we were unable to recover it. 00:30:09.365 [2024-07-13 10:16:15.077402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.077548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.077572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.365 qpair failed and we were unable to recover it. 00:30:09.365 [2024-07-13 10:16:15.077724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.077892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.077919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.365 qpair failed and we were unable to recover it. 00:30:09.365 [2024-07-13 10:16:15.078069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.078197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.078222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.365 qpair failed and we were unable to recover it. 00:30:09.365 [2024-07-13 10:16:15.078393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.078545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.078569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.365 qpair failed and we were unable to recover it. 00:30:09.365 [2024-07-13 10:16:15.078749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.078925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.078951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.365 qpair failed and we were unable to recover it. 00:30:09.365 [2024-07-13 10:16:15.079104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.079254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.079278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.365 qpair failed and we were unable to recover it. 00:30:09.365 [2024-07-13 10:16:15.079426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.079569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.365 [2024-07-13 10:16:15.079594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.365 qpair failed and we were unable to recover it. 00:30:09.366 [2024-07-13 10:16:15.079769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.079924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.079949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.366 qpair failed and we were unable to recover it. 00:30:09.366 [2024-07-13 10:16:15.080070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.080221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.080245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.366 qpair failed and we were unable to recover it. 00:30:09.366 [2024-07-13 10:16:15.080395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.080522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.080546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.366 qpair failed and we were unable to recover it. 00:30:09.366 [2024-07-13 10:16:15.080729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.080860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.080891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.366 qpair failed and we were unable to recover it. 00:30:09.366 [2024-07-13 10:16:15.081018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.081166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.081191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.366 qpair failed and we were unable to recover it. 00:30:09.366 [2024-07-13 10:16:15.081346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.081478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.081502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.366 qpair failed and we were unable to recover it. 00:30:09.366 [2024-07-13 10:16:15.081650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.081805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.081829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.366 qpair failed and we were unable to recover it. 00:30:09.366 [2024-07-13 10:16:15.081976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.082128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.082153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.366 qpair failed and we were unable to recover it. 00:30:09.366 EAL: No free 2048 kB hugepages reported on node 1 00:30:09.366 [2024-07-13 10:16:15.082332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.082490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.082515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.366 qpair failed and we were unable to recover it. 00:30:09.366 [2024-07-13 10:16:15.082647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.082805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.082829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.366 qpair failed and we were unable to recover it. 00:30:09.366 [2024-07-13 10:16:15.083031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.083189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.083214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.366 qpair failed and we were unable to recover it. 00:30:09.366 [2024-07-13 10:16:15.083366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.083514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.083538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.366 qpair failed and we were unable to recover it. 00:30:09.366 [2024-07-13 10:16:15.083684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.083829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.083854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.366 qpair failed and we were unable to recover it. 00:30:09.366 [2024-07-13 10:16:15.084045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.084170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.084195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.366 qpair failed and we were unable to recover it. 00:30:09.366 [2024-07-13 10:16:15.084346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.084470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.084494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.366 qpair failed and we were unable to recover it. 00:30:09.366 [2024-07-13 10:16:15.084648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.084777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.084802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.366 qpair failed and we were unable to recover it. 00:30:09.366 [2024-07-13 10:16:15.084980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.085128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.085152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.366 qpair failed and we were unable to recover it. 00:30:09.366 [2024-07-13 10:16:15.085304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.085430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.085455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.366 qpair failed and we were unable to recover it. 00:30:09.366 [2024-07-13 10:16:15.085610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.085754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.085779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.366 qpair failed and we were unable to recover it. 00:30:09.366 [2024-07-13 10:16:15.085910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.086030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.086055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.366 qpair failed and we were unable to recover it. 00:30:09.366 [2024-07-13 10:16:15.086255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.086407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.086432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.366 qpair failed and we were unable to recover it. 00:30:09.366 [2024-07-13 10:16:15.086579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.086755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.086781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.366 qpair failed and we were unable to recover it. 00:30:09.366 [2024-07-13 10:16:15.086932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.087104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.087129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.366 qpair failed and we were unable to recover it. 00:30:09.366 [2024-07-13 10:16:15.087274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.087407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.087431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.366 qpair failed and we were unable to recover it. 00:30:09.366 [2024-07-13 10:16:15.087617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.087768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.087792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.366 qpair failed and we were unable to recover it. 00:30:09.366 [2024-07-13 10:16:15.087962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.088108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.088133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.366 qpair failed and we were unable to recover it. 00:30:09.366 [2024-07-13 10:16:15.088262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.088408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.088433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.366 qpair failed and we were unable to recover it. 00:30:09.366 [2024-07-13 10:16:15.088562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.088740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.088765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.366 qpair failed and we were unable to recover it. 00:30:09.366 [2024-07-13 10:16:15.088922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.089072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.089098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.366 qpair failed and we were unable to recover it. 00:30:09.366 [2024-07-13 10:16:15.089265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.089411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.366 [2024-07-13 10:16:15.089436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.366 qpair failed and we were unable to recover it. 00:30:09.366 [2024-07-13 10:16:15.089582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.089723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.089748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.367 qpair failed and we were unable to recover it. 00:30:09.367 [2024-07-13 10:16:15.089901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.090072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.090097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.367 qpair failed and we were unable to recover it. 00:30:09.367 [2024-07-13 10:16:15.090223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.090396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.090421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.367 qpair failed and we were unable to recover it. 00:30:09.367 [2024-07-13 10:16:15.090595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.090775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.090800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.367 qpair failed and we were unable to recover it. 00:30:09.367 [2024-07-13 10:16:15.090941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.091097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.091122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.367 qpair failed and we were unable to recover it. 00:30:09.367 [2024-07-13 10:16:15.091254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.091401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.091426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.367 qpair failed and we were unable to recover it. 00:30:09.367 [2024-07-13 10:16:15.091600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.091742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.091767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.367 qpair failed and we were unable to recover it. 00:30:09.367 [2024-07-13 10:16:15.091910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.092034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.092059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.367 qpair failed and we were unable to recover it. 00:30:09.367 [2024-07-13 10:16:15.092244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.092392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.092417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.367 qpair failed and we were unable to recover it. 00:30:09.367 [2024-07-13 10:16:15.092562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.092736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.092761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.367 qpair failed and we were unable to recover it. 00:30:09.367 [2024-07-13 10:16:15.092881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.093025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.093050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.367 qpair failed and we were unable to recover it. 00:30:09.367 [2024-07-13 10:16:15.093197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.093347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.093371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.367 qpair failed and we were unable to recover it. 00:30:09.367 [2024-07-13 10:16:15.093527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.093680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.093705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.367 qpair failed and we were unable to recover it. 00:30:09.367 [2024-07-13 10:16:15.093883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.094048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.094074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.367 qpair failed and we were unable to recover it. 00:30:09.367 [2024-07-13 10:16:15.094203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.094385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.094410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.367 qpair failed and we were unable to recover it. 00:30:09.367 [2024-07-13 10:16:15.094555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.094679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.094704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.367 qpair failed and we were unable to recover it. 00:30:09.367 [2024-07-13 10:16:15.094846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.095009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.095034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.367 qpair failed and we were unable to recover it. 00:30:09.367 [2024-07-13 10:16:15.095188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.095303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.095328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.367 qpair failed and we were unable to recover it. 00:30:09.367 [2024-07-13 10:16:15.095477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.095624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.095648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.367 qpair failed and we were unable to recover it. 00:30:09.367 [2024-07-13 10:16:15.095767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.095896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.095922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.367 qpair failed and we were unable to recover it. 00:30:09.367 [2024-07-13 10:16:15.096073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.096198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.096223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.367 qpair failed and we were unable to recover it. 00:30:09.367 [2024-07-13 10:16:15.096399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.096514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.096539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.367 qpair failed and we were unable to recover it. 00:30:09.367 [2024-07-13 10:16:15.096692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.096809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.096833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.367 qpair failed and we were unable to recover it. 00:30:09.367 [2024-07-13 10:16:15.096986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.097113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.097138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.367 qpair failed and we were unable to recover it. 00:30:09.367 [2024-07-13 10:16:15.097289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.097412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.097437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.367 qpair failed and we were unable to recover it. 00:30:09.367 [2024-07-13 10:16:15.097615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.097732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.097756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.367 qpair failed and we were unable to recover it. 00:30:09.367 [2024-07-13 10:16:15.097911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.098064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.098089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.367 qpair failed and we were unable to recover it. 00:30:09.367 [2024-07-13 10:16:15.098243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.098397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.098421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.367 qpair failed and we were unable to recover it. 00:30:09.367 [2024-07-13 10:16:15.098570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.098732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.098757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.367 qpair failed and we were unable to recover it. 00:30:09.367 [2024-07-13 10:16:15.098910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.099055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.099079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.367 qpair failed and we were unable to recover it. 00:30:09.367 [2024-07-13 10:16:15.099201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.099350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.367 [2024-07-13 10:16:15.099375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.368 qpair failed and we were unable to recover it. 00:30:09.368 [2024-07-13 10:16:15.099504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.099656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.099682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.368 qpair failed and we were unable to recover it. 00:30:09.368 [2024-07-13 10:16:15.099864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.099989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.100015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.368 qpair failed and we were unable to recover it. 00:30:09.368 [2024-07-13 10:16:15.100149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.100300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.100325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.368 qpair failed and we were unable to recover it. 00:30:09.368 [2024-07-13 10:16:15.100460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.100607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.100632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.368 qpair failed and we were unable to recover it. 00:30:09.368 [2024-07-13 10:16:15.100779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.100900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.100926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.368 qpair failed and we were unable to recover it. 00:30:09.368 [2024-07-13 10:16:15.101052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.101172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.101198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.368 qpair failed and we were unable to recover it. 00:30:09.368 [2024-07-13 10:16:15.101357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.101504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.101530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.368 qpair failed and we were unable to recover it. 00:30:09.368 [2024-07-13 10:16:15.101679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.101833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.101858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.368 qpair failed and we were unable to recover it. 00:30:09.368 [2024-07-13 10:16:15.102023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.102141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.102166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.368 qpair failed and we were unable to recover it. 00:30:09.368 [2024-07-13 10:16:15.102290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.102473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.102497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.368 qpair failed and we were unable to recover it. 00:30:09.368 [2024-07-13 10:16:15.102652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.102776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.102801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.368 qpair failed and we were unable to recover it. 00:30:09.368 [2024-07-13 10:16:15.102964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.103112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.103137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.368 qpair failed and we were unable to recover it. 00:30:09.368 [2024-07-13 10:16:15.103286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.103437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.103463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.368 qpair failed and we were unable to recover it. 00:30:09.368 [2024-07-13 10:16:15.103590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.103743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.103768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.368 qpair failed and we were unable to recover it. 00:30:09.368 [2024-07-13 10:16:15.103961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.104123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.104148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.368 qpair failed and we were unable to recover it. 00:30:09.368 [2024-07-13 10:16:15.104310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.104440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.104465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.368 qpair failed and we were unable to recover it. 00:30:09.368 [2024-07-13 10:16:15.104620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.104773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.104798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.368 qpair failed and we were unable to recover it. 00:30:09.368 [2024-07-13 10:16:15.104989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.105114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.105139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.368 qpair failed and we were unable to recover it. 00:30:09.368 [2024-07-13 10:16:15.105322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.105477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.105502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.368 qpair failed and we were unable to recover it. 00:30:09.368 [2024-07-13 10:16:15.105623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.105743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.105769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.368 qpair failed and we were unable to recover it. 00:30:09.368 [2024-07-13 10:16:15.105942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.106111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.106136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.368 qpair failed and we were unable to recover it. 00:30:09.368 [2024-07-13 10:16:15.106291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.106417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.106442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.368 qpair failed and we were unable to recover it. 00:30:09.368 [2024-07-13 10:16:15.106569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.106726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.106751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.368 qpair failed and we were unable to recover it. 00:30:09.368 [2024-07-13 10:16:15.106917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.107069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.107093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.368 qpair failed and we were unable to recover it. 00:30:09.368 [2024-07-13 10:16:15.107223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.107401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.107426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.368 qpair failed and we were unable to recover it. 00:30:09.368 [2024-07-13 10:16:15.107601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.107731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.368 [2024-07-13 10:16:15.107757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.369 qpair failed and we were unable to recover it. 00:30:09.369 [2024-07-13 10:16:15.107885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.108008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.108033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.369 qpair failed and we were unable to recover it. 00:30:09.369 [2024-07-13 10:16:15.108191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.108343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.108368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.369 qpair failed and we were unable to recover it. 00:30:09.369 [2024-07-13 10:16:15.108503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.108627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.108652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.369 qpair failed and we were unable to recover it. 00:30:09.369 [2024-07-13 10:16:15.108833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.108989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.109015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.369 qpair failed and we were unable to recover it. 00:30:09.369 [2024-07-13 10:16:15.109166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.109342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.109366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.369 qpair failed and we were unable to recover it. 00:30:09.369 [2024-07-13 10:16:15.109514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.109666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.109691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.369 qpair failed and we were unable to recover it. 00:30:09.369 [2024-07-13 10:16:15.109838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.110023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.110049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.369 qpair failed and we were unable to recover it. 00:30:09.369 [2024-07-13 10:16:15.110175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.110332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.110356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.369 qpair failed and we were unable to recover it. 00:30:09.369 [2024-07-13 10:16:15.110514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.110657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.110681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.369 qpair failed and we were unable to recover it. 00:30:09.369 [2024-07-13 10:16:15.110834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.111004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.111031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.369 qpair failed and we were unable to recover it. 00:30:09.369 [2024-07-13 10:16:15.111184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.111312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.111336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.369 qpair failed and we were unable to recover it. 00:30:09.369 [2024-07-13 10:16:15.111496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.111666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.111690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.369 qpair failed and we were unable to recover it. 00:30:09.369 [2024-07-13 10:16:15.111839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.112002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.112029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.369 qpair failed and we were unable to recover it. 00:30:09.369 [2024-07-13 10:16:15.112173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.112304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.112329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.369 qpair failed and we were unable to recover it. 00:30:09.369 [2024-07-13 10:16:15.112443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.112606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.112631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.369 qpair failed and we were unable to recover it. 00:30:09.369 [2024-07-13 10:16:15.112783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.112904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.112930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.369 qpair failed and we were unable to recover it. 00:30:09.369 [2024-07-13 10:16:15.113057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.113220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.113245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.369 qpair failed and we were unable to recover it. 00:30:09.369 [2024-07-13 10:16:15.113395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.113511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.113535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.369 qpair failed and we were unable to recover it. 00:30:09.369 [2024-07-13 10:16:15.113664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.113819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.113844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.369 qpair failed and we were unable to recover it. 00:30:09.369 [2024-07-13 10:16:15.114002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.114148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.114173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.369 qpair failed and we were unable to recover it. 00:30:09.369 [2024-07-13 10:16:15.114349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.114471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.114495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.369 qpair failed and we were unable to recover it. 00:30:09.369 [2024-07-13 10:16:15.114639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.114814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.114838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.369 qpair failed and we were unable to recover it. 00:30:09.369 [2024-07-13 10:16:15.114993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.115116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.115140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.369 qpair failed and we were unable to recover it. 00:30:09.369 [2024-07-13 10:16:15.115285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.115459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.115484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.369 qpair failed and we were unable to recover it. 00:30:09.369 [2024-07-13 10:16:15.115643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.115763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.115788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.369 qpair failed and we were unable to recover it. 00:30:09.369 [2024-07-13 10:16:15.115932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.116070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.116096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.369 qpair failed and we were unable to recover it. 00:30:09.369 [2024-07-13 10:16:15.116282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.116412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.116441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.369 qpair failed and we were unable to recover it. 00:30:09.369 [2024-07-13 10:16:15.116596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.116714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.116739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.369 qpair failed and we were unable to recover it. 00:30:09.369 [2024-07-13 10:16:15.116894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.117001] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:09.369 [2024-07-13 10:16:15.117042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.117066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.369 qpair failed and we were unable to recover it. 00:30:09.369 [2024-07-13 10:16:15.117195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.117372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.369 [2024-07-13 10:16:15.117397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.370 qpair failed and we were unable to recover it. 00:30:09.370 [2024-07-13 10:16:15.117523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.117640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.117666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.370 qpair failed and we were unable to recover it. 00:30:09.370 [2024-07-13 10:16:15.117822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.117942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.117968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.370 qpair failed and we were unable to recover it. 00:30:09.370 [2024-07-13 10:16:15.118088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.118247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.118271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.370 qpair failed and we were unable to recover it. 00:30:09.370 [2024-07-13 10:16:15.118427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.118574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.118599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.370 qpair failed and we were unable to recover it. 00:30:09.370 [2024-07-13 10:16:15.118721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.118841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.118873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.370 qpair failed and we were unable to recover it. 00:30:09.370 [2024-07-13 10:16:15.119059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.119209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.119234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.370 qpair failed and we were unable to recover it. 00:30:09.370 [2024-07-13 10:16:15.119382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.119519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.119544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.370 qpair failed and we were unable to recover it. 00:30:09.370 [2024-07-13 10:16:15.119707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.119854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.119887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.370 qpair failed and we were unable to recover it. 00:30:09.370 [2024-07-13 10:16:15.120053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.120209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.120234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.370 qpair failed and we were unable to recover it. 00:30:09.370 [2024-07-13 10:16:15.120398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.120545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.120570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.370 qpair failed and we were unable to recover it. 00:30:09.370 [2024-07-13 10:16:15.120720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.120856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.120890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.370 qpair failed and we were unable to recover it. 00:30:09.370 [2024-07-13 10:16:15.121069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.121234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.121259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.370 qpair failed and we were unable to recover it. 00:30:09.370 [2024-07-13 10:16:15.121409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.121557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.121582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.370 qpair failed and we were unable to recover it. 00:30:09.370 [2024-07-13 10:16:15.121762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.121910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.121936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.370 qpair failed and we were unable to recover it. 00:30:09.370 [2024-07-13 10:16:15.122114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.122231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.122256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.370 qpair failed and we were unable to recover it. 00:30:09.370 [2024-07-13 10:16:15.122407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.122570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.122595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.370 qpair failed and we were unable to recover it. 00:30:09.370 [2024-07-13 10:16:15.122747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.122913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.122939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.370 qpair failed and we were unable to recover it. 00:30:09.370 [2024-07-13 10:16:15.123085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.123211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.123236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.370 qpair failed and we were unable to recover it. 00:30:09.370 [2024-07-13 10:16:15.123387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.123534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.123559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.370 qpair failed and we were unable to recover it. 00:30:09.370 [2024-07-13 10:16:15.123713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.123846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.123877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.370 qpair failed and we were unable to recover it. 00:30:09.370 [2024-07-13 10:16:15.124035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.124211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.124236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.370 qpair failed and we were unable to recover it. 00:30:09.370 [2024-07-13 10:16:15.124358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.124512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.124537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.370 qpair failed and we were unable to recover it. 00:30:09.370 [2024-07-13 10:16:15.124656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.124836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.124861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.370 qpair failed and we were unable to recover it. 00:30:09.370 [2024-07-13 10:16:15.125041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.125165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.125190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.370 qpair failed and we were unable to recover it. 00:30:09.370 [2024-07-13 10:16:15.125344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.125469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.125494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.370 qpair failed and we were unable to recover it. 00:30:09.370 [2024-07-13 10:16:15.125619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.125777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.125801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.370 qpair failed and we were unable to recover it. 00:30:09.370 [2024-07-13 10:16:15.125927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.126056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.126089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.370 qpair failed and we were unable to recover it. 00:30:09.370 [2024-07-13 10:16:15.126269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.126397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.126422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.370 qpair failed and we were unable to recover it. 00:30:09.370 [2024-07-13 10:16:15.126636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.126788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.126812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.370 qpair failed and we were unable to recover it. 00:30:09.370 [2024-07-13 10:16:15.126968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.127119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.370 [2024-07-13 10:16:15.127146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.370 qpair failed and we were unable to recover it. 00:30:09.370 [2024-07-13 10:16:15.127300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.127452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.127478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.371 qpair failed and we were unable to recover it. 00:30:09.371 [2024-07-13 10:16:15.127630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.127813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.127837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.371 qpair failed and we were unable to recover it. 00:30:09.371 [2024-07-13 10:16:15.127968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.128095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.128119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.371 qpair failed and we were unable to recover it. 00:30:09.371 [2024-07-13 10:16:15.128248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.128403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.128428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.371 qpair failed and we were unable to recover it. 00:30:09.371 [2024-07-13 10:16:15.128608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.128730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.128754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.371 qpair failed and we were unable to recover it. 00:30:09.371 [2024-07-13 10:16:15.128915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.129085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.129110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.371 qpair failed and we were unable to recover it. 00:30:09.371 [2024-07-13 10:16:15.129275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.129431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.129460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.371 qpair failed and we were unable to recover it. 00:30:09.371 [2024-07-13 10:16:15.129632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.129777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.129803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.371 qpair failed and we were unable to recover it. 00:30:09.371 [2024-07-13 10:16:15.130026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.130201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.130226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.371 qpair failed and we were unable to recover it. 00:30:09.371 [2024-07-13 10:16:15.130382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.130557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.130582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.371 qpair failed and we were unable to recover it. 00:30:09.371 [2024-07-13 10:16:15.130706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.130855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.130887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.371 qpair failed and we were unable to recover it. 00:30:09.371 [2024-07-13 10:16:15.131019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.131164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.131188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.371 qpair failed and we were unable to recover it. 00:30:09.371 [2024-07-13 10:16:15.131316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.131448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.131472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.371 qpair failed and we were unable to recover it. 00:30:09.371 [2024-07-13 10:16:15.131624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.131806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.131830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.371 qpair failed and we were unable to recover it. 00:30:09.371 [2024-07-13 10:16:15.131969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.132134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.132159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.371 qpair failed and we were unable to recover it. 00:30:09.371 [2024-07-13 10:16:15.132311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.132539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.132564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.371 qpair failed and we were unable to recover it. 00:30:09.371 [2024-07-13 10:16:15.132716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.132873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.132903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.371 qpair failed and we were unable to recover it. 00:30:09.371 [2024-07-13 10:16:15.133059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.133182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.133206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.371 qpair failed and we were unable to recover it. 00:30:09.371 [2024-07-13 10:16:15.133360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.133511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.133535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.371 qpair failed and we were unable to recover it. 00:30:09.371 [2024-07-13 10:16:15.133693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.133887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.133913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.371 qpair failed and we were unable to recover it. 00:30:09.371 [2024-07-13 10:16:15.134143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.134325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.134350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.371 qpair failed and we were unable to recover it. 00:30:09.371 [2024-07-13 10:16:15.134501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.134622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.134646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.371 qpair failed and we were unable to recover it. 00:30:09.371 [2024-07-13 10:16:15.134788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.134935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.134961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.371 qpair failed and we were unable to recover it. 00:30:09.371 [2024-07-13 10:16:15.135113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.135278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.135303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.371 qpair failed and we were unable to recover it. 00:30:09.371 [2024-07-13 10:16:15.135450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.135563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.371 [2024-07-13 10:16:15.135588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.371 qpair failed and we were unable to recover it. 00:30:09.371 [2024-07-13 10:16:15.135745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.653 [2024-07-13 10:16:15.135974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.653 [2024-07-13 10:16:15.136001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.653 qpair failed and we were unable to recover it. 00:30:09.653 [2024-07-13 10:16:15.136160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.653 [2024-07-13 10:16:15.136388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.653 [2024-07-13 10:16:15.136417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.653 qpair failed and we were unable to recover it. 00:30:09.653 [2024-07-13 10:16:15.136582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.653 [2024-07-13 10:16:15.136747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.653 [2024-07-13 10:16:15.136772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.653 qpair failed and we were unable to recover it. 00:30:09.653 [2024-07-13 10:16:15.136931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.653 [2024-07-13 10:16:15.137061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.653 [2024-07-13 10:16:15.137088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.653 qpair failed and we were unable to recover it. 00:30:09.653 [2024-07-13 10:16:15.137211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.653 [2024-07-13 10:16:15.137332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.653 [2024-07-13 10:16:15.137357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.653 qpair failed and we were unable to recover it. 00:30:09.653 [2024-07-13 10:16:15.137533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.653 [2024-07-13 10:16:15.137652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.653 [2024-07-13 10:16:15.137679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.653 qpair failed and we were unable to recover it. 00:30:09.653 [2024-07-13 10:16:15.137840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.653 [2024-07-13 10:16:15.137969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.653 [2024-07-13 10:16:15.137996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.653 qpair failed and we were unable to recover it. 00:30:09.653 [2024-07-13 10:16:15.138151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.653 [2024-07-13 10:16:15.138304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.653 [2024-07-13 10:16:15.138329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.653 qpair failed and we were unable to recover it. 00:30:09.653 [2024-07-13 10:16:15.138519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.653 [2024-07-13 10:16:15.138641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.653 [2024-07-13 10:16:15.138665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.653 qpair failed and we were unable to recover it. 00:30:09.653 [2024-07-13 10:16:15.138817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.653 [2024-07-13 10:16:15.138990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.653 [2024-07-13 10:16:15.139016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.653 qpair failed and we were unable to recover it. 00:30:09.653 [2024-07-13 10:16:15.139147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.653 [2024-07-13 10:16:15.139269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.653 [2024-07-13 10:16:15.139295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.653 qpair failed and we were unable to recover it. 00:30:09.653 [2024-07-13 10:16:15.139472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.653 [2024-07-13 10:16:15.139596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.653 [2024-07-13 10:16:15.139621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.653 qpair failed and we were unable to recover it. 00:30:09.653 [2024-07-13 10:16:15.139752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.653 [2024-07-13 10:16:15.139877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.653 [2024-07-13 10:16:15.139903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.653 qpair failed and we were unable to recover it. 00:30:09.653 [2024-07-13 10:16:15.140089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.653 [2024-07-13 10:16:15.140212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.653 [2024-07-13 10:16:15.140237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.653 qpair failed and we were unable to recover it. 00:30:09.653 [2024-07-13 10:16:15.140371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.653 [2024-07-13 10:16:15.140522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.653 [2024-07-13 10:16:15.140549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.653 qpair failed and we were unable to recover it. 00:30:09.653 [2024-07-13 10:16:15.140705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.653 [2024-07-13 10:16:15.140855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.653 [2024-07-13 10:16:15.140892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.653 qpair failed and we were unable to recover it. 00:30:09.653 [2024-07-13 10:16:15.141029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.653 [2024-07-13 10:16:15.141177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.653 [2024-07-13 10:16:15.141202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.653 qpair failed and we were unable to recover it. 00:30:09.653 [2024-07-13 10:16:15.141385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.653 [2024-07-13 10:16:15.141535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.653 [2024-07-13 10:16:15.141559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.653 qpair failed and we were unable to recover it. 00:30:09.653 [2024-07-13 10:16:15.141710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.653 [2024-07-13 10:16:15.141836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.653 [2024-07-13 10:16:15.141860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.653 qpair failed and we were unable to recover it. 00:30:09.653 [2024-07-13 10:16:15.142003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.653 [2024-07-13 10:16:15.142135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.653 [2024-07-13 10:16:15.142160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.653 qpair failed and we were unable to recover it. 00:30:09.653 [2024-07-13 10:16:15.142308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.653 [2024-07-13 10:16:15.142429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.653 [2024-07-13 10:16:15.142453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.653 qpair failed and we were unable to recover it. 00:30:09.653 [2024-07-13 10:16:15.142578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.142727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.142752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.654 qpair failed and we were unable to recover it. 00:30:09.654 [2024-07-13 10:16:15.142914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.143044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.143069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.654 qpair failed and we were unable to recover it. 00:30:09.654 [2024-07-13 10:16:15.143193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.143343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.143368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.654 qpair failed and we were unable to recover it. 00:30:09.654 [2024-07-13 10:16:15.143521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.143652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.143677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.654 qpair failed and we were unable to recover it. 00:30:09.654 [2024-07-13 10:16:15.143805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.143942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.143967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.654 qpair failed and we were unable to recover it. 00:30:09.654 [2024-07-13 10:16:15.144130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.144281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.144306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.654 qpair failed and we were unable to recover it. 00:30:09.654 [2024-07-13 10:16:15.144453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.144615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.144640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.654 qpair failed and we were unable to recover it. 00:30:09.654 [2024-07-13 10:16:15.144795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.144922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.144948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.654 qpair failed and we were unable to recover it. 00:30:09.654 [2024-07-13 10:16:15.145095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.145241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.145266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.654 qpair failed and we were unable to recover it. 00:30:09.654 [2024-07-13 10:16:15.145415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.145547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.145573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.654 qpair failed and we were unable to recover it. 00:30:09.654 [2024-07-13 10:16:15.145698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.145846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.145877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.654 qpair failed and we were unable to recover it. 00:30:09.654 [2024-07-13 10:16:15.146028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.146181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.146205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.654 qpair failed and we were unable to recover it. 00:30:09.654 [2024-07-13 10:16:15.146325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.146474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.146500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.654 qpair failed and we were unable to recover it. 00:30:09.654 [2024-07-13 10:16:15.146623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.146777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.146802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.654 qpair failed and we were unable to recover it. 00:30:09.654 [2024-07-13 10:16:15.146992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.147150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.147175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.654 qpair failed and we were unable to recover it. 00:30:09.654 [2024-07-13 10:16:15.147323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.147475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.147501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.654 qpair failed and we were unable to recover it. 00:30:09.654 [2024-07-13 10:16:15.147651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.147814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.147839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.654 qpair failed and we were unable to recover it. 00:30:09.654 [2024-07-13 10:16:15.148003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.148158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.148182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.654 qpair failed and we were unable to recover it. 00:30:09.654 [2024-07-13 10:16:15.148306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.148432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.148457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.654 qpair failed and we were unable to recover it. 00:30:09.654 [2024-07-13 10:16:15.148635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.148782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.148808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.654 qpair failed and we were unable to recover it. 00:30:09.654 [2024-07-13 10:16:15.148954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.149109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.149134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.654 qpair failed and we were unable to recover it. 00:30:09.654 [2024-07-13 10:16:15.149289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.149411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.149436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.654 qpair failed and we were unable to recover it. 00:30:09.654 [2024-07-13 10:16:15.149665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.149784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.149811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.654 qpair failed and we were unable to recover it. 00:30:09.654 [2024-07-13 10:16:15.149937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.150090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.150115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.654 qpair failed and we were unable to recover it. 00:30:09.654 [2024-07-13 10:16:15.150246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.150421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.150447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.654 qpair failed and we were unable to recover it. 00:30:09.654 [2024-07-13 10:16:15.150571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.150749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.150774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.654 qpair failed and we were unable to recover it. 00:30:09.654 [2024-07-13 10:16:15.150914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.151033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.151058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.654 qpair failed and we were unable to recover it. 00:30:09.654 [2024-07-13 10:16:15.151203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.151353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.151377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.654 qpair failed and we were unable to recover it. 00:30:09.654 [2024-07-13 10:16:15.151507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.151659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.151684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.654 qpair failed and we were unable to recover it. 00:30:09.654 [2024-07-13 10:16:15.151841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.151975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.654 [2024-07-13 10:16:15.152001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.655 qpair failed and we were unable to recover it. 00:30:09.655 [2024-07-13 10:16:15.152157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.152303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.152327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.655 qpair failed and we were unable to recover it. 00:30:09.655 [2024-07-13 10:16:15.152479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.152618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.152644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.655 qpair failed and we were unable to recover it. 00:30:09.655 [2024-07-13 10:16:15.152774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.152927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.152953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.655 qpair failed and we were unable to recover it. 00:30:09.655 [2024-07-13 10:16:15.153081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.153231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.153256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.655 qpair failed and we were unable to recover it. 00:30:09.655 [2024-07-13 10:16:15.153381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.153525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.153550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.655 qpair failed and we were unable to recover it. 00:30:09.655 [2024-07-13 10:16:15.153705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.153853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.153884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.655 qpair failed and we were unable to recover it. 00:30:09.655 [2024-07-13 10:16:15.154033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.154183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.154207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.655 qpair failed and we were unable to recover it. 00:30:09.655 [2024-07-13 10:16:15.154360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.154510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.154535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.655 qpair failed and we were unable to recover it. 00:30:09.655 [2024-07-13 10:16:15.154689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.154815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.154840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.655 qpair failed and we were unable to recover it. 00:30:09.655 [2024-07-13 10:16:15.154987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.155166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.155191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.655 qpair failed and we were unable to recover it. 00:30:09.655 [2024-07-13 10:16:15.155364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.155517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.155541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.655 qpair failed and we were unable to recover it. 00:30:09.655 [2024-07-13 10:16:15.155673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.155848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.155882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.655 qpair failed and we were unable to recover it. 00:30:09.655 [2024-07-13 10:16:15.156009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.156163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.156188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.655 qpair failed and we were unable to recover it. 00:30:09.655 [2024-07-13 10:16:15.156342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.156486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.156510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.655 qpair failed and we were unable to recover it. 00:30:09.655 [2024-07-13 10:16:15.156690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.156861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.156894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.655 qpair failed and we were unable to recover it. 00:30:09.655 [2024-07-13 10:16:15.157047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.157220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.157246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.655 qpair failed and we were unable to recover it. 00:30:09.655 [2024-07-13 10:16:15.157390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.157563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.157588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.655 qpair failed and we were unable to recover it. 00:30:09.655 [2024-07-13 10:16:15.157707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.157857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.157889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.655 qpair failed and we were unable to recover it. 00:30:09.655 [2024-07-13 10:16:15.158049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.158196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.158221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.655 qpair failed and we were unable to recover it. 00:30:09.655 [2024-07-13 10:16:15.158397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.158553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.158578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.655 qpair failed and we were unable to recover it. 00:30:09.655 [2024-07-13 10:16:15.158724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.158889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.158916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.655 qpair failed and we were unable to recover it. 00:30:09.655 [2024-07-13 10:16:15.159070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.159196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.159222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.655 qpair failed and we were unable to recover it. 00:30:09.655 [2024-07-13 10:16:15.159352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.159495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.159520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.655 qpair failed and we were unable to recover it. 00:30:09.655 [2024-07-13 10:16:15.159665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.159815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.159840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.655 qpair failed and we were unable to recover it. 00:30:09.655 [2024-07-13 10:16:15.159998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.160226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.160250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.655 qpair failed and we were unable to recover it. 00:30:09.655 [2024-07-13 10:16:15.160437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.160563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.160589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.655 qpair failed and we were unable to recover it. 00:30:09.655 [2024-07-13 10:16:15.160740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.160860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.160917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.655 qpair failed and we were unable to recover it. 00:30:09.655 [2024-07-13 10:16:15.161070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.161223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.161248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.655 qpair failed and we were unable to recover it. 00:30:09.655 [2024-07-13 10:16:15.161392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.161540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.161565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.655 qpair failed and we were unable to recover it. 00:30:09.655 [2024-07-13 10:16:15.161690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.161814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.655 [2024-07-13 10:16:15.161838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.656 qpair failed and we were unable to recover it. 00:30:09.656 [2024-07-13 10:16:15.162027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.162150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.162176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.656 qpair failed and we were unable to recover it. 00:30:09.656 [2024-07-13 10:16:15.162222] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1805dc0 (9): Bad file descriptor 00:30:09.656 [2024-07-13 10:16:15.162488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.162660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.162690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.656 qpair failed and we were unable to recover it. 00:30:09.656 [2024-07-13 10:16:15.162912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.163100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.163127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.656 qpair failed and we were unable to recover it. 00:30:09.656 [2024-07-13 10:16:15.163249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.163409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.163436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.656 qpair failed and we were unable to recover it. 00:30:09.656 [2024-07-13 10:16:15.163589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.163713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.163739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.656 qpair failed and we were unable to recover it. 00:30:09.656 [2024-07-13 10:16:15.163895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.164061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.164087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.656 qpair failed and we were unable to recover it. 00:30:09.656 [2024-07-13 10:16:15.164243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.164403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.164428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.656 qpair failed and we were unable to recover it. 00:30:09.656 [2024-07-13 10:16:15.164615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.164772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.164796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.656 qpair failed and we were unable to recover it. 00:30:09.656 [2024-07-13 10:16:15.164983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.165111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.165136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.656 qpair failed and we were unable to recover it. 00:30:09.656 [2024-07-13 10:16:15.165294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.165442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.165467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.656 qpair failed and we were unable to recover it. 00:30:09.656 [2024-07-13 10:16:15.165666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.165842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.165872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.656 qpair failed and we were unable to recover it. 00:30:09.656 [2024-07-13 10:16:15.166035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.166162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.166187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.656 qpair failed and we were unable to recover it. 00:30:09.656 [2024-07-13 10:16:15.166339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.166493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.166520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.656 qpair failed and we were unable to recover it. 00:30:09.656 [2024-07-13 10:16:15.166675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.166794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.166819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.656 qpair failed and we were unable to recover it. 00:30:09.656 [2024-07-13 10:16:15.166943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.167134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.167160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.656 qpair failed and we were unable to recover it. 00:30:09.656 [2024-07-13 10:16:15.167313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.167441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.167466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.656 qpair failed and we were unable to recover it. 00:30:09.656 [2024-07-13 10:16:15.167591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.167771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.167797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.656 qpair failed and we were unable to recover it. 00:30:09.656 [2024-07-13 10:16:15.167922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.168080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.168105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.656 qpair failed and we were unable to recover it. 00:30:09.656 [2024-07-13 10:16:15.168282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.168401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.168427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.656 qpair failed and we were unable to recover it. 00:30:09.656 [2024-07-13 10:16:15.168607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.168795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.168821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.656 qpair failed and we were unable to recover it. 00:30:09.656 [2024-07-13 10:16:15.169000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.169153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.169178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.656 qpair failed and we were unable to recover it. 00:30:09.656 [2024-07-13 10:16:15.169298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.169427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.169453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.656 qpair failed and we were unable to recover it. 00:30:09.656 [2024-07-13 10:16:15.169578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.169732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.169758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.656 qpair failed and we were unable to recover it. 00:30:09.656 [2024-07-13 10:16:15.169939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.170060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.170086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.656 qpair failed and we were unable to recover it. 00:30:09.656 [2024-07-13 10:16:15.170216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.170339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.170365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.656 qpair failed and we were unable to recover it. 00:30:09.656 [2024-07-13 10:16:15.170519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.170673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.170698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.656 qpair failed and we were unable to recover it. 00:30:09.656 [2024-07-13 10:16:15.170846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.170999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.171025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.656 qpair failed and we were unable to recover it. 00:30:09.656 [2024-07-13 10:16:15.171178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.171358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.171384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.656 qpair failed and we were unable to recover it. 00:30:09.656 [2024-07-13 10:16:15.171506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.171626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.656 [2024-07-13 10:16:15.171652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.656 qpair failed and we were unable to recover it. 00:30:09.656 [2024-07-13 10:16:15.171788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.171942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.171968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.657 qpair failed and we were unable to recover it. 00:30:09.657 [2024-07-13 10:16:15.172098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.172220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.172246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.657 qpair failed and we were unable to recover it. 00:30:09.657 [2024-07-13 10:16:15.172373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.172522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.172548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.657 qpair failed and we were unable to recover it. 00:30:09.657 [2024-07-13 10:16:15.172681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.172824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.172849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.657 qpair failed and we were unable to recover it. 00:30:09.657 [2024-07-13 10:16:15.173020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.173167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.173193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.657 qpair failed and we were unable to recover it. 00:30:09.657 [2024-07-13 10:16:15.173371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.173544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.173569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.657 qpair failed and we were unable to recover it. 00:30:09.657 [2024-07-13 10:16:15.173744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.173896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.173922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.657 qpair failed and we were unable to recover it. 00:30:09.657 [2024-07-13 10:16:15.174077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.174256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.174282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.657 qpair failed and we were unable to recover it. 00:30:09.657 [2024-07-13 10:16:15.174412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.174560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.174586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.657 qpair failed and we were unable to recover it. 00:30:09.657 [2024-07-13 10:16:15.174735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.174915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.174941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.657 qpair failed and we were unable to recover it. 00:30:09.657 [2024-07-13 10:16:15.175060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.175187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.175212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.657 qpair failed and we were unable to recover it. 00:30:09.657 [2024-07-13 10:16:15.175367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.175519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.175544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.657 qpair failed and we were unable to recover it. 00:30:09.657 [2024-07-13 10:16:15.175677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.175832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.175858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.657 qpair failed and we were unable to recover it. 00:30:09.657 [2024-07-13 10:16:15.175997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.176146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.176170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.657 qpair failed and we were unable to recover it. 00:30:09.657 [2024-07-13 10:16:15.176295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.176435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.176460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.657 qpair failed and we were unable to recover it. 00:30:09.657 [2024-07-13 10:16:15.176638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.176788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.176814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.657 qpair failed and we were unable to recover it. 00:30:09.657 [2024-07-13 10:16:15.176948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.177068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.177094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.657 qpair failed and we were unable to recover it. 00:30:09.657 [2024-07-13 10:16:15.177272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.177426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.177452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.657 qpair failed and we were unable to recover it. 00:30:09.657 [2024-07-13 10:16:15.177577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.177718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.177743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.657 qpair failed and we were unable to recover it. 00:30:09.657 [2024-07-13 10:16:15.177924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.178052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.178079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.657 qpair failed and we were unable to recover it. 00:30:09.657 [2024-07-13 10:16:15.178263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.178385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.178410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.657 qpair failed and we were unable to recover it. 00:30:09.657 [2024-07-13 10:16:15.178556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.178728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.178755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.657 qpair failed and we were unable to recover it. 00:30:09.657 [2024-07-13 10:16:15.178940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.179122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.179147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.657 qpair failed and we were unable to recover it. 00:30:09.657 [2024-07-13 10:16:15.179276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.179416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.657 [2024-07-13 10:16:15.179443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.657 qpair failed and we were unable to recover it. 00:30:09.658 [2024-07-13 10:16:15.179598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.179720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.179745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.658 qpair failed and we were unable to recover it. 00:30:09.658 [2024-07-13 10:16:15.179872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.180023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.180049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.658 qpair failed and we were unable to recover it. 00:30:09.658 [2024-07-13 10:16:15.180169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.180318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.180344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.658 qpair failed and we were unable to recover it. 00:30:09.658 [2024-07-13 10:16:15.180520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.180670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.180696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.658 qpair failed and we were unable to recover it. 00:30:09.658 [2024-07-13 10:16:15.180844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.180991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.181018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.658 qpair failed and we were unable to recover it. 00:30:09.658 [2024-07-13 10:16:15.181142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.181293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.181319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.658 qpair failed and we were unable to recover it. 00:30:09.658 [2024-07-13 10:16:15.181494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.181668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.181693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.658 qpair failed and we were unable to recover it. 00:30:09.658 [2024-07-13 10:16:15.181847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.181991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.182018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14e4000b90 with addr=10.0.0.2, port=4420 00:30:09.658 qpair failed and we were unable to recover it. 00:30:09.658 [2024-07-13 10:16:15.182271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.182402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.182427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.658 qpair failed and we were unable to recover it. 00:30:09.658 [2024-07-13 10:16:15.182557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.182710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.182736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.658 qpair failed and we were unable to recover it. 00:30:09.658 [2024-07-13 10:16:15.182890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.183044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.183069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.658 qpair failed and we were unable to recover it. 00:30:09.658 [2024-07-13 10:16:15.183225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.183346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.183370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.658 qpair failed and we were unable to recover it. 00:30:09.658 [2024-07-13 10:16:15.183548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.183688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.183713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.658 qpair failed and we were unable to recover it. 00:30:09.658 [2024-07-13 10:16:15.183945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.184095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.184120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.658 qpair failed and we were unable to recover it. 00:30:09.658 [2024-07-13 10:16:15.184248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.184427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.184452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.658 qpair failed and we were unable to recover it. 00:30:09.658 [2024-07-13 10:16:15.184607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.184732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.184757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.658 qpair failed and we were unable to recover it. 00:30:09.658 [2024-07-13 10:16:15.184910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.185057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.185082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.658 qpair failed and we were unable to recover it. 00:30:09.658 [2024-07-13 10:16:15.185211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.185367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.185394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.658 qpair failed and we were unable to recover it. 00:30:09.658 [2024-07-13 10:16:15.185551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.185679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.185705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.658 qpair failed and we were unable to recover it. 00:30:09.658 [2024-07-13 10:16:15.185828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.185992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.186018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.658 qpair failed and we were unable to recover it. 00:30:09.658 [2024-07-13 10:16:15.186148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.186294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.186318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.658 qpair failed and we were unable to recover it. 00:30:09.658 [2024-07-13 10:16:15.186468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.186616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.186641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.658 qpair failed and we were unable to recover it. 00:30:09.658 [2024-07-13 10:16:15.186765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.186896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.186923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.658 qpair failed and we were unable to recover it. 00:30:09.658 [2024-07-13 10:16:15.187044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.187170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.187195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.658 qpair failed and we were unable to recover it. 00:30:09.658 [2024-07-13 10:16:15.187315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.187460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.187485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.658 qpair failed and we were unable to recover it. 00:30:09.658 [2024-07-13 10:16:15.187612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.187735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.187762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.658 qpair failed and we were unable to recover it. 00:30:09.658 [2024-07-13 10:16:15.187920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.188095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.188120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.658 qpair failed and we were unable to recover it. 00:30:09.658 [2024-07-13 10:16:15.188269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.188425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.188450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.658 qpair failed and we were unable to recover it. 00:30:09.658 [2024-07-13 10:16:15.188598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.188751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.188776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.658 qpair failed and we were unable to recover it. 00:30:09.658 [2024-07-13 10:16:15.188900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.189053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.658 [2024-07-13 10:16:15.189079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.658 qpair failed and we were unable to recover it. 00:30:09.659 [2024-07-13 10:16:15.189208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.189382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.189408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.659 qpair failed and we were unable to recover it. 00:30:09.659 [2024-07-13 10:16:15.189559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.189743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.189767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.659 qpair failed and we were unable to recover it. 00:30:09.659 [2024-07-13 10:16:15.189943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.190105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.190130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.659 qpair failed and we were unable to recover it. 00:30:09.659 [2024-07-13 10:16:15.190252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.190372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.190398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.659 qpair failed and we were unable to recover it. 00:30:09.659 [2024-07-13 10:16:15.190579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.190752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.190777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.659 qpair failed and we were unable to recover it. 00:30:09.659 [2024-07-13 10:16:15.190934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.191055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.191080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.659 qpair failed and we were unable to recover it. 00:30:09.659 [2024-07-13 10:16:15.191232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.191378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.191403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.659 qpair failed and we were unable to recover it. 00:30:09.659 [2024-07-13 10:16:15.191523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.191648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.191672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.659 qpair failed and we were unable to recover it. 00:30:09.659 [2024-07-13 10:16:15.191823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.191957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.191984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.659 qpair failed and we were unable to recover it. 00:30:09.659 [2024-07-13 10:16:15.192100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.192298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.192323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.659 qpair failed and we were unable to recover it. 00:30:09.659 [2024-07-13 10:16:15.192439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.192591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.192617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.659 qpair failed and we were unable to recover it. 00:30:09.659 [2024-07-13 10:16:15.192796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.192946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.192972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.659 qpair failed and we were unable to recover it. 00:30:09.659 [2024-07-13 10:16:15.193092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.193240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.193266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.659 qpair failed and we were unable to recover it. 00:30:09.659 [2024-07-13 10:16:15.193413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.193565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.193590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.659 qpair failed and we were unable to recover it. 00:30:09.659 [2024-07-13 10:16:15.193720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.193883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.193909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.659 qpair failed and we were unable to recover it. 00:30:09.659 [2024-07-13 10:16:15.194083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.194203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.194229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.659 qpair failed and we were unable to recover it. 00:30:09.659 [2024-07-13 10:16:15.194376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.194516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.194541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.659 qpair failed and we were unable to recover it. 00:30:09.659 [2024-07-13 10:16:15.194671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.194853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.194885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.659 qpair failed and we were unable to recover it. 00:30:09.659 [2024-07-13 10:16:15.195007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.195156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.195190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.659 qpair failed and we were unable to recover it. 00:30:09.659 [2024-07-13 10:16:15.195308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.195460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.195485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.659 qpair failed and we were unable to recover it. 00:30:09.659 [2024-07-13 10:16:15.195626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.195775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.195801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.659 qpair failed and we were unable to recover it. 00:30:09.659 [2024-07-13 10:16:15.195949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.196119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.196144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.659 qpair failed and we were unable to recover it. 00:30:09.659 [2024-07-13 10:16:15.196296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.196445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.196470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.659 qpair failed and we were unable to recover it. 00:30:09.659 [2024-07-13 10:16:15.196620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.196797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.196823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.659 qpair failed and we were unable to recover it. 00:30:09.659 [2024-07-13 10:16:15.196972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.197106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.197131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.659 qpair failed and we were unable to recover it. 00:30:09.659 [2024-07-13 10:16:15.197259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.197381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.197407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.659 qpair failed and we were unable to recover it. 00:30:09.659 [2024-07-13 10:16:15.197587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.197715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.197740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.659 qpair failed and we were unable to recover it. 00:30:09.659 [2024-07-13 10:16:15.197871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.198018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.198044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.659 qpair failed and we were unable to recover it. 00:30:09.659 [2024-07-13 10:16:15.198166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.198320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.198351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.659 qpair failed and we were unable to recover it. 00:30:09.659 [2024-07-13 10:16:15.198502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.198647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.659 [2024-07-13 10:16:15.198672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.659 qpair failed and we were unable to recover it. 00:30:09.659 [2024-07-13 10:16:15.198821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.198971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.198998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.660 qpair failed and we were unable to recover it. 00:30:09.660 [2024-07-13 10:16:15.199178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.199324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.199349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.660 qpair failed and we were unable to recover it. 00:30:09.660 [2024-07-13 10:16:15.199477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.199655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.199680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.660 qpair failed and we were unable to recover it. 00:30:09.660 [2024-07-13 10:16:15.199803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.199934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.199961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.660 qpair failed and we were unable to recover it. 00:30:09.660 [2024-07-13 10:16:15.200108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.200254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.200279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.660 qpair failed and we were unable to recover it. 00:30:09.660 [2024-07-13 10:16:15.200411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.200531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.200556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.660 qpair failed and we were unable to recover it. 00:30:09.660 [2024-07-13 10:16:15.200708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.200855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.200885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.660 qpair failed and we were unable to recover it. 00:30:09.660 [2024-07-13 10:16:15.201031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.201180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.201205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.660 qpair failed and we were unable to recover it. 00:30:09.660 [2024-07-13 10:16:15.201377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.201502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.201533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.660 qpair failed and we were unable to recover it. 00:30:09.660 [2024-07-13 10:16:15.201687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.201841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.201872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.660 qpair failed and we were unable to recover it. 00:30:09.660 [2024-07-13 10:16:15.202031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.202185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.202210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.660 qpair failed and we were unable to recover it. 00:30:09.660 [2024-07-13 10:16:15.202383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.202532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.202557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.660 qpair failed and we were unable to recover it. 00:30:09.660 [2024-07-13 10:16:15.202673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.202828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.202853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.660 qpair failed and we were unable to recover it. 00:30:09.660 [2024-07-13 10:16:15.203019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.203180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.203205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.660 qpair failed and we were unable to recover it. 00:30:09.660 [2024-07-13 10:16:15.203326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.203474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.203499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.660 qpair failed and we were unable to recover it. 00:30:09.660 [2024-07-13 10:16:15.203651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.203798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.203824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.660 qpair failed and we were unable to recover it. 00:30:09.660 [2024-07-13 10:16:15.203987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.204163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.204188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.660 qpair failed and we were unable to recover it. 00:30:09.660 [2024-07-13 10:16:15.204348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.204476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.204501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.660 qpair failed and we were unable to recover it. 00:30:09.660 [2024-07-13 10:16:15.204653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.204800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.204829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.660 qpair failed and we were unable to recover it. 00:30:09.660 [2024-07-13 10:16:15.204986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.205216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.205241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.660 qpair failed and we were unable to recover it. 00:30:09.660 [2024-07-13 10:16:15.205387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.205510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.205536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.660 qpair failed and we were unable to recover it. 00:30:09.660 [2024-07-13 10:16:15.205716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.205836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.205860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.660 qpair failed and we were unable to recover it. 00:30:09.660 [2024-07-13 10:16:15.206002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.206031] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:09.660 [2024-07-13 10:16:15.206122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.206147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.660 qpair failed and we were unable to recover it. 00:30:09.660 [2024-07-13 10:16:15.206168] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:09.660 [2024-07-13 10:16:15.206187] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:09.660 [2024-07-13 10:16:15.206200] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:09.660 [2024-07-13 10:16:15.206281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.206428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.206457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.660 qpair failed and we were unable to recover it. 00:30:09.660 [2024-07-13 10:16:15.206462] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:30:09.660 [2024-07-13 10:16:15.206644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.206692] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:30:09.660 [2024-07-13 10:16:15.206799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.206719] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:30:09.660 [2024-07-13 10:16:15.206722] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:30:09.660 [2024-07-13 10:16:15.206825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.660 qpair failed and we were unable to recover it. 00:30:09.660 [2024-07-13 10:16:15.206991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.207219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.207244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.660 qpair failed and we were unable to recover it. 00:30:09.660 [2024-07-13 10:16:15.207394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.207547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.207576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.660 qpair failed and we were unable to recover it. 00:30:09.660 [2024-07-13 10:16:15.207699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.207832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.660 [2024-07-13 10:16:15.207857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.660 qpair failed and we were unable to recover it. 00:30:09.660 [2024-07-13 10:16:15.207996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.208135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.208160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.661 qpair failed and we were unable to recover it. 00:30:09.661 [2024-07-13 10:16:15.208306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.208500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.208525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.661 qpair failed and we were unable to recover it. 00:30:09.661 [2024-07-13 10:16:15.208668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.208820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.208844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14f4000b90 with addr=10.0.0.2, port=4420 00:30:09.661 qpair failed and we were unable to recover it. 00:30:09.661 [2024-07-13 10:16:15.209025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.209156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.209186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.661 qpair failed and we were unable to recover it. 00:30:09.661 [2024-07-13 10:16:15.209374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.209578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.209604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.661 qpair failed and we were unable to recover it. 00:30:09.661 [2024-07-13 10:16:15.209727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.209880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.209907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.661 qpair failed and we were unable to recover it. 00:30:09.661 [2024-07-13 10:16:15.210058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.210212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.210238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.661 qpair failed and we were unable to recover it. 00:30:09.661 [2024-07-13 10:16:15.210391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.210514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.210539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.661 qpair failed and we were unable to recover it. 00:30:09.661 [2024-07-13 10:16:15.210657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.210785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.210817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.661 qpair failed and we were unable to recover it. 00:30:09.661 [2024-07-13 10:16:15.210944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.211119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.211144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.661 qpair failed and we were unable to recover it. 00:30:09.661 [2024-07-13 10:16:15.211271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.211411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.211436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.661 qpair failed and we were unable to recover it. 00:30:09.661 [2024-07-13 10:16:15.211582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.211714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.211738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.661 qpair failed and we were unable to recover it. 00:30:09.661 [2024-07-13 10:16:15.211870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.212026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.212052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.661 qpair failed and we were unable to recover it. 00:30:09.661 [2024-07-13 10:16:15.212179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.212324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.212349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.661 qpair failed and we were unable to recover it. 00:30:09.661 [2024-07-13 10:16:15.212468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.212591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.212616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.661 qpair failed and we were unable to recover it. 00:30:09.661 [2024-07-13 10:16:15.212758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.212884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.212910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.661 qpair failed and we were unable to recover it. 00:30:09.661 [2024-07-13 10:16:15.213035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.213161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.213186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.661 qpair failed and we were unable to recover it. 00:30:09.661 [2024-07-13 10:16:15.213323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.213464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.213488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.661 qpair failed and we were unable to recover it. 00:30:09.661 [2024-07-13 10:16:15.213636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.213757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.213787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.661 qpair failed and we were unable to recover it. 00:30:09.661 [2024-07-13 10:16:15.213942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.214101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.214128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.661 qpair failed and we were unable to recover it. 00:30:09.661 [2024-07-13 10:16:15.214274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.214417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.214442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.661 qpair failed and we were unable to recover it. 00:30:09.661 [2024-07-13 10:16:15.214589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.214736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.214761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.661 qpair failed and we were unable to recover it. 00:30:09.661 [2024-07-13 10:16:15.214885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.215033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.215057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.661 qpair failed and we were unable to recover it. 00:30:09.661 [2024-07-13 10:16:15.215182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.215300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.215327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.661 qpair failed and we were unable to recover it. 00:30:09.661 [2024-07-13 10:16:15.215510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.215671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.215696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.661 qpair failed and we were unable to recover it. 00:30:09.661 [2024-07-13 10:16:15.215892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.216047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.216073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.661 qpair failed and we were unable to recover it. 00:30:09.661 [2024-07-13 10:16:15.216198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.216345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.216370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.661 qpair failed and we were unable to recover it. 00:30:09.661 [2024-07-13 10:16:15.216559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.216734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.216759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.661 qpair failed and we were unable to recover it. 00:30:09.661 [2024-07-13 10:16:15.216890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.217041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.217067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.661 qpair failed and we were unable to recover it. 00:30:09.661 [2024-07-13 10:16:15.217207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.217381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.661 [2024-07-13 10:16:15.217406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.661 qpair failed and we were unable to recover it. 00:30:09.661 [2024-07-13 10:16:15.217602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.217724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.217748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.662 qpair failed and we were unable to recover it. 00:30:09.662 [2024-07-13 10:16:15.217926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.218071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.218095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.662 qpair failed and we were unable to recover it. 00:30:09.662 [2024-07-13 10:16:15.218212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.218390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.218414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.662 qpair failed and we were unable to recover it. 00:30:09.662 [2024-07-13 10:16:15.218547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.218696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.218720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.662 qpair failed and we were unable to recover it. 00:30:09.662 [2024-07-13 10:16:15.218862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.219015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.219040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.662 qpair failed and we were unable to recover it. 00:30:09.662 [2024-07-13 10:16:15.219167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.219286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.219311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.662 qpair failed and we were unable to recover it. 00:30:09.662 [2024-07-13 10:16:15.219441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.219591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.219615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.662 qpair failed and we were unable to recover it. 00:30:09.662 [2024-07-13 10:16:15.219741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.219876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.219918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.662 qpair failed and we were unable to recover it. 00:30:09.662 [2024-07-13 10:16:15.220078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.220209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.220234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.662 qpair failed and we were unable to recover it. 00:30:09.662 [2024-07-13 10:16:15.220370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.220499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.220524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.662 qpair failed and we were unable to recover it. 00:30:09.662 [2024-07-13 10:16:15.220653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.220802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.220826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.662 qpair failed and we were unable to recover it. 00:30:09.662 [2024-07-13 10:16:15.220964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.221109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.221134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.662 qpair failed and we were unable to recover it. 00:30:09.662 [2024-07-13 10:16:15.221269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.221386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.221412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.662 qpair failed and we were unable to recover it. 00:30:09.662 [2024-07-13 10:16:15.221572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.221721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.221747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.662 qpair failed and we were unable to recover it. 00:30:09.662 [2024-07-13 10:16:15.221902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.222035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.222060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.662 qpair failed and we were unable to recover it. 00:30:09.662 [2024-07-13 10:16:15.222184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.222319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.222343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.662 qpair failed and we were unable to recover it. 00:30:09.662 [2024-07-13 10:16:15.222531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.222655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.222681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.662 qpair failed and we were unable to recover it. 00:30:09.662 [2024-07-13 10:16:15.222809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.222945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.222971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.662 qpair failed and we were unable to recover it. 00:30:09.662 [2024-07-13 10:16:15.223117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.223261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.223286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.662 qpair failed and we were unable to recover it. 00:30:09.662 [2024-07-13 10:16:15.223421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.223573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.223597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.662 qpair failed and we were unable to recover it. 00:30:09.662 [2024-07-13 10:16:15.223741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.223898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.223923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.662 qpair failed and we were unable to recover it. 00:30:09.662 [2024-07-13 10:16:15.224075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.224192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.224217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.662 qpair failed and we were unable to recover it. 00:30:09.662 [2024-07-13 10:16:15.224373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.224503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.224530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.662 qpair failed and we were unable to recover it. 00:30:09.662 [2024-07-13 10:16:15.224650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.224825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.224851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.662 qpair failed and we were unable to recover it. 00:30:09.662 [2024-07-13 10:16:15.224983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.225130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.225155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.662 qpair failed and we were unable to recover it. 00:30:09.662 [2024-07-13 10:16:15.225278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.225402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.662 [2024-07-13 10:16:15.225426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.662 qpair failed and we were unable to recover it. 00:30:09.662 [2024-07-13 10:16:15.225576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.225700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.225724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.663 qpair failed and we were unable to recover it. 00:30:09.663 [2024-07-13 10:16:15.225846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.225971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.225997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.663 qpair failed and we were unable to recover it. 00:30:09.663 [2024-07-13 10:16:15.226162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.226317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.226344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.663 qpair failed and we were unable to recover it. 00:30:09.663 [2024-07-13 10:16:15.226475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.226617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.226642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.663 qpair failed and we were unable to recover it. 00:30:09.663 [2024-07-13 10:16:15.226777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.226900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.226926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.663 qpair failed and we were unable to recover it. 00:30:09.663 [2024-07-13 10:16:15.227086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.227240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.227264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.663 qpair failed and we were unable to recover it. 00:30:09.663 [2024-07-13 10:16:15.227377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.227501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.227526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.663 qpair failed and we were unable to recover it. 00:30:09.663 [2024-07-13 10:16:15.227689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.227843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.227873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.663 qpair failed and we were unable to recover it. 00:30:09.663 [2024-07-13 10:16:15.228011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.228135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.228161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.663 qpair failed and we were unable to recover it. 00:30:09.663 [2024-07-13 10:16:15.228276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.228423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.228447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.663 qpair failed and we were unable to recover it. 00:30:09.663 [2024-07-13 10:16:15.228595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.228721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.228747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.663 qpair failed and we were unable to recover it. 00:30:09.663 [2024-07-13 10:16:15.228904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.229051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.229075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.663 qpair failed and we were unable to recover it. 00:30:09.663 [2024-07-13 10:16:15.229207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.229359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.229383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.663 qpair failed and we were unable to recover it. 00:30:09.663 [2024-07-13 10:16:15.229519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.229665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.229690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.663 qpair failed and we were unable to recover it. 00:30:09.663 [2024-07-13 10:16:15.229817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.229971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.229996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.663 qpair failed and we were unable to recover it. 00:30:09.663 [2024-07-13 10:16:15.230142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.230290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.230315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.663 qpair failed and we were unable to recover it. 00:30:09.663 [2024-07-13 10:16:15.230434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.230560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.230584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.663 qpair failed and we were unable to recover it. 00:30:09.663 [2024-07-13 10:16:15.230767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.230918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.230944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.663 qpair failed and we were unable to recover it. 00:30:09.663 [2024-07-13 10:16:15.231096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.231275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.231300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.663 qpair failed and we were unable to recover it. 00:30:09.663 [2024-07-13 10:16:15.231419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.231549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.231574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.663 qpair failed and we were unable to recover it. 00:30:09.663 [2024-07-13 10:16:15.231710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.231859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.231889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.663 qpair failed and we were unable to recover it. 00:30:09.663 [2024-07-13 10:16:15.232012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.232158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.232183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.663 qpair failed and we were unable to recover it. 00:30:09.663 [2024-07-13 10:16:15.232316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.232463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.232488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.663 qpair failed and we were unable to recover it. 00:30:09.663 [2024-07-13 10:16:15.232618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.232775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.232801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.663 qpair failed and we were unable to recover it. 00:30:09.663 [2024-07-13 10:16:15.232949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.233067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.233092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.663 qpair failed and we were unable to recover it. 00:30:09.663 [2024-07-13 10:16:15.233217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.233333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.233357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.663 qpair failed and we were unable to recover it. 00:30:09.663 [2024-07-13 10:16:15.233504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.233649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.233675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.663 qpair failed and we were unable to recover it. 00:30:09.663 [2024-07-13 10:16:15.233807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.233934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.233959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.663 qpair failed and we were unable to recover it. 00:30:09.663 [2024-07-13 10:16:15.234077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.234202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.234226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.663 qpair failed and we were unable to recover it. 00:30:09.663 [2024-07-13 10:16:15.234365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.234489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.234515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.663 qpair failed and we were unable to recover it. 00:30:09.663 [2024-07-13 10:16:15.234642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.663 [2024-07-13 10:16:15.234783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.234808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.664 qpair failed and we were unable to recover it. 00:30:09.664 [2024-07-13 10:16:15.234956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.235095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.235120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.664 qpair failed and we were unable to recover it. 00:30:09.664 [2024-07-13 10:16:15.235278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.235409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.235433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f14ec000b90 with addr=10.0.0.2, port=4420 00:30:09.664 qpair failed and we were unable to recover it. 00:30:09.664 [2024-07-13 10:16:15.235585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.235726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.235754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.664 qpair failed and we were unable to recover it. 00:30:09.664 [2024-07-13 10:16:15.235898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.236021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.236046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.664 qpair failed and we were unable to recover it. 00:30:09.664 [2024-07-13 10:16:15.236208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.236339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.236363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.664 qpair failed and we were unable to recover it. 00:30:09.664 [2024-07-13 10:16:15.236505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.236633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.236657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.664 qpair failed and we were unable to recover it. 00:30:09.664 [2024-07-13 10:16:15.236804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.236939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.236965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.664 qpair failed and we were unable to recover it. 00:30:09.664 [2024-07-13 10:16:15.237122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.237271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.237296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.664 qpair failed and we were unable to recover it. 00:30:09.664 [2024-07-13 10:16:15.237455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.237575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.237599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.664 qpair failed and we were unable to recover it. 00:30:09.664 [2024-07-13 10:16:15.237753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.237885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.237910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.664 qpair failed and we were unable to recover it. 00:30:09.664 [2024-07-13 10:16:15.238028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.238181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.238204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.664 qpair failed and we were unable to recover it. 00:30:09.664 [2024-07-13 10:16:15.238354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.238469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.238493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.664 qpair failed and we were unable to recover it. 00:30:09.664 [2024-07-13 10:16:15.238614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.238734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.238759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.664 qpair failed and we were unable to recover it. 00:30:09.664 [2024-07-13 10:16:15.238917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.239068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.239093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.664 qpair failed and we were unable to recover it. 00:30:09.664 [2024-07-13 10:16:15.239221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.239337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.239360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.664 qpair failed and we were unable to recover it. 00:30:09.664 [2024-07-13 10:16:15.239476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.239594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.239618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.664 qpair failed and we were unable to recover it. 00:30:09.664 [2024-07-13 10:16:15.239744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.239861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.239890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.664 qpair failed and we were unable to recover it. 00:30:09.664 [2024-07-13 10:16:15.240004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.240164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.240188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.664 qpair failed and we were unable to recover it. 00:30:09.664 [2024-07-13 10:16:15.240312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.240460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.240483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.664 qpair failed and we were unable to recover it. 00:30:09.664 [2024-07-13 10:16:15.240607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.240760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.240786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.664 qpair failed and we were unable to recover it. 00:30:09.664 [2024-07-13 10:16:15.240925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.241118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.241142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.664 qpair failed and we were unable to recover it. 00:30:09.664 [2024-07-13 10:16:15.241275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.241429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.241452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.664 qpair failed and we were unable to recover it. 00:30:09.664 [2024-07-13 10:16:15.241606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.241756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.241784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.664 qpair failed and we were unable to recover it. 00:30:09.664 [2024-07-13 10:16:15.241918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.242061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.242085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.664 qpair failed and we were unable to recover it. 00:30:09.664 [2024-07-13 10:16:15.242256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.242375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.242399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.664 qpair failed and we were unable to recover it. 00:30:09.664 [2024-07-13 10:16:15.242543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.242701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.242725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.664 qpair failed and we were unable to recover it. 00:30:09.664 [2024-07-13 10:16:15.242849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.242989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.243013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.664 qpair failed and we were unable to recover it. 00:30:09.664 [2024-07-13 10:16:15.243168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.243278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.243302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.664 qpair failed and we were unable to recover it. 00:30:09.664 [2024-07-13 10:16:15.243439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.243582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.243605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.664 qpair failed and we were unable to recover it. 00:30:09.664 [2024-07-13 10:16:15.243781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.243958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.664 [2024-07-13 10:16:15.243983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.665 qpair failed and we were unable to recover it. 00:30:09.665 [2024-07-13 10:16:15.244105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.244253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.244277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.665 qpair failed and we were unable to recover it. 00:30:09.665 [2024-07-13 10:16:15.244468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.244618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.244642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.665 qpair failed and we were unable to recover it. 00:30:09.665 [2024-07-13 10:16:15.244762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.244904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.244929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.665 qpair failed and we were unable to recover it. 00:30:09.665 [2024-07-13 10:16:15.245057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.245187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.245210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.665 qpair failed and we were unable to recover it. 00:30:09.665 [2024-07-13 10:16:15.245389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.245536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.245560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.665 qpair failed and we were unable to recover it. 00:30:09.665 [2024-07-13 10:16:15.245682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.245886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.245911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.665 qpair failed and we were unable to recover it. 00:30:09.665 [2024-07-13 10:16:15.246039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.246158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.246183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.665 qpair failed and we were unable to recover it. 00:30:09.665 [2024-07-13 10:16:15.246340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.246527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.246550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.665 qpair failed and we were unable to recover it. 00:30:09.665 [2024-07-13 10:16:15.246701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.246822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.246845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.665 qpair failed and we were unable to recover it. 00:30:09.665 [2024-07-13 10:16:15.246975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.247105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.247130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.665 qpair failed and we were unable to recover it. 00:30:09.665 [2024-07-13 10:16:15.247279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.247418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.247442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.665 qpair failed and we were unable to recover it. 00:30:09.665 [2024-07-13 10:16:15.247571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.247770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.247794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.665 qpair failed and we were unable to recover it. 00:30:09.665 [2024-07-13 10:16:15.247947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.248073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.248097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.665 qpair failed and we were unable to recover it. 00:30:09.665 [2024-07-13 10:16:15.248260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.248400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.248425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.665 qpair failed and we were unable to recover it. 00:30:09.665 [2024-07-13 10:16:15.248547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.248676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.248703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.665 qpair failed and we were unable to recover it. 00:30:09.665 [2024-07-13 10:16:15.248824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.248961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.248986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.665 qpair failed and we were unable to recover it. 00:30:09.665 [2024-07-13 10:16:15.249145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.249267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.249291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.665 qpair failed and we were unable to recover it. 00:30:09.665 [2024-07-13 10:16:15.249416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.249559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.249582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.665 qpair failed and we were unable to recover it. 00:30:09.665 [2024-07-13 10:16:15.249696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.249818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.249841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.665 qpair failed and we were unable to recover it. 00:30:09.665 [2024-07-13 10:16:15.250013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.250142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.250169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.665 qpair failed and we were unable to recover it. 00:30:09.665 [2024-07-13 10:16:15.250302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.250447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.250471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.665 qpair failed and we were unable to recover it. 00:30:09.665 [2024-07-13 10:16:15.250620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.250746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.250770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.665 qpair failed and we were unable to recover it. 00:30:09.665 [2024-07-13 10:16:15.250899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.251016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.251040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.665 qpair failed and we were unable to recover it. 00:30:09.665 [2024-07-13 10:16:15.251186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.251302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.251327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.665 qpair failed and we were unable to recover it. 00:30:09.665 [2024-07-13 10:16:15.251449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.251590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.251614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.665 qpair failed and we were unable to recover it. 00:30:09.665 [2024-07-13 10:16:15.251736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.251875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.251899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.665 qpair failed and we were unable to recover it. 00:30:09.665 [2024-07-13 10:16:15.252044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.252186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.252209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.665 qpair failed and we were unable to recover it. 00:30:09.665 [2024-07-13 10:16:15.252368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.252488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.252512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.665 qpair failed and we were unable to recover it. 00:30:09.665 [2024-07-13 10:16:15.252666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.252820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.252843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.665 qpair failed and we were unable to recover it. 00:30:09.665 [2024-07-13 10:16:15.252967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.253091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.665 [2024-07-13 10:16:15.253114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.666 qpair failed and we were unable to recover it. 00:30:09.666 [2024-07-13 10:16:15.253267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.253395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.253419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.666 qpair failed and we were unable to recover it. 00:30:09.666 [2024-07-13 10:16:15.253571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.253686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.253711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.666 qpair failed and we were unable to recover it. 00:30:09.666 [2024-07-13 10:16:15.253833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.253979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.254004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.666 qpair failed and we were unable to recover it. 00:30:09.666 [2024-07-13 10:16:15.254128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.254257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.254281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.666 qpair failed and we were unable to recover it. 00:30:09.666 [2024-07-13 10:16:15.254443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.254568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.254593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.666 qpair failed and we were unable to recover it. 00:30:09.666 [2024-07-13 10:16:15.254721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.254842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.254905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.666 qpair failed and we were unable to recover it. 00:30:09.666 [2024-07-13 10:16:15.255042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.255156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.255179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.666 qpair failed and we were unable to recover it. 00:30:09.666 [2024-07-13 10:16:15.255330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.255445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.255470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.666 qpair failed and we were unable to recover it. 00:30:09.666 [2024-07-13 10:16:15.255628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.255805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.255829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.666 qpair failed and we were unable to recover it. 00:30:09.666 [2024-07-13 10:16:15.255975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.256126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.256151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.666 qpair failed and we were unable to recover it. 00:30:09.666 [2024-07-13 10:16:15.256279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.256404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.256428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.666 qpair failed and we were unable to recover it. 00:30:09.666 [2024-07-13 10:16:15.256553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.256679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.256702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.666 qpair failed and we were unable to recover it. 00:30:09.666 [2024-07-13 10:16:15.256818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.256953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.256978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.666 qpair failed and we were unable to recover it. 00:30:09.666 [2024-07-13 10:16:15.257099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.257230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.257258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.666 qpair failed and we were unable to recover it. 00:30:09.666 [2024-07-13 10:16:15.257423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.257533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.257556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.666 qpair failed and we were unable to recover it. 00:30:09.666 [2024-07-13 10:16:15.257683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.257837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.257860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.666 qpair failed and we were unable to recover it. 00:30:09.666 [2024-07-13 10:16:15.257992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.258112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.258136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.666 qpair failed and we were unable to recover it. 00:30:09.666 [2024-07-13 10:16:15.258298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.258440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.258464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.666 qpair failed and we were unable to recover it. 00:30:09.666 [2024-07-13 10:16:15.258577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.258708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.258732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.666 qpair failed and we were unable to recover it. 00:30:09.666 [2024-07-13 10:16:15.258853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.259010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.259034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.666 qpair failed and we were unable to recover it. 00:30:09.666 [2024-07-13 10:16:15.259160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.259313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.259337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.666 qpair failed and we were unable to recover it. 00:30:09.666 [2024-07-13 10:16:15.259487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.259613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.259637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.666 qpair failed and we were unable to recover it. 00:30:09.666 [2024-07-13 10:16:15.259778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.259927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.259952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.666 qpair failed and we were unable to recover it. 00:30:09.666 [2024-07-13 10:16:15.260084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.260233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.260261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.666 qpair failed and we were unable to recover it. 00:30:09.666 [2024-07-13 10:16:15.260392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.260510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.260535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.666 qpair failed and we were unable to recover it. 00:30:09.666 [2024-07-13 10:16:15.260709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.666 [2024-07-13 10:16:15.260835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.260859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.667 qpair failed and we were unable to recover it. 00:30:09.667 [2024-07-13 10:16:15.261037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.261190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.261222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.667 qpair failed and we were unable to recover it. 00:30:09.667 [2024-07-13 10:16:15.261371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.261496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.261520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.667 qpair failed and we were unable to recover it. 00:30:09.667 [2024-07-13 10:16:15.261665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.261786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.261810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.667 qpair failed and we were unable to recover it. 00:30:09.667 [2024-07-13 10:16:15.261968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.262115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.262140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.667 qpair failed and we were unable to recover it. 00:30:09.667 [2024-07-13 10:16:15.262307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.262421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.262444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.667 qpair failed and we were unable to recover it. 00:30:09.667 [2024-07-13 10:16:15.262602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.262713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.262738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.667 qpair failed and we were unable to recover it. 00:30:09.667 [2024-07-13 10:16:15.262890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.263012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.263037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.667 qpair failed and we were unable to recover it. 00:30:09.667 [2024-07-13 10:16:15.263183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.263326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.263350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.667 qpair failed and we were unable to recover it. 00:30:09.667 [2024-07-13 10:16:15.263499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.263614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.263638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.667 qpair failed and we were unable to recover it. 00:30:09.667 [2024-07-13 10:16:15.263760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.263949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.263974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.667 qpair failed and we were unable to recover it. 00:30:09.667 [2024-07-13 10:16:15.264125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.264256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.264280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.667 qpair failed and we were unable to recover it. 00:30:09.667 [2024-07-13 10:16:15.264406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.264528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.264552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.667 qpair failed and we were unable to recover it. 00:30:09.667 [2024-07-13 10:16:15.264707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.264835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.264858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.667 qpair failed and we were unable to recover it. 00:30:09.667 [2024-07-13 10:16:15.265009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.265154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.265178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.667 qpair failed and we were unable to recover it. 00:30:09.667 [2024-07-13 10:16:15.265345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.265462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.265487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.667 qpair failed and we were unable to recover it. 00:30:09.667 [2024-07-13 10:16:15.265653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.265803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.265827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.667 qpair failed and we were unable to recover it. 00:30:09.667 [2024-07-13 10:16:15.265955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.266078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.266102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.667 qpair failed and we were unable to recover it. 00:30:09.667 [2024-07-13 10:16:15.266227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.266373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.266397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.667 qpair failed and we were unable to recover it. 00:30:09.667 [2024-07-13 10:16:15.266528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.266679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.266704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.667 qpair failed and we were unable to recover it. 00:30:09.667 [2024-07-13 10:16:15.266854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.266996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.267020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.667 qpair failed and we were unable to recover it. 00:30:09.667 [2024-07-13 10:16:15.267137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.267257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.267280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.667 qpair failed and we were unable to recover it. 00:30:09.667 [2024-07-13 10:16:15.267429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.267582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.267606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.667 qpair failed and we were unable to recover it. 00:30:09.667 [2024-07-13 10:16:15.267729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.267842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.267873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.667 qpair failed and we were unable to recover it. 00:30:09.667 [2024-07-13 10:16:15.267991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.268119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.268143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.667 qpair failed and we were unable to recover it. 00:30:09.667 [2024-07-13 10:16:15.268278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.268394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.268418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.667 qpair failed and we were unable to recover it. 00:30:09.667 [2024-07-13 10:16:15.268578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.268700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.268724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.667 qpair failed and we were unable to recover it. 00:30:09.667 [2024-07-13 10:16:15.268843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.268971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.268996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.667 qpair failed and we were unable to recover it. 00:30:09.667 [2024-07-13 10:16:15.269164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.269313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.269337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.667 qpair failed and we were unable to recover it. 00:30:09.667 [2024-07-13 10:16:15.269474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.269625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.269649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.667 qpair failed and we were unable to recover it. 00:30:09.667 [2024-07-13 10:16:15.269792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.270018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.667 [2024-07-13 10:16:15.270043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.667 qpair failed and we were unable to recover it. 00:30:09.668 [2024-07-13 10:16:15.270197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.270346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.270370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.668 qpair failed and we were unable to recover it. 00:30:09.668 [2024-07-13 10:16:15.270501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.270628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.270653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.668 qpair failed and we were unable to recover it. 00:30:09.668 [2024-07-13 10:16:15.270801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.270921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.270946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.668 qpair failed and we were unable to recover it. 00:30:09.668 [2024-07-13 10:16:15.271069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.271194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.271217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.668 qpair failed and we were unable to recover it. 00:30:09.668 [2024-07-13 10:16:15.271369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.271558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.271582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.668 qpair failed and we were unable to recover it. 00:30:09.668 [2024-07-13 10:16:15.271726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.271846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.271876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.668 qpair failed and we were unable to recover it. 00:30:09.668 [2024-07-13 10:16:15.272040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.272161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.272185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.668 qpair failed and we were unable to recover it. 00:30:09.668 [2024-07-13 10:16:15.272307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.272430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.272454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.668 qpair failed and we were unable to recover it. 00:30:09.668 [2024-07-13 10:16:15.272575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.272694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.272717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.668 qpair failed and we were unable to recover it. 00:30:09.668 [2024-07-13 10:16:15.272844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.272991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.273015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.668 qpair failed and we were unable to recover it. 00:30:09.668 [2024-07-13 10:16:15.273166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.273391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.273415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.668 qpair failed and we were unable to recover it. 00:30:09.668 [2024-07-13 10:16:15.273599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.273718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.273742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.668 qpair failed and we were unable to recover it. 00:30:09.668 [2024-07-13 10:16:15.273889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.274017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.274040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.668 qpair failed and we were unable to recover it. 00:30:09.668 [2024-07-13 10:16:15.274218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.274363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.274387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.668 qpair failed and we were unable to recover it. 00:30:09.668 [2024-07-13 10:16:15.274559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.274685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.274708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.668 qpair failed and we were unable to recover it. 00:30:09.668 [2024-07-13 10:16:15.274922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.275080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.275104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.668 qpair failed and we were unable to recover it. 00:30:09.668 [2024-07-13 10:16:15.275228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.275381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.275406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.668 qpair failed and we were unable to recover it. 00:30:09.668 [2024-07-13 10:16:15.275561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.275788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.275812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.668 qpair failed and we were unable to recover it. 00:30:09.668 [2024-07-13 10:16:15.275939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.276085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.276114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.668 qpair failed and we were unable to recover it. 00:30:09.668 [2024-07-13 10:16:15.276239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.276427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.276451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.668 qpair failed and we were unable to recover it. 00:30:09.668 [2024-07-13 10:16:15.276583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.276811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.276836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.668 qpair failed and we were unable to recover it. 00:30:09.668 [2024-07-13 10:16:15.276975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.277146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.277169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.668 qpair failed and we were unable to recover it. 00:30:09.668 [2024-07-13 10:16:15.277298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.277415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.277438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.668 qpair failed and we were unable to recover it. 00:30:09.668 [2024-07-13 10:16:15.277558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.277679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.277703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.668 qpair failed and we were unable to recover it. 00:30:09.668 [2024-07-13 10:16:15.277912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.278032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.278055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.668 qpair failed and we were unable to recover it. 00:30:09.668 [2024-07-13 10:16:15.278238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.278389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.278414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.668 qpair failed and we were unable to recover it. 00:30:09.668 [2024-07-13 10:16:15.278532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.278690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.278714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.668 qpair failed and we were unable to recover it. 00:30:09.668 [2024-07-13 10:16:15.278870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.278999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.279022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.668 qpair failed and we were unable to recover it. 00:30:09.668 [2024-07-13 10:16:15.279136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.279282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.279305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.668 qpair failed and we were unable to recover it. 00:30:09.668 [2024-07-13 10:16:15.279462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.279592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.279616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.668 qpair failed and we were unable to recover it. 00:30:09.668 [2024-07-13 10:16:15.279744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.668 [2024-07-13 10:16:15.279874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.279907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.669 qpair failed and we were unable to recover it. 00:30:09.669 [2024-07-13 10:16:15.280029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.280204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.280228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.669 qpair failed and we were unable to recover it. 00:30:09.669 [2024-07-13 10:16:15.280379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.280499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.280521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.669 qpair failed and we were unable to recover it. 00:30:09.669 [2024-07-13 10:16:15.280643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.280770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.280794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.669 qpair failed and we were unable to recover it. 00:30:09.669 [2024-07-13 10:16:15.280965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.281090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.281115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.669 qpair failed and we were unable to recover it. 00:30:09.669 [2024-07-13 10:16:15.281250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.281397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.281421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.669 qpair failed and we were unable to recover it. 00:30:09.669 [2024-07-13 10:16:15.281552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.281742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.281767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.669 qpair failed and we were unable to recover it. 00:30:09.669 [2024-07-13 10:16:15.281897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.282045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.282070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.669 qpair failed and we were unable to recover it. 00:30:09.669 [2024-07-13 10:16:15.282225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.282346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.282370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.669 qpair failed and we were unable to recover it. 00:30:09.669 [2024-07-13 10:16:15.282510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.282663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.282688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.669 qpair failed and we were unable to recover it. 00:30:09.669 [2024-07-13 10:16:15.282806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.282947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.282972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.669 qpair failed and we were unable to recover it. 00:30:09.669 [2024-07-13 10:16:15.283089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.283215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.283240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.669 qpair failed and we were unable to recover it. 00:30:09.669 [2024-07-13 10:16:15.283369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.283512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.283536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.669 qpair failed and we were unable to recover it. 00:30:09.669 [2024-07-13 10:16:15.283691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.283810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.283834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.669 qpair failed and we were unable to recover it. 00:30:09.669 [2024-07-13 10:16:15.283972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.284129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.284152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.669 qpair failed and we were unable to recover it. 00:30:09.669 [2024-07-13 10:16:15.284267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.284388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.284414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.669 qpair failed and we were unable to recover it. 00:30:09.669 [2024-07-13 10:16:15.284539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.284677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.284701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.669 qpair failed and we were unable to recover it. 00:30:09.669 [2024-07-13 10:16:15.284842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.285028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.285053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.669 qpair failed and we were unable to recover it. 00:30:09.669 [2024-07-13 10:16:15.285196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.285319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.285344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.669 qpair failed and we were unable to recover it. 00:30:09.669 [2024-07-13 10:16:15.285471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.285594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.285617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.669 qpair failed and we were unable to recover it. 00:30:09.669 [2024-07-13 10:16:15.285739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.285895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.285922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.669 qpair failed and we were unable to recover it. 00:30:09.669 [2024-07-13 10:16:15.286041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.286178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.286204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.669 qpair failed and we were unable to recover it. 00:30:09.669 [2024-07-13 10:16:15.286318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.286464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.286488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.669 qpair failed and we were unable to recover it. 00:30:09.669 [2024-07-13 10:16:15.286615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.286791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.286816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.669 qpair failed and we were unable to recover it. 00:30:09.669 [2024-07-13 10:16:15.286972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.287147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.287173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.669 qpair failed and we were unable to recover it. 00:30:09.669 [2024-07-13 10:16:15.287328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.287440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.287464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.669 qpair failed and we were unable to recover it. 00:30:09.669 [2024-07-13 10:16:15.287578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.287724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.287749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.669 qpair failed and we were unable to recover it. 00:30:09.669 [2024-07-13 10:16:15.287876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.288022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.288047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.669 qpair failed and we were unable to recover it. 00:30:09.669 [2024-07-13 10:16:15.288163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.288291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.288317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.669 qpair failed and we were unable to recover it. 00:30:09.669 [2024-07-13 10:16:15.288464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.288580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.288604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.669 qpair failed and we were unable to recover it. 00:30:09.669 [2024-07-13 10:16:15.288751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.288875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.669 [2024-07-13 10:16:15.288901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.670 qpair failed and we were unable to recover it. 00:30:09.670 [2024-07-13 10:16:15.289039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.289188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.289213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.670 qpair failed and we were unable to recover it. 00:30:09.670 [2024-07-13 10:16:15.289351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.289511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.289536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.670 qpair failed and we were unable to recover it. 00:30:09.670 [2024-07-13 10:16:15.289692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.289838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.289862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.670 qpair failed and we were unable to recover it. 00:30:09.670 [2024-07-13 10:16:15.290004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.290157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.290182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.670 qpair failed and we were unable to recover it. 00:30:09.670 [2024-07-13 10:16:15.290320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.290465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.290490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.670 qpair failed and we were unable to recover it. 00:30:09.670 [2024-07-13 10:16:15.290646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.290772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.290798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.670 qpair failed and we were unable to recover it. 00:30:09.670 [2024-07-13 10:16:15.290958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.291080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.291105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.670 qpair failed and we were unable to recover it. 00:30:09.670 [2024-07-13 10:16:15.291259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.291406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.291430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.670 qpair failed and we were unable to recover it. 00:30:09.670 [2024-07-13 10:16:15.291586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.291699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.291732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.670 qpair failed and we were unable to recover it. 00:30:09.670 [2024-07-13 10:16:15.291874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.291987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.292012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.670 qpair failed and we were unable to recover it. 00:30:09.670 [2024-07-13 10:16:15.292138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.292249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.292274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.670 qpair failed and we were unable to recover it. 00:30:09.670 [2024-07-13 10:16:15.292424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.292589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.292614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.670 qpair failed and we were unable to recover it. 00:30:09.670 [2024-07-13 10:16:15.292734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.292886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.292912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.670 qpair failed and we were unable to recover it. 00:30:09.670 [2024-07-13 10:16:15.293063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.293186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.293210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.670 qpair failed and we were unable to recover it. 00:30:09.670 [2024-07-13 10:16:15.293385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.293505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.293530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.670 qpair failed and we were unable to recover it. 00:30:09.670 [2024-07-13 10:16:15.293644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.293807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.293832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.670 qpair failed and we were unable to recover it. 00:30:09.670 [2024-07-13 10:16:15.293957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.294081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.294105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.670 qpair failed and we were unable to recover it. 00:30:09.670 [2024-07-13 10:16:15.294250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.294386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.294411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.670 qpair failed and we were unable to recover it. 00:30:09.670 [2024-07-13 10:16:15.294529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.294713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.294738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.670 qpair failed and we were unable to recover it. 00:30:09.670 [2024-07-13 10:16:15.294863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.295026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.295051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.670 qpair failed and we were unable to recover it. 00:30:09.670 [2024-07-13 10:16:15.295220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.295338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.295362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.670 qpair failed and we were unable to recover it. 00:30:09.670 [2024-07-13 10:16:15.295490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.295644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.295669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.670 qpair failed and we were unable to recover it. 00:30:09.670 [2024-07-13 10:16:15.295793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.295922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.295948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.670 qpair failed and we were unable to recover it. 00:30:09.670 [2024-07-13 10:16:15.296102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.296218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.296242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.670 qpair failed and we were unable to recover it. 00:30:09.670 [2024-07-13 10:16:15.296379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.296558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.296582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.670 qpair failed and we were unable to recover it. 00:30:09.670 [2024-07-13 10:16:15.296700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.670 [2024-07-13 10:16:15.296825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.296849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.671 qpair failed and we were unable to recover it. 00:30:09.671 [2024-07-13 10:16:15.296980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.297094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.297119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.671 qpair failed and we were unable to recover it. 00:30:09.671 [2024-07-13 10:16:15.297266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.297389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.297414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.671 qpair failed and we were unable to recover it. 00:30:09.671 [2024-07-13 10:16:15.297534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.297677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.297702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.671 qpair failed and we were unable to recover it. 00:30:09.671 [2024-07-13 10:16:15.297884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.298030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.298055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.671 qpair failed and we were unable to recover it. 00:30:09.671 [2024-07-13 10:16:15.298174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.298291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.298326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.671 qpair failed and we were unable to recover it. 00:30:09.671 [2024-07-13 10:16:15.298475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.298635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.298659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.671 qpair failed and we were unable to recover it. 00:30:09.671 [2024-07-13 10:16:15.298786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.298906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.298932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.671 qpair failed and we were unable to recover it. 00:30:09.671 [2024-07-13 10:16:15.299085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.299200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.299224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.671 qpair failed and we were unable to recover it. 00:30:09.671 [2024-07-13 10:16:15.299372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.299517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.299542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.671 qpair failed and we were unable to recover it. 00:30:09.671 [2024-07-13 10:16:15.299666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.299785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.299811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.671 qpair failed and we were unable to recover it. 00:30:09.671 [2024-07-13 10:16:15.299936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.300096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.300120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.671 qpair failed and we were unable to recover it. 00:30:09.671 [2024-07-13 10:16:15.300263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.300414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.300438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.671 qpair failed and we were unable to recover it. 00:30:09.671 [2024-07-13 10:16:15.300677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.300798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.300835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.671 qpair failed and we were unable to recover it. 00:30:09.671 [2024-07-13 10:16:15.300995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.301172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.301197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.671 qpair failed and we were unable to recover it. 00:30:09.671 [2024-07-13 10:16:15.301318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.301450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.301476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.671 qpair failed and we were unable to recover it. 00:30:09.671 [2024-07-13 10:16:15.301631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.301791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.301816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.671 qpair failed and we were unable to recover it. 00:30:09.671 [2024-07-13 10:16:15.301934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.302056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.302083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.671 qpair failed and we were unable to recover it. 00:30:09.671 [2024-07-13 10:16:15.302259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.302376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.302402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.671 qpair failed and we were unable to recover it. 00:30:09.671 [2024-07-13 10:16:15.302561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.302677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.302702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.671 qpair failed and we were unable to recover it. 00:30:09.671 [2024-07-13 10:16:15.302832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.302981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.303007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.671 qpair failed and we were unable to recover it. 00:30:09.671 [2024-07-13 10:16:15.303136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.303253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.303278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.671 qpair failed and we were unable to recover it. 00:30:09.671 [2024-07-13 10:16:15.303454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.303639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.303664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.671 qpair failed and we were unable to recover it. 00:30:09.671 [2024-07-13 10:16:15.303796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.303938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.303964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.671 qpair failed and we were unable to recover it. 00:30:09.671 [2024-07-13 10:16:15.304099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.304222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.304246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.671 qpair failed and we were unable to recover it. 00:30:09.671 [2024-07-13 10:16:15.304361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.304505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.304540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.671 qpair failed and we were unable to recover it. 00:30:09.671 [2024-07-13 10:16:15.304662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.304805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.304830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.671 qpair failed and we were unable to recover it. 00:30:09.671 [2024-07-13 10:16:15.304999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.305116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.305141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.671 qpair failed and we were unable to recover it. 00:30:09.671 [2024-07-13 10:16:15.305322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.305484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.305509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.671 qpair failed and we were unable to recover it. 00:30:09.671 [2024-07-13 10:16:15.305685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.305820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.305845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.671 qpair failed and we were unable to recover it. 00:30:09.671 [2024-07-13 10:16:15.306016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.306170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.671 [2024-07-13 10:16:15.306196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.671 qpair failed and we were unable to recover it. 00:30:09.671 [2024-07-13 10:16:15.306360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.306542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.306567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.672 qpair failed and we were unable to recover it. 00:30:09.672 [2024-07-13 10:16:15.306723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.306836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.306861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.672 qpair failed and we were unable to recover it. 00:30:09.672 [2024-07-13 10:16:15.307015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.307126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.307153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.672 qpair failed and we were unable to recover it. 00:30:09.672 [2024-07-13 10:16:15.307313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.307448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.307477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.672 qpair failed and we were unable to recover it. 00:30:09.672 [2024-07-13 10:16:15.307596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.307769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.307795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.672 qpair failed and we were unable to recover it. 00:30:09.672 [2024-07-13 10:16:15.307917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.308035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.308061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.672 qpair failed and we were unable to recover it. 00:30:09.672 [2024-07-13 10:16:15.308183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.308329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.308361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.672 qpair failed and we were unable to recover it. 00:30:09.672 [2024-07-13 10:16:15.308498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.308643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.308669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.672 qpair failed and we were unable to recover it. 00:30:09.672 [2024-07-13 10:16:15.308798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.308962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.308988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.672 qpair failed and we were unable to recover it. 00:30:09.672 [2024-07-13 10:16:15.309107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.309237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.309262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.672 qpair failed and we were unable to recover it. 00:30:09.672 [2024-07-13 10:16:15.309417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.309556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.309581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.672 qpair failed and we were unable to recover it. 00:30:09.672 [2024-07-13 10:16:15.309724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.309844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.309877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.672 qpair failed and we were unable to recover it. 00:30:09.672 [2024-07-13 10:16:15.310009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.310122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.310146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.672 qpair failed and we were unable to recover it. 00:30:09.672 [2024-07-13 10:16:15.310301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.310456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.310485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.672 qpair failed and we were unable to recover it. 00:30:09.672 [2024-07-13 10:16:15.310602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.310769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.310794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.672 qpair failed and we were unable to recover it. 00:30:09.672 [2024-07-13 10:16:15.310936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.311415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.311444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.672 qpair failed and we were unable to recover it. 00:30:09.672 [2024-07-13 10:16:15.311629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.311757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.311783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.672 qpair failed and we were unable to recover it. 00:30:09.672 [2024-07-13 10:16:15.311912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.312035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.312060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.672 qpair failed and we were unable to recover it. 00:30:09.672 [2024-07-13 10:16:15.312195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.312342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.312367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.672 qpair failed and we were unable to recover it. 00:30:09.672 [2024-07-13 10:16:15.312518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.312678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.312703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.672 qpair failed and we were unable to recover it. 00:30:09.672 [2024-07-13 10:16:15.312828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.312970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.312996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.672 qpair failed and we were unable to recover it. 00:30:09.672 [2024-07-13 10:16:15.313147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.313301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.313326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.672 qpair failed and we were unable to recover it. 00:30:09.672 [2024-07-13 10:16:15.313439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.313556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.313581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.672 qpair failed and we were unable to recover it. 00:30:09.672 [2024-07-13 10:16:15.313728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.313897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.313923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.672 qpair failed and we were unable to recover it. 00:30:09.672 [2024-07-13 10:16:15.314078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.314200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.314225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.672 qpair failed and we were unable to recover it. 00:30:09.672 [2024-07-13 10:16:15.314344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.314464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.314489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.672 qpair failed and we were unable to recover it. 00:30:09.672 [2024-07-13 10:16:15.314637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.314760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.314785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.672 qpair failed and we were unable to recover it. 00:30:09.672 [2024-07-13 10:16:15.314912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.315031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.315055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.672 qpair failed and we were unable to recover it. 00:30:09.672 [2024-07-13 10:16:15.315186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.315308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.315332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.672 qpair failed and we were unable to recover it. 00:30:09.672 [2024-07-13 10:16:15.315480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.315591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.315616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.672 qpair failed and we were unable to recover it. 00:30:09.672 [2024-07-13 10:16:15.315738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.315892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.672 [2024-07-13 10:16:15.315917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.673 qpair failed and we were unable to recover it. 00:30:09.673 [2024-07-13 10:16:15.316046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.316158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.316190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.673 qpair failed and we were unable to recover it. 00:30:09.673 [2024-07-13 10:16:15.316358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.316469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.316494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.673 qpair failed and we were unable to recover it. 00:30:09.673 [2024-07-13 10:16:15.316624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.316747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.316771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.673 qpair failed and we were unable to recover it. 00:30:09.673 [2024-07-13 10:16:15.316893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.317053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.317077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.673 qpair failed and we were unable to recover it. 00:30:09.673 [2024-07-13 10:16:15.317191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.317339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.317364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.673 qpair failed and we were unable to recover it. 00:30:09.673 [2024-07-13 10:16:15.317495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.317682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.317708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.673 qpair failed and we were unable to recover it. 00:30:09.673 [2024-07-13 10:16:15.317836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.317990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.318015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.673 qpair failed and we were unable to recover it. 00:30:09.673 [2024-07-13 10:16:15.318136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.318300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.318326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.673 qpair failed and we were unable to recover it. 00:30:09.673 [2024-07-13 10:16:15.318473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.318600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.318624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.673 qpair failed and we were unable to recover it. 00:30:09.673 [2024-07-13 10:16:15.318783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.318898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.318923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.673 qpair failed and we were unable to recover it. 00:30:09.673 [2024-07-13 10:16:15.319076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.319203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.319240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.673 qpair failed and we were unable to recover it. 00:30:09.673 [2024-07-13 10:16:15.319396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.319539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.319564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.673 qpair failed and we were unable to recover it. 00:30:09.673 [2024-07-13 10:16:15.319705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.319830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.319872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.673 qpair failed and we were unable to recover it. 00:30:09.673 [2024-07-13 10:16:15.320013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.320169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.320194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.673 qpair failed and we were unable to recover it. 00:30:09.673 [2024-07-13 10:16:15.320375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.320547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.320572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.673 qpair failed and we were unable to recover it. 00:30:09.673 [2024-07-13 10:16:15.320695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.320841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.320874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.673 qpair failed and we were unable to recover it. 00:30:09.673 [2024-07-13 10:16:15.321037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.321167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.321192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.673 qpair failed and we were unable to recover it. 00:30:09.673 [2024-07-13 10:16:15.321322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.321457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.321482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.673 qpair failed and we were unable to recover it. 00:30:09.673 [2024-07-13 10:16:15.321642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.321789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.321814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.673 qpair failed and we were unable to recover it. 00:30:09.673 [2024-07-13 10:16:15.321950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.322084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.322108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.673 qpair failed and we were unable to recover it. 00:30:09.673 [2024-07-13 10:16:15.322235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.322378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.322403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.673 qpair failed and we were unable to recover it. 00:30:09.673 [2024-07-13 10:16:15.322550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.322696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.322721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.673 qpair failed and we were unable to recover it. 00:30:09.673 [2024-07-13 10:16:15.322849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.322981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.323006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.673 qpair failed and we were unable to recover it. 00:30:09.673 [2024-07-13 10:16:15.323162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.323311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.323336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.673 qpair failed and we were unable to recover it. 00:30:09.673 [2024-07-13 10:16:15.323451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.323575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.323599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.673 qpair failed and we were unable to recover it. 00:30:09.673 [2024-07-13 10:16:15.323746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.323913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.323958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.673 qpair failed and we were unable to recover it. 00:30:09.673 [2024-07-13 10:16:15.324094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.324262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.324287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.673 qpair failed and we were unable to recover it. 00:30:09.673 [2024-07-13 10:16:15.324437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.324560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.324584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.673 qpair failed and we were unable to recover it. 00:30:09.673 [2024-07-13 10:16:15.324709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.324852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.324880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.673 qpair failed and we were unable to recover it. 00:30:09.673 [2024-07-13 10:16:15.325008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.325125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.325150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.673 qpair failed and we were unable to recover it. 00:30:09.673 [2024-07-13 10:16:15.325272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.673 [2024-07-13 10:16:15.325393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.325417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.674 qpair failed and we were unable to recover it. 00:30:09.674 [2024-07-13 10:16:15.325550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.325692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.325716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.674 qpair failed and we were unable to recover it. 00:30:09.674 [2024-07-13 10:16:15.325857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.326006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.326031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.674 qpair failed and we were unable to recover it. 00:30:09.674 [2024-07-13 10:16:15.326187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.326331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.326359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.674 qpair failed and we were unable to recover it. 00:30:09.674 [2024-07-13 10:16:15.326516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.326643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.326667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.674 qpair failed and we were unable to recover it. 00:30:09.674 [2024-07-13 10:16:15.326818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.326963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.326988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.674 qpair failed and we were unable to recover it. 00:30:09.674 [2024-07-13 10:16:15.327114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.327266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.327290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.674 qpair failed and we were unable to recover it. 00:30:09.674 [2024-07-13 10:16:15.327445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.327621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.327645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.674 qpair failed and we were unable to recover it. 00:30:09.674 [2024-07-13 10:16:15.327790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.327951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.327977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.674 qpair failed and we were unable to recover it. 00:30:09.674 [2024-07-13 10:16:15.328093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.328252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.328276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.674 qpair failed and we were unable to recover it. 00:30:09.674 [2024-07-13 10:16:15.328438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.328561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.328586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.674 qpair failed and we were unable to recover it. 00:30:09.674 [2024-07-13 10:16:15.328699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.328813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.328838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.674 qpair failed and we were unable to recover it. 00:30:09.674 [2024-07-13 10:16:15.329009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.329123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.329148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.674 qpair failed and we were unable to recover it. 00:30:09.674 [2024-07-13 10:16:15.329263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.329436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.329460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.674 qpair failed and we were unable to recover it. 00:30:09.674 [2024-07-13 10:16:15.329610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.329756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.329781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.674 qpair failed and we were unable to recover it. 00:30:09.674 [2024-07-13 10:16:15.329909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.330065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.330090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.674 qpair failed and we were unable to recover it. 00:30:09.674 [2024-07-13 10:16:15.330241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.330381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.330405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.674 qpair failed and we were unable to recover it. 00:30:09.674 [2024-07-13 10:16:15.330535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.330680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.330704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.674 qpair failed and we were unable to recover it. 00:30:09.674 [2024-07-13 10:16:15.330822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.330960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.330986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.674 qpair failed and we were unable to recover it. 00:30:09.674 [2024-07-13 10:16:15.331109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.331288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.331313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.674 qpair failed and we were unable to recover it. 00:30:09.674 [2024-07-13 10:16:15.331441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.331613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.331638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.674 qpair failed and we were unable to recover it. 00:30:09.674 [2024-07-13 10:16:15.331760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.331884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.331910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.674 qpair failed and we were unable to recover it. 00:30:09.674 [2024-07-13 10:16:15.332063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.332220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.332244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.674 qpair failed and we were unable to recover it. 00:30:09.674 [2024-07-13 10:16:15.332366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.332482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.332507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.674 qpair failed and we were unable to recover it. 00:30:09.674 [2024-07-13 10:16:15.332642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.332784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.332809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.674 qpair failed and we were unable to recover it. 00:30:09.674 [2024-07-13 10:16:15.332949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.333104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.333129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.674 qpair failed and we were unable to recover it. 00:30:09.674 [2024-07-13 10:16:15.333257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.333391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.333415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.674 qpair failed and we were unable to recover it. 00:30:09.674 [2024-07-13 10:16:15.333589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.333730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.333755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.674 qpair failed and we were unable to recover it. 00:30:09.674 [2024-07-13 10:16:15.333876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.334008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.334033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.674 qpair failed and we were unable to recover it. 00:30:09.674 [2024-07-13 10:16:15.334182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.334334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.334359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.674 qpair failed and we were unable to recover it. 00:30:09.674 [2024-07-13 10:16:15.334482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.334612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.674 [2024-07-13 10:16:15.334637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.674 qpair failed and we were unable to recover it. 00:30:09.675 [2024-07-13 10:16:15.334762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.334885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.334911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.675 qpair failed and we were unable to recover it. 00:30:09.675 [2024-07-13 10:16:15.335037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.335188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.335212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.675 qpair failed and we were unable to recover it. 00:30:09.675 [2024-07-13 10:16:15.335351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.335527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.335552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.675 qpair failed and we were unable to recover it. 00:30:09.675 [2024-07-13 10:16:15.335682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.335803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.335830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.675 qpair failed and we were unable to recover it. 00:30:09.675 [2024-07-13 10:16:15.335986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.336113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.336138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.675 qpair failed and we were unable to recover it. 00:30:09.675 [2024-07-13 10:16:15.336266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.336389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.336414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.675 qpair failed and we were unable to recover it. 00:30:09.675 [2024-07-13 10:16:15.336569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.336695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.336718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.675 qpair failed and we were unable to recover it. 00:30:09.675 [2024-07-13 10:16:15.336899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.337045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.337069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.675 qpair failed and we were unable to recover it. 00:30:09.675 [2024-07-13 10:16:15.337185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.337298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.337322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.675 qpair failed and we were unable to recover it. 00:30:09.675 [2024-07-13 10:16:15.337494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.337614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.337639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.675 qpair failed and we were unable to recover it. 00:30:09.675 [2024-07-13 10:16:15.337819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.337945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.337970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.675 qpair failed and we were unable to recover it. 00:30:09.675 [2024-07-13 10:16:15.338121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.338253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.338277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.675 qpair failed and we were unable to recover it. 00:30:09.675 [2024-07-13 10:16:15.338424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.338573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.338597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.675 qpair failed and we were unable to recover it. 00:30:09.675 [2024-07-13 10:16:15.338725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.338837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.338876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.675 qpair failed and we were unable to recover it. 00:30:09.675 [2024-07-13 10:16:15.339008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.339135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.339168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.675 qpair failed and we were unable to recover it. 00:30:09.675 [2024-07-13 10:16:15.339299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.339408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.339432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.675 qpair failed and we were unable to recover it. 00:30:09.675 [2024-07-13 10:16:15.339585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.339738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.339762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.675 qpair failed and we were unable to recover it. 00:30:09.675 [2024-07-13 10:16:15.339885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.340039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.340064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.675 qpair failed and we were unable to recover it. 00:30:09.675 [2024-07-13 10:16:15.340224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.340344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.340368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.675 qpair failed and we were unable to recover it. 00:30:09.675 [2024-07-13 10:16:15.340513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.340637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.340662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.675 qpair failed and we were unable to recover it. 00:30:09.675 [2024-07-13 10:16:15.340793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.340974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.341001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.675 qpair failed and we were unable to recover it. 00:30:09.675 [2024-07-13 10:16:15.341149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.341276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.341300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.675 qpair failed and we were unable to recover it. 00:30:09.675 [2024-07-13 10:16:15.341429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.341543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.341567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.675 qpair failed and we were unable to recover it. 00:30:09.675 [2024-07-13 10:16:15.341681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.341821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.341850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.675 qpair failed and we were unable to recover it. 00:30:09.675 [2024-07-13 10:16:15.342008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.342124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.342160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.675 qpair failed and we were unable to recover it. 00:30:09.675 [2024-07-13 10:16:15.342305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.342458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.675 [2024-07-13 10:16:15.342482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.676 qpair failed and we were unable to recover it. 00:30:09.676 [2024-07-13 10:16:15.342635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.342768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.342793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.676 qpair failed and we were unable to recover it. 00:30:09.676 [2024-07-13 10:16:15.342934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.343053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.343078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.676 qpair failed and we were unable to recover it. 00:30:09.676 [2024-07-13 10:16:15.343210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.343357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.343382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.676 qpair failed and we were unable to recover it. 00:30:09.676 [2024-07-13 10:16:15.343508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.343664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.343689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.676 qpair failed and we were unable to recover it. 00:30:09.676 [2024-07-13 10:16:15.343836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.343969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.343994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.676 qpair failed and we were unable to recover it. 00:30:09.676 [2024-07-13 10:16:15.344128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.344294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.344319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.676 qpair failed and we were unable to recover it. 00:30:09.676 [2024-07-13 10:16:15.344442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.344556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.344581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.676 qpair failed and we were unable to recover it. 00:30:09.676 [2024-07-13 10:16:15.344712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.344871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.344897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.676 qpair failed and we were unable to recover it. 00:30:09.676 [2024-07-13 10:16:15.345032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.345147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.345172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.676 qpair failed and we were unable to recover it. 00:30:09.676 [2024-07-13 10:16:15.345335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.345485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.345510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.676 qpair failed and we were unable to recover it. 00:30:09.676 [2024-07-13 10:16:15.345657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.345772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.345797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.676 qpair failed and we were unable to recover it. 00:30:09.676 [2024-07-13 10:16:15.345922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.346046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.346071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.676 qpair failed and we were unable to recover it. 00:30:09.676 [2024-07-13 10:16:15.346192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.346325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.346350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.676 qpair failed and we were unable to recover it. 00:30:09.676 [2024-07-13 10:16:15.346477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.346621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.346646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.676 qpair failed and we were unable to recover it. 00:30:09.676 [2024-07-13 10:16:15.346769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.346937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.346963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.676 qpair failed and we were unable to recover it. 00:30:09.676 [2024-07-13 10:16:15.347086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.347219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.347244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.676 qpair failed and we were unable to recover it. 00:30:09.676 [2024-07-13 10:16:15.347359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.347469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.347493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.676 qpair failed and we were unable to recover it. 00:30:09.676 [2024-07-13 10:16:15.347621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.347774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.347798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.676 qpair failed and we were unable to recover it. 00:30:09.676 [2024-07-13 10:16:15.347934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.348058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.348083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.676 qpair failed and we were unable to recover it. 00:30:09.676 [2024-07-13 10:16:15.348259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.348401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.348426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.676 qpair failed and we were unable to recover it. 00:30:09.676 [2024-07-13 10:16:15.348547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.348726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.348751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.676 qpair failed and we were unable to recover it. 00:30:09.676 [2024-07-13 10:16:15.348912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.349028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.349053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.676 qpair failed and we were unable to recover it. 00:30:09.676 [2024-07-13 10:16:15.349170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.349321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.349346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.676 qpair failed and we were unable to recover it. 00:30:09.676 [2024-07-13 10:16:15.349459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.349606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.349631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.676 qpair failed and we were unable to recover it. 00:30:09.676 [2024-07-13 10:16:15.349775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.349921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.349947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.676 qpair failed and we were unable to recover it. 00:30:09.676 [2024-07-13 10:16:15.350066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.350213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.350238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.676 qpair failed and we were unable to recover it. 00:30:09.676 [2024-07-13 10:16:15.350411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.350523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.350548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.676 qpair failed and we were unable to recover it. 00:30:09.676 [2024-07-13 10:16:15.350690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.350836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.350873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.676 qpair failed and we were unable to recover it. 00:30:09.676 [2024-07-13 10:16:15.350997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.351111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.351136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.676 qpair failed and we were unable to recover it. 00:30:09.676 [2024-07-13 10:16:15.351265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.351437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.676 [2024-07-13 10:16:15.351462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.676 qpair failed and we were unable to recover it. 00:30:09.676 [2024-07-13 10:16:15.351574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.351694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.351718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.677 qpair failed and we were unable to recover it. 00:30:09.677 [2024-07-13 10:16:15.351837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.352031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.352056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.677 qpair failed and we were unable to recover it. 00:30:09.677 [2024-07-13 10:16:15.352179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.352307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.352332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.677 qpair failed and we were unable to recover it. 00:30:09.677 [2024-07-13 10:16:15.352447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.352591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.352616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.677 qpair failed and we were unable to recover it. 00:30:09.677 [2024-07-13 10:16:15.352743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.352862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.352893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.677 qpair failed and we were unable to recover it. 00:30:09.677 [2024-07-13 10:16:15.353028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.353141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.353165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.677 qpair failed and we were unable to recover it. 00:30:09.677 [2024-07-13 10:16:15.353307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.353431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.353455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.677 qpair failed and we were unable to recover it. 00:30:09.677 [2024-07-13 10:16:15.353599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.353717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.353741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.677 qpair failed and we were unable to recover it. 00:30:09.677 [2024-07-13 10:16:15.353862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.354000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.354025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.677 qpair failed and we were unable to recover it. 00:30:09.677 [2024-07-13 10:16:15.354213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.354332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.354357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.677 qpair failed and we were unable to recover it. 00:30:09.677 [2024-07-13 10:16:15.354512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.354632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.354657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.677 qpair failed and we were unable to recover it. 00:30:09.677 [2024-07-13 10:16:15.354772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.354909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.354935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.677 qpair failed and we were unable to recover it. 00:30:09.677 [2024-07-13 10:16:15.355096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.355269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.355294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.677 qpair failed and we were unable to recover it. 00:30:09.677 [2024-07-13 10:16:15.355424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.355547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.355571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.677 qpair failed and we were unable to recover it. 00:30:09.677 [2024-07-13 10:16:15.355709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.355836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.355876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.677 qpair failed and we were unable to recover it. 00:30:09.677 [2024-07-13 10:16:15.356028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.356202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.356227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.677 qpair failed and we were unable to recover it. 00:30:09.677 [2024-07-13 10:16:15.356351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.356496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.356520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.677 qpair failed and we were unable to recover it. 00:30:09.677 [2024-07-13 10:16:15.356676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.356825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.356850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.677 qpair failed and we were unable to recover it. 00:30:09.677 [2024-07-13 10:16:15.356998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.357114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.357143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.677 qpair failed and we were unable to recover it. 00:30:09.677 [2024-07-13 10:16:15.357292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.357443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.357470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.677 qpair failed and we were unable to recover it. 00:30:09.677 [2024-07-13 10:16:15.357600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.357740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.357764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.677 qpair failed and we were unable to recover it. 00:30:09.677 [2024-07-13 10:16:15.357884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.358036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.358061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.677 qpair failed and we were unable to recover it. 00:30:09.677 [2024-07-13 10:16:15.358220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.358377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.358402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.677 qpair failed and we were unable to recover it. 00:30:09.677 [2024-07-13 10:16:15.358529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.358679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.358704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.677 qpair failed and we were unable to recover it. 00:30:09.677 [2024-07-13 10:16:15.358882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.359001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.359027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.677 qpair failed and we were unable to recover it. 00:30:09.677 [2024-07-13 10:16:15.359144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.359318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.359343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.677 qpair failed and we were unable to recover it. 00:30:09.677 [2024-07-13 10:16:15.359499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.359620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.359645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.677 qpair failed and we were unable to recover it. 00:30:09.677 [2024-07-13 10:16:15.359799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.359933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.359958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.677 qpair failed and we were unable to recover it. 00:30:09.677 [2024-07-13 10:16:15.360103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.360240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.360268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.677 qpair failed and we were unable to recover it. 00:30:09.677 [2024-07-13 10:16:15.360420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.360561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.360585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.677 qpair failed and we were unable to recover it. 00:30:09.677 [2024-07-13 10:16:15.360732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.677 [2024-07-13 10:16:15.360844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.360892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.678 qpair failed and we were unable to recover it. 00:30:09.678 [2024-07-13 10:16:15.361051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.361179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.361206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.678 qpair failed and we were unable to recover it. 00:30:09.678 [2024-07-13 10:16:15.361349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.361471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.361497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.678 qpair failed and we were unable to recover it. 00:30:09.678 [2024-07-13 10:16:15.361650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.361769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.361793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.678 qpair failed and we were unable to recover it. 00:30:09.678 [2024-07-13 10:16:15.361940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.362056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.362081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.678 qpair failed and we were unable to recover it. 00:30:09.678 [2024-07-13 10:16:15.362242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.362386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.362410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.678 qpair failed and we were unable to recover it. 00:30:09.678 [2024-07-13 10:16:15.362557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.362709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.362734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.678 qpair failed and we were unable to recover it. 00:30:09.678 [2024-07-13 10:16:15.362858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.362983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.363010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.678 qpair failed and we were unable to recover it. 00:30:09.678 [2024-07-13 10:16:15.363128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.363273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.363299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.678 qpair failed and we were unable to recover it. 00:30:09.678 [2024-07-13 10:16:15.363419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.363528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.363553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.678 qpair failed and we were unable to recover it. 00:30:09.678 [2024-07-13 10:16:15.363703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.363854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.363896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.678 qpair failed and we were unable to recover it. 00:30:09.678 [2024-07-13 10:16:15.364046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.364188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.364213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.678 qpair failed and we were unable to recover it. 00:30:09.678 [2024-07-13 10:16:15.364369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.364491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.364516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.678 qpair failed and we were unable to recover it. 00:30:09.678 [2024-07-13 10:16:15.364677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.364788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.364813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.678 qpair failed and we were unable to recover it. 00:30:09.678 [2024-07-13 10:16:15.364932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.365094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.365120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.678 qpair failed and we were unable to recover it. 00:30:09.678 [2024-07-13 10:16:15.365255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.365396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.365420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.678 qpair failed and we were unable to recover it. 00:30:09.678 [2024-07-13 10:16:15.365565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.365692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.365718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.678 qpair failed and we were unable to recover it. 00:30:09.678 [2024-07-13 10:16:15.365863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.365986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.366011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.678 qpair failed and we were unable to recover it. 00:30:09.678 [2024-07-13 10:16:15.366135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.366256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.366281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.678 qpair failed and we were unable to recover it. 00:30:09.678 [2024-07-13 10:16:15.366431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.366554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.366579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.678 qpair failed and we were unable to recover it. 00:30:09.678 [2024-07-13 10:16:15.366706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.366880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.366906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.678 qpair failed and we were unable to recover it. 00:30:09.678 [2024-07-13 10:16:15.367050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.367170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.367196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.678 qpair failed and we were unable to recover it. 00:30:09.678 [2024-07-13 10:16:15.367328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.367481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.367505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.678 qpair failed and we were unable to recover it. 00:30:09.678 [2024-07-13 10:16:15.367622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.367740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.367764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.678 qpair failed and we were unable to recover it. 00:30:09.678 [2024-07-13 10:16:15.367919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.368043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.368067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.678 qpair failed and we were unable to recover it. 00:30:09.678 [2024-07-13 10:16:15.368195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.368339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.368363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.678 qpair failed and we were unable to recover it. 00:30:09.678 [2024-07-13 10:16:15.368509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.368619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.368644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.678 qpair failed and we were unable to recover it. 00:30:09.678 [2024-07-13 10:16:15.368822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.368935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.368962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.678 qpair failed and we were unable to recover it. 00:30:09.678 [2024-07-13 10:16:15.369086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.369261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.369285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.678 qpair failed and we were unable to recover it. 00:30:09.678 [2024-07-13 10:16:15.369399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.369555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.369581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.678 qpair failed and we were unable to recover it. 00:30:09.678 [2024-07-13 10:16:15.369736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.369884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.678 [2024-07-13 10:16:15.369911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.678 qpair failed and we were unable to recover it. 00:30:09.679 [2024-07-13 10:16:15.370028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.370143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.370167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.679 qpair failed and we were unable to recover it. 00:30:09.679 [2024-07-13 10:16:15.370283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.370428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.370453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.679 qpair failed and we were unable to recover it. 00:30:09.679 [2024-07-13 10:16:15.370603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.370725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.370750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.679 qpair failed and we were unable to recover it. 00:30:09.679 [2024-07-13 10:16:15.370877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.371029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.371055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.679 qpair failed and we were unable to recover it. 00:30:09.679 [2024-07-13 10:16:15.371182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.371342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.371366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.679 qpair failed and we were unable to recover it. 00:30:09.679 [2024-07-13 10:16:15.371484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.371642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.371666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.679 qpair failed and we were unable to recover it. 00:30:09.679 [2024-07-13 10:16:15.371792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.371919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.371944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.679 qpair failed and we were unable to recover it. 00:30:09.679 [2024-07-13 10:16:15.372086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.372238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.372263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.679 qpair failed and we were unable to recover it. 00:30:09.679 [2024-07-13 10:16:15.372402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.372528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.372557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.679 qpair failed and we were unable to recover it. 00:30:09.679 [2024-07-13 10:16:15.372687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.372860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.372890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.679 qpair failed and we were unable to recover it. 00:30:09.679 [2024-07-13 10:16:15.373027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.373144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.373168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.679 qpair failed and we were unable to recover it. 00:30:09.679 [2024-07-13 10:16:15.373319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.373438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.373463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.679 qpair failed and we were unable to recover it. 00:30:09.679 [2024-07-13 10:16:15.373586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.373707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.373731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.679 qpair failed and we were unable to recover it. 00:30:09.679 [2024-07-13 10:16:15.373880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.374011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.374035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.679 qpair failed and we were unable to recover it. 00:30:09.679 [2024-07-13 10:16:15.374191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.374341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.374366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.679 qpair failed and we were unable to recover it. 00:30:09.679 [2024-07-13 10:16:15.374523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.374640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.374664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.679 qpair failed and we were unable to recover it. 00:30:09.679 [2024-07-13 10:16:15.374803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.374927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.374951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.679 qpair failed and we were unable to recover it. 00:30:09.679 [2024-07-13 10:16:15.375072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.375206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.375230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.679 qpair failed and we were unable to recover it. 00:30:09.679 [2024-07-13 10:16:15.375359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.375485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.375513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.679 qpair failed and we were unable to recover it. 00:30:09.679 [2024-07-13 10:16:15.375631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.375748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.375772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.679 qpair failed and we were unable to recover it. 00:30:09.679 [2024-07-13 10:16:15.375899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.376024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.376049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.679 qpair failed and we were unable to recover it. 00:30:09.679 [2024-07-13 10:16:15.376173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.376284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.376309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.679 qpair failed and we were unable to recover it. 00:30:09.679 [2024-07-13 10:16:15.376458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.376571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.376595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.679 qpair failed and we were unable to recover it. 00:30:09.679 [2024-07-13 10:16:15.376717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.376832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.376856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.679 qpair failed and we were unable to recover it. 00:30:09.679 [2024-07-13 10:16:15.376977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.377104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.377128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.679 qpair failed and we were unable to recover it. 00:30:09.679 [2024-07-13 10:16:15.377276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.377388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.679 [2024-07-13 10:16:15.377411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.679 qpair failed and we were unable to recover it. 00:30:09.680 [2024-07-13 10:16:15.377571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.377684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.377708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.680 qpair failed and we were unable to recover it. 00:30:09.680 [2024-07-13 10:16:15.377857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.377976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.378000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.680 qpair failed and we were unable to recover it. 00:30:09.680 [2024-07-13 10:16:15.378142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.378298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.378322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.680 qpair failed and we were unable to recover it. 00:30:09.680 [2024-07-13 10:16:15.378472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.378626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.378650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.680 qpair failed and we were unable to recover it. 00:30:09.680 [2024-07-13 10:16:15.378768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.378882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.378907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.680 qpair failed and we were unable to recover it. 00:30:09.680 [2024-07-13 10:16:15.379036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.379156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.379181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.680 qpair failed and we were unable to recover it. 00:30:09.680 [2024-07-13 10:16:15.379310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.379425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.379449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.680 qpair failed and we were unable to recover it. 00:30:09.680 [2024-07-13 10:16:15.379563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.379706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.379730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.680 qpair failed and we were unable to recover it. 00:30:09.680 [2024-07-13 10:16:15.379887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.380032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.380057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.680 qpair failed and we were unable to recover it. 00:30:09.680 [2024-07-13 10:16:15.380183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.380364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.380389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.680 qpair failed and we were unable to recover it. 00:30:09.680 [2024-07-13 10:16:15.380510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.380628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.380653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.680 qpair failed and we were unable to recover it. 00:30:09.680 [2024-07-13 10:16:15.380784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.380931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.380955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.680 qpair failed and we were unable to recover it. 00:30:09.680 [2024-07-13 10:16:15.381070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.381221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.381245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.680 qpair failed and we were unable to recover it. 00:30:09.680 [2024-07-13 10:16:15.381379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.381498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.381523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.680 qpair failed and we were unable to recover it. 00:30:09.680 [2024-07-13 10:16:15.381685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.381858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.381887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.680 qpair failed and we were unable to recover it. 00:30:09.680 [2024-07-13 10:16:15.382041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.382157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.382181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.680 qpair failed and we were unable to recover it. 00:30:09.680 [2024-07-13 10:16:15.382295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.382413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.382436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.680 qpair failed and we were unable to recover it. 00:30:09.680 [2024-07-13 10:16:15.382561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.382710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.382734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.680 qpair failed and we were unable to recover it. 00:30:09.680 [2024-07-13 10:16:15.382888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.383002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.383027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.680 qpair failed and we were unable to recover it. 00:30:09.680 [2024-07-13 10:16:15.383148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.383261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.383286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.680 qpair failed and we were unable to recover it. 00:30:09.680 [2024-07-13 10:16:15.383413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.383584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.383609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.680 qpair failed and we were unable to recover it. 00:30:09.680 [2024-07-13 10:16:15.383729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.383861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.383889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.680 qpair failed and we were unable to recover it. 00:30:09.680 [2024-07-13 10:16:15.384012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.384140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.384164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.680 qpair failed and we were unable to recover it. 00:30:09.680 [2024-07-13 10:16:15.384298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.384451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.384476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.680 qpair failed and we were unable to recover it. 00:30:09.680 [2024-07-13 10:16:15.384627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.384770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.384794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.680 qpair failed and we were unable to recover it. 00:30:09.680 [2024-07-13 10:16:15.384920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.385033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.385057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.680 qpair failed and we were unable to recover it. 00:30:09.680 [2024-07-13 10:16:15.385202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.385315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.385338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.680 qpair failed and we were unable to recover it. 00:30:09.680 [2024-07-13 10:16:15.385481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.385624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.385648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.680 qpair failed and we were unable to recover it. 00:30:09.680 [2024-07-13 10:16:15.385778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.385953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.385979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.680 qpair failed and we were unable to recover it. 00:30:09.680 [2024-07-13 10:16:15.386125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.386265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.386290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.680 qpair failed and we were unable to recover it. 00:30:09.680 [2024-07-13 10:16:15.386419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.680 [2024-07-13 10:16:15.386560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.386584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.681 qpair failed and we were unable to recover it. 00:30:09.681 [2024-07-13 10:16:15.386716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.386871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.386896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.681 qpair failed and we were unable to recover it. 00:30:09.681 [2024-07-13 10:16:15.387021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.387145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.387169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.681 qpair failed and we were unable to recover it. 00:30:09.681 [2024-07-13 10:16:15.387311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.387490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.387515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.681 qpair failed and we were unable to recover it. 00:30:09.681 [2024-07-13 10:16:15.387696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.387811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.387836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.681 qpair failed and we were unable to recover it. 00:30:09.681 [2024-07-13 10:16:15.387996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.388122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.388147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.681 qpair failed and we were unable to recover it. 00:30:09.681 [2024-07-13 10:16:15.388304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.388463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.388487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.681 qpair failed and we were unable to recover it. 00:30:09.681 [2024-07-13 10:16:15.388612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.388745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.388769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.681 qpair failed and we were unable to recover it. 00:30:09.681 [2024-07-13 10:16:15.388892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.389038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.389063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.681 qpair failed and we were unable to recover it. 00:30:09.681 [2024-07-13 10:16:15.389182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.389307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.389330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.681 qpair failed and we were unable to recover it. 00:30:09.681 [2024-07-13 10:16:15.389447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.389587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.389611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.681 qpair failed and we were unable to recover it. 00:30:09.681 [2024-07-13 10:16:15.389740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.389855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.389885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.681 qpair failed and we were unable to recover it. 00:30:09.681 [2024-07-13 10:16:15.390033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.390187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.390212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.681 qpair failed and we were unable to recover it. 00:30:09.681 [2024-07-13 10:16:15.390364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.390508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.390537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.681 qpair failed and we were unable to recover it. 00:30:09.681 [2024-07-13 10:16:15.390660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.390774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.390797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.681 qpair failed and we were unable to recover it. 00:30:09.681 [2024-07-13 10:16:15.390929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.391086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.391110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.681 qpair failed and we were unable to recover it. 00:30:09.681 [2024-07-13 10:16:15.391240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.391361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.391385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.681 qpair failed and we were unable to recover it. 00:30:09.681 [2024-07-13 10:16:15.391528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.391653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.391677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.681 qpair failed and we were unable to recover it. 00:30:09.681 [2024-07-13 10:16:15.391807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.391955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.391980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.681 qpair failed and we were unable to recover it. 00:30:09.681 [2024-07-13 10:16:15.392100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.392248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.392273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.681 qpair failed and we were unable to recover it. 00:30:09.681 [2024-07-13 10:16:15.392390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.392540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.392567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.681 qpair failed and we were unable to recover it. 00:30:09.681 [2024-07-13 10:16:15.392687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.392830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.392855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.681 qpair failed and we were unable to recover it. 00:30:09.681 [2024-07-13 10:16:15.392986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.393131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.393155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.681 qpair failed and we were unable to recover it. 00:30:09.681 [2024-07-13 10:16:15.393298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.393407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.393431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.681 qpair failed and we were unable to recover it. 00:30:09.681 [2024-07-13 10:16:15.393556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.393708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.393732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.681 qpair failed and we were unable to recover it. 00:30:09.681 [2024-07-13 10:16:15.393853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.393978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.394002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.681 qpair failed and we were unable to recover it. 00:30:09.681 [2024-07-13 10:16:15.394167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.394279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.394304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.681 qpair failed and we were unable to recover it. 00:30:09.681 [2024-07-13 10:16:15.394434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.394603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.394628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.681 qpair failed and we were unable to recover it. 00:30:09.681 [2024-07-13 10:16:15.394740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.394861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.394892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.681 qpair failed and we were unable to recover it. 00:30:09.681 [2024-07-13 10:16:15.395052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.395177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.395200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.681 qpair failed and we were unable to recover it. 00:30:09.681 [2024-07-13 10:16:15.395344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.395468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.681 [2024-07-13 10:16:15.395492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.681 qpair failed and we were unable to recover it. 00:30:09.682 [2024-07-13 10:16:15.395636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.395770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.395794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.682 qpair failed and we were unable to recover it. 00:30:09.682 [2024-07-13 10:16:15.395939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.396072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.396096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.682 qpair failed and we were unable to recover it. 00:30:09.682 [2024-07-13 10:16:15.396279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.396390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.396415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.682 qpair failed and we were unable to recover it. 00:30:09.682 [2024-07-13 10:16:15.396542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.396667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.396693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.682 qpair failed and we were unable to recover it. 00:30:09.682 [2024-07-13 10:16:15.396821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.396952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.396979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.682 qpair failed and we were unable to recover it. 00:30:09.682 [2024-07-13 10:16:15.397100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.397210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.397234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.682 qpair failed and we were unable to recover it. 00:30:09.682 [2024-07-13 10:16:15.397391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.397512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.397536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.682 qpair failed and we were unable to recover it. 00:30:09.682 [2024-07-13 10:16:15.397697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.397875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.397900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.682 qpair failed and we were unable to recover it. 00:30:09.682 [2024-07-13 10:16:15.398017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.398142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.398169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.682 qpair failed and we were unable to recover it. 00:30:09.682 [2024-07-13 10:16:15.398284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.398443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.398467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.682 qpair failed and we were unable to recover it. 00:30:09.682 [2024-07-13 10:16:15.398591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.398738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.398763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.682 qpair failed and we were unable to recover it. 00:30:09.682 [2024-07-13 10:16:15.398893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.399013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.399038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.682 qpair failed and we were unable to recover it. 00:30:09.682 [2024-07-13 10:16:15.399150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.399272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.399298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.682 qpair failed and we were unable to recover it. 00:30:09.682 [2024-07-13 10:16:15.399435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.399552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.399581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.682 qpair failed and we were unable to recover it. 00:30:09.682 [2024-07-13 10:16:15.399739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.399872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.399897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.682 qpair failed and we were unable to recover it. 00:30:09.682 [2024-07-13 10:16:15.400022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.400163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.400189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.682 qpair failed and we were unable to recover it. 00:30:09.682 [2024-07-13 10:16:15.400342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.400463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.400488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.682 qpair failed and we were unable to recover it. 00:30:09.682 [2024-07-13 10:16:15.400619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.400729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.400753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.682 qpair failed and we were unable to recover it. 00:30:09.682 [2024-07-13 10:16:15.400876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.401025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.401051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.682 qpair failed and we were unable to recover it. 00:30:09.682 [2024-07-13 10:16:15.401193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.401321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.401346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.682 qpair failed and we were unable to recover it. 00:30:09.682 [2024-07-13 10:16:15.401507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.401655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.401680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.682 qpair failed and we were unable to recover it. 00:30:09.682 [2024-07-13 10:16:15.401837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.401955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.401981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.682 qpair failed and we were unable to recover it. 00:30:09.682 [2024-07-13 10:16:15.402140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.402289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.402313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.682 qpair failed and we were unable to recover it. 00:30:09.682 [2024-07-13 10:16:15.402443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.402589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.402614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.682 qpair failed and we were unable to recover it. 00:30:09.682 [2024-07-13 10:16:15.402763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.402891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.402916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.682 qpair failed and we were unable to recover it. 00:30:09.682 [2024-07-13 10:16:15.403045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.403167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.403192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.682 qpair failed and we were unable to recover it. 00:30:09.682 [2024-07-13 10:16:15.403322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.403435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.403459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.682 qpair failed and we were unable to recover it. 00:30:09.682 [2024-07-13 10:16:15.403573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.403685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.403710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.682 qpair failed and we were unable to recover it. 00:30:09.682 [2024-07-13 10:16:15.403822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.403950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.403977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.682 qpair failed and we were unable to recover it. 00:30:09.682 [2024-07-13 10:16:15.404128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.404246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.404271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.682 qpair failed and we were unable to recover it. 00:30:09.682 [2024-07-13 10:16:15.404399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.682 [2024-07-13 10:16:15.404520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.404545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.683 qpair failed and we were unable to recover it. 00:30:09.683 [2024-07-13 10:16:15.404676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.404796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.404821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.683 qpair failed and we were unable to recover it. 00:30:09.683 [2024-07-13 10:16:15.404946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.405123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.405148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.683 qpair failed and we were unable to recover it. 00:30:09.683 [2024-07-13 10:16:15.405272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.405386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.405415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.683 qpair failed and we were unable to recover it. 00:30:09.683 [2024-07-13 10:16:15.405563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.405737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.405762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.683 qpair failed and we were unable to recover it. 00:30:09.683 [2024-07-13 10:16:15.405913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.406033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.406058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.683 qpair failed and we were unable to recover it. 00:30:09.683 [2024-07-13 10:16:15.406205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.406319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.406344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.683 qpair failed and we were unable to recover it. 00:30:09.683 [2024-07-13 10:16:15.406499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.406618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.406643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.683 qpair failed and we were unable to recover it. 00:30:09.683 [2024-07-13 10:16:15.406765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.406885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.406912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.683 qpair failed and we were unable to recover it. 00:30:09.683 [2024-07-13 10:16:15.407038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.407212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.407237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.683 qpair failed and we were unable to recover it. 00:30:09.683 [2024-07-13 10:16:15.407355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.407479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.407504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.683 qpair failed and we were unable to recover it. 00:30:09.683 [2024-07-13 10:16:15.407618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.407764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.407790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.683 qpair failed and we were unable to recover it. 00:30:09.683 [2024-07-13 10:16:15.407948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.408091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.408115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.683 qpair failed and we were unable to recover it. 00:30:09.683 [2024-07-13 10:16:15.408267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.408385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.408409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.683 qpair failed and we were unable to recover it. 00:30:09.683 [2024-07-13 10:16:15.408535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.408702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.408727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.683 qpair failed and we were unable to recover it. 00:30:09.683 [2024-07-13 10:16:15.408853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.408976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.409002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.683 qpair failed and we were unable to recover it. 00:30:09.683 [2024-07-13 10:16:15.409131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.409291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.409316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.683 qpair failed and we were unable to recover it. 00:30:09.683 [2024-07-13 10:16:15.409465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.409617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.409642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.683 qpair failed and we were unable to recover it. 00:30:09.683 [2024-07-13 10:16:15.409772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.409891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.409918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.683 qpair failed and we were unable to recover it. 00:30:09.683 [2024-07-13 10:16:15.410037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.410163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.410188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.683 qpair failed and we were unable to recover it. 00:30:09.683 [2024-07-13 10:16:15.410325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.410478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.410513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.683 qpair failed and we were unable to recover it. 00:30:09.683 [2024-07-13 10:16:15.410627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.410761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.410785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.683 qpair failed and we were unable to recover it. 00:30:09.683 [2024-07-13 10:16:15.410958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.411076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.411100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.683 qpair failed and we were unable to recover it. 00:30:09.683 [2024-07-13 10:16:15.411216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.411357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.411382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.683 qpair failed and we were unable to recover it. 00:30:09.683 [2024-07-13 10:16:15.411541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.411657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.411682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.683 qpair failed and we were unable to recover it. 00:30:09.683 [2024-07-13 10:16:15.411806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.411983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.683 [2024-07-13 10:16:15.412009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.683 qpair failed and we were unable to recover it. 00:30:09.683 [2024-07-13 10:16:15.412140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.412281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.412306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.684 qpair failed and we were unable to recover it. 00:30:09.684 [2024-07-13 10:16:15.412436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.412546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.412571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.684 qpair failed and we were unable to recover it. 00:30:09.684 [2024-07-13 10:16:15.412683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.412858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.412889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.684 qpair failed and we were unable to recover it. 00:30:09.684 [2024-07-13 10:16:15.413012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.413122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.413146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.684 qpair failed and we were unable to recover it. 00:30:09.684 [2024-07-13 10:16:15.413291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.413449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.413474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.684 qpair failed and we were unable to recover it. 00:30:09.684 [2024-07-13 10:16:15.413596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.413711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.413735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.684 qpair failed and we were unable to recover it. 00:30:09.684 [2024-07-13 10:16:15.413883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.413999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.414023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.684 qpair failed and we were unable to recover it. 00:30:09.684 [2024-07-13 10:16:15.414170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.414318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.414348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.684 qpair failed and we were unable to recover it. 00:30:09.684 [2024-07-13 10:16:15.414482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.414625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.414650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.684 qpair failed and we were unable to recover it. 00:30:09.684 [2024-07-13 10:16:15.414763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.414925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.414951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.684 qpair failed and we were unable to recover it. 00:30:09.684 [2024-07-13 10:16:15.415107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.415237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.415262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.684 qpair failed and we were unable to recover it. 00:30:09.684 [2024-07-13 10:16:15.415440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.415567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.415591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.684 qpair failed and we were unable to recover it. 00:30:09.684 [2024-07-13 10:16:15.415741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.415893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.415919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.684 qpair failed and we were unable to recover it. 00:30:09.684 [2024-07-13 10:16:15.416046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.416187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.416211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.684 qpair failed and we were unable to recover it. 00:30:09.684 [2024-07-13 10:16:15.416352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.416462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.416487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.684 qpair failed and we were unable to recover it. 00:30:09.684 [2024-07-13 10:16:15.416643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.416764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.416790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.684 qpair failed and we were unable to recover it. 00:30:09.684 [2024-07-13 10:16:15.416921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.417065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.417090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.684 qpair failed and we were unable to recover it. 00:30:09.684 [2024-07-13 10:16:15.417236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.417370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.417394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.684 qpair failed and we were unable to recover it. 00:30:09.684 [2024-07-13 10:16:15.417548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.417680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.417705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.684 qpair failed and we were unable to recover it. 00:30:09.684 [2024-07-13 10:16:15.417846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.417974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.417999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.684 qpair failed and we were unable to recover it. 00:30:09.684 [2024-07-13 10:16:15.418145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.418296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.418330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.684 qpair failed and we were unable to recover it. 00:30:09.684 [2024-07-13 10:16:15.418482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.418615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.418650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.684 qpair failed and we were unable to recover it. 00:30:09.684 [2024-07-13 10:16:15.418800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.418927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.418953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.684 qpair failed and we were unable to recover it. 00:30:09.684 [2024-07-13 10:16:15.419111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.419265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.419290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.684 qpair failed and we were unable to recover it. 00:30:09.684 [2024-07-13 10:16:15.419434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.419562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.419589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.684 qpair failed and we were unable to recover it. 00:30:09.684 [2024-07-13 10:16:15.419713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.419843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.419885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.684 qpair failed and we were unable to recover it. 00:30:09.684 [2024-07-13 10:16:15.420004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.420165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.420191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.684 qpair failed and we were unable to recover it. 00:30:09.684 [2024-07-13 10:16:15.420349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.420469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.420493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.684 qpair failed and we were unable to recover it. 00:30:09.684 [2024-07-13 10:16:15.420635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.420783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.420811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.684 qpair failed and we were unable to recover it. 00:30:09.684 [2024-07-13 10:16:15.420967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.421093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.421118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.684 qpair failed and we were unable to recover it. 00:30:09.684 [2024-07-13 10:16:15.421252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.684 [2024-07-13 10:16:15.421392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.421417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.685 qpair failed and we were unable to recover it. 00:30:09.685 [2024-07-13 10:16:15.421531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.421685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.421711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.685 qpair failed and we were unable to recover it. 00:30:09.685 [2024-07-13 10:16:15.421879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.422025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.422049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.685 qpair failed and we were unable to recover it. 00:30:09.685 [2024-07-13 10:16:15.422175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.422295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.422319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.685 qpair failed and we were unable to recover it. 00:30:09.685 [2024-07-13 10:16:15.422435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.422573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.422597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.685 qpair failed and we were unable to recover it. 00:30:09.685 [2024-07-13 10:16:15.422729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.422875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.422901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.685 qpair failed and we were unable to recover it. 00:30:09.685 [2024-07-13 10:16:15.423031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.423207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.423232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.685 qpair failed and we were unable to recover it. 00:30:09.685 [2024-07-13 10:16:15.423366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.423481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.423513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.685 qpair failed and we were unable to recover it. 00:30:09.685 [2024-07-13 10:16:15.423638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.423809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.423838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.685 qpair failed and we were unable to recover it. 00:30:09.685 [2024-07-13 10:16:15.424006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.424146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.424180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.685 qpair failed and we were unable to recover it. 00:30:09.685 [2024-07-13 10:16:15.424304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.424418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.424444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.685 qpair failed and we were unable to recover it. 00:30:09.685 [2024-07-13 10:16:15.424592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.424782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.424808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.685 qpair failed and we were unable to recover it. 00:30:09.685 [2024-07-13 10:16:15.424945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.425062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.425087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.685 qpair failed and we were unable to recover it. 00:30:09.685 [2024-07-13 10:16:15.425232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.425346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.425370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.685 qpair failed and we were unable to recover it. 00:30:09.685 [2024-07-13 10:16:15.425528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.425638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.425662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.685 qpair failed and we were unable to recover it. 00:30:09.685 [2024-07-13 10:16:15.425803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.425940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.425966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.685 qpair failed and we were unable to recover it. 00:30:09.685 [2024-07-13 10:16:15.426121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.426252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.426277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.685 qpair failed and we were unable to recover it. 00:30:09.685 [2024-07-13 10:16:15.426406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.426519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.426544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.685 qpair failed and we were unable to recover it. 00:30:09.685 [2024-07-13 10:16:15.426675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.426812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.426837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.685 qpair failed and we were unable to recover it. 00:30:09.685 [2024-07-13 10:16:15.426978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.427089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.427113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.685 qpair failed and we were unable to recover it. 00:30:09.685 [2024-07-13 10:16:15.427313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.427486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.427510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.685 qpair failed and we were unable to recover it. 00:30:09.685 [2024-07-13 10:16:15.427642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.427755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.427780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.685 qpair failed and we were unable to recover it. 00:30:09.685 [2024-07-13 10:16:15.427937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.428058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.428082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.685 qpair failed and we were unable to recover it. 00:30:09.685 [2024-07-13 10:16:15.428238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.428384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.428409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.685 qpair failed and we were unable to recover it. 00:30:09.685 [2024-07-13 10:16:15.428568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.428715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.428740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.685 qpair failed and we were unable to recover it. 00:30:09.685 [2024-07-13 10:16:15.428872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.428993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.429019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.685 qpair failed and we were unable to recover it. 00:30:09.685 [2024-07-13 10:16:15.429145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.429281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.429306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.685 qpair failed and we were unable to recover it. 00:30:09.685 [2024-07-13 10:16:15.429465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.429641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.429665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.685 qpair failed and we were unable to recover it. 00:30:09.685 [2024-07-13 10:16:15.429780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.429899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.429924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.685 qpair failed and we were unable to recover it. 00:30:09.685 [2024-07-13 10:16:15.430049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.430205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.430231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.685 qpair failed and we were unable to recover it. 00:30:09.685 [2024-07-13 10:16:15.430373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.430517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.685 [2024-07-13 10:16:15.430543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.685 qpair failed and we were unable to recover it. 00:30:09.685 [2024-07-13 10:16:15.430682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.430805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.430829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.686 qpair failed and we were unable to recover it. 00:30:09.686 [2024-07-13 10:16:15.430962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.431105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.431130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.686 qpair failed and we were unable to recover it. 00:30:09.686 [2024-07-13 10:16:15.431313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.431438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.431462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.686 qpair failed and we were unable to recover it. 00:30:09.686 [2024-07-13 10:16:15.431617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.431741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.431765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.686 qpair failed and we were unable to recover it. 00:30:09.686 [2024-07-13 10:16:15.431924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.432042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.432067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.686 qpair failed and we were unable to recover it. 00:30:09.686 [2024-07-13 10:16:15.432192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.432344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.432369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.686 qpair failed and we were unable to recover it. 00:30:09.686 [2024-07-13 10:16:15.432494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.432619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.432644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.686 qpair failed and we were unable to recover it. 00:30:09.686 [2024-07-13 10:16:15.432794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.432915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.432940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.686 qpair failed and we were unable to recover it. 00:30:09.686 [2024-07-13 10:16:15.433075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.433255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.433280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.686 qpair failed and we were unable to recover it. 00:30:09.686 [2024-07-13 10:16:15.433429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.433572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.433597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.686 qpair failed and we were unable to recover it. 00:30:09.686 [2024-07-13 10:16:15.433730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.433890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.433916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.686 qpair failed and we were unable to recover it. 00:30:09.686 [2024-07-13 10:16:15.434065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.434185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.434210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.686 qpair failed and we were unable to recover it. 00:30:09.686 [2024-07-13 10:16:15.434389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.434510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.434535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.686 qpair failed and we were unable to recover it. 00:30:09.686 [2024-07-13 10:16:15.434649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.434796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.434821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.686 qpair failed and we were unable to recover it. 00:30:09.686 [2024-07-13 10:16:15.434976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.435120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.435145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.686 qpair failed and we were unable to recover it. 00:30:09.686 [2024-07-13 10:16:15.435336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.435459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.435484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.686 qpair failed and we were unable to recover it. 00:30:09.686 [2024-07-13 10:16:15.435596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.435744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.435768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.686 qpair failed and we were unable to recover it. 00:30:09.686 [2024-07-13 10:16:15.435918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.436059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.436084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.686 qpair failed and we were unable to recover it. 00:30:09.686 [2024-07-13 10:16:15.436236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.436367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.436391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.686 qpair failed and we were unable to recover it. 00:30:09.686 [2024-07-13 10:16:15.436519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.436628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.436653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.686 qpair failed and we were unable to recover it. 00:30:09.686 [2024-07-13 10:16:15.436817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.436964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.436990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.686 qpair failed and we were unable to recover it. 00:30:09.686 [2024-07-13 10:16:15.437121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.437254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.437280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.686 qpair failed and we were unable to recover it. 00:30:09.686 [2024-07-13 10:16:15.437427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.437598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.437623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.686 qpair failed and we were unable to recover it. 00:30:09.686 [2024-07-13 10:16:15.437780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.437900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.437926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.686 qpair failed and we were unable to recover it. 00:30:09.686 [2024-07-13 10:16:15.438061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.438205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.438229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.686 qpair failed and we were unable to recover it. 00:30:09.686 [2024-07-13 10:16:15.438357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.438502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.438528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.686 qpair failed and we were unable to recover it. 00:30:09.686 [2024-07-13 10:16:15.438670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.438826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.438851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.686 qpair failed and we were unable to recover it. 00:30:09.686 [2024-07-13 10:16:15.438986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.439117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.439141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.686 qpair failed and we were unable to recover it. 00:30:09.686 [2024-07-13 10:16:15.439272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.439398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.439428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.686 qpair failed and we were unable to recover it. 00:30:09.686 [2024-07-13 10:16:15.439587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.439725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.439750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.686 qpair failed and we were unable to recover it. 00:30:09.686 [2024-07-13 10:16:15.439870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.686 [2024-07-13 10:16:15.439984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.440009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.687 qpair failed and we were unable to recover it. 00:30:09.687 [2024-07-13 10:16:15.440132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.440276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.440301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.687 qpair failed and we were unable to recover it. 00:30:09.687 [2024-07-13 10:16:15.440467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.440624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.440649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.687 qpair failed and we were unable to recover it. 00:30:09.687 [2024-07-13 10:16:15.440801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.440927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.440952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.687 qpair failed and we were unable to recover it. 00:30:09.687 [2024-07-13 10:16:15.441081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.441225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.441250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.687 qpair failed and we were unable to recover it. 00:30:09.687 [2024-07-13 10:16:15.441381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.441508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.441532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.687 qpair failed and we were unable to recover it. 00:30:09.687 [2024-07-13 10:16:15.441713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.441847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.441884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.687 qpair failed and we were unable to recover it. 00:30:09.687 [2024-07-13 10:16:15.442027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.442198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.442223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.687 qpair failed and we were unable to recover it. 00:30:09.687 [2024-07-13 10:16:15.442366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.442508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.442532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.687 qpair failed and we were unable to recover it. 00:30:09.687 [2024-07-13 10:16:15.442662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.442818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.442842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.687 qpair failed and we were unable to recover it. 00:30:09.687 [2024-07-13 10:16:15.442974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.443105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.443129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.687 qpair failed and we were unable to recover it. 00:30:09.687 [2024-07-13 10:16:15.443246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.443390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.443427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.687 qpair failed and we were unable to recover it. 00:30:09.687 [2024-07-13 10:16:15.443591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.443756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.443782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.687 qpair failed and we were unable to recover it. 00:30:09.687 [2024-07-13 10:16:15.443912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.444036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.444060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.687 qpair failed and we were unable to recover it. 00:30:09.687 [2024-07-13 10:16:15.444181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.444323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.444348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.687 qpair failed and we were unable to recover it. 00:30:09.687 [2024-07-13 10:16:15.444475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.444596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.444621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.687 qpair failed and we were unable to recover it. 00:30:09.687 [2024-07-13 10:16:15.444740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.444855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.444892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.687 qpair failed and we were unable to recover it. 00:30:09.687 [2024-07-13 10:16:15.445043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.445168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.445193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.687 qpair failed and we were unable to recover it. 00:30:09.687 [2024-07-13 10:16:15.445339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.445488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.445514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.687 qpair failed and we were unable to recover it. 00:30:09.687 [2024-07-13 10:16:15.445666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.445776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.445812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.687 qpair failed and we were unable to recover it. 00:30:09.687 [2024-07-13 10:16:15.445960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.446100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.446126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.687 qpair failed and we were unable to recover it. 00:30:09.687 [2024-07-13 10:16:15.446273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.446423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.446447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.687 qpair failed and we were unable to recover it. 00:30:09.687 [2024-07-13 10:16:15.446568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.446679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.446707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.687 qpair failed and we were unable to recover it. 00:30:09.687 [2024-07-13 10:16:15.446877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.447020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.447045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.687 qpair failed and we were unable to recover it. 00:30:09.687 [2024-07-13 10:16:15.447159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.447343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.447367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.687 qpair failed and we were unable to recover it. 00:30:09.687 [2024-07-13 10:16:15.447528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.447707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.447733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.687 qpair failed and we were unable to recover it. 00:30:09.687 [2024-07-13 10:16:15.447882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.448036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.687 [2024-07-13 10:16:15.448062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.687 qpair failed and we were unable to recover it. 00:30:09.687 [2024-07-13 10:16:15.448182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.448302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.448328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.972 qpair failed and we were unable to recover it. 00:30:09.972 [2024-07-13 10:16:15.448486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.448631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.448657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.972 qpair failed and we were unable to recover it. 00:30:09.972 [2024-07-13 10:16:15.448791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.448951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.448977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.972 qpair failed and we were unable to recover it. 00:30:09.972 [2024-07-13 10:16:15.449127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.449280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.449305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.972 qpair failed and we were unable to recover it. 00:30:09.972 [2024-07-13 10:16:15.449426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.449542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.449571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.972 qpair failed and we were unable to recover it. 00:30:09.972 [2024-07-13 10:16:15.449698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.449824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.449857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.972 qpair failed and we were unable to recover it. 00:30:09.972 [2024-07-13 10:16:15.449988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.450141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.450167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.972 qpair failed and we were unable to recover it. 00:30:09.972 [2024-07-13 10:16:15.450283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.450410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.450436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.972 qpair failed and we were unable to recover it. 00:30:09.972 [2024-07-13 10:16:15.450561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.450709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.450736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.972 qpair failed and we were unable to recover it. 00:30:09.972 [2024-07-13 10:16:15.450888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.451009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.451034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.972 qpair failed and we were unable to recover it. 00:30:09.972 [2024-07-13 10:16:15.451151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.451269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.451300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.972 qpair failed and we were unable to recover it. 00:30:09.972 [2024-07-13 10:16:15.451431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.451582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.451623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.972 qpair failed and we were unable to recover it. 00:30:09.972 [2024-07-13 10:16:15.451769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.451929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.451956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.972 qpair failed and we were unable to recover it. 00:30:09.972 [2024-07-13 10:16:15.452112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.452266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.452292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.972 qpair failed and we were unable to recover it. 00:30:09.972 [2024-07-13 10:16:15.452475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.452612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.452637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.972 qpair failed and we were unable to recover it. 00:30:09.972 [2024-07-13 10:16:15.452781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.452903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.452928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.972 qpair failed and we were unable to recover it. 00:30:09.972 [2024-07-13 10:16:15.453056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.453193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.453218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.972 qpair failed and we were unable to recover it. 00:30:09.972 [2024-07-13 10:16:15.453340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.453489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.453513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.972 qpair failed and we were unable to recover it. 00:30:09.972 [2024-07-13 10:16:15.453645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.453801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.453826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.972 qpair failed and we were unable to recover it. 00:30:09.972 [2024-07-13 10:16:15.453992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.454150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.454175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.972 qpair failed and we were unable to recover it. 00:30:09.972 [2024-07-13 10:16:15.454323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.454479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.454504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.972 qpair failed and we were unable to recover it. 00:30:09.972 [2024-07-13 10:16:15.454679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.454832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.454872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.972 qpair failed and we were unable to recover it. 00:30:09.972 [2024-07-13 10:16:15.454995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.455110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.455140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.972 qpair failed and we were unable to recover it. 00:30:09.972 [2024-07-13 10:16:15.455307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.455452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.455477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.972 qpair failed and we were unable to recover it. 00:30:09.972 [2024-07-13 10:16:15.455608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.455753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.455777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.972 qpair failed and we were unable to recover it. 00:30:09.972 [2024-07-13 10:16:15.455907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.456024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.972 [2024-07-13 10:16:15.456049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.973 qpair failed and we were unable to recover it. 00:30:09.973 [2024-07-13 10:16:15.456176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.456324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.456349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.973 qpair failed and we were unable to recover it. 00:30:09.973 [2024-07-13 10:16:15.456528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.456646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.456671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.973 qpair failed and we were unable to recover it. 00:30:09.973 [2024-07-13 10:16:15.456800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.456953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.456979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.973 qpair failed and we were unable to recover it. 00:30:09.973 [2024-07-13 10:16:15.457104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.457223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.457248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.973 qpair failed and we were unable to recover it. 00:30:09.973 [2024-07-13 10:16:15.457369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.457513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.457538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.973 qpair failed and we were unable to recover it. 00:30:09.973 [2024-07-13 10:16:15.457687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.457812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.457836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.973 qpair failed and we were unable to recover it. 00:30:09.973 [2024-07-13 10:16:15.457968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.458122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.458146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.973 qpair failed and we were unable to recover it. 00:30:09.973 [2024-07-13 10:16:15.458284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.458413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.458438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.973 qpair failed and we were unable to recover it. 00:30:09.973 [2024-07-13 10:16:15.458580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.458702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.458727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.973 qpair failed and we were unable to recover it. 00:30:09.973 [2024-07-13 10:16:15.458876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.459011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.459036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.973 qpair failed and we were unable to recover it. 00:30:09.973 [2024-07-13 10:16:15.459180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.459296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.459321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.973 qpair failed and we were unable to recover it. 00:30:09.973 [2024-07-13 10:16:15.459465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.459594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.459625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.973 qpair failed and we were unable to recover it. 00:30:09.973 [2024-07-13 10:16:15.459752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.459892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.459917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.973 qpair failed and we were unable to recover it. 00:30:09.973 [2024-07-13 10:16:15.460069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.460225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.460250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.973 qpair failed and we were unable to recover it. 00:30:09.973 [2024-07-13 10:16:15.460409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.460537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.460562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.973 qpair failed and we were unable to recover it. 00:30:09.973 [2024-07-13 10:16:15.460712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.460834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.460873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.973 qpair failed and we were unable to recover it. 00:30:09.973 [2024-07-13 10:16:15.461000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.461132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.461156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.973 qpair failed and we were unable to recover it. 00:30:09.973 [2024-07-13 10:16:15.461316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.461467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.461491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.973 qpair failed and we were unable to recover it. 00:30:09.973 [2024-07-13 10:16:15.461617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.461736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.461761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.973 qpair failed and we were unable to recover it. 00:30:09.973 [2024-07-13 10:16:15.461919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.462042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.462068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.973 qpair failed and we were unable to recover it. 00:30:09.973 [2024-07-13 10:16:15.462214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.462350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.462375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.973 qpair failed and we were unable to recover it. 00:30:09.973 [2024-07-13 10:16:15.462520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.462670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.462694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.973 qpair failed and we were unable to recover it. 00:30:09.973 [2024-07-13 10:16:15.462834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.462991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.463015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.973 qpair failed and we were unable to recover it. 00:30:09.973 [2024-07-13 10:16:15.463163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.463298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.463323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.973 qpair failed and we were unable to recover it. 00:30:09.973 [2024-07-13 10:16:15.463436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.463599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.463625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.973 qpair failed and we were unable to recover it. 00:30:09.973 [2024-07-13 10:16:15.463754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.463879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.463904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.973 qpair failed and we were unable to recover it. 00:30:09.973 [2024-07-13 10:16:15.464058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.464185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.464210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.973 qpair failed and we were unable to recover it. 00:30:09.973 [2024-07-13 10:16:15.464360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.464517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.464542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.973 qpair failed and we were unable to recover it. 00:30:09.973 [2024-07-13 10:16:15.464679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.464830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.464870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.973 qpair failed and we were unable to recover it. 00:30:09.973 [2024-07-13 10:16:15.464999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.465116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.465141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.973 qpair failed and we were unable to recover it. 00:30:09.973 [2024-07-13 10:16:15.465342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.465484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.465508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.973 qpair failed and we were unable to recover it. 00:30:09.973 [2024-07-13 10:16:15.465632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.465764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.465788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.973 qpair failed and we were unable to recover it. 00:30:09.973 [2024-07-13 10:16:15.465964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.466110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.466135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.973 qpair failed and we were unable to recover it. 00:30:09.973 [2024-07-13 10:16:15.466277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.466392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.466417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.973 qpair failed and we were unable to recover it. 00:30:09.973 [2024-07-13 10:16:15.466574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.466721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.466745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.973 qpair failed and we were unable to recover it. 00:30:09.973 [2024-07-13 10:16:15.466891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.467037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.467062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.973 qpair failed and we were unable to recover it. 00:30:09.973 [2024-07-13 10:16:15.467206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.467380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.467405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.973 qpair failed and we were unable to recover it. 00:30:09.973 [2024-07-13 10:16:15.467552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.467689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.467714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.973 qpair failed and we were unable to recover it. 00:30:09.973 [2024-07-13 10:16:15.467839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.467978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.468003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.973 qpair failed and we were unable to recover it. 00:30:09.973 [2024-07-13 10:16:15.468173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.973 [2024-07-13 10:16:15.468324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.468349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.974 qpair failed and we were unable to recover it. 00:30:09.974 [2024-07-13 10:16:15.468511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.468627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.468651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.974 qpair failed and we were unable to recover it. 00:30:09.974 [2024-07-13 10:16:15.468797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.468935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.468962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.974 qpair failed and we were unable to recover it. 00:30:09.974 [2024-07-13 10:16:15.469090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.469246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.469271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.974 qpair failed and we were unable to recover it. 00:30:09.974 [2024-07-13 10:16:15.469392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.469537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.469561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.974 qpair failed and we were unable to recover it. 00:30:09.974 [2024-07-13 10:16:15.469687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.469810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.469834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.974 qpair failed and we were unable to recover it. 00:30:09.974 [2024-07-13 10:16:15.470029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.470143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.470167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.974 qpair failed and we were unable to recover it. 00:30:09.974 [2024-07-13 10:16:15.470295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.470422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.470446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.974 qpair failed and we were unable to recover it. 00:30:09.974 [2024-07-13 10:16:15.470579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.470697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.470725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.974 qpair failed and we were unable to recover it. 00:30:09.974 [2024-07-13 10:16:15.470900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.471044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.471069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.974 qpair failed and we were unable to recover it. 00:30:09.974 [2024-07-13 10:16:15.471228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.471386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.471411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.974 qpair failed and we were unable to recover it. 00:30:09.974 [2024-07-13 10:16:15.471537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.471662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.471688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.974 qpair failed and we were unable to recover it. 00:30:09.974 [2024-07-13 10:16:15.471816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.471939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.471964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.974 qpair failed and we were unable to recover it. 00:30:09.974 [2024-07-13 10:16:15.472108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.472272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.472297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.974 qpair failed and we were unable to recover it. 00:30:09.974 [2024-07-13 10:16:15.472441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.472585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.472610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.974 qpair failed and we were unable to recover it. 00:30:09.974 [2024-07-13 10:16:15.472750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.472903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.472929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.974 qpair failed and we were unable to recover it. 00:30:09.974 [2024-07-13 10:16:15.473057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.473197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.473223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.974 qpair failed and we were unable to recover it. 00:30:09.974 [2024-07-13 10:16:15.473372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.473501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.473526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.974 qpair failed and we were unable to recover it. 00:30:09.974 [2024-07-13 10:16:15.473640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.473763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.473794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.974 qpair failed and we were unable to recover it. 00:30:09.974 [2024-07-13 10:16:15.473921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.474064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.474090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.974 qpair failed and we were unable to recover it. 00:30:09.974 [2024-07-13 10:16:15.474223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.474350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.474375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.974 qpair failed and we were unable to recover it. 00:30:09.974 [2024-07-13 10:16:15.474493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.474642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.474667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.974 qpair failed and we were unable to recover it. 00:30:09.974 [2024-07-13 10:16:15.474797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.474927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.474953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.974 qpair failed and we were unable to recover it. 00:30:09.974 [2024-07-13 10:16:15.475078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.475224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.475259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.974 qpair failed and we were unable to recover it. 00:30:09.974 [2024-07-13 10:16:15.475420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.475561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.475598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.974 qpair failed and we were unable to recover it. 00:30:09.974 [2024-07-13 10:16:15.475742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.475874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.475900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.974 qpair failed and we were unable to recover it. 00:30:09.974 [2024-07-13 10:16:15.476038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.476174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.476199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.974 qpair failed and we were unable to recover it. 00:30:09.974 [2024-07-13 10:16:15.476371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.476498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.476523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.974 qpair failed and we were unable to recover it. 00:30:09.974 [2024-07-13 10:16:15.476671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.476821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.476847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.974 qpair failed and we were unable to recover it. 00:30:09.974 [2024-07-13 10:16:15.477026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.477141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.477167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.974 qpair failed and we were unable to recover it. 00:30:09.974 [2024-07-13 10:16:15.477300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.477419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.477444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.974 qpair failed and we were unable to recover it. 00:30:09.974 [2024-07-13 10:16:15.477592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.477723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.477748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.974 qpair failed and we were unable to recover it. 00:30:09.974 [2024-07-13 10:16:15.477863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.478015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.478041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.974 qpair failed and we were unable to recover it. 00:30:09.974 [2024-07-13 10:16:15.478195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.478347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.478373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.974 qpair failed and we were unable to recover it. 00:30:09.974 [2024-07-13 10:16:15.478490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.478617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.478642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.974 qpair failed and we were unable to recover it. 00:30:09.974 [2024-07-13 10:16:15.478768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.478897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.478923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.974 qpair failed and we were unable to recover it. 00:30:09.974 [2024-07-13 10:16:15.479069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.479224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.479250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.974 qpair failed and we were unable to recover it. 00:30:09.974 [2024-07-13 10:16:15.479373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.479492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.479518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.974 qpair failed and we were unable to recover it. 00:30:09.974 [2024-07-13 10:16:15.479683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.479797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.479822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.974 qpair failed and we were unable to recover it. 00:30:09.974 [2024-07-13 10:16:15.479948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.480060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.480086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.974 qpair failed and we were unable to recover it. 00:30:09.974 [2024-07-13 10:16:15.480251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.480387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.480412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.974 qpair failed and we were unable to recover it. 00:30:09.974 [2024-07-13 10:16:15.480534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.974 [2024-07-13 10:16:15.480690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.480715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.975 qpair failed and we were unable to recover it. 00:30:09.975 [2024-07-13 10:16:15.480859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.480988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.481013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.975 qpair failed and we were unable to recover it. 00:30:09.975 [2024-07-13 10:16:15.481143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.481327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.481352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.975 qpair failed and we were unable to recover it. 00:30:09.975 [2024-07-13 10:16:15.481480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.481625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.481650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.975 qpair failed and we were unable to recover it. 00:30:09.975 [2024-07-13 10:16:15.481799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.481934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.481960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.975 qpair failed and we were unable to recover it. 00:30:09.975 [2024-07-13 10:16:15.482089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.482244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.482269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.975 qpair failed and we were unable to recover it. 00:30:09.975 [2024-07-13 10:16:15.482395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.482552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.482577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.975 qpair failed and we were unable to recover it. 00:30:09.975 [2024-07-13 10:16:15.482707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.482825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.482850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.975 qpair failed and we were unable to recover it. 00:30:09.975 [2024-07-13 10:16:15.482990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.483129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.483154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.975 qpair failed and we were unable to recover it. 00:30:09.975 [2024-07-13 10:16:15.483273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.483413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.483438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.975 qpair failed and we were unable to recover it. 00:30:09.975 [2024-07-13 10:16:15.483585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.483704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.483729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.975 qpair failed and we were unable to recover it. 00:30:09.975 [2024-07-13 10:16:15.483843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.484004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.484030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.975 qpair failed and we were unable to recover it. 00:30:09.975 [2024-07-13 10:16:15.484158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.484280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.484304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.975 qpair failed and we were unable to recover it. 00:30:09.975 [2024-07-13 10:16:15.484421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.484545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.484569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.975 qpair failed and we were unable to recover it. 00:30:09.975 [2024-07-13 10:16:15.484714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.484841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.484881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.975 qpair failed and we were unable to recover it. 00:30:09.975 [2024-07-13 10:16:15.485002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.485125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.485151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.975 qpair failed and we were unable to recover it. 00:30:09.975 [2024-07-13 10:16:15.485284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.485406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.485431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.975 qpair failed and we were unable to recover it. 00:30:09.975 [2024-07-13 10:16:15.485554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.485700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.485726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.975 qpair failed and we were unable to recover it. 00:30:09.975 [2024-07-13 10:16:15.485843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.486032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.486058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.975 qpair failed and we were unable to recover it. 00:30:09.975 [2024-07-13 10:16:15.486215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.486363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.486395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.975 qpair failed and we were unable to recover it. 00:30:09.975 [2024-07-13 10:16:15.486551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.486727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.486752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.975 qpair failed and we were unable to recover it. 00:30:09.975 [2024-07-13 10:16:15.486930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.487058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.487085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.975 qpair failed and we were unable to recover it. 00:30:09.975 [2024-07-13 10:16:15.487264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.487406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.975 [2024-07-13 10:16:15.487431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.976 qpair failed and we were unable to recover it. 00:30:09.976 [2024-07-13 10:16:15.487555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.976 [2024-07-13 10:16:15.487736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.976 [2024-07-13 10:16:15.487760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.976 qpair failed and we were unable to recover it. 00:30:09.976 [2024-07-13 10:16:15.487905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.976 [2024-07-13 10:16:15.488050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.976 [2024-07-13 10:16:15.488074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.976 qpair failed and we were unable to recover it. 00:30:09.976 [2024-07-13 10:16:15.488227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.976 [2024-07-13 10:16:15.488342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.976 [2024-07-13 10:16:15.488378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.976 qpair failed and we were unable to recover it. 00:30:09.976 [2024-07-13 10:16:15.488504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.976 [2024-07-13 10:16:15.488654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.976 [2024-07-13 10:16:15.488680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.976 qpair failed and we were unable to recover it. 00:30:09.976 [2024-07-13 10:16:15.488798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.976 [2024-07-13 10:16:15.488947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.976 [2024-07-13 10:16:15.488972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.976 qpair failed and we were unable to recover it. 00:30:09.976 [2024-07-13 10:16:15.489097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.976 [2024-07-13 10:16:15.489253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.976 [2024-07-13 10:16:15.489282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.976 qpair failed and we were unable to recover it. 00:30:09.976 [2024-07-13 10:16:15.489409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.976 [2024-07-13 10:16:15.489540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.976 [2024-07-13 10:16:15.489576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.976 qpair failed and we were unable to recover it. 00:30:09.976 [2024-07-13 10:16:15.489711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.976 [2024-07-13 10:16:15.489819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.976 [2024-07-13 10:16:15.489843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.976 qpair failed and we were unable to recover it. 00:30:09.976 [2024-07-13 10:16:15.490010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.976 [2024-07-13 10:16:15.490153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.976 [2024-07-13 10:16:15.490188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.976 qpair failed and we were unable to recover it. 00:30:09.976 [2024-07-13 10:16:15.490338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.976 [2024-07-13 10:16:15.490470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.976 [2024-07-13 10:16:15.490495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.976 qpair failed and we were unable to recover it. 00:30:09.976 [2024-07-13 10:16:15.490646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.976 [2024-07-13 10:16:15.490819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.976 [2024-07-13 10:16:15.490844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.976 qpair failed and we were unable to recover it. 00:30:09.976 [2024-07-13 10:16:15.491013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.976 [2024-07-13 10:16:15.491129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.976 [2024-07-13 10:16:15.491153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.976 qpair failed and we were unable to recover it. 00:30:09.976 [2024-07-13 10:16:15.491271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.976 [2024-07-13 10:16:15.491426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.491451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.977 qpair failed and we were unable to recover it. 00:30:09.977 [2024-07-13 10:16:15.491575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.491684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.491710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.977 qpair failed and we were unable to recover it. 00:30:09.977 [2024-07-13 10:16:15.491862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.491985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.492011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.977 qpair failed and we were unable to recover it. 00:30:09.977 [2024-07-13 10:16:15.492142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.492288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.492313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.977 qpair failed and we were unable to recover it. 00:30:09.977 [2024-07-13 10:16:15.492451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.492574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.492599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.977 qpair failed and we were unable to recover it. 00:30:09.977 [2024-07-13 10:16:15.492776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.492900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.492926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.977 qpair failed and we were unable to recover it. 00:30:09.977 [2024-07-13 10:16:15.493044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.493170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.493201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.977 qpair failed and we were unable to recover it. 00:30:09.977 [2024-07-13 10:16:15.493337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.493480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.493505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.977 qpair failed and we were unable to recover it. 00:30:09.977 [2024-07-13 10:16:15.493655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.493808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.493834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.977 qpair failed and we were unable to recover it. 00:30:09.977 [2024-07-13 10:16:15.493994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.494118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.494142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.977 qpair failed and we were unable to recover it. 00:30:09.977 [2024-07-13 10:16:15.494289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.494404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.494440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.977 qpair failed and we were unable to recover it. 00:30:09.977 [2024-07-13 10:16:15.494560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.494678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.494702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.977 qpair failed and we were unable to recover it. 00:30:09.977 [2024-07-13 10:16:15.494855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.495004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.495030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.977 qpair failed and we were unable to recover it. 00:30:09.977 [2024-07-13 10:16:15.495143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.495302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.495327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.977 qpair failed and we were unable to recover it. 00:30:09.977 [2024-07-13 10:16:15.495508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.495656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.495680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.977 qpair failed and we were unable to recover it. 00:30:09.977 [2024-07-13 10:16:15.495857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.496016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.496041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.977 qpair failed and we were unable to recover it. 00:30:09.977 [2024-07-13 10:16:15.496164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.496291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.496316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.977 qpair failed and we were unable to recover it. 00:30:09.977 [2024-07-13 10:16:15.496453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.496613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.496638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.977 qpair failed and we were unable to recover it. 00:30:09.977 [2024-07-13 10:16:15.496766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.496892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.496918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.977 qpair failed and we were unable to recover it. 00:30:09.977 [2024-07-13 10:16:15.497068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.497242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.497276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.977 qpair failed and we were unable to recover it. 00:30:09.977 [2024-07-13 10:16:15.497401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.497554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.497591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.977 qpair failed and we were unable to recover it. 00:30:09.977 [2024-07-13 10:16:15.497756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.497909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.497935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.977 qpair failed and we were unable to recover it. 00:30:09.977 [2024-07-13 10:16:15.498067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.498232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.498257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.977 qpair failed and we were unable to recover it. 00:30:09.977 [2024-07-13 10:16:15.498436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.498605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.498630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.977 qpair failed and we were unable to recover it. 00:30:09.977 [2024-07-13 10:16:15.498777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.498939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.498965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.977 qpair failed and we were unable to recover it. 00:30:09.977 [2024-07-13 10:16:15.499120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.499256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.499282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.977 qpair failed and we were unable to recover it. 00:30:09.977 [2024-07-13 10:16:15.499412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.499529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.499554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.977 qpair failed and we were unable to recover it. 00:30:09.977 [2024-07-13 10:16:15.499725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.499843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.499884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.977 qpair failed and we were unable to recover it. 00:30:09.977 [2024-07-13 10:16:15.500022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.500194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.500219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.977 qpair failed and we were unable to recover it. 00:30:09.977 [2024-07-13 10:16:15.500373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.500496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.500532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.977 qpair failed and we were unable to recover it. 00:30:09.977 [2024-07-13 10:16:15.500696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.500820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.500856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.977 qpair failed and we were unable to recover it. 00:30:09.977 [2024-07-13 10:16:15.501007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.501162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.501186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.977 qpair failed and we were unable to recover it. 00:30:09.977 [2024-07-13 10:16:15.501348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.501472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.501496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.977 qpair failed and we were unable to recover it. 00:30:09.977 [2024-07-13 10:16:15.501655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.501806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.501831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.977 qpair failed and we were unable to recover it. 00:30:09.977 [2024-07-13 10:16:15.501965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.502115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.502140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.977 qpair failed and we were unable to recover it. 00:30:09.977 [2024-07-13 10:16:15.502267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.502444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.502469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.977 qpair failed and we were unable to recover it. 00:30:09.977 [2024-07-13 10:16:15.502637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.502771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.502796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.977 qpair failed and we were unable to recover it. 00:30:09.977 [2024-07-13 10:16:15.502956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.503109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.503135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.977 qpair failed and we were unable to recover it. 00:30:09.977 [2024-07-13 10:16:15.503265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.503403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.977 [2024-07-13 10:16:15.503429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.977 qpair failed and we were unable to recover it. 00:30:09.978 [2024-07-13 10:16:15.503553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.503700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.503724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.978 qpair failed and we were unable to recover it. 00:30:09.978 [2024-07-13 10:16:15.503884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.504008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.504033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.978 qpair failed and we were unable to recover it. 00:30:09.978 [2024-07-13 10:16:15.504160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.504303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.504328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.978 qpair failed and we were unable to recover it. 00:30:09.978 [2024-07-13 10:16:15.504485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.504647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.504671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.978 qpair failed and we were unable to recover it. 00:30:09.978 [2024-07-13 10:16:15.504785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.504937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.504963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.978 qpair failed and we were unable to recover it. 00:30:09.978 [2024-07-13 10:16:15.505099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.505213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.505244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.978 qpair failed and we were unable to recover it. 00:30:09.978 [2024-07-13 10:16:15.505399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.505516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.505541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.978 qpair failed and we were unable to recover it. 00:30:09.978 [2024-07-13 10:16:15.505744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.505877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.505902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.978 qpair failed and we were unable to recover it. 00:30:09.978 [2024-07-13 10:16:15.506052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.506169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.506194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.978 qpair failed and we were unable to recover it. 00:30:09.978 [2024-07-13 10:16:15.506343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.506482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.506514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.978 qpair failed and we were unable to recover it. 00:30:09.978 [2024-07-13 10:16:15.506703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.506873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.506900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.978 qpair failed and we were unable to recover it. 00:30:09.978 [2024-07-13 10:16:15.507052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.507169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.507194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.978 qpair failed and we were unable to recover it. 00:30:09.978 [2024-07-13 10:16:15.507327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.507480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.507505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.978 qpair failed and we were unable to recover it. 00:30:09.978 [2024-07-13 10:16:15.507656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.507786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.507810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.978 qpair failed and we were unable to recover it. 00:30:09.978 [2024-07-13 10:16:15.507962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.508075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.508101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.978 qpair failed and we were unable to recover it. 00:30:09.978 [2024-07-13 10:16:15.508231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.508363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.508390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.978 qpair failed and we were unable to recover it. 00:30:09.978 [2024-07-13 10:16:15.508541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.508662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.508689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.978 qpair failed and we were unable to recover it. 00:30:09.978 [2024-07-13 10:16:15.508837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.508986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.509011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.978 qpair failed and we were unable to recover it. 00:30:09.978 [2024-07-13 10:16:15.509131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.509262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.509287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.978 qpair failed and we were unable to recover it. 00:30:09.978 [2024-07-13 10:16:15.509465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.509584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.509610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.978 qpair failed and we were unable to recover it. 00:30:09.978 [2024-07-13 10:16:15.509740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.509896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.509922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.978 qpair failed and we were unable to recover it. 00:30:09.978 [2024-07-13 10:16:15.510067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.510240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.510264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.978 qpair failed and we were unable to recover it. 00:30:09.978 [2024-07-13 10:16:15.510400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.510556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.510582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.978 qpair failed and we were unable to recover it. 00:30:09.978 [2024-07-13 10:16:15.510706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.510841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.510878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.978 qpair failed and we were unable to recover it. 00:30:09.978 [2024-07-13 10:16:15.511026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.511181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.511206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.978 qpair failed and we were unable to recover it. 00:30:09.978 [2024-07-13 10:16:15.511326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.511479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.511504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.978 qpair failed and we were unable to recover it. 00:30:09.978 [2024-07-13 10:16:15.511654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.511793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.511818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.978 qpair failed and we were unable to recover it. 00:30:09.978 [2024-07-13 10:16:15.511966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.512082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.512106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.978 qpair failed and we were unable to recover it. 00:30:09.978 [2024-07-13 10:16:15.512235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.512388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.512413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.978 qpair failed and we were unable to recover it. 00:30:09.978 [2024-07-13 10:16:15.512571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.512689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.512714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.978 qpair failed and we were unable to recover it. 00:30:09.978 [2024-07-13 10:16:15.512893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.513018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.513043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.978 qpair failed and we were unable to recover it. 00:30:09.978 [2024-07-13 10:16:15.513161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.513290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.513314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.978 qpair failed and we were unable to recover it. 00:30:09.978 [2024-07-13 10:16:15.513469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.513622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.513647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.978 qpair failed and we were unable to recover it. 00:30:09.978 [2024-07-13 10:16:15.513767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.513908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.513934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.978 qpair failed and we were unable to recover it. 00:30:09.978 [2024-07-13 10:16:15.514059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.514175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.514200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.978 qpair failed and we were unable to recover it. 00:30:09.978 [2024-07-13 10:16:15.514354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.514465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.514490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.978 qpair failed and we were unable to recover it. 00:30:09.978 [2024-07-13 10:16:15.514626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.514773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.514797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.978 qpair failed and we were unable to recover it. 00:30:09.978 [2024-07-13 10:16:15.514955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.515104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.515129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.978 qpair failed and we were unable to recover it. 00:30:09.978 [2024-07-13 10:16:15.515257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.515405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.978 [2024-07-13 10:16:15.515430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.979 qpair failed and we were unable to recover it. 00:30:09.979 [2024-07-13 10:16:15.515579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.515688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.515713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.979 qpair failed and we were unable to recover it. 00:30:09.979 [2024-07-13 10:16:15.515825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.516002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.516028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.979 qpair failed and we were unable to recover it. 00:30:09.979 [2024-07-13 10:16:15.516152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.516317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.516341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.979 qpair failed and we were unable to recover it. 00:30:09.979 [2024-07-13 10:16:15.516483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.516635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.516660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.979 qpair failed and we were unable to recover it. 00:30:09.979 [2024-07-13 10:16:15.516806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.516950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.516976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.979 qpair failed and we were unable to recover it. 00:30:09.979 [2024-07-13 10:16:15.517127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.517290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.517315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.979 qpair failed and we were unable to recover it. 00:30:09.979 [2024-07-13 10:16:15.517440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.517557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.517582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.979 qpair failed and we were unable to recover it. 00:30:09.979 [2024-07-13 10:16:15.517755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.517906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.517931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.979 qpair failed and we were unable to recover it. 00:30:09.979 [2024-07-13 10:16:15.518077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.518258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.518283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.979 qpair failed and we were unable to recover it. 00:30:09.979 [2024-07-13 10:16:15.518406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.518557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.518594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.979 qpair failed and we were unable to recover it. 00:30:09.979 [2024-07-13 10:16:15.518717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.518841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.518882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.979 qpair failed and we were unable to recover it. 00:30:09.979 [2024-07-13 10:16:15.519060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.519211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.519235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.979 qpair failed and we were unable to recover it. 00:30:09.979 [2024-07-13 10:16:15.519389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.519536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.519561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.979 qpair failed and we were unable to recover it. 00:30:09.979 [2024-07-13 10:16:15.519693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.519804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.519830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.979 qpair failed and we were unable to recover it. 00:30:09.979 [2024-07-13 10:16:15.519971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.520083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.520109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.979 qpair failed and we were unable to recover it. 00:30:09.979 [2024-07-13 10:16:15.520254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.520375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.520400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.979 qpair failed and we were unable to recover it. 00:30:09.979 [2024-07-13 10:16:15.520545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.520709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.520734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.979 qpair failed and we were unable to recover it. 00:30:09.979 [2024-07-13 10:16:15.520863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.521030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.521061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.979 qpair failed and we were unable to recover it. 00:30:09.979 [2024-07-13 10:16:15.521212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.521392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.521417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.979 qpair failed and we were unable to recover it. 00:30:09.979 [2024-07-13 10:16:15.521568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.521716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.521740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.979 qpair failed and we were unable to recover it. 00:30:09.979 [2024-07-13 10:16:15.521860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.522005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.522029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.979 qpair failed and we were unable to recover it. 00:30:09.979 [2024-07-13 10:16:15.522157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.522285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.522310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.979 qpair failed and we were unable to recover it. 00:30:09.979 [2024-07-13 10:16:15.522444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.522568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.522593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.979 qpair failed and we were unable to recover it. 00:30:09.979 [2024-07-13 10:16:15.522716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.522860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.522891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.979 qpair failed and we were unable to recover it. 00:30:09.979 [2024-07-13 10:16:15.523011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.523158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.523185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.979 qpair failed and we were unable to recover it. 00:30:09.979 [2024-07-13 10:16:15.523306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.523420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.523445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.979 qpair failed and we were unable to recover it. 00:30:09.979 [2024-07-13 10:16:15.523624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.523739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.523764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.979 qpair failed and we were unable to recover it. 00:30:09.979 [2024-07-13 10:16:15.523919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.524034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.524059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.979 qpair failed and we were unable to recover it. 00:30:09.979 [2024-07-13 10:16:15.524206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.524326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.524350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.979 qpair failed and we were unable to recover it. 00:30:09.979 [2024-07-13 10:16:15.524491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.524644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.524669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.979 qpair failed and we were unable to recover it. 00:30:09.979 [2024-07-13 10:16:15.524815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.524999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.525025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.979 qpair failed and we were unable to recover it. 00:30:09.979 [2024-07-13 10:16:15.525159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.525306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.525331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.979 qpair failed and we were unable to recover it. 00:30:09.979 [2024-07-13 10:16:15.525508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.525659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.525683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.979 qpair failed and we were unable to recover it. 00:30:09.979 [2024-07-13 10:16:15.525804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.525953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.525978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.979 qpair failed and we were unable to recover it. 00:30:09.979 [2024-07-13 10:16:15.526105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.526258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.526283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.979 qpair failed and we were unable to recover it. 00:30:09.979 [2024-07-13 10:16:15.526401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.526516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.526542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.979 qpair failed and we were unable to recover it. 00:30:09.979 [2024-07-13 10:16:15.526668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.526815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.526840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.979 qpair failed and we were unable to recover it. 00:30:09.979 [2024-07-13 10:16:15.526973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.527116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.979 [2024-07-13 10:16:15.527140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.979 qpair failed and we were unable to recover it. 00:30:09.979 [2024-07-13 10:16:15.527299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.527443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.527467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.980 qpair failed and we were unable to recover it. 00:30:09.980 [2024-07-13 10:16:15.527645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.527793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.527819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.980 qpair failed and we were unable to recover it. 00:30:09.980 [2024-07-13 10:16:15.527948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.528063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.528087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.980 qpair failed and we were unable to recover it. 00:30:09.980 [2024-07-13 10:16:15.528216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.528333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.528358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.980 qpair failed and we were unable to recover it. 00:30:09.980 [2024-07-13 10:16:15.528513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.528623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.528654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.980 qpair failed and we were unable to recover it. 00:30:09.980 [2024-07-13 10:16:15.528827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.528974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.528999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.980 qpair failed and we were unable to recover it. 00:30:09.980 [2024-07-13 10:16:15.529147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.529311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.529335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.980 qpair failed and we were unable to recover it. 00:30:09.980 [2024-07-13 10:16:15.529485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.529626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.529651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.980 qpair failed and we were unable to recover it. 00:30:09.980 [2024-07-13 10:16:15.529801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.529947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.529973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.980 qpair failed and we were unable to recover it. 00:30:09.980 [2024-07-13 10:16:15.530130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.530253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.530278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.980 qpair failed and we were unable to recover it. 00:30:09.980 [2024-07-13 10:16:15.530432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.530546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.530571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.980 qpair failed and we were unable to recover it. 00:30:09.980 [2024-07-13 10:16:15.530689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.530835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.530877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.980 qpair failed and we were unable to recover it. 00:30:09.980 [2024-07-13 10:16:15.530998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.531121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.531146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.980 qpair failed and we were unable to recover it. 00:30:09.980 [2024-07-13 10:16:15.531285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.531402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.531427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.980 qpair failed and we were unable to recover it. 00:30:09.980 [2024-07-13 10:16:15.531573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.531687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.531713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.980 qpair failed and we were unable to recover it. 00:30:09.980 [2024-07-13 10:16:15.531889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.532019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.532044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.980 qpair failed and we were unable to recover it. 00:30:09.980 [2024-07-13 10:16:15.532172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.532305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.532330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.980 qpair failed and we were unable to recover it. 00:30:09.980 [2024-07-13 10:16:15.532459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.532604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.532629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.980 qpair failed and we were unable to recover it. 00:30:09.980 [2024-07-13 10:16:15.532759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.532907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.532933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.980 qpair failed and we were unable to recover it. 00:30:09.980 [2024-07-13 10:16:15.533053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.533183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.533208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.980 qpair failed and we were unable to recover it. 00:30:09.980 [2024-07-13 10:16:15.533332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.533461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.533486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.980 qpair failed and we were unable to recover it. 00:30:09.980 [2024-07-13 10:16:15.533639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.533761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.533786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.980 qpair failed and we were unable to recover it. 00:30:09.980 [2024-07-13 10:16:15.533935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.534056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.534082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.980 qpair failed and we were unable to recover it. 00:30:09.980 [2024-07-13 10:16:15.534232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.534349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.534374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.980 qpair failed and we were unable to recover it. 00:30:09.980 [2024-07-13 10:16:15.534493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.534638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.534664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.980 qpair failed and we were unable to recover it. 00:30:09.980 [2024-07-13 10:16:15.534781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.534908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.534934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.980 qpair failed and we were unable to recover it. 00:30:09.980 [2024-07-13 10:16:15.535081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.535234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.535259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.980 qpair failed and we were unable to recover it. 00:30:09.980 [2024-07-13 10:16:15.535371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.535544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.535569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.980 qpair failed and we were unable to recover it. 00:30:09.980 [2024-07-13 10:16:15.535695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.535816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.535841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.980 qpair failed and we were unable to recover it. 00:30:09.980 [2024-07-13 10:16:15.535999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.536142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.536171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.980 qpair failed and we were unable to recover it. 00:30:09.980 [2024-07-13 10:16:15.536325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.536449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.536478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.980 qpair failed and we were unable to recover it. 00:30:09.980 [2024-07-13 10:16:15.536624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.536780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.536805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.980 qpair failed and we were unable to recover it. 00:30:09.980 [2024-07-13 10:16:15.536973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.537099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.537125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.980 qpair failed and we were unable to recover it. 00:30:09.980 [2024-07-13 10:16:15.537259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.537403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.537428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.980 qpair failed and we were unable to recover it. 00:30:09.980 [2024-07-13 10:16:15.537558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.537697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.537722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.980 qpair failed and we were unable to recover it. 00:30:09.980 [2024-07-13 10:16:15.537848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.537989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.538015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.980 qpair failed and we were unable to recover it. 00:30:09.980 [2024-07-13 10:16:15.538134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.980 [2024-07-13 10:16:15.538285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.538310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.981 qpair failed and we were unable to recover it. 00:30:09.981 [2024-07-13 10:16:15.538460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.538575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.538601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.981 qpair failed and we were unable to recover it. 00:30:09.981 [2024-07-13 10:16:15.538747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.538863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.538911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.981 qpair failed and we were unable to recover it. 00:30:09.981 [2024-07-13 10:16:15.539032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.539183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.539209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.981 qpair failed and we were unable to recover it. 00:30:09.981 [2024-07-13 10:16:15.539358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.539485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.539514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.981 qpair failed and we were unable to recover it. 00:30:09.981 [2024-07-13 10:16:15.539693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.539838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.539882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.981 qpair failed and we were unable to recover it. 00:30:09.981 [2024-07-13 10:16:15.540013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.540127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.540152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.981 qpair failed and we were unable to recover it. 00:30:09.981 [2024-07-13 10:16:15.540285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.540393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.540417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.981 qpair failed and we were unable to recover it. 00:30:09.981 [2024-07-13 10:16:15.540567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.540741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.540766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.981 qpair failed and we were unable to recover it. 00:30:09.981 [2024-07-13 10:16:15.540921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.541044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.541068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.981 qpair failed and we were unable to recover it. 00:30:09.981 [2024-07-13 10:16:15.541186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.541328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.541353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.981 qpair failed and we were unable to recover it. 00:30:09.981 [2024-07-13 10:16:15.541479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.541594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.541618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.981 qpair failed and we were unable to recover it. 00:30:09.981 [2024-07-13 10:16:15.541803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.541959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.541985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.981 qpair failed and we were unable to recover it. 00:30:09.981 [2024-07-13 10:16:15.542112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.542240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.542265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.981 qpair failed and we were unable to recover it. 00:30:09.981 [2024-07-13 10:16:15.542380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.542502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.542526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.981 qpair failed and we were unable to recover it. 00:30:09.981 [2024-07-13 10:16:15.542687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.542812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.542836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.981 qpair failed and we were unable to recover it. 00:30:09.981 [2024-07-13 10:16:15.543004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.543162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.543187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.981 qpair failed and we were unable to recover it. 00:30:09.981 [2024-07-13 10:16:15.543302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.543449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.543473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.981 qpair failed and we were unable to recover it. 00:30:09.981 [2024-07-13 10:16:15.543628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.543743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.543767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.981 qpair failed and we were unable to recover it. 00:30:09.981 [2024-07-13 10:16:15.543897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.544028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.544053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.981 qpair failed and we were unable to recover it. 00:30:09.981 [2024-07-13 10:16:15.544202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.544376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.544401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.981 qpair failed and we were unable to recover it. 00:30:09.981 [2024-07-13 10:16:15.544556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.544710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.544735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.981 qpair failed and we were unable to recover it. 00:30:09.981 [2024-07-13 10:16:15.544896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.545024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.545051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.981 qpair failed and we were unable to recover it. 00:30:09.981 [2024-07-13 10:16:15.545179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.545294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.545318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.981 qpair failed and we were unable to recover it. 00:30:09.981 [2024-07-13 10:16:15.545465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.545608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.545632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.981 qpair failed and we were unable to recover it. 00:30:09.981 [2024-07-13 10:16:15.545821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.545971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.545997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.981 qpair failed and we were unable to recover it. 00:30:09.981 [2024-07-13 10:16:15.546123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.546286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.546310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.981 qpair failed and we were unable to recover it. 00:30:09.981 [2024-07-13 10:16:15.546430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.546579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.546603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.981 qpair failed and we were unable to recover it. 00:30:09.981 [2024-07-13 10:16:15.546724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.546847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.546881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.981 qpair failed and we were unable to recover it. 00:30:09.981 [2024-07-13 10:16:15.546998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.547114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.547138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.981 qpair failed and we were unable to recover it. 00:30:09.981 [2024-07-13 10:16:15.547266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.547438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.547463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.981 qpair failed and we were unable to recover it. 00:30:09.981 [2024-07-13 10:16:15.547612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.547748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.547773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.981 qpair failed and we were unable to recover it. 00:30:09.981 [2024-07-13 10:16:15.547904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.548037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.548062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.981 qpair failed and we were unable to recover it. 00:30:09.981 [2024-07-13 10:16:15.548248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.548401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.548425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.981 qpair failed and we were unable to recover it. 00:30:09.981 [2024-07-13 10:16:15.548572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.548748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.548772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.981 qpair failed and we were unable to recover it. 00:30:09.981 [2024-07-13 10:16:15.548900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.549072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.549097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.981 qpair failed and we were unable to recover it. 00:30:09.981 [2024-07-13 10:16:15.549248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.549396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.549421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.981 qpair failed and we were unable to recover it. 00:30:09.981 [2024-07-13 10:16:15.549574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.549690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.549714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.981 qpair failed and we were unable to recover it. 00:30:09.981 [2024-07-13 10:16:15.549839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.550007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.550032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.981 qpair failed and we were unable to recover it. 00:30:09.981 [2024-07-13 10:16:15.550182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.981 [2024-07-13 10:16:15.550316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.550341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.982 qpair failed and we were unable to recover it. 00:30:09.982 [2024-07-13 10:16:15.550490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.550664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.550689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.982 qpair failed and we were unable to recover it. 00:30:09.982 [2024-07-13 10:16:15.550808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.550941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.550966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.982 qpair failed and we were unable to recover it. 00:30:09.982 [2024-07-13 10:16:15.551098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.551223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.551248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.982 qpair failed and we were unable to recover it. 00:30:09.982 [2024-07-13 10:16:15.551392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.551505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.551530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.982 qpair failed and we were unable to recover it. 00:30:09.982 [2024-07-13 10:16:15.551674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.551809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.551833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.982 qpair failed and we were unable to recover it. 00:30:09.982 [2024-07-13 10:16:15.552002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.552128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.552154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.982 qpair failed and we were unable to recover it. 00:30:09.982 [2024-07-13 10:16:15.552270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.552396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.552420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.982 qpair failed and we were unable to recover it. 00:30:09.982 [2024-07-13 10:16:15.552570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.552713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.552738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.982 qpair failed and we were unable to recover it. 00:30:09.982 [2024-07-13 10:16:15.552863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.553030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.553055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.982 qpair failed and we were unable to recover it. 00:30:09.982 [2024-07-13 10:16:15.553199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.553351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.553375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.982 qpair failed and we were unable to recover it. 00:30:09.982 [2024-07-13 10:16:15.553494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.553648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.553673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.982 qpair failed and we were unable to recover it. 00:30:09.982 [2024-07-13 10:16:15.553818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.553953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.553979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.982 qpair failed and we were unable to recover it. 00:30:09.982 [2024-07-13 10:16:15.554125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.554296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.554321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.982 qpair failed and we were unable to recover it. 00:30:09.982 [2024-07-13 10:16:15.554468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.554609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.554633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.982 qpair failed and we were unable to recover it. 00:30:09.982 [2024-07-13 10:16:15.554759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.554880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.554905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.982 qpair failed and we were unable to recover it. 00:30:09.982 [2024-07-13 10:16:15.555061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.555173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.555201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.982 qpair failed and we were unable to recover it. 00:30:09.982 [2024-07-13 10:16:15.555329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.555480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.555505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.982 qpair failed and we were unable to recover it. 00:30:09.982 [2024-07-13 10:16:15.555681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.555796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.555821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.982 qpair failed and we were unable to recover it. 00:30:09.982 [2024-07-13 10:16:15.555972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.556118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.556143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.982 qpair failed and we were unable to recover it. 00:30:09.982 [2024-07-13 10:16:15.556295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.556413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.556439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.982 qpair failed and we were unable to recover it. 00:30:09.982 [2024-07-13 10:16:15.556617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.556765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.556790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.982 qpair failed and we were unable to recover it. 00:30:09.982 [2024-07-13 10:16:15.556945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.557090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.557115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.982 qpair failed and we were unable to recover it. 00:30:09.982 [2024-07-13 10:16:15.557234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.557373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.557398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.982 qpair failed and we were unable to recover it. 00:30:09.982 [2024-07-13 10:16:15.557521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.557638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.557665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.982 qpair failed and we were unable to recover it. 00:30:09.982 [2024-07-13 10:16:15.557826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.557945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.557970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.982 qpair failed and we were unable to recover it. 00:30:09.982 [2024-07-13 10:16:15.558083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.558203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.558229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.982 qpair failed and we were unable to recover it. 00:30:09.982 [2024-07-13 10:16:15.558365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.558477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.558502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.982 qpair failed and we were unable to recover it. 00:30:09.982 [2024-07-13 10:16:15.558621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.558749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.558774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.982 qpair failed and we were unable to recover it. 00:30:09.982 [2024-07-13 10:16:15.558900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.559021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.559046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.982 qpair failed and we were unable to recover it. 00:30:09.982 [2024-07-13 10:16:15.559201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.559317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.559341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.982 qpair failed and we were unable to recover it. 00:30:09.982 [2024-07-13 10:16:15.559489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.559607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.559631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.982 qpair failed and we were unable to recover it. 00:30:09.982 [2024-07-13 10:16:15.559780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.559921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.559947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.982 qpair failed and we were unable to recover it. 00:30:09.982 [2024-07-13 10:16:15.560070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.560250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.560275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.982 qpair failed and we were unable to recover it. 00:30:09.982 [2024-07-13 10:16:15.560418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.560591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.560615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.982 qpair failed and we were unable to recover it. 00:30:09.982 [2024-07-13 10:16:15.560760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.560915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.560940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.982 qpair failed and we were unable to recover it. 00:30:09.982 [2024-07-13 10:16:15.561075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.561226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.561252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.982 qpair failed and we were unable to recover it. 00:30:09.982 [2024-07-13 10:16:15.561377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.561490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.561515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.982 qpair failed and we were unable to recover it. 00:30:09.982 [2024-07-13 10:16:15.561664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.561783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.561810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.982 qpair failed and we were unable to recover it. 00:30:09.982 [2024-07-13 10:16:15.561944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.562068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.982 [2024-07-13 10:16:15.562093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.982 qpair failed and we were unable to recover it. 00:30:09.983 [2024-07-13 10:16:15.562217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.562345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.562371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.983 qpair failed and we were unable to recover it. 00:30:09.983 [2024-07-13 10:16:15.562501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.562614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.562639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.983 qpair failed and we were unable to recover it. 00:30:09.983 [2024-07-13 10:16:15.562762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.562887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.562913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.983 qpair failed and we were unable to recover it. 00:30:09.983 [2024-07-13 10:16:15.563074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.563229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.563254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.983 qpair failed and we were unable to recover it. 00:30:09.983 [2024-07-13 10:16:15.563367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.563496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.563521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.983 qpair failed and we were unable to recover it. 00:30:09.983 [2024-07-13 10:16:15.563645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.563818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.563843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.983 qpair failed and we were unable to recover it. 00:30:09.983 [2024-07-13 10:16:15.563973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.564117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.564142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.983 qpair failed and we were unable to recover it. 00:30:09.983 [2024-07-13 10:16:15.564293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.564410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.564435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.983 qpair failed and we were unable to recover it. 00:30:09.983 [2024-07-13 10:16:15.564587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.564708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.564734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.983 qpair failed and we were unable to recover it. 00:30:09.983 [2024-07-13 10:16:15.564891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.565018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.565043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.983 qpair failed and we were unable to recover it. 00:30:09.983 [2024-07-13 10:16:15.565192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.565340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.565364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.983 qpair failed and we were unable to recover it. 00:30:09.983 [2024-07-13 10:16:15.565509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.565661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.565687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.983 qpair failed and we were unable to recover it. 00:30:09.983 [2024-07-13 10:16:15.565836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.565999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.566023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.983 qpair failed and we were unable to recover it. 00:30:09.983 [2024-07-13 10:16:15.566141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.566293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.566317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.983 qpair failed and we were unable to recover it. 00:30:09.983 [2024-07-13 10:16:15.566474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.566585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.566609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.983 qpair failed and we were unable to recover it. 00:30:09.983 [2024-07-13 10:16:15.566764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.566931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.566958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.983 qpair failed and we were unable to recover it. 00:30:09.983 [2024-07-13 10:16:15.567089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.567245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.567271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.983 qpair failed and we were unable to recover it. 00:30:09.983 [2024-07-13 10:16:15.567392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.567536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.567561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.983 qpair failed and we were unable to recover it. 00:30:09.983 [2024-07-13 10:16:15.567706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.567858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.567887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.983 qpair failed and we were unable to recover it. 00:30:09.983 [2024-07-13 10:16:15.568013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.568143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.568173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.983 qpair failed and we were unable to recover it. 00:30:09.983 [2024-07-13 10:16:15.568290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.568410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.568434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.983 qpair failed and we were unable to recover it. 00:30:09.983 [2024-07-13 10:16:15.568582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.568730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.568755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.983 qpair failed and we were unable to recover it. 00:30:09.983 [2024-07-13 10:16:15.568893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.569018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.569043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.983 qpair failed and we were unable to recover it. 00:30:09.983 [2024-07-13 10:16:15.569195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.569337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.569362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.983 qpair failed and we were unable to recover it. 00:30:09.983 [2024-07-13 10:16:15.569491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.569610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.569635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.983 qpair failed and we were unable to recover it. 00:30:09.983 [2024-07-13 10:16:15.569749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.569899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.569925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.983 qpair failed and we were unable to recover it. 00:30:09.983 [2024-07-13 10:16:15.570045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.570194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.570218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.983 qpair failed and we were unable to recover it. 00:30:09.983 [2024-07-13 10:16:15.570344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.570489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.570518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.983 qpair failed and we were unable to recover it. 00:30:09.983 [2024-07-13 10:16:15.570636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.570784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.570809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.983 qpair failed and we were unable to recover it. 00:30:09.983 [2024-07-13 10:16:15.570928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.571083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.571108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.983 qpair failed and we were unable to recover it. 00:30:09.983 [2024-07-13 10:16:15.571231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.571371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.571397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.983 qpair failed and we were unable to recover it. 00:30:09.983 [2024-07-13 10:16:15.571539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.571656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.571681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.983 qpair failed and we were unable to recover it. 00:30:09.983 [2024-07-13 10:16:15.571798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.571924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.571949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.983 qpair failed and we were unable to recover it. 00:30:09.983 [2024-07-13 10:16:15.572080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.572209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.572234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.983 qpair failed and we were unable to recover it. 00:30:09.983 [2024-07-13 10:16:15.572380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.983 [2024-07-13 10:16:15.572531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.572556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.984 qpair failed and we were unable to recover it. 00:30:09.984 [2024-07-13 10:16:15.572682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.572811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.572836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.984 qpair failed and we were unable to recover it. 00:30:09.984 [2024-07-13 10:16:15.572999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.573137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.573162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.984 qpair failed and we were unable to recover it. 00:30:09.984 [2024-07-13 10:16:15.573307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.573454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.573479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.984 qpair failed and we were unable to recover it. 00:30:09.984 [2024-07-13 10:16:15.573638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.573787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.573813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.984 qpair failed and we were unable to recover it. 00:30:09.984 [2024-07-13 10:16:15.573942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.574087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.574112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.984 qpair failed and we were unable to recover it. 00:30:09.984 [2024-07-13 10:16:15.574238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.574349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.574374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.984 qpair failed and we were unable to recover it. 00:30:09.984 [2024-07-13 10:16:15.574505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.574643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.574669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.984 qpair failed and we were unable to recover it. 00:30:09.984 [2024-07-13 10:16:15.574792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.574934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.574960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.984 qpair failed and we were unable to recover it. 00:30:09.984 [2024-07-13 10:16:15.575104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.575260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.575285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.984 qpair failed and we were unable to recover it. 00:30:09.984 [2024-07-13 10:16:15.575411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.575532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.575558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.984 qpair failed and we were unable to recover it. 00:30:09.984 [2024-07-13 10:16:15.575682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.575795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.575821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.984 qpair failed and we were unable to recover it. 00:30:09.984 [2024-07-13 10:16:15.575939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.576086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.576111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.984 qpair failed and we were unable to recover it. 00:30:09.984 [2024-07-13 10:16:15.576253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.576395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.576420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.984 qpair failed and we were unable to recover it. 00:30:09.984 [2024-07-13 10:16:15.576552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.576671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.576696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.984 qpair failed and we were unable to recover it. 00:30:09.984 [2024-07-13 10:16:15.576811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.576924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.576950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.984 qpair failed and we were unable to recover it. 00:30:09.984 [2024-07-13 10:16:15.577072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.577186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.577212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.984 qpair failed and we were unable to recover it. 00:30:09.984 [2024-07-13 10:16:15.577358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.577503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.577528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.984 qpair failed and we were unable to recover it. 00:30:09.984 [2024-07-13 10:16:15.577679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.577823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.577848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.984 qpair failed and we were unable to recover it. 00:30:09.984 [2024-07-13 10:16:15.578007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.578129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.578154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.984 qpair failed and we were unable to recover it. 00:30:09.984 [2024-07-13 10:16:15.578306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.578433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.578458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.984 qpair failed and we were unable to recover it. 00:30:09.984 [2024-07-13 10:16:15.578585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.578705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.578730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.984 qpair failed and we were unable to recover it. 00:30:09.984 [2024-07-13 10:16:15.578845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.578980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.579005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.984 qpair failed and we were unable to recover it. 00:30:09.984 [2024-07-13 10:16:15.579156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.579327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.579353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.984 qpair failed and we were unable to recover it. 00:30:09.984 [2024-07-13 10:16:15.579503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.579616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.579641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.984 qpair failed and we were unable to recover it. 00:30:09.984 [2024-07-13 10:16:15.579794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.579917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.579943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.984 qpair failed and we were unable to recover it. 00:30:09.984 [2024-07-13 10:16:15.580073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.580192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.580217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.984 qpair failed and we were unable to recover it. 00:30:09.984 [2024-07-13 10:16:15.580331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.580440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.580465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.984 qpair failed and we were unable to recover it. 00:30:09.984 [2024-07-13 10:16:15.580626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.580768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.580794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.984 qpair failed and we were unable to recover it. 00:30:09.984 [2024-07-13 10:16:15.580914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.581059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.581084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.984 qpair failed and we were unable to recover it. 00:30:09.984 [2024-07-13 10:16:15.581229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.581386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.581412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.984 qpair failed and we were unable to recover it. 00:30:09.984 [2024-07-13 10:16:15.581550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.581662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.581687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.984 qpair failed and we were unable to recover it. 00:30:09.984 [2024-07-13 10:16:15.581815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.581963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.581988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.984 qpair failed and we were unable to recover it. 00:30:09.984 [2024-07-13 10:16:15.582107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.582258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.582282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.984 qpair failed and we were unable to recover it. 00:30:09.984 [2024-07-13 10:16:15.582409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.582537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.582561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.984 qpair failed and we were unable to recover it. 00:30:09.984 [2024-07-13 10:16:15.582681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.582839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.582864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.984 qpair failed and we were unable to recover it. 00:30:09.984 [2024-07-13 10:16:15.582998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.583137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.583163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.984 qpair failed and we were unable to recover it. 00:30:09.984 [2024-07-13 10:16:15.583283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.583422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.583448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.984 qpair failed and we were unable to recover it. 00:30:09.984 [2024-07-13 10:16:15.583573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.583720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.583744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.984 qpair failed and we were unable to recover it. 00:30:09.984 [2024-07-13 10:16:15.583897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.584023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.584047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.984 qpair failed and we were unable to recover it. 00:30:09.984 [2024-07-13 10:16:15.584198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.984 [2024-07-13 10:16:15.584321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.584346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.985 qpair failed and we were unable to recover it. 00:30:09.985 [2024-07-13 10:16:15.584491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.584601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.584625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.985 qpair failed and we were unable to recover it. 00:30:09.985 [2024-07-13 10:16:15.584742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.584893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.584918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.985 qpair failed and we were unable to recover it. 00:30:09.985 [2024-07-13 10:16:15.585051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.585198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.585223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.985 qpair failed and we were unable to recover it. 00:30:09.985 [2024-07-13 10:16:15.585347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.585460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.585490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.985 qpair failed and we were unable to recover it. 00:30:09.985 [2024-07-13 10:16:15.585609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.585730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.585755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.985 qpair failed and we were unable to recover it. 00:30:09.985 [2024-07-13 10:16:15.585907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.586023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.586047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.985 qpair failed and we were unable to recover it. 00:30:09.985 [2024-07-13 10:16:15.586181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.586351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.586375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.985 qpair failed and we were unable to recover it. 00:30:09.985 [2024-07-13 10:16:15.586548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.586669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.586693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.985 qpair failed and we were unable to recover it. 00:30:09.985 [2024-07-13 10:16:15.586839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.587018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.587043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.985 qpair failed and we were unable to recover it. 00:30:09.985 [2024-07-13 10:16:15.587223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.587347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.587372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.985 qpair failed and we were unable to recover it. 00:30:09.985 [2024-07-13 10:16:15.587499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.587621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.587648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.985 qpair failed and we were unable to recover it. 00:30:09.985 [2024-07-13 10:16:15.587805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.587934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.587960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.985 qpair failed and we were unable to recover it. 00:30:09.985 [2024-07-13 10:16:15.588118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.588238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.588264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.985 qpair failed and we were unable to recover it. 00:30:09.985 [2024-07-13 10:16:15.588410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.588557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.588585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.985 qpair failed and we were unable to recover it. 00:30:09.985 [2024-07-13 10:16:15.588707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.588831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.588855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.985 qpair failed and we were unable to recover it. 00:30:09.985 [2024-07-13 10:16:15.588989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.589116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.589140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.985 qpair failed and we were unable to recover it. 00:30:09.985 [2024-07-13 10:16:15.589320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.589480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.589505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.985 qpair failed and we were unable to recover it. 00:30:09.985 [2024-07-13 10:16:15.589633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.589776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.589800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.985 qpair failed and we were unable to recover it. 00:30:09.985 [2024-07-13 10:16:15.589922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.590046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.590070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.985 qpair failed and we were unable to recover it. 00:30:09.985 [2024-07-13 10:16:15.590229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.590369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.590394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.985 qpair failed and we were unable to recover it. 00:30:09.985 [2024-07-13 10:16:15.590570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.590704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.590729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.985 qpair failed and we were unable to recover it. 00:30:09.985 [2024-07-13 10:16:15.590883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.591025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.591049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.985 qpair failed and we were unable to recover it. 00:30:09.985 [2024-07-13 10:16:15.591180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.591354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.591379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.985 qpair failed and we were unable to recover it. 00:30:09.985 [2024-07-13 10:16:15.591554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.591668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.591693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.985 qpair failed and we were unable to recover it. 00:30:09.985 [2024-07-13 10:16:15.591857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.591992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.592019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.985 qpair failed and we were unable to recover it. 00:30:09.985 [2024-07-13 10:16:15.592199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.592317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.592342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.985 qpair failed and we were unable to recover it. 00:30:09.985 [2024-07-13 10:16:15.592468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.592585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.592609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.985 qpair failed and we were unable to recover it. 00:30:09.985 [2024-07-13 10:16:15.592753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.592895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.592920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.985 qpair failed and we were unable to recover it. 00:30:09.985 [2024-07-13 10:16:15.593056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.593200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.593224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.985 qpair failed and we were unable to recover it. 00:30:09.985 [2024-07-13 10:16:15.593379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.593503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.593528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.985 qpair failed and we were unable to recover it. 00:30:09.985 [2024-07-13 10:16:15.593646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.593791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.593816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.985 qpair failed and we were unable to recover it. 00:30:09.985 [2024-07-13 10:16:15.593964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.594103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.594127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.985 qpair failed and we were unable to recover it. 00:30:09.985 [2024-07-13 10:16:15.594304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.594447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.594472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.985 qpair failed and we were unable to recover it. 00:30:09.985 [2024-07-13 10:16:15.594623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.594750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.594775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.985 qpair failed and we were unable to recover it. 00:30:09.985 [2024-07-13 10:16:15.594903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.595047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.595072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.985 qpair failed and we were unable to recover it. 00:30:09.985 [2024-07-13 10:16:15.595197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.595305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.595330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.985 qpair failed and we were unable to recover it. 00:30:09.985 [2024-07-13 10:16:15.595480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.595598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.595623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.985 qpair failed and we were unable to recover it. 00:30:09.985 [2024-07-13 10:16:15.595746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.595905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.595933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.985 qpair failed and we were unable to recover it. 00:30:09.985 [2024-07-13 10:16:15.596049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.596163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.596188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.985 qpair failed and we were unable to recover it. 00:30:09.985 [2024-07-13 10:16:15.596343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.596465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.596490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.985 qpair failed and we were unable to recover it. 00:30:09.985 [2024-07-13 10:16:15.596650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.985 [2024-07-13 10:16:15.596823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.596847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.986 qpair failed and we were unable to recover it. 00:30:09.986 [2024-07-13 10:16:15.596985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.597119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.597144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.986 qpair failed and we were unable to recover it. 00:30:09.986 [2024-07-13 10:16:15.597265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.597407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.597432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.986 qpair failed and we were unable to recover it. 00:30:09.986 [2024-07-13 10:16:15.597563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.597676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.597701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.986 qpair failed and we were unable to recover it. 00:30:09.986 [2024-07-13 10:16:15.597846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.598014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.598039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.986 qpair failed and we were unable to recover it. 00:30:09.986 [2024-07-13 10:16:15.598174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.598310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.598335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.986 qpair failed and we were unable to recover it. 00:30:09.986 [2024-07-13 10:16:15.598463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.598586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.598611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.986 qpair failed and we were unable to recover it. 00:30:09.986 [2024-07-13 10:16:15.598742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.598896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.598921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.986 qpair failed and we were unable to recover it. 00:30:09.986 [2024-07-13 10:16:15.599058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.599215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.599240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.986 qpair failed and we were unable to recover it. 00:30:09.986 [2024-07-13 10:16:15.599383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.599538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.599563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.986 qpair failed and we were unable to recover it. 00:30:09.986 [2024-07-13 10:16:15.599689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.599875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.599900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.986 qpair failed and we were unable to recover it. 00:30:09.986 [2024-07-13 10:16:15.600028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.600144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.600168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.986 qpair failed and we were unable to recover it. 00:30:09.986 [2024-07-13 10:16:15.600322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.600456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.600480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.986 qpair failed and we were unable to recover it. 00:30:09.986 [2024-07-13 10:16:15.600599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.600718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.600743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.986 qpair failed and we were unable to recover it. 00:30:09.986 [2024-07-13 10:16:15.600894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.601018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.601043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.986 qpair failed and we were unable to recover it. 00:30:09.986 [2024-07-13 10:16:15.601169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.601281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.601307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.986 qpair failed and we were unable to recover it. 00:30:09.986 [2024-07-13 10:16:15.601453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.601614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.601639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.986 qpair failed and we were unable to recover it. 00:30:09.986 [2024-07-13 10:16:15.601786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.601935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.601961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.986 qpair failed and we were unable to recover it. 00:30:09.986 [2024-07-13 10:16:15.602075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.602190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.602215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.986 qpair failed and we were unable to recover it. 00:30:09.986 [2024-07-13 10:16:15.602347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.602468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.602494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.986 qpair failed and we were unable to recover it. 00:30:09.986 [2024-07-13 10:16:15.602622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.602766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.602791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.986 qpair failed and we were unable to recover it. 00:30:09.986 [2024-07-13 10:16:15.602921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.603063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.603088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.986 qpair failed and we were unable to recover it. 00:30:09.986 [2024-07-13 10:16:15.603236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.603386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.603414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.986 qpair failed and we were unable to recover it. 00:30:09.986 [2024-07-13 10:16:15.603534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.603679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.603703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.986 qpair failed and we were unable to recover it. 00:30:09.986 [2024-07-13 10:16:15.603843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.603983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.604013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.986 qpair failed and we were unable to recover it. 00:30:09.986 [2024-07-13 10:16:15.604139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.604255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.604280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.986 qpair failed and we were unable to recover it. 00:30:09.986 [2024-07-13 10:16:15.604400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.604544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.604570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.986 qpair failed and we were unable to recover it. 00:30:09.986 [2024-07-13 10:16:15.604683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.604830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.604870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.986 qpair failed and we were unable to recover it. 00:30:09.986 [2024-07-13 10:16:15.605004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.605117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.605141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.986 qpair failed and we were unable to recover it. 00:30:09.986 [2024-07-13 10:16:15.605291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.605415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.605440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.986 qpair failed and we were unable to recover it. 00:30:09.986 [2024-07-13 10:16:15.605588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.605707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.605732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.986 qpair failed and we were unable to recover it. 00:30:09.986 [2024-07-13 10:16:15.605864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.605990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.606014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.986 qpair failed and we were unable to recover it. 00:30:09.986 [2024-07-13 10:16:15.606141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.606302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.606327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.986 qpair failed and we were unable to recover it. 00:30:09.986 [2024-07-13 10:16:15.606455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.606579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.606605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.986 qpair failed and we were unable to recover it. 00:30:09.986 [2024-07-13 10:16:15.606766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.606917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.606943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.986 qpair failed and we were unable to recover it. 00:30:09.986 [2024-07-13 10:16:15.607078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.607204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.607229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.986 qpair failed and we were unable to recover it. 00:30:09.986 [2024-07-13 10:16:15.607376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.607501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.986 [2024-07-13 10:16:15.607526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.987 qpair failed and we were unable to recover it. 00:30:09.987 [2024-07-13 10:16:15.607644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.607759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.607783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.987 qpair failed and we were unable to recover it. 00:30:09.987 [2024-07-13 10:16:15.607929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.608053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.608077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.987 qpair failed and we were unable to recover it. 00:30:09.987 [2024-07-13 10:16:15.608231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.608388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.608413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.987 qpair failed and we were unable to recover it. 00:30:09.987 [2024-07-13 10:16:15.608564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.608708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.608733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.987 qpair failed and we were unable to recover it. 00:30:09.987 [2024-07-13 10:16:15.608851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.609001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.609026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.987 qpair failed and we were unable to recover it. 00:30:09.987 [2024-07-13 10:16:15.609152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.609278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.609303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.987 qpair failed and we were unable to recover it. 00:30:09.987 [2024-07-13 10:16:15.609435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.609579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.609604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.987 qpair failed and we were unable to recover it. 00:30:09.987 [2024-07-13 10:16:15.609722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.609880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.609906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.987 qpair failed and we were unable to recover it. 00:30:09.987 [2024-07-13 10:16:15.610035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.610161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.610185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.987 qpair failed and we were unable to recover it. 00:30:09.987 [2024-07-13 10:16:15.610312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.610466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.610491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.987 qpair failed and we were unable to recover it. 00:30:09.987 [2024-07-13 10:16:15.610636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.610795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.610820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.987 qpair failed and we were unable to recover it. 00:30:09.987 [2024-07-13 10:16:15.610981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.611104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.611129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.987 qpair failed and we were unable to recover it. 00:30:09.987 [2024-07-13 10:16:15.611255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.611377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.611401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.987 qpair failed and we were unable to recover it. 00:30:09.987 [2024-07-13 10:16:15.611521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.611651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.611675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.987 qpair failed and we were unable to recover it. 00:30:09.987 [2024-07-13 10:16:15.611821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.611993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.612019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.987 qpair failed and we were unable to recover it. 00:30:09.987 [2024-07-13 10:16:15.612139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.612301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.612328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.987 qpair failed and we were unable to recover it. 00:30:09.987 [2024-07-13 10:16:15.612483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.612635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.612660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.987 qpair failed and we were unable to recover it. 00:30:09.987 [2024-07-13 10:16:15.612809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.612983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.613009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.987 qpair failed and we were unable to recover it. 00:30:09.987 [2024-07-13 10:16:15.613164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.613293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.613318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.987 qpair failed and we were unable to recover it. 00:30:09.987 [2024-07-13 10:16:15.613497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.613616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.613641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.987 qpair failed and we were unable to recover it. 00:30:09.987 [2024-07-13 10:16:15.613778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.613932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.613959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.987 qpair failed and we were unable to recover it. 00:30:09.987 [2024-07-13 10:16:15.614089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.614243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.614269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.987 qpair failed and we were unable to recover it. 00:30:09.987 [2024-07-13 10:16:15.614413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.614559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.614585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.987 qpair failed and we were unable to recover it. 00:30:09.987 [2024-07-13 10:16:15.614745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.614890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.614915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.987 qpair failed and we were unable to recover it. 00:30:09.987 [2024-07-13 10:16:15.615063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.615178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.615203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.987 qpair failed and we were unable to recover it. 00:30:09.987 [2024-07-13 10:16:15.615330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.615475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.615500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.987 qpair failed and we were unable to recover it. 00:30:09.987 [2024-07-13 10:16:15.615648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.615806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.615832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.987 qpair failed and we were unable to recover it. 00:30:09.987 [2024-07-13 10:16:15.615965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.616117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.616143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.987 qpair failed and we were unable to recover it. 00:30:09.987 [2024-07-13 10:16:15.616328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.616479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.616505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.987 qpair failed and we were unable to recover it. 00:30:09.987 [2024-07-13 10:16:15.616619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.616791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.616817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.987 qpair failed and we were unable to recover it. 00:30:09.987 [2024-07-13 10:16:15.616958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.617078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.617103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.987 qpair failed and we were unable to recover it. 00:30:09.987 [2024-07-13 10:16:15.617267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.617417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.617443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.987 qpair failed and we were unable to recover it. 00:30:09.987 [2024-07-13 10:16:15.617554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.617664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.617689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.987 qpair failed and we were unable to recover it. 00:30:09.987 [2024-07-13 10:16:15.617841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.617982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.618007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.987 qpair failed and we were unable to recover it. 00:30:09.987 [2024-07-13 10:16:15.618165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.618339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.618364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.987 qpair failed and we were unable to recover it. 00:30:09.987 [2024-07-13 10:16:15.618545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.618717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.618742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.987 qpair failed and we were unable to recover it. 00:30:09.987 [2024-07-13 10:16:15.618881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.619056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.619081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.987 qpair failed and we were unable to recover it. 00:30:09.987 [2024-07-13 10:16:15.619202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.619317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.619342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.987 qpair failed and we were unable to recover it. 00:30:09.987 [2024-07-13 10:16:15.619495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.619644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.619674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.987 qpair failed and we were unable to recover it. 00:30:09.987 [2024-07-13 10:16:15.619833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.619976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.620002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.987 qpair failed and we were unable to recover it. 00:30:09.987 [2024-07-13 10:16:15.620131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.620260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.987 [2024-07-13 10:16:15.620286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.987 qpair failed and we were unable to recover it. 00:30:09.988 [2024-07-13 10:16:15.620415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.620547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.620572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.988 qpair failed and we were unable to recover it. 00:30:09.988 [2024-07-13 10:16:15.620727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.620853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.620885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.988 qpair failed and we were unable to recover it. 00:30:09.988 [2024-07-13 10:16:15.621012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.621140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.621172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.988 qpair failed and we were unable to recover it. 00:30:09.988 [2024-07-13 10:16:15.621351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.621475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.621500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.988 qpair failed and we were unable to recover it. 00:30:09.988 [2024-07-13 10:16:15.621624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.621779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.621805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.988 qpair failed and we were unable to recover it. 00:30:09.988 [2024-07-13 10:16:15.621962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.622113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.622138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.988 qpair failed and we were unable to recover it. 00:30:09.988 [2024-07-13 10:16:15.622293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.622446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.622472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.988 qpair failed and we were unable to recover it. 00:30:09.988 [2024-07-13 10:16:15.622630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.622745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.622770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.988 qpair failed and we were unable to recover it. 00:30:09.988 [2024-07-13 10:16:15.622928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.623056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.623082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.988 qpair failed and we were unable to recover it. 00:30:09.988 [2024-07-13 10:16:15.623208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.623353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.623377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.988 qpair failed and we were unable to recover it. 00:30:09.988 [2024-07-13 10:16:15.623522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.623641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.623666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.988 qpair failed and we were unable to recover it. 00:30:09.988 [2024-07-13 10:16:15.623796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.623953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.623979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.988 qpair failed and we were unable to recover it. 00:30:09.988 [2024-07-13 10:16:15.624114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.624245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.624270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.988 qpair failed and we were unable to recover it. 00:30:09.988 [2024-07-13 10:16:15.624420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.624532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.624556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.988 qpair failed and we were unable to recover it. 00:30:09.988 [2024-07-13 10:16:15.624704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.624863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.624892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.988 qpair failed and we were unable to recover it. 00:30:09.988 [2024-07-13 10:16:15.625038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.625164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.625189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.988 qpair failed and we were unable to recover it. 00:30:09.988 [2024-07-13 10:16:15.625302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.625426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.625451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.988 qpair failed and we were unable to recover it. 00:30:09.988 [2024-07-13 10:16:15.625585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.625705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.625732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.988 qpair failed and we were unable to recover it. 00:30:09.988 [2024-07-13 10:16:15.625856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.626013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.626039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.988 qpair failed and we were unable to recover it. 00:30:09.988 [2024-07-13 10:16:15.626190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.626311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.626337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.988 qpair failed and we were unable to recover it. 00:30:09.988 [2024-07-13 10:16:15.626461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.626632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.626657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.988 qpair failed and we were unable to recover it. 00:30:09.988 [2024-07-13 10:16:15.626773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.626894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.626920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.988 qpair failed and we were unable to recover it. 00:30:09.988 [2024-07-13 10:16:15.627045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.627187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.627212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.988 qpair failed and we were unable to recover it. 00:30:09.988 [2024-07-13 10:16:15.627339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.627483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.627508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.988 qpair failed and we were unable to recover it. 00:30:09.988 [2024-07-13 10:16:15.627662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.627830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.627872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.988 qpair failed and we were unable to recover it. 00:30:09.988 [2024-07-13 10:16:15.627994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.628139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.628175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.988 qpair failed and we were unable to recover it. 00:30:09.988 [2024-07-13 10:16:15.628303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.628422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.628446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.988 qpair failed and we were unable to recover it. 00:30:09.988 [2024-07-13 10:16:15.628585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.628728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.628753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.988 qpair failed and we were unable to recover it. 00:30:09.988 [2024-07-13 10:16:15.628899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.629032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.629057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.988 qpair failed and we were unable to recover it. 00:30:09.988 [2024-07-13 10:16:15.629221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.629378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.629402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.988 qpair failed and we were unable to recover it. 00:30:09.988 [2024-07-13 10:16:15.629526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.629676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.629701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.988 qpair failed and we were unable to recover it. 00:30:09.988 [2024-07-13 10:16:15.629822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.629971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.629997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.988 qpair failed and we were unable to recover it. 00:30:09.988 [2024-07-13 10:16:15.630122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.630270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.630296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.988 qpair failed and we were unable to recover it. 00:30:09.988 [2024-07-13 10:16:15.630442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.630556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.630581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.988 qpair failed and we were unable to recover it. 00:30:09.988 [2024-07-13 10:16:15.630734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.630894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.630921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.988 qpair failed and we were unable to recover it. 00:30:09.988 [2024-07-13 10:16:15.631079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.631216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.631240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.988 qpair failed and we were unable to recover it. 00:30:09.988 [2024-07-13 10:16:15.631368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.631480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.631505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.988 qpair failed and we were unable to recover it. 00:30:09.988 [2024-07-13 10:16:15.631619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.631770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.631794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.988 qpair failed and we were unable to recover it. 00:30:09.988 [2024-07-13 10:16:15.631952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.632086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.632112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.988 qpair failed and we were unable to recover it. 00:30:09.988 [2024-07-13 10:16:15.632242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.632365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.632391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.988 qpair failed and we were unable to recover it. 00:30:09.988 [2024-07-13 10:16:15.632528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.632710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.988 [2024-07-13 10:16:15.632735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.988 qpair failed and we were unable to recover it. 00:30:09.989 [2024-07-13 10:16:15.632852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.633003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.633028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.989 qpair failed and we were unable to recover it. 00:30:09.989 [2024-07-13 10:16:15.633149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.633282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.633307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.989 qpair failed and we were unable to recover it. 00:30:09.989 [2024-07-13 10:16:15.633424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.633537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.633561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.989 qpair failed and we were unable to recover it. 00:30:09.989 [2024-07-13 10:16:15.633686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.633836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.633876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.989 qpair failed and we were unable to recover it. 00:30:09.989 [2024-07-13 10:16:15.634014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.634138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.634173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.989 qpair failed and we were unable to recover it. 00:30:09.989 [2024-07-13 10:16:15.634346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.634499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.634525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.989 qpair failed and we were unable to recover it. 00:30:09.989 [2024-07-13 10:16:15.634671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.634785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.634810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.989 qpair failed and we were unable to recover it. 00:30:09.989 [2024-07-13 10:16:15.634979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.635098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.635127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.989 qpair failed and we were unable to recover it. 00:30:09.989 [2024-07-13 10:16:15.635281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.635410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.635435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.989 qpair failed and we were unable to recover it. 00:30:09.989 [2024-07-13 10:16:15.635557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.635691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.635716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.989 qpair failed and we were unable to recover it. 00:30:09.989 [2024-07-13 10:16:15.635840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.636005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.636030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.989 qpair failed and we were unable to recover it. 00:30:09.989 [2024-07-13 10:16:15.636152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.636285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.636312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.989 qpair failed and we were unable to recover it. 00:30:09.989 [2024-07-13 10:16:15.636437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.636550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.636575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.989 qpair failed and we were unable to recover it. 00:30:09.989 [2024-07-13 10:16:15.636727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.636863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.636893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.989 qpair failed and we were unable to recover it. 00:30:09.989 [2024-07-13 10:16:15.637019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.637162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.637186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.989 qpair failed and we were unable to recover it. 00:30:09.989 [2024-07-13 10:16:15.637334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.637487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.637512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.989 qpair failed and we were unable to recover it. 00:30:09.989 [2024-07-13 10:16:15.637637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.637798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.637822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.989 qpair failed and we were unable to recover it. 00:30:09.989 [2024-07-13 10:16:15.637981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.638114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.638139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.989 qpair failed and we were unable to recover it. 00:30:09.989 [2024-07-13 10:16:15.638268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.638414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.638438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.989 qpair failed and we were unable to recover it. 00:30:09.989 [2024-07-13 10:16:15.638601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.638727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.638761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.989 qpair failed and we were unable to recover it. 00:30:09.989 [2024-07-13 10:16:15.638887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.639042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.639067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.989 qpair failed and we were unable to recover it. 00:30:09.989 [2024-07-13 10:16:15.639202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.639347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.639371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.989 qpair failed and we were unable to recover it. 00:30:09.989 [2024-07-13 10:16:15.639522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.639652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.639677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.989 qpair failed and we were unable to recover it. 00:30:09.989 [2024-07-13 10:16:15.639858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.640014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.640039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.989 qpair failed and we were unable to recover it. 00:30:09.989 [2024-07-13 10:16:15.640166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.640280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.640306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.989 qpair failed and we were unable to recover it. 00:30:09.989 [2024-07-13 10:16:15.640452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.640578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.640603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.989 qpair failed and we were unable to recover it. 00:30:09.989 [2024-07-13 10:16:15.640731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.640882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.640909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.989 qpair failed and we were unable to recover it. 00:30:09.989 [2024-07-13 10:16:15.641049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.641192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.641216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.989 qpair failed and we were unable to recover it. 00:30:09.989 [2024-07-13 10:16:15.641396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.641554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.641579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.989 qpair failed and we were unable to recover it. 00:30:09.989 [2024-07-13 10:16:15.641705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.641851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.641881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.989 qpair failed and we were unable to recover it. 00:30:09.989 [2024-07-13 10:16:15.642009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.642134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.642163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.989 qpair failed and we were unable to recover it. 00:30:09.989 [2024-07-13 10:16:15.642306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.642438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.642462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.989 qpair failed and we were unable to recover it. 00:30:09.989 [2024-07-13 10:16:15.642583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.642709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.642734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.989 qpair failed and we were unable to recover it. 00:30:09.989 [2024-07-13 10:16:15.642887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.643032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.643057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.989 qpair failed and we were unable to recover it. 00:30:09.989 [2024-07-13 10:16:15.643184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.643338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.643363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.989 qpair failed and we were unable to recover it. 00:30:09.989 [2024-07-13 10:16:15.643484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.643645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.643669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.989 qpair failed and we were unable to recover it. 00:30:09.989 [2024-07-13 10:16:15.643845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.643969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.989 [2024-07-13 10:16:15.643995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.989 qpair failed and we were unable to recover it. 00:30:09.989 [2024-07-13 10:16:15.644147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.644273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.644298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.990 qpair failed and we were unable to recover it. 00:30:09.990 [2024-07-13 10:16:15.644452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.644596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.644620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.990 qpair failed and we were unable to recover it. 00:30:09.990 [2024-07-13 10:16:15.644752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.644900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.644926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.990 qpair failed and we were unable to recover it. 00:30:09.990 [2024-07-13 10:16:15.645065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.645213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.645237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.990 qpair failed and we were unable to recover it. 00:30:09.990 [2024-07-13 10:16:15.645384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.645500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.645525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.990 qpair failed and we were unable to recover it. 00:30:09.990 [2024-07-13 10:16:15.645672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.645788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.645813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.990 qpair failed and we were unable to recover it. 00:30:09.990 [2024-07-13 10:16:15.645949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.646060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.646085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.990 qpair failed and we were unable to recover it. 00:30:09.990 [2024-07-13 10:16:15.646240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.646354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.646379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.990 qpair failed and we were unable to recover it. 00:30:09.990 [2024-07-13 10:16:15.646503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.646623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.646648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.990 qpair failed and we were unable to recover it. 00:30:09.990 [2024-07-13 10:16:15.646804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.646936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.646962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.990 qpair failed and we were unable to recover it. 00:30:09.990 [2024-07-13 10:16:15.647091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.647202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.647226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.990 qpair failed and we were unable to recover it. 00:30:09.990 [2024-07-13 10:16:15.647369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.647503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.647527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.990 qpair failed and we were unable to recover it. 00:30:09.990 [2024-07-13 10:16:15.647681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.647801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.647825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.990 qpair failed and we were unable to recover it. 00:30:09.990 [2024-07-13 10:16:15.647981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.648129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.648164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.990 qpair failed and we were unable to recover it. 00:30:09.990 [2024-07-13 10:16:15.648312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.648455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.648480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.990 qpair failed and we were unable to recover it. 00:30:09.990 [2024-07-13 10:16:15.648598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.648715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.648739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.990 qpair failed and we were unable to recover it. 00:30:09.990 [2024-07-13 10:16:15.648893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.649046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.649071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.990 qpair failed and we were unable to recover it. 00:30:09.990 [2024-07-13 10:16:15.649219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.649346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.649370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.990 qpair failed and we were unable to recover it. 00:30:09.990 [2024-07-13 10:16:15.649498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.649643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.649667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.990 qpair failed and we were unable to recover it. 00:30:09.990 [2024-07-13 10:16:15.649798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.649956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.649982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.990 qpair failed and we were unable to recover it. 00:30:09.990 [2024-07-13 10:16:15.650106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.650231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.650256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.990 qpair failed and we were unable to recover it. 00:30:09.990 [2024-07-13 10:16:15.650403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.650534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.650563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.990 qpair failed and we were unable to recover it. 00:30:09.990 [2024-07-13 10:16:15.650739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.650859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.650899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.990 qpair failed and we were unable to recover it. 00:30:09.990 [2024-07-13 10:16:15.651031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.651146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.651170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.990 qpair failed and we were unable to recover it. 00:30:09.990 [2024-07-13 10:16:15.651317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.651432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.651457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.990 qpair failed and we were unable to recover it. 00:30:09.990 [2024-07-13 10:16:15.651603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.651749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.651773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.990 qpair failed and we were unable to recover it. 00:30:09.990 [2024-07-13 10:16:15.651886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.652045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.652070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.990 qpair failed and we were unable to recover it. 00:30:09.990 [2024-07-13 10:16:15.652218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.652345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.652369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.990 qpair failed and we were unable to recover it. 00:30:09.990 [2024-07-13 10:16:15.652506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.652663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.652687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.990 qpair failed and we were unable to recover it. 00:30:09.990 [2024-07-13 10:16:15.652803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.652987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.653013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.990 qpair failed and we were unable to recover it. 00:30:09.990 [2024-07-13 10:16:15.653149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.653272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.653297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.990 qpair failed and we were unable to recover it. 00:30:09.990 [2024-07-13 10:16:15.653452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.653568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.653596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.990 qpair failed and we were unable to recover it. 00:30:09.990 [2024-07-13 10:16:15.653743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.653890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.653915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.990 qpair failed and we were unable to recover it. 00:30:09.990 [2024-07-13 10:16:15.654075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.654226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.654251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.990 qpair failed and we were unable to recover it. 00:30:09.990 [2024-07-13 10:16:15.654385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.654529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.654555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.990 qpair failed and we were unable to recover it. 00:30:09.990 [2024-07-13 10:16:15.654678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.654802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.654827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.990 qpair failed and we were unable to recover it. 00:30:09.990 [2024-07-13 10:16:15.654943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.655065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.655090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.990 qpair failed and we were unable to recover it. 00:30:09.990 [2024-07-13 10:16:15.655208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.655354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.655379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.990 qpair failed and we were unable to recover it. 00:30:09.990 [2024-07-13 10:16:15.655536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.655680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.655705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.990 qpair failed and we were unable to recover it. 00:30:09.990 [2024-07-13 10:16:15.655851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.656001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.656027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.990 qpair failed and we were unable to recover it. 00:30:09.990 [2024-07-13 10:16:15.656174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.656295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.990 [2024-07-13 10:16:15.656320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.990 qpair failed and we were unable to recover it. 00:30:09.990 [2024-07-13 10:16:15.656437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.656547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.656572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.991 qpair failed and we were unable to recover it. 00:30:09.991 [2024-07-13 10:16:15.656734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.656857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.656889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.991 qpair failed and we were unable to recover it. 00:30:09.991 [2024-07-13 10:16:15.657037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.657178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.657204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.991 qpair failed and we were unable to recover it. 00:30:09.991 [2024-07-13 10:16:15.657358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.657471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.657496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.991 qpair failed and we were unable to recover it. 00:30:09.991 [2024-07-13 10:16:15.657624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.657769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.657794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.991 qpair failed and we were unable to recover it. 00:30:09.991 [2024-07-13 10:16:15.657944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.658069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.658094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.991 qpair failed and we were unable to recover it. 00:30:09.991 [2024-07-13 10:16:15.658250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.658376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.658401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.991 qpair failed and we were unable to recover it. 00:30:09.991 [2024-07-13 10:16:15.658522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.658642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.658667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.991 qpair failed and we were unable to recover it. 00:30:09.991 [2024-07-13 10:16:15.658780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.658921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.658947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.991 qpair failed and we were unable to recover it. 00:30:09.991 [2024-07-13 10:16:15.659086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.659268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.659293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.991 qpair failed and we were unable to recover it. 00:30:09.991 [2024-07-13 10:16:15.659417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.659532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.659558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.991 qpair failed and we were unable to recover it. 00:30:09.991 [2024-07-13 10:16:15.659724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.659873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.659899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.991 qpair failed and we were unable to recover it. 00:30:09.991 [2024-07-13 10:16:15.660046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.660159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.660184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.991 qpair failed and we were unable to recover it. 00:30:09.991 [2024-07-13 10:16:15.660336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.660483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.660508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.991 qpair failed and we were unable to recover it. 00:30:09.991 [2024-07-13 10:16:15.660624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.660798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.660823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.991 qpair failed and we were unable to recover it. 00:30:09.991 [2024-07-13 10:16:15.660962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.661076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.661101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.991 qpair failed and we were unable to recover it. 00:30:09.991 [2024-07-13 10:16:15.661265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.661393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.661418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.991 qpair failed and we were unable to recover it. 00:30:09.991 [2024-07-13 10:16:15.661568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.661683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.661708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.991 qpair failed and we were unable to recover it. 00:30:09.991 [2024-07-13 10:16:15.661860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.662007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.662033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.991 qpair failed and we were unable to recover it. 00:30:09.991 [2024-07-13 10:16:15.662212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.662327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.662352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.991 qpair failed and we were unable to recover it. 00:30:09.991 [2024-07-13 10:16:15.662500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.662616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.662642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.991 qpair failed and we were unable to recover it. 00:30:09.991 [2024-07-13 10:16:15.662755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.662894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.662920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.991 qpair failed and we were unable to recover it. 00:30:09.991 [2024-07-13 10:16:15.663101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.663229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.663254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.991 qpair failed and we were unable to recover it. 00:30:09.991 [2024-07-13 10:16:15.663387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.663508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.663533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.991 qpair failed and we were unable to recover it. 00:30:09.991 [2024-07-13 10:16:15.663690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.663834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.663876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.991 qpair failed and we were unable to recover it. 00:30:09.991 [2024-07-13 10:16:15.664011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.664135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.664167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.991 qpair failed and we were unable to recover it. 00:30:09.991 [2024-07-13 10:16:15.664289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.664434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.664459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.991 qpair failed and we were unable to recover it. 00:30:09.991 [2024-07-13 10:16:15.664607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.664719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.664744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.991 qpair failed and we were unable to recover it. 00:30:09.991 [2024-07-13 10:16:15.664875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.665019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.665044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.991 qpair failed and we were unable to recover it. 00:30:09.991 [2024-07-13 10:16:15.665187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.665312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.665336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.991 qpair failed and we were unable to recover it. 00:30:09.991 [2024-07-13 10:16:15.665482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.665594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.665618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.991 qpair failed and we were unable to recover it. 00:30:09.991 [2024-07-13 10:16:15.665743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.665925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.665951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.991 qpair failed and we were unable to recover it. 00:30:09.991 [2024-07-13 10:16:15.666073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.666218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.666243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.991 qpair failed and we were unable to recover it. 00:30:09.991 [2024-07-13 10:16:15.666401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.666515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.666539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.991 qpair failed and we were unable to recover it. 00:30:09.991 [2024-07-13 10:16:15.666653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.666781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.666805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.991 qpair failed and we were unable to recover it. 00:30:09.991 [2024-07-13 10:16:15.666936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.667064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.667090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.991 qpair failed and we were unable to recover it. 00:30:09.991 [2024-07-13 10:16:15.667245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.667369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.667394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.991 qpair failed and we were unable to recover it. 00:30:09.991 [2024-07-13 10:16:15.667514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.667629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.667653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.991 qpair failed and we were unable to recover it. 00:30:09.991 [2024-07-13 10:16:15.667765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.667928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.667952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.991 qpair failed and we were unable to recover it. 00:30:09.991 [2024-07-13 10:16:15.668104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.668256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.668281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.991 qpair failed and we were unable to recover it. 00:30:09.991 [2024-07-13 10:16:15.668428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.668555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.668579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.991 qpair failed and we were unable to recover it. 00:30:09.991 [2024-07-13 10:16:15.668715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.991 [2024-07-13 10:16:15.668839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.668878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.992 qpair failed and we were unable to recover it. 00:30:09.992 [2024-07-13 10:16:15.669007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.669119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.669144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.992 qpair failed and we were unable to recover it. 00:30:09.992 [2024-07-13 10:16:15.669316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.669434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.669459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.992 qpair failed and we were unable to recover it. 00:30:09.992 [2024-07-13 10:16:15.669599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.669770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.669794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.992 qpair failed and we were unable to recover it. 00:30:09.992 [2024-07-13 10:16:15.669924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.670058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.670082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.992 qpair failed and we were unable to recover it. 00:30:09.992 [2024-07-13 10:16:15.670201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.670354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.670380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.992 qpair failed and we were unable to recover it. 00:30:09.992 [2024-07-13 10:16:15.670560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.670717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.670742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.992 qpair failed and we were unable to recover it. 00:30:09.992 [2024-07-13 10:16:15.670900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.671033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.671059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.992 qpair failed and we were unable to recover it. 00:30:09.992 [2024-07-13 10:16:15.671214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.671333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.671359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.992 qpair failed and we were unable to recover it. 00:30:09.992 [2024-07-13 10:16:15.671522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.671671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.671696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.992 qpair failed and we were unable to recover it. 00:30:09.992 [2024-07-13 10:16:15.671851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.671973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.671999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.992 qpair failed and we were unable to recover it. 00:30:09.992 [2024-07-13 10:16:15.672130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.672277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.672302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.992 qpair failed and we were unable to recover it. 00:30:09.992 [2024-07-13 10:16:15.672440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.672585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.672611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.992 qpair failed and we were unable to recover it. 00:30:09.992 [2024-07-13 10:16:15.672738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.672862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.672893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.992 qpair failed and we were unable to recover it. 00:30:09.992 [2024-07-13 10:16:15.673053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.673184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.673209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.992 qpair failed and we were unable to recover it. 00:30:09.992 [2024-07-13 10:16:15.673359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.673484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.673508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.992 qpair failed and we were unable to recover it. 00:30:09.992 [2024-07-13 10:16:15.673674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.673793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.673818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.992 qpair failed and we were unable to recover it. 00:30:09.992 [2024-07-13 10:16:15.673942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.674065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.674091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.992 qpair failed and we were unable to recover it. 00:30:09.992 [2024-07-13 10:16:15.674222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.674342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.674367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.992 qpair failed and we were unable to recover it. 00:30:09.992 [2024-07-13 10:16:15.674494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.674637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.674663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.992 qpair failed and we were unable to recover it. 00:30:09.992 [2024-07-13 10:16:15.674828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.674969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.674994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.992 qpair failed and we were unable to recover it. 00:30:09.992 [2024-07-13 10:16:15.675125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.675260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.675286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.992 qpair failed and we were unable to recover it. 00:30:09.992 [2024-07-13 10:16:15.675429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.675569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.675594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.992 qpair failed and we were unable to recover it. 00:30:09.992 [2024-07-13 10:16:15.675741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.675877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.675903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.992 qpair failed and we were unable to recover it. 00:30:09.992 [2024-07-13 10:16:15.676081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.676202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.676227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.992 qpair failed and we were unable to recover it. 00:30:09.992 [2024-07-13 10:16:15.676380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.676506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.676532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.992 qpair failed and we were unable to recover it. 00:30:09.992 [2024-07-13 10:16:15.676663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.676814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.676839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.992 qpair failed and we were unable to recover it. 00:30:09.992 [2024-07-13 10:16:15.676975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.677128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.677152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.992 qpair failed and we were unable to recover it. 00:30:09.992 [2024-07-13 10:16:15.677276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.677451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.677475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.992 qpair failed and we were unable to recover it. 00:30:09.992 [2024-07-13 10:16:15.677610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.677754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.677779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.992 qpair failed and we were unable to recover it. 00:30:09.992 [2024-07-13 10:16:15.677914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.678037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.678063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.992 qpair failed and we were unable to recover it. 00:30:09.992 [2024-07-13 10:16:15.678223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.678356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.678382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.992 qpair failed and we were unable to recover it. 00:30:09.992 [2024-07-13 10:16:15.678505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.678634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.678660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.992 qpair failed and we were unable to recover it. 00:30:09.992 [2024-07-13 10:16:15.678812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.678929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.678955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.992 qpair failed and we were unable to recover it. 00:30:09.992 [2024-07-13 10:16:15.679110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.679259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.679284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.992 qpair failed and we were unable to recover it. 00:30:09.992 [2024-07-13 10:16:15.679410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.679590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.679615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.992 qpair failed and we were unable to recover it. 00:30:09.992 [2024-07-13 10:16:15.679773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.679898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.679933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.992 qpair failed and we were unable to recover it. 00:30:09.992 [2024-07-13 10:16:15.680056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.680213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.680239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.992 qpair failed and we were unable to recover it. 00:30:09.992 [2024-07-13 10:16:15.680392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.680516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.680541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.992 qpair failed and we were unable to recover it. 00:30:09.992 [2024-07-13 10:16:15.680697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.680841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.680871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.992 qpair failed and we were unable to recover it. 00:30:09.992 [2024-07-13 10:16:15.681006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.681123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.992 [2024-07-13 10:16:15.681149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.992 qpair failed and we were unable to recover it. 00:30:09.992 [2024-07-13 10:16:15.681289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.681422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.681447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.993 qpair failed and we were unable to recover it. 00:30:09.993 [2024-07-13 10:16:15.681598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.681719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.681745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.993 qpair failed and we were unable to recover it. 00:30:09.993 [2024-07-13 10:16:15.681890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.682027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.682051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.993 qpair failed and we were unable to recover it. 00:30:09.993 [2024-07-13 10:16:15.682194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.682321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.682345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.993 qpair failed and we were unable to recover it. 00:30:09.993 [2024-07-13 10:16:15.682470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.682621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.682646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.993 qpair failed and we were unable to recover it. 00:30:09.993 [2024-07-13 10:16:15.682764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.682893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.682925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.993 qpair failed and we were unable to recover it. 00:30:09.993 [2024-07-13 10:16:15.683078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.683208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.683234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.993 qpair failed and we were unable to recover it. 00:30:09.993 [2024-07-13 10:16:15.683355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.683531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.683556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.993 qpair failed and we were unable to recover it. 00:30:09.993 [2024-07-13 10:16:15.683737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.683859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.683890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.993 qpair failed and we were unable to recover it. 00:30:09.993 [2024-07-13 10:16:15.684016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.684132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.684166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.993 qpair failed and we were unable to recover it. 00:30:09.993 [2024-07-13 10:16:15.684297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.684409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.684437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.993 qpair failed and we were unable to recover it. 00:30:09.993 [2024-07-13 10:16:15.684598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.684746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.684770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.993 qpair failed and we were unable to recover it. 00:30:09.993 [2024-07-13 10:16:15.684901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.685026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.685051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.993 qpair failed and we were unable to recover it. 00:30:09.993 [2024-07-13 10:16:15.685199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.685343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.685369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.993 qpair failed and we were unable to recover it. 00:30:09.993 [2024-07-13 10:16:15.685498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.685670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.685696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.993 qpair failed and we were unable to recover it. 00:30:09.993 [2024-07-13 10:16:15.685813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.685974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.686000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.993 qpair failed and we were unable to recover it. 00:30:09.993 [2024-07-13 10:16:15.686162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.686288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.686313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.993 qpair failed and we were unable to recover it. 00:30:09.993 [2024-07-13 10:16:15.686429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.686574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.686599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.993 qpair failed and we were unable to recover it. 00:30:09.993 [2024-07-13 10:16:15.686721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.686846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.686893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.993 qpair failed and we were unable to recover it. 00:30:09.993 [2024-07-13 10:16:15.687025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.687179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.687204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.993 qpair failed and we were unable to recover it. 00:30:09.993 [2024-07-13 10:16:15.687338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.687485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.687511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.993 qpair failed and we were unable to recover it. 00:30:09.993 [2024-07-13 10:16:15.687634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.687809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.687833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.993 qpair failed and we were unable to recover it. 00:30:09.993 [2024-07-13 10:16:15.687996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.688118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.688143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.993 qpair failed and we were unable to recover it. 00:30:09.993 [2024-07-13 10:16:15.688262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.688382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.688407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.993 qpair failed and we were unable to recover it. 00:30:09.993 [2024-07-13 10:16:15.688557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.688669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.688693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.993 qpair failed and we were unable to recover it. 00:30:09.993 [2024-07-13 10:16:15.688837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.688967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.688993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.993 qpair failed and we were unable to recover it. 00:30:09.993 [2024-07-13 10:16:15.689141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.689271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.689297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.993 qpair failed and we were unable to recover it. 00:30:09.993 [2024-07-13 10:16:15.689452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.689607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.689633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.993 qpair failed and we were unable to recover it. 00:30:09.993 [2024-07-13 10:16:15.689781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.689926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.689952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.993 qpair failed and we were unable to recover it. 00:30:09.993 [2024-07-13 10:16:15.690079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.690225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.690250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.993 qpair failed and we were unable to recover it. 00:30:09.993 [2024-07-13 10:16:15.690376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.690495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.690520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.993 qpair failed and we were unable to recover it. 00:30:09.993 [2024-07-13 10:16:15.690644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.690818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.690844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.993 qpair failed and we were unable to recover it. 00:30:09.993 [2024-07-13 10:16:15.691011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.691151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.691179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.993 qpair failed and we were unable to recover it. 00:30:09.993 [2024-07-13 10:16:15.691335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.691511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.691536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.993 qpair failed and we were unable to recover it. 00:30:09.993 [2024-07-13 10:16:15.691685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.691840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.691872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.993 qpair failed and we were unable to recover it. 00:30:09.993 [2024-07-13 10:16:15.691996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.692140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.692176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.993 qpair failed and we were unable to recover it. 00:30:09.993 [2024-07-13 10:16:15.692297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.692410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.993 [2024-07-13 10:16:15.692435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.993 qpair failed and we were unable to recover it. 00:30:09.993 [2024-07-13 10:16:15.692580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.692710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.692735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.994 qpair failed and we were unable to recover it. 00:30:09.994 [2024-07-13 10:16:15.692887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.693046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.693070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.994 qpair failed and we were unable to recover it. 00:30:09.994 [2024-07-13 10:16:15.693195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.693337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.693362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.994 qpair failed and we were unable to recover it. 00:30:09.994 [2024-07-13 10:16:15.693491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.693629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.693654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.994 qpair failed and we were unable to recover it. 00:30:09.994 [2024-07-13 10:16:15.693783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.693930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.693957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.994 qpair failed and we were unable to recover it. 00:30:09.994 [2024-07-13 10:16:15.694094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.694226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.694251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.994 qpair failed and we were unable to recover it. 00:30:09.994 [2024-07-13 10:16:15.694384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.694511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.694536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.994 qpair failed and we were unable to recover it. 00:30:09.994 [2024-07-13 10:16:15.694649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.694804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.694828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.994 qpair failed and we were unable to recover it. 00:30:09.994 [2024-07-13 10:16:15.694951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.695067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.695091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.994 qpair failed and we were unable to recover it. 00:30:09.994 [2024-07-13 10:16:15.695259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.695407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.695432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.994 qpair failed and we were unable to recover it. 00:30:09.994 [2024-07-13 10:16:15.695578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.695729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.695754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.994 qpair failed and we were unable to recover it. 00:30:09.994 [2024-07-13 10:16:15.695878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.696015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.696040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.994 qpair failed and we were unable to recover it. 00:30:09.994 [2024-07-13 10:16:15.696200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.696319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.696344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.994 qpair failed and we were unable to recover it. 00:30:09.994 [2024-07-13 10:16:15.696502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.696624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.696650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.994 qpair failed and we were unable to recover it. 00:30:09.994 [2024-07-13 10:16:15.696808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.696990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.697016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.994 qpair failed and we were unable to recover it. 00:30:09.994 [2024-07-13 10:16:15.697137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.697252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.697278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.994 qpair failed and we were unable to recover it. 00:30:09.994 [2024-07-13 10:16:15.697454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.697600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.697625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.994 qpair failed and we were unable to recover it. 00:30:09.994 [2024-07-13 10:16:15.697762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.697909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.697935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.994 qpair failed and we were unable to recover it. 00:30:09.994 [2024-07-13 10:16:15.698085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.698216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.698241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.994 qpair failed and we were unable to recover it. 00:30:09.994 [2024-07-13 10:16:15.698391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.698507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.698533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.994 qpair failed and we were unable to recover it. 00:30:09.994 [2024-07-13 10:16:15.698686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.698835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.698860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.994 qpair failed and we were unable to recover it. 00:30:09.994 [2024-07-13 10:16:15.699043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.699194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.699219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.994 qpair failed and we were unable to recover it. 00:30:09.994 [2024-07-13 10:16:15.699368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.699488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.699513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.994 qpair failed and we were unable to recover it. 00:30:09.994 [2024-07-13 10:16:15.699659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.699781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.699807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.994 qpair failed and we were unable to recover it. 00:30:09.994 [2024-07-13 10:16:15.699935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.700060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.700090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.994 qpair failed and we were unable to recover it. 00:30:09.994 [2024-07-13 10:16:15.700254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.700377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.700404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.994 qpair failed and we were unable to recover it. 00:30:09.994 [2024-07-13 10:16:15.700549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.700693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.700718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.994 qpair failed and we were unable to recover it. 00:30:09.994 [2024-07-13 10:16:15.700877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.700993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.701018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.994 qpair failed and we were unable to recover it. 00:30:09.994 [2024-07-13 10:16:15.701134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.701268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.701293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.994 qpair failed and we were unable to recover it. 00:30:09.994 [2024-07-13 10:16:15.701422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.701568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.701595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.994 qpair failed and we were unable to recover it. 00:30:09.994 [2024-07-13 10:16:15.701747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.701863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.701895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.994 qpair failed and we were unable to recover it. 00:30:09.994 [2024-07-13 10:16:15.702051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.702198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.702224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.994 qpair failed and we were unable to recover it. 00:30:09.994 [2024-07-13 10:16:15.702348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.702527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.702553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.994 qpair failed and we were unable to recover it. 00:30:09.994 [2024-07-13 10:16:15.702667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.702841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.702880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.994 qpair failed and we were unable to recover it. 00:30:09.994 [2024-07-13 10:16:15.703024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.703141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.703171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.994 qpair failed and we were unable to recover it. 00:30:09.994 [2024-07-13 10:16:15.703319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.703468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.703493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.994 qpair failed and we were unable to recover it. 00:30:09.994 [2024-07-13 10:16:15.703645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.703759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.703784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.994 qpair failed and we were unable to recover it. 00:30:09.994 [2024-07-13 10:16:15.703902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.704050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.704075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.994 qpair failed and we were unable to recover it. 00:30:09.994 [2024-07-13 10:16:15.704200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.704346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.704372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.994 qpair failed and we were unable to recover it. 00:30:09.994 [2024-07-13 10:16:15.704486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.704629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.704654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.994 qpair failed and we were unable to recover it. 00:30:09.994 [2024-07-13 10:16:15.704779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.704901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.704926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.994 qpair failed and we were unable to recover it. 00:30:09.994 [2024-07-13 10:16:15.705079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.994 [2024-07-13 10:16:15.705204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.705229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.995 qpair failed and we were unable to recover it. 00:30:09.995 [2024-07-13 10:16:15.705343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.705462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.705487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.995 qpair failed and we were unable to recover it. 00:30:09.995 [2024-07-13 10:16:15.705599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.705713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.705739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.995 qpair failed and we were unable to recover it. 00:30:09.995 [2024-07-13 10:16:15.705894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.706021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.706048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.995 qpair failed and we were unable to recover it. 00:30:09.995 [2024-07-13 10:16:15.706165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.706308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.706332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.995 qpair failed and we were unable to recover it. 00:30:09.995 [2024-07-13 10:16:15.706479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.706625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.706651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.995 qpair failed and we were unable to recover it. 00:30:09.995 [2024-07-13 10:16:15.706795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.706928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.706954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.995 qpair failed and we were unable to recover it. 00:30:09.995 [2024-07-13 10:16:15.707103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.707224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.707250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.995 qpair failed and we were unable to recover it. 00:30:09.995 [2024-07-13 10:16:15.707381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.707496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.707520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.995 qpair failed and we were unable to recover it. 00:30:09.995 [2024-07-13 10:16:15.707665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.707836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.707861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.995 qpair failed and we were unable to recover it. 00:30:09.995 [2024-07-13 10:16:15.708088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.708235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.708261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.995 qpair failed and we were unable to recover it. 00:30:09.995 [2024-07-13 10:16:15.708416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.708566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.708591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.995 qpair failed and we were unable to recover it. 00:30:09.995 [2024-07-13 10:16:15.708714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.708832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.708857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.995 qpair failed and we were unable to recover it. 00:30:09.995 [2024-07-13 10:16:15.708993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.709116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.709142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.995 qpair failed and we were unable to recover it. 00:30:09.995 [2024-07-13 10:16:15.709295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.709439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.709465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.995 qpair failed and we were unable to recover it. 00:30:09.995 [2024-07-13 10:16:15.709585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.709709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.709734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.995 qpair failed and we were unable to recover it. 00:30:09.995 [2024-07-13 10:16:15.709882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.709999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.710025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.995 qpair failed and we were unable to recover it. 00:30:09.995 [2024-07-13 10:16:15.710149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.710272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.710297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.995 qpair failed and we were unable to recover it. 00:30:09.995 [2024-07-13 10:16:15.710423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.710595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.710620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.995 qpair failed and we were unable to recover it. 00:30:09.995 [2024-07-13 10:16:15.710764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.710888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.710918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.995 qpair failed and we were unable to recover it. 00:30:09.995 [2024-07-13 10:16:15.711047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.711167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.711192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.995 qpair failed and we were unable to recover it. 00:30:09.995 [2024-07-13 10:16:15.711344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.711486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.711511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.995 qpair failed and we were unable to recover it. 00:30:09.995 [2024-07-13 10:16:15.711662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.711796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.711822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.995 qpair failed and we were unable to recover it. 00:30:09.995 [2024-07-13 10:16:15.711989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.712112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.712138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.995 qpair failed and we were unable to recover it. 00:30:09.995 [2024-07-13 10:16:15.712295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.712446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.712471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.995 qpair failed and we were unable to recover it. 00:30:09.995 [2024-07-13 10:16:15.712646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.712774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.712799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.995 qpair failed and we were unable to recover it. 00:30:09.995 [2024-07-13 10:16:15.712936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.713063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.713088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.995 qpair failed and we were unable to recover it. 00:30:09.995 [2024-07-13 10:16:15.713231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.713408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.713434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.995 qpair failed and we were unable to recover it. 00:30:09.995 [2024-07-13 10:16:15.713582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.713724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.713749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.995 qpair failed and we were unable to recover it. 00:30:09.995 [2024-07-13 10:16:15.713878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.714003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.714029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.995 qpair failed and we were unable to recover it. 00:30:09.995 [2024-07-13 10:16:15.714159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.714273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.714298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.995 qpair failed and we were unable to recover it. 00:30:09.995 [2024-07-13 10:16:15.714432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.714582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.714608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.995 qpair failed and we were unable to recover it. 00:30:09.995 [2024-07-13 10:16:15.714740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.714872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.714899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.995 qpair failed and we were unable to recover it. 00:30:09.995 [2024-07-13 10:16:15.715037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.715183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.715208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.995 qpair failed and we were unable to recover it. 00:30:09.995 [2024-07-13 10:16:15.715366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.715514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.715539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.995 qpair failed and we were unable to recover it. 00:30:09.995 [2024-07-13 10:16:15.715660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.715801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.715825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.995 qpair failed and we were unable to recover it. 00:30:09.995 [2024-07-13 10:16:15.715965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.716087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.716111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.995 qpair failed and we were unable to recover it. 00:30:09.995 [2024-07-13 10:16:15.716236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.716410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.716435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.995 qpair failed and we were unable to recover it. 00:30:09.995 [2024-07-13 10:16:15.716551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.716708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.716734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.995 qpair failed and we were unable to recover it. 00:30:09.995 [2024-07-13 10:16:15.716852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.717012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.717036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.995 qpair failed and we were unable to recover it. 00:30:09.995 [2024-07-13 10:16:15.717189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.717327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.995 [2024-07-13 10:16:15.717353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.995 qpair failed and we were unable to recover it. 00:30:09.995 [2024-07-13 10:16:15.717514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.717658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.717684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.996 qpair failed and we were unable to recover it. 00:30:09.996 [2024-07-13 10:16:15.717820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.717956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.717982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.996 qpair failed and we were unable to recover it. 00:30:09.996 [2024-07-13 10:16:15.718107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.718239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.718264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.996 qpair failed and we were unable to recover it. 00:30:09.996 [2024-07-13 10:16:15.718410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.718559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.718588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.996 qpair failed and we were unable to recover it. 00:30:09.996 [2024-07-13 10:16:15.718703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.718840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.718871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.996 qpair failed and we were unable to recover it. 00:30:09.996 [2024-07-13 10:16:15.719034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.719150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.719188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.996 qpair failed and we were unable to recover it. 00:30:09.996 [2024-07-13 10:16:15.719313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.719463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.719490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.996 qpair failed and we were unable to recover it. 00:30:09.996 [2024-07-13 10:16:15.719620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.719761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.719787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.996 qpair failed and we were unable to recover it. 00:30:09.996 [2024-07-13 10:16:15.719947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.720097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.720122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.996 qpair failed and we were unable to recover it. 00:30:09.996 [2024-07-13 10:16:15.720278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.720420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.720445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.996 qpair failed and we were unable to recover it. 00:30:09.996 [2024-07-13 10:16:15.720623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.720742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.720767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.996 qpair failed and we were unable to recover it. 00:30:09.996 [2024-07-13 10:16:15.720887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.721016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.721040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.996 qpair failed and we were unable to recover it. 00:30:09.996 [2024-07-13 10:16:15.721156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.721304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.721329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.996 qpair failed and we were unable to recover it. 00:30:09.996 [2024-07-13 10:16:15.721457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.721604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.721629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.996 qpair failed and we were unable to recover it. 00:30:09.996 [2024-07-13 10:16:15.721753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.721906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.721934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.996 qpair failed and we were unable to recover it. 00:30:09.996 [2024-07-13 10:16:15.722095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.722243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.722269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.996 qpair failed and we were unable to recover it. 00:30:09.996 [2024-07-13 10:16:15.722387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.722505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.722530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.996 qpair failed and we were unable to recover it. 00:30:09.996 [2024-07-13 10:16:15.722647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.722789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.722814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.996 qpair failed and we were unable to recover it. 00:30:09.996 [2024-07-13 10:16:15.722964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.723083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.723108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.996 qpair failed and we were unable to recover it. 00:30:09.996 [2024-07-13 10:16:15.723243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.723385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.723411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.996 qpair failed and we were unable to recover it. 00:30:09.996 [2024-07-13 10:16:15.723563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.723676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.723702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.996 qpair failed and we were unable to recover it. 00:30:09.996 [2024-07-13 10:16:15.723821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.723948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.723973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.996 qpair failed and we were unable to recover it. 00:30:09.996 [2024-07-13 10:16:15.724104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.724234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.724260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.996 qpair failed and we were unable to recover it. 00:30:09.996 [2024-07-13 10:16:15.724385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.724530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.724556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.996 qpair failed and we were unable to recover it. 00:30:09.996 [2024-07-13 10:16:15.724674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.724825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.724850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.996 qpair failed and we were unable to recover it. 00:30:09.996 [2024-07-13 10:16:15.725004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.725116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.725140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.996 qpair failed and we were unable to recover it. 00:30:09.996 [2024-07-13 10:16:15.725286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.725432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.725456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.996 qpair failed and we were unable to recover it. 00:30:09.996 [2024-07-13 10:16:15.725597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.725710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.725735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.996 qpair failed and we were unable to recover it. 00:30:09.996 [2024-07-13 10:16:15.725886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.726014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.726039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.996 qpair failed and we were unable to recover it. 00:30:09.996 [2024-07-13 10:16:15.726161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.726298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.726324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.996 qpair failed and we were unable to recover it. 00:30:09.996 [2024-07-13 10:16:15.726467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.726589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.726615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.996 qpair failed and we were unable to recover it. 00:30:09.996 [2024-07-13 10:16:15.726776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.726902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.726934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.996 qpair failed and we were unable to recover it. 00:30:09.996 [2024-07-13 10:16:15.727058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.727184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.727209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.996 qpair failed and we were unable to recover it. 00:30:09.996 [2024-07-13 10:16:15.727358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.727470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.727496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.996 qpair failed and we were unable to recover it. 00:30:09.996 [2024-07-13 10:16:15.727634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.727782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.727808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.996 qpair failed and we were unable to recover it. 00:30:09.996 [2024-07-13 10:16:15.727963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.728076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.728102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.996 qpair failed and we were unable to recover it. 00:30:09.996 [2024-07-13 10:16:15.728230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.728408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.996 [2024-07-13 10:16:15.728434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.996 qpair failed and we were unable to recover it. 00:30:09.997 [2024-07-13 10:16:15.728555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.728677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.728702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.997 qpair failed and we were unable to recover it. 00:30:09.997 [2024-07-13 10:16:15.728816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.728935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.728961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.997 qpair failed and we were unable to recover it. 00:30:09.997 [2024-07-13 10:16:15.729111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.729228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.729253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.997 qpair failed and we were unable to recover it. 00:30:09.997 [2024-07-13 10:16:15.729376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.729488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.729513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.997 qpair failed and we were unable to recover it. 00:30:09.997 [2024-07-13 10:16:15.729663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.729839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.729871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.997 qpair failed and we were unable to recover it. 00:30:09.997 [2024-07-13 10:16:15.730013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.730125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.730150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.997 qpair failed and we were unable to recover it. 00:30:09.997 [2024-07-13 10:16:15.730298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.730445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.730471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.997 qpair failed and we were unable to recover it. 00:30:09.997 [2024-07-13 10:16:15.730617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.730764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.730790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.997 qpair failed and we were unable to recover it. 00:30:09.997 [2024-07-13 10:16:15.730960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.731135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.731161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.997 qpair failed and we were unable to recover it. 00:30:09.997 [2024-07-13 10:16:15.731290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.731405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.731431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.997 qpair failed and we were unable to recover it. 00:30:09.997 [2024-07-13 10:16:15.731592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.731709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.731734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.997 qpair failed and we were unable to recover it. 00:30:09.997 [2024-07-13 10:16:15.731888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.732021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.732045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.997 qpair failed and we were unable to recover it. 00:30:09.997 [2024-07-13 10:16:15.732194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.732343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.732371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.997 qpair failed and we were unable to recover it. 00:30:09.997 [2024-07-13 10:16:15.732498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.732628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.732653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.997 qpair failed and we were unable to recover it. 00:30:09.997 [2024-07-13 10:16:15.732774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.732924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.732950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.997 qpair failed and we were unable to recover it. 00:30:09.997 [2024-07-13 10:16:15.733062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.733173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.733199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.997 qpair failed and we were unable to recover it. 00:30:09.997 [2024-07-13 10:16:15.733321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.733490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.733515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.997 qpair failed and we were unable to recover it. 00:30:09.997 [2024-07-13 10:16:15.733630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.733748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.733779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.997 qpair failed and we were unable to recover it. 00:30:09.997 [2024-07-13 10:16:15.733902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.734027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.734052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.997 qpair failed and we were unable to recover it. 00:30:09.997 [2024-07-13 10:16:15.734200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.734327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.734352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.997 qpair failed and we were unable to recover it. 00:30:09.997 [2024-07-13 10:16:15.734474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.734634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.734660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.997 qpair failed and we were unable to recover it. 00:30:09.997 [2024-07-13 10:16:15.734815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.734969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.734995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.997 qpair failed and we were unable to recover it. 00:30:09.997 [2024-07-13 10:16:15.735142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.735296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.735322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.997 qpair failed and we were unable to recover it. 00:30:09.997 [2024-07-13 10:16:15.735476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.735605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.735631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.997 qpair failed and we were unable to recover it. 00:30:09.997 [2024-07-13 10:16:15.735808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.735931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.735956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.997 qpair failed and we were unable to recover it. 00:30:09.997 [2024-07-13 10:16:15.736078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.736205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.736230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.997 qpair failed and we were unable to recover it. 00:30:09.997 [2024-07-13 10:16:15.736347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.736468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.736494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.997 qpair failed and we were unable to recover it. 00:30:09.997 [2024-07-13 10:16:15.736613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.736790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.736816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.997 qpair failed and we were unable to recover it. 00:30:09.997 [2024-07-13 10:16:15.736983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.737107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.737131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.997 qpair failed and we were unable to recover it. 00:30:09.997 [2024-07-13 10:16:15.737253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.737412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.737437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.997 qpair failed and we were unable to recover it. 00:30:09.997 [2024-07-13 10:16:15.737584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.737729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.737754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.997 qpair failed and we were unable to recover it. 00:30:09.997 [2024-07-13 10:16:15.737901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.738053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.738079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.997 qpair failed and we were unable to recover it. 00:30:09.997 [2024-07-13 10:16:15.738196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.738373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.738410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.997 qpair failed and we were unable to recover it. 00:30:09.997 [2024-07-13 10:16:15.738592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.738740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.738772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.997 qpair failed and we were unable to recover it. 00:30:09.997 [2024-07-13 10:16:15.738895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.739020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.739046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.997 qpair failed and we were unable to recover it. 00:30:09.997 [2024-07-13 10:16:15.739187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.739326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.739352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.997 qpair failed and we were unable to recover it. 00:30:09.997 [2024-07-13 10:16:15.739501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.739630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.739656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.997 qpair failed and we were unable to recover it. 00:30:09.997 [2024-07-13 10:16:15.739797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.739962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.739988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.997 qpair failed and we were unable to recover it. 00:30:09.997 [2024-07-13 10:16:15.740148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.740299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.740324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.997 qpair failed and we were unable to recover it. 00:30:09.997 [2024-07-13 10:16:15.740479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.740599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.740626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.997 qpair failed and we were unable to recover it. 00:30:09.997 [2024-07-13 10:16:15.740744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.740875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.997 [2024-07-13 10:16:15.740900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.997 qpair failed and we were unable to recover it. 00:30:09.997 [2024-07-13 10:16:15.741056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.741184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.741210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.998 qpair failed and we were unable to recover it. 00:30:09.998 [2024-07-13 10:16:15.741356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.741529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.741555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.998 qpair failed and we were unable to recover it. 00:30:09.998 [2024-07-13 10:16:15.741685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.741834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.741860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.998 qpair failed and we were unable to recover it. 00:30:09.998 [2024-07-13 10:16:15.742027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.742143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.742167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.998 qpair failed and we were unable to recover it. 00:30:09.998 [2024-07-13 10:16:15.742314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.742432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.742457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.998 qpair failed and we were unable to recover it. 00:30:09.998 [2024-07-13 10:16:15.742569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.742685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.742710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.998 qpair failed and we were unable to recover it. 00:30:09.998 [2024-07-13 10:16:15.742858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.743015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.743040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.998 qpair failed and we were unable to recover it. 00:30:09.998 [2024-07-13 10:16:15.743161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.743292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.743316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.998 qpair failed and we were unable to recover it. 00:30:09.998 [2024-07-13 10:16:15.743470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.743598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.743625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.998 qpair failed and we were unable to recover it. 00:30:09.998 [2024-07-13 10:16:15.743770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.743896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.743929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.998 qpair failed and we were unable to recover it. 00:30:09.998 [2024-07-13 10:16:15.744053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.744165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.744190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.998 qpair failed and we were unable to recover it. 00:30:09.998 [2024-07-13 10:16:15.744311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.744485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.744511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.998 qpair failed and we were unable to recover it. 00:30:09.998 [2024-07-13 10:16:15.744628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.744774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.744799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.998 qpair failed and we were unable to recover it. 00:30:09.998 [2024-07-13 10:16:15.744914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.745039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.745065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.998 qpair failed and we were unable to recover it. 00:30:09.998 [2024-07-13 10:16:15.745226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.745351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.745376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.998 qpair failed and we were unable to recover it. 00:30:09.998 [2024-07-13 10:16:15.745520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.745646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.745671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.998 qpair failed and we were unable to recover it. 00:30:09.998 [2024-07-13 10:16:15.745802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.745949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.745975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.998 qpair failed and we were unable to recover it. 00:30:09.998 [2024-07-13 10:16:15.746097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.746225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.746250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.998 qpair failed and we were unable to recover it. 00:30:09.998 [2024-07-13 10:16:15.746375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.746514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.746551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.998 qpair failed and we were unable to recover it. 00:30:09.998 [2024-07-13 10:16:15.746701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.746828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.746853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.998 qpair failed and we were unable to recover it. 00:30:09.998 [2024-07-13 10:16:15.747018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.747161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.747186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.998 qpair failed and we were unable to recover it. 00:30:09.998 [2024-07-13 10:16:15.747330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.747453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.747479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.998 qpair failed and we were unable to recover it. 00:30:09.998 [2024-07-13 10:16:15.747624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.747735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.747761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.998 qpair failed and we were unable to recover it. 00:30:09.998 [2024-07-13 10:16:15.747907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.748032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.748057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.998 qpair failed and we were unable to recover it. 00:30:09.998 [2024-07-13 10:16:15.748175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.748306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.748331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.998 qpair failed and we were unable to recover it. 00:30:09.998 [2024-07-13 10:16:15.748484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.748626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.748650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.998 qpair failed and we were unable to recover it. 00:30:09.998 [2024-07-13 10:16:15.748802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.748921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.748947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.998 qpair failed and we were unable to recover it. 00:30:09.998 [2024-07-13 10:16:15.749065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.749186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.749216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.998 qpair failed and we were unable to recover it. 00:30:09.998 [2024-07-13 10:16:15.749332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.749482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.749506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.998 qpair failed and we were unable to recover it. 00:30:09.998 [2024-07-13 10:16:15.749657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.749769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.749794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.998 qpair failed and we were unable to recover it. 00:30:09.998 [2024-07-13 10:16:15.749943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.750064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.750088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.998 qpair failed and we were unable to recover it. 00:30:09.998 [2024-07-13 10:16:15.750201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.750318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.750342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.998 qpair failed and we were unable to recover it. 00:30:09.998 [2024-07-13 10:16:15.750466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.750594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.750624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.998 qpair failed and we were unable to recover it. 00:30:09.998 [2024-07-13 10:16:15.750771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.750911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.750937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.998 qpair failed and we were unable to recover it. 00:30:09.998 [2024-07-13 10:16:15.751061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.751178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.751202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.998 qpair failed and we were unable to recover it. 00:30:09.998 [2024-07-13 10:16:15.751332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.751480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.751505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.998 qpair failed and we were unable to recover it. 00:30:09.998 [2024-07-13 10:16:15.751626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.751778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.751803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.998 qpair failed and we were unable to recover it. 00:30:09.998 [2024-07-13 10:16:15.751964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.752077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.752101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.998 qpair failed and we were unable to recover it. 00:30:09.998 [2024-07-13 10:16:15.752229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.752350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.752375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.998 qpair failed and we were unable to recover it. 00:30:09.998 [2024-07-13 10:16:15.752518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.752645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.752670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.998 qpair failed and we were unable to recover it. 00:30:09.998 [2024-07-13 10:16:15.752819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.752967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.752993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.998 qpair failed and we were unable to recover it. 00:30:09.998 [2024-07-13 10:16:15.753124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.998 [2024-07-13 10:16:15.753275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.753300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.999 qpair failed and we were unable to recover it. 00:30:09.999 [2024-07-13 10:16:15.753418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.753544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.753569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.999 qpair failed and we were unable to recover it. 00:30:09.999 [2024-07-13 10:16:15.753702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.753830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.753855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.999 qpair failed and we were unable to recover it. 00:30:09.999 [2024-07-13 10:16:15.754012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.754162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.754186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.999 qpair failed and we were unable to recover it. 00:30:09.999 [2024-07-13 10:16:15.754298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.754414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.754438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.999 qpair failed and we were unable to recover it. 00:30:09.999 [2024-07-13 10:16:15.754584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.754699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.754723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.999 qpair failed and we were unable to recover it. 00:30:09.999 [2024-07-13 10:16:15.754851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.754997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.755021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.999 qpair failed and we were unable to recover it. 00:30:09.999 [2024-07-13 10:16:15.755172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.755332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.755357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.999 qpair failed and we were unable to recover it. 00:30:09.999 [2024-07-13 10:16:15.755478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.755632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.755657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.999 qpair failed and we were unable to recover it. 00:30:09.999 [2024-07-13 10:16:15.755801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.755917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.755943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.999 qpair failed and we were unable to recover it. 00:30:09.999 [2024-07-13 10:16:15.756092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.756204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.756230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.999 qpair failed and we were unable to recover it. 00:30:09.999 [2024-07-13 10:16:15.756384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.756524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.756549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.999 qpair failed and we were unable to recover it. 00:30:09.999 [2024-07-13 10:16:15.756674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.756817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.756843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.999 qpair failed and we were unable to recover it. 00:30:09.999 [2024-07-13 10:16:15.756999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.757126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.757152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.999 qpair failed and we were unable to recover it. 00:30:09.999 [2024-07-13 10:16:15.757304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.757451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.757476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.999 qpair failed and we were unable to recover it. 00:30:09.999 [2024-07-13 10:16:15.757602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.757759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.757784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.999 qpair failed and we were unable to recover it. 00:30:09.999 [2024-07-13 10:16:15.757912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.758029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.758053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.999 qpair failed and we were unable to recover it. 00:30:09.999 [2024-07-13 10:16:15.758204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.758352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.758376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.999 qpair failed and we were unable to recover it. 00:30:09.999 [2024-07-13 10:16:15.758505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.758652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.758676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.999 qpair failed and we were unable to recover it. 00:30:09.999 [2024-07-13 10:16:15.758806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.758969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.758994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.999 qpair failed and we were unable to recover it. 00:30:09.999 [2024-07-13 10:16:15.759123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.759264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.759290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.999 qpair failed and we were unable to recover it. 00:30:09.999 [2024-07-13 10:16:15.759416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.759560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.759586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.999 qpair failed and we were unable to recover it. 00:30:09.999 [2024-07-13 10:16:15.759743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.759876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.759902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.999 qpair failed and we were unable to recover it. 00:30:09.999 [2024-07-13 10:16:15.760036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.760190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.760214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.999 qpair failed and we were unable to recover it. 00:30:09.999 [2024-07-13 10:16:15.760336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.760485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.760511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.999 qpair failed and we were unable to recover it. 00:30:09.999 [2024-07-13 10:16:15.760630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.760773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.760798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.999 qpair failed and we were unable to recover it. 00:30:09.999 [2024-07-13 10:16:15.760914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.761064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.761089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.999 qpair failed and we were unable to recover it. 00:30:09.999 [2024-07-13 10:16:15.761235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.761387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.761412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.999 qpair failed and we were unable to recover it. 00:30:09.999 [2024-07-13 10:16:15.761527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.761668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.761694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.999 qpair failed and we were unable to recover it. 00:30:09.999 [2024-07-13 10:16:15.761813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.761968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.761994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.999 qpair failed and we were unable to recover it. 00:30:09.999 [2024-07-13 10:16:15.762109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.762222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.762247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.999 qpair failed and we were unable to recover it. 00:30:09.999 [2024-07-13 10:16:15.762366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.762478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.762503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.999 qpair failed and we were unable to recover it. 00:30:09.999 [2024-07-13 10:16:15.762663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.762782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.762808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.999 qpair failed and we were unable to recover it. 00:30:09.999 [2024-07-13 10:16:15.762961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.763118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.763142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.999 qpair failed and we were unable to recover it. 00:30:09.999 [2024-07-13 10:16:15.763276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.763444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.763468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.999 qpair failed and we were unable to recover it. 00:30:09.999 [2024-07-13 10:16:15.763581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.763712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.763736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.999 qpair failed and we were unable to recover it. 00:30:09.999 [2024-07-13 10:16:15.763876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.764004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:09.999 [2024-07-13 10:16:15.764029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:09.999 qpair failed and we were unable to recover it. 00:30:09.999 [2024-07-13 10:16:15.764202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.764322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.764351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.000 qpair failed and we were unable to recover it. 00:30:10.000 [2024-07-13 10:16:15.764468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.764624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.764649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.000 qpair failed and we were unable to recover it. 00:30:10.000 [2024-07-13 10:16:15.764797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.764929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.764954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.000 qpair failed and we were unable to recover it. 00:30:10.000 [2024-07-13 10:16:15.765103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.765251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.765276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.000 qpair failed and we were unable to recover it. 00:30:10.000 [2024-07-13 10:16:15.765406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.765549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.765574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.000 qpair failed and we were unable to recover it. 00:30:10.000 [2024-07-13 10:16:15.765702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.765822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.765849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.000 qpair failed and we were unable to recover it. 00:30:10.000 [2024-07-13 10:16:15.765995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.766122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.766147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.000 qpair failed and we were unable to recover it. 00:30:10.000 [2024-07-13 10:16:15.766277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.766406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.766432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.000 qpair failed and we were unable to recover it. 00:30:10.000 [2024-07-13 10:16:15.766586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.766718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.766742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.000 qpair failed and we were unable to recover it. 00:30:10.000 [2024-07-13 10:16:15.766891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.767038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.767062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.000 qpair failed and we were unable to recover it. 00:30:10.000 [2024-07-13 10:16:15.767191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.767345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.767373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.000 qpair failed and we were unable to recover it. 00:30:10.000 [2024-07-13 10:16:15.767527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.767678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.767703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.000 qpair failed and we were unable to recover it. 00:30:10.000 [2024-07-13 10:16:15.767856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.767985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.768011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.000 qpair failed and we were unable to recover it. 00:30:10.000 [2024-07-13 10:16:15.768160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.768328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.768354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.000 qpair failed and we were unable to recover it. 00:30:10.000 [2024-07-13 10:16:15.768505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.768627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.768653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.000 qpair failed and we were unable to recover it. 00:30:10.000 [2024-07-13 10:16:15.768805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.768964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.769003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.000 qpair failed and we were unable to recover it. 00:30:10.000 [2024-07-13 10:16:15.769151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.769297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.769322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.000 qpair failed and we were unable to recover it. 00:30:10.000 [2024-07-13 10:16:15.769477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.769595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.769620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.000 qpair failed and we were unable to recover it. 00:30:10.000 [2024-07-13 10:16:15.769753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.769909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.769936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.000 qpair failed and we were unable to recover it. 00:30:10.000 [2024-07-13 10:16:15.770108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.770225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.770250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.000 qpair failed and we were unable to recover it. 00:30:10.000 [2024-07-13 10:16:15.770406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.770524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.770550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.000 qpair failed and we were unable to recover it. 00:30:10.000 [2024-07-13 10:16:15.770715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.770898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.770932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.000 qpair failed and we were unable to recover it. 00:30:10.000 [2024-07-13 10:16:15.771085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.771199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.771224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.000 qpair failed and we were unable to recover it. 00:30:10.000 [2024-07-13 10:16:15.771345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.771475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.771500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.000 qpair failed and we were unable to recover it. 00:30:10.000 [2024-07-13 10:16:15.771638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.771763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.771788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.000 qpair failed and we were unable to recover it. 00:30:10.000 [2024-07-13 10:16:15.771959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.772089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.772114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.000 qpair failed and we were unable to recover it. 00:30:10.000 [2024-07-13 10:16:15.772239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.772390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.772427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.000 qpair failed and we were unable to recover it. 00:30:10.000 [2024-07-13 10:16:15.772592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.772734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.772762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.000 qpair failed and we were unable to recover it. 00:30:10.000 [2024-07-13 10:16:15.772887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.773023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.773059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.000 qpair failed and we were unable to recover it. 00:30:10.000 [2024-07-13 10:16:15.773229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.773375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.000 [2024-07-13 10:16:15.773402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.000 qpair failed and we were unable to recover it. 00:30:10.000 [2024-07-13 10:16:15.773530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.278 [2024-07-13 10:16:15.773655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.278 [2024-07-13 10:16:15.773681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.278 qpair failed and we were unable to recover it. 00:30:10.278 [2024-07-13 10:16:15.773806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.278 [2024-07-13 10:16:15.773930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.278 [2024-07-13 10:16:15.773958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.278 qpair failed and we were unable to recover it. 00:30:10.278 [2024-07-13 10:16:15.774108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.278 [2024-07-13 10:16:15.774258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.278 [2024-07-13 10:16:15.774283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.278 qpair failed and we were unable to recover it. 00:30:10.278 [2024-07-13 10:16:15.774425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.278 [2024-07-13 10:16:15.774572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.278 [2024-07-13 10:16:15.774597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.278 qpair failed and we were unable to recover it. 00:30:10.278 [2024-07-13 10:16:15.774732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.278 [2024-07-13 10:16:15.774890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.278 [2024-07-13 10:16:15.774929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.278 qpair failed and we were unable to recover it. 00:30:10.278 [2024-07-13 10:16:15.775051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.278 [2024-07-13 10:16:15.775173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.278 [2024-07-13 10:16:15.775203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.278 qpair failed and we were unable to recover it. 00:30:10.278 [2024-07-13 10:16:15.775335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.278 [2024-07-13 10:16:15.775509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.278 [2024-07-13 10:16:15.775535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.278 qpair failed and we were unable to recover it. 00:30:10.278 [2024-07-13 10:16:15.775690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.278 [2024-07-13 10:16:15.775854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.278 [2024-07-13 10:16:15.775886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.278 qpair failed and we were unable to recover it. 00:30:10.278 [2024-07-13 10:16:15.776053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.278 [2024-07-13 10:16:15.776199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.278 [2024-07-13 10:16:15.776224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.278 qpair failed and we were unable to recover it. 00:30:10.278 [2024-07-13 10:16:15.776362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.278 [2024-07-13 10:16:15.776536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.278 [2024-07-13 10:16:15.776563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.278 qpair failed and we were unable to recover it. 00:30:10.278 [2024-07-13 10:16:15.776686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.278 [2024-07-13 10:16:15.776832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.278 [2024-07-13 10:16:15.776862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.278 qpair failed and we were unable to recover it. 00:30:10.278 [2024-07-13 10:16:15.776998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.278 [2024-07-13 10:16:15.777150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.278 [2024-07-13 10:16:15.777175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.278 qpair failed and we were unable to recover it. 00:30:10.278 [2024-07-13 10:16:15.777303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.278 [2024-07-13 10:16:15.777416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.278 [2024-07-13 10:16:15.777440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.278 qpair failed and we were unable to recover it. 00:30:10.278 [2024-07-13 10:16:15.777562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.278 [2024-07-13 10:16:15.777678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.278 [2024-07-13 10:16:15.777705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.278 qpair failed and we were unable to recover it. 00:30:10.278 [2024-07-13 10:16:15.777832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.278 [2024-07-13 10:16:15.778002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.278 [2024-07-13 10:16:15.778029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.278 qpair failed and we were unable to recover it. 00:30:10.278 [2024-07-13 10:16:15.778188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.278 [2024-07-13 10:16:15.778342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.278 [2024-07-13 10:16:15.778367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.278 qpair failed and we were unable to recover it. 00:30:10.278 [2024-07-13 10:16:15.778492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.278 [2024-07-13 10:16:15.778635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.278 [2024-07-13 10:16:15.778660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.278 qpair failed and we were unable to recover it. 00:30:10.279 [2024-07-13 10:16:15.778788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.778944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.778971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.279 qpair failed and we were unable to recover it. 00:30:10.279 [2024-07-13 10:16:15.779089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.779247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.779272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.279 qpair failed and we were unable to recover it. 00:30:10.279 [2024-07-13 10:16:15.779448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.779573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.779598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.279 qpair failed and we were unable to recover it. 00:30:10.279 [2024-07-13 10:16:15.779774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.779893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.779919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.279 qpair failed and we were unable to recover it. 00:30:10.279 [2024-07-13 10:16:15.780054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.780185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.780210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.279 qpair failed and we were unable to recover it. 00:30:10.279 [2024-07-13 10:16:15.780368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.780492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.780517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.279 qpair failed and we were unable to recover it. 00:30:10.279 [2024-07-13 10:16:15.780701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.780826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.780851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.279 qpair failed and we were unable to recover it. 00:30:10.279 [2024-07-13 10:16:15.780986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.781118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.781143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.279 qpair failed and we were unable to recover it. 00:30:10.279 [2024-07-13 10:16:15.781317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.781451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.781476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.279 qpair failed and we were unable to recover it. 00:30:10.279 [2024-07-13 10:16:15.781621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.781743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.781767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.279 qpair failed and we were unable to recover it. 00:30:10.279 [2024-07-13 10:16:15.781899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.782022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.782047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.279 qpair failed and we were unable to recover it. 00:30:10.279 [2024-07-13 10:16:15.782199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.782347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.782372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.279 qpair failed and we were unable to recover it. 00:30:10.279 [2024-07-13 10:16:15.782518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.782648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.782673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.279 qpair failed and we were unable to recover it. 00:30:10.279 [2024-07-13 10:16:15.782822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.782957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.782983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.279 qpair failed and we were unable to recover it. 00:30:10.279 [2024-07-13 10:16:15.783101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.783222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.783254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.279 qpair failed and we were unable to recover it. 00:30:10.279 [2024-07-13 10:16:15.783407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.783525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.783550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.279 qpair failed and we were unable to recover it. 00:30:10.279 [2024-07-13 10:16:15.783681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.783815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.783840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.279 qpair failed and we were unable to recover it. 00:30:10.279 [2024-07-13 10:16:15.783977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.784096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.784121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.279 qpair failed and we were unable to recover it. 00:30:10.279 [2024-07-13 10:16:15.784284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.784402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.784427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.279 qpair failed and we were unable to recover it. 00:30:10.279 [2024-07-13 10:16:15.784582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.784741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.784766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.279 qpair failed and we were unable to recover it. 00:30:10.279 [2024-07-13 10:16:15.784892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.785016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.785042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.279 qpair failed and we were unable to recover it. 00:30:10.279 [2024-07-13 10:16:15.785168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.785339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.785364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.279 qpair failed and we were unable to recover it. 00:30:10.279 [2024-07-13 10:16:15.785479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.785599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.785624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.279 qpair failed and we were unable to recover it. 00:30:10.279 [2024-07-13 10:16:15.785773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.785886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.785912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.279 qpair failed and we were unable to recover it. 00:30:10.279 [2024-07-13 10:16:15.786075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.786223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.786248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.279 qpair failed and we were unable to recover it. 00:30:10.279 [2024-07-13 10:16:15.786371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.786508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.786533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.279 qpair failed and we were unable to recover it. 00:30:10.279 [2024-07-13 10:16:15.786681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.786802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.786827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.279 qpair failed and we were unable to recover it. 00:30:10.279 [2024-07-13 10:16:15.786982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.787106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.787131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.279 qpair failed and we were unable to recover it. 00:30:10.279 [2024-07-13 10:16:15.787294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.787411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.787436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.279 qpair failed and we were unable to recover it. 00:30:10.279 [2024-07-13 10:16:15.787578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.787700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.787725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.279 qpair failed and we were unable to recover it. 00:30:10.279 [2024-07-13 10:16:15.787858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.279 [2024-07-13 10:16:15.787977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.788002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.280 qpair failed and we were unable to recover it. 00:30:10.280 [2024-07-13 10:16:15.788126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.788281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.788306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.280 qpair failed and we were unable to recover it. 00:30:10.280 [2024-07-13 10:16:15.788439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.788585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.788610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.280 qpair failed and we were unable to recover it. 00:30:10.280 [2024-07-13 10:16:15.788726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.788905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.788931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.280 qpair failed and we were unable to recover it. 00:30:10.280 [2024-07-13 10:16:15.789091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.789222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.789247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.280 qpair failed and we were unable to recover it. 00:30:10.280 [2024-07-13 10:16:15.789403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.789519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.789544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.280 qpair failed and we were unable to recover it. 00:30:10.280 [2024-07-13 10:16:15.789656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.789797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.789822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.280 qpair failed and we were unable to recover it. 00:30:10.280 [2024-07-13 10:16:15.789943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.790066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.790092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.280 qpair failed and we were unable to recover it. 00:30:10.280 [2024-07-13 10:16:15.790225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.790368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.790393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.280 qpair failed and we were unable to recover it. 00:30:10.280 [2024-07-13 10:16:15.790508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.790656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.790680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.280 qpair failed and we were unable to recover it. 00:30:10.280 [2024-07-13 10:16:15.790812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.790930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.790955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.280 qpair failed and we were unable to recover it. 00:30:10.280 [2024-07-13 10:16:15.791079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.791190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.791214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.280 qpair failed and we were unable to recover it. 00:30:10.280 [2024-07-13 10:16:15.791369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.791491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.791516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.280 qpair failed and we were unable to recover it. 00:30:10.280 [2024-07-13 10:16:15.791635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.791748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.791772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.280 qpair failed and we were unable to recover it. 00:30:10.280 [2024-07-13 10:16:15.791908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.792053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.792078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.280 qpair failed and we were unable to recover it. 00:30:10.280 [2024-07-13 10:16:15.792234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.792349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.792373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.280 qpair failed and we were unable to recover it. 00:30:10.280 [2024-07-13 10:16:15.792516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.792661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.792685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.280 qpair failed and we were unable to recover it. 00:30:10.280 [2024-07-13 10:16:15.792832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.792976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.793001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.280 qpair failed and we were unable to recover it. 00:30:10.280 [2024-07-13 10:16:15.793153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.793275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.793300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.280 qpair failed and we were unable to recover it. 00:30:10.280 [2024-07-13 10:16:15.793420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.793549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.793574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.280 qpair failed and we were unable to recover it. 00:30:10.280 [2024-07-13 10:16:15.793747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.793876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.793902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.280 qpair failed and we were unable to recover it. 00:30:10.280 [2024-07-13 10:16:15.794021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.794167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.794192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.280 qpair failed and we were unable to recover it. 00:30:10.280 [2024-07-13 10:16:15.794342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.794516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.794540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.280 qpair failed and we were unable to recover it. 00:30:10.280 [2024-07-13 10:16:15.794693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.794843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.794874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.280 qpair failed and we were unable to recover it. 00:30:10.280 [2024-07-13 10:16:15.795001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.795129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.795159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.280 qpair failed and we were unable to recover it. 00:30:10.280 [2024-07-13 10:16:15.795306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.795427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.795452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.280 qpair failed and we were unable to recover it. 00:30:10.280 [2024-07-13 10:16:15.795571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.795690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.795714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.280 qpair failed and we were unable to recover it. 00:30:10.280 [2024-07-13 10:16:15.795863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.796016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.796040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.280 qpair failed and we were unable to recover it. 00:30:10.280 [2024-07-13 10:16:15.796171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.796311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.796335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.280 qpair failed and we were unable to recover it. 00:30:10.280 [2024-07-13 10:16:15.796475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.796631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.796656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.280 qpair failed and we were unable to recover it. 00:30:10.280 [2024-07-13 10:16:15.796812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.796941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.796966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.280 qpair failed and we were unable to recover it. 00:30:10.280 [2024-07-13 10:16:15.797090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.280 [2024-07-13 10:16:15.797241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.797265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.281 qpair failed and we were unable to recover it. 00:30:10.281 [2024-07-13 10:16:15.797415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.797589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.797613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.281 qpair failed and we were unable to recover it. 00:30:10.281 [2024-07-13 10:16:15.797757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.797916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.797942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.281 qpair failed and we were unable to recover it. 00:30:10.281 [2024-07-13 10:16:15.798055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.798176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.798201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.281 qpair failed and we were unable to recover it. 00:30:10.281 [2024-07-13 10:16:15.798341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.798463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.798492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.281 qpair failed and we were unable to recover it. 00:30:10.281 [2024-07-13 10:16:15.798667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.798832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.798856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.281 qpair failed and we were unable to recover it. 00:30:10.281 [2024-07-13 10:16:15.799020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.799133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.799158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.281 qpair failed and we were unable to recover it. 00:30:10.281 [2024-07-13 10:16:15.799332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.799452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.799477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.281 qpair failed and we were unable to recover it. 00:30:10.281 [2024-07-13 10:16:15.799617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.799757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.799782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.281 qpair failed and we were unable to recover it. 00:30:10.281 [2024-07-13 10:16:15.799916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.800030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.800055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.281 qpair failed and we were unable to recover it. 00:30:10.281 [2024-07-13 10:16:15.800199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.800318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.800342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.281 qpair failed and we were unable to recover it. 00:30:10.281 [2024-07-13 10:16:15.800469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.800622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.800646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.281 qpair failed and we were unable to recover it. 00:30:10.281 [2024-07-13 10:16:15.800762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.800891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.800917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.281 qpair failed and we were unable to recover it. 00:30:10.281 [2024-07-13 10:16:15.801074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.801198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.801222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.281 qpair failed and we were unable to recover it. 00:30:10.281 [2024-07-13 10:16:15.801343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.801460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.801484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.281 qpair failed and we were unable to recover it. 00:30:10.281 [2024-07-13 10:16:15.801661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.801817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.801842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.281 qpair failed and we were unable to recover it. 00:30:10.281 [2024-07-13 10:16:15.801998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.802147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.802172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.281 qpair failed and we were unable to recover it. 00:30:10.281 [2024-07-13 10:16:15.802287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.802410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.802435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.281 qpair failed and we were unable to recover it. 00:30:10.281 [2024-07-13 10:16:15.802580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.802755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.802779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.281 qpair failed and we were unable to recover it. 00:30:10.281 [2024-07-13 10:16:15.802918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.803047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.803072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.281 qpair failed and we were unable to recover it. 00:30:10.281 [2024-07-13 10:16:15.803190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.803298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.803321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.281 qpair failed and we were unable to recover it. 00:30:10.281 [2024-07-13 10:16:15.803477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.803597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.803622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.281 qpair failed and we were unable to recover it. 00:30:10.281 [2024-07-13 10:16:15.803773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.803906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.803934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.281 qpair failed and we were unable to recover it. 00:30:10.281 [2024-07-13 10:16:15.804084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.804204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.804228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.281 qpair failed and we were unable to recover it. 00:30:10.281 [2024-07-13 10:16:15.804376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.804525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.804549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.281 qpair failed and we were unable to recover it. 00:30:10.281 [2024-07-13 10:16:15.804685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.804838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.804863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.281 qpair failed and we were unable to recover it. 00:30:10.281 [2024-07-13 10:16:15.805046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.805174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.805199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.281 qpair failed and we were unable to recover it. 00:30:10.281 [2024-07-13 10:16:15.805329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.805447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.805472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.281 qpair failed and we were unable to recover it. 00:30:10.281 [2024-07-13 10:16:15.805594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.805733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.805758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.281 qpair failed and we were unable to recover it. 00:30:10.281 [2024-07-13 10:16:15.805886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.806014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.806039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.281 qpair failed and we were unable to recover it. 00:30:10.281 [2024-07-13 10:16:15.806201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.806352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.281 [2024-07-13 10:16:15.806379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.282 qpair failed and we were unable to recover it. 00:30:10.282 [2024-07-13 10:16:15.806525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.806699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.806724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.282 qpair failed and we were unable to recover it. 00:30:10.282 [2024-07-13 10:16:15.806853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.806976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.807001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.282 qpair failed and we were unable to recover it. 00:30:10.282 [2024-07-13 10:16:15.807178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.807319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.807343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.282 qpair failed and we were unable to recover it. 00:30:10.282 [2024-07-13 10:16:15.807492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.807639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.807663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.282 qpair failed and we were unable to recover it. 00:30:10.282 [2024-07-13 10:16:15.807812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.807925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.807950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.282 qpair failed and we were unable to recover it. 00:30:10.282 [2024-07-13 10:16:15.808080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.808223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.808248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.282 qpair failed and we were unable to recover it. 00:30:10.282 [2024-07-13 10:16:15.808368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.808519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.808545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.282 qpair failed and we were unable to recover it. 00:30:10.282 [2024-07-13 10:16:15.808703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.808843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.808888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.282 qpair failed and we were unable to recover it. 00:30:10.282 [2024-07-13 10:16:15.809017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.809153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.809177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.282 qpair failed and we were unable to recover it. 00:30:10.282 [2024-07-13 10:16:15.809296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.809422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.809446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.282 qpair failed and we were unable to recover it. 00:30:10.282 [2024-07-13 10:16:15.809598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.809717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.809741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.282 qpair failed and we were unable to recover it. 00:30:10.282 [2024-07-13 10:16:15.809890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.810019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.810045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.282 qpair failed and we were unable to recover it. 00:30:10.282 [2024-07-13 10:16:15.810181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.810319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.810344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.282 qpair failed and we were unable to recover it. 00:30:10.282 [2024-07-13 10:16:15.810525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.810646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.810671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.282 qpair failed and we were unable to recover it. 00:30:10.282 [2024-07-13 10:16:15.810802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.810961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.810986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.282 qpair failed and we were unable to recover it. 00:30:10.282 [2024-07-13 10:16:15.811106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.811250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.811274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.282 qpair failed and we were unable to recover it. 00:30:10.282 [2024-07-13 10:16:15.811399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.811544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.811569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.282 qpair failed and we were unable to recover it. 00:30:10.282 [2024-07-13 10:16:15.811688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.811837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.811862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.282 qpair failed and we were unable to recover it. 00:30:10.282 [2024-07-13 10:16:15.812024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.812201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.812227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.282 qpair failed and we were unable to recover it. 00:30:10.282 [2024-07-13 10:16:15.812372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.812520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.812544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.282 qpair failed and we were unable to recover it. 00:30:10.282 [2024-07-13 10:16:15.812671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.812815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.812840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.282 qpair failed and we were unable to recover it. 00:30:10.282 [2024-07-13 10:16:15.812984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.813131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.813157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.282 qpair failed and we were unable to recover it. 00:30:10.282 [2024-07-13 10:16:15.813282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.813433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.813458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.282 qpair failed and we were unable to recover it. 00:30:10.282 [2024-07-13 10:16:15.813577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.813720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.813745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.282 qpair failed and we were unable to recover it. 00:30:10.282 [2024-07-13 10:16:15.813892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.814068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.282 [2024-07-13 10:16:15.814097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.282 qpair failed and we were unable to recover it. 00:30:10.282 [2024-07-13 10:16:15.814226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.814338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.814362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.283 qpair failed and we were unable to recover it. 00:30:10.283 [2024-07-13 10:16:15.814484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.814625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.814649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.283 qpair failed and we were unable to recover it. 00:30:10.283 [2024-07-13 10:16:15.814789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.814907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.814933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.283 qpair failed and we were unable to recover it. 00:30:10.283 [2024-07-13 10:16:15.815048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.815200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.815225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.283 qpair failed and we were unable to recover it. 00:30:10.283 [2024-07-13 10:16:15.815384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.815554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.815579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.283 qpair failed and we were unable to recover it. 00:30:10.283 [2024-07-13 10:16:15.815706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.815836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.815860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.283 qpair failed and we were unable to recover it. 00:30:10.283 [2024-07-13 10:16:15.816016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.816130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.816155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.283 qpair failed and we were unable to recover it. 00:30:10.283 [2024-07-13 10:16:15.816307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.816436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.816460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.283 qpair failed and we were unable to recover it. 00:30:10.283 [2024-07-13 10:16:15.816587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.816729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.816753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.283 qpair failed and we were unable to recover it. 00:30:10.283 [2024-07-13 10:16:15.816886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.817007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.817035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.283 qpair failed and we were unable to recover it. 00:30:10.283 [2024-07-13 10:16:15.817182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.817295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.817319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.283 qpair failed and we were unable to recover it. 00:30:10.283 [2024-07-13 10:16:15.817438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.817609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.817634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.283 qpair failed and we were unable to recover it. 00:30:10.283 [2024-07-13 10:16:15.817765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.817883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.817909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.283 qpair failed and we were unable to recover it. 00:30:10.283 [2024-07-13 10:16:15.818042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.818195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.818220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.283 qpair failed and we were unable to recover it. 00:30:10.283 [2024-07-13 10:16:15.818356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.818502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.818528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.283 qpair failed and we were unable to recover it. 00:30:10.283 [2024-07-13 10:16:15.818686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.818817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.818841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.283 qpair failed and we were unable to recover it. 00:30:10.283 [2024-07-13 10:16:15.819009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.819143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.819170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.283 qpair failed and we were unable to recover it. 00:30:10.283 [2024-07-13 10:16:15.819324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.819459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.819495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.283 qpair failed and we were unable to recover it. 00:30:10.283 [2024-07-13 10:16:15.819652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.819829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.819874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.283 qpair failed and we were unable to recover it. 00:30:10.283 [2024-07-13 10:16:15.820016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.820161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.820185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.283 qpair failed and we were unable to recover it. 00:30:10.283 [2024-07-13 10:16:15.820309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.820480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.820506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.283 qpair failed and we were unable to recover it. 00:30:10.283 [2024-07-13 10:16:15.820659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.820770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.820794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.283 qpair failed and we were unable to recover it. 00:30:10.283 [2024-07-13 10:16:15.820963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.821123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.821148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.283 qpair failed and we were unable to recover it. 00:30:10.283 [2024-07-13 10:16:15.821280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.821432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.821458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.283 qpair failed and we were unable to recover it. 00:30:10.283 [2024-07-13 10:16:15.821610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.821724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.821749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.283 qpair failed and we were unable to recover it. 00:30:10.283 [2024-07-13 10:16:15.821895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.822046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.822070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.283 qpair failed and we were unable to recover it. 00:30:10.283 [2024-07-13 10:16:15.822229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.822354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.822378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.283 qpair failed and we were unable to recover it. 00:30:10.283 [2024-07-13 10:16:15.822535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.822679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.822704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.283 qpair failed and we were unable to recover it. 00:30:10.283 [2024-07-13 10:16:15.822827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.822976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.823002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.283 qpair failed and we were unable to recover it. 00:30:10.283 [2024-07-13 10:16:15.823148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.823274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.823299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.283 qpair failed and we were unable to recover it. 00:30:10.283 [2024-07-13 10:16:15.823432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.823579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.283 [2024-07-13 10:16:15.823604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.284 qpair failed and we were unable to recover it. 00:30:10.284 [2024-07-13 10:16:15.823715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.823870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.823894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.284 qpair failed and we were unable to recover it. 00:30:10.284 [2024-07-13 10:16:15.824018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.824144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.824168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.284 qpair failed and we were unable to recover it. 00:30:10.284 [2024-07-13 10:16:15.824322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.824445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.824469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.284 qpair failed and we were unable to recover it. 00:30:10.284 [2024-07-13 10:16:15.824623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.824799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.824824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.284 qpair failed and we were unable to recover it. 00:30:10.284 [2024-07-13 10:16:15.824950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.825065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.825089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.284 qpair failed and we were unable to recover it. 00:30:10.284 [2024-07-13 10:16:15.825204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.825346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.825371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.284 qpair failed and we were unable to recover it. 00:30:10.284 [2024-07-13 10:16:15.825515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.825636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.825660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.284 qpair failed and we were unable to recover it. 00:30:10.284 [2024-07-13 10:16:15.825811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.825976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.826001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.284 qpair failed and we were unable to recover it. 00:30:10.284 [2024-07-13 10:16:15.826133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.826290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.826315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.284 qpair failed and we were unable to recover it. 00:30:10.284 [2024-07-13 10:16:15.826434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.826584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.826609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.284 qpair failed and we were unable to recover it. 00:30:10.284 [2024-07-13 10:16:15.826725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.826873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.826898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.284 qpair failed and we were unable to recover it. 00:30:10.284 [2024-07-13 10:16:15.827037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.827158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.827183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.284 qpair failed and we were unable to recover it. 00:30:10.284 [2024-07-13 10:16:15.827330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.827456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.827480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.284 qpair failed and we were unable to recover it. 00:30:10.284 [2024-07-13 10:16:15.827605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.827725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.827750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.284 qpair failed and we were unable to recover it. 00:30:10.284 [2024-07-13 10:16:15.827892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.828019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.828043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.284 qpair failed and we were unable to recover it. 00:30:10.284 [2024-07-13 10:16:15.828165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.828298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.828322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.284 qpair failed and we were unable to recover it. 00:30:10.284 [2024-07-13 10:16:15.828468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.828582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.828607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.284 qpair failed and we were unable to recover it. 00:30:10.284 [2024-07-13 10:16:15.828724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.828853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.828882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.284 qpair failed and we were unable to recover it. 00:30:10.284 [2024-07-13 10:16:15.829014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.829132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.829156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.284 qpair failed and we were unable to recover it. 00:30:10.284 [2024-07-13 10:16:15.829298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.829446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.829470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.284 qpair failed and we were unable to recover it. 00:30:10.284 [2024-07-13 10:16:15.829647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.829786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.829810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.284 qpair failed and we were unable to recover it. 00:30:10.284 [2024-07-13 10:16:15.829934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.830076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.830101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.284 qpair failed and we were unable to recover it. 00:30:10.284 [2024-07-13 10:16:15.830228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.830343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.830367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.284 qpair failed and we were unable to recover it. 00:30:10.284 [2024-07-13 10:16:15.830492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.830619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.830644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.284 qpair failed and we were unable to recover it. 00:30:10.284 [2024-07-13 10:16:15.830793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.830927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.830953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.284 qpair failed and we were unable to recover it. 00:30:10.284 [2024-07-13 10:16:15.831070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.831216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.831240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.284 qpair failed and we were unable to recover it. 00:30:10.284 [2024-07-13 10:16:15.831373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.831514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.831538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.284 qpair failed and we were unable to recover it. 00:30:10.284 [2024-07-13 10:16:15.831671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.831787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.831811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.284 qpair failed and we were unable to recover it. 00:30:10.284 [2024-07-13 10:16:15.831932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.832056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.832080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.284 qpair failed and we were unable to recover it. 00:30:10.284 [2024-07-13 10:16:15.832238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.832367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.832395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.284 qpair failed and we were unable to recover it. 00:30:10.284 [2024-07-13 10:16:15.832542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.832685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.284 [2024-07-13 10:16:15.832710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.285 qpair failed and we were unable to recover it. 00:30:10.285 [2024-07-13 10:16:15.832872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.833015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.833039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.285 qpair failed and we were unable to recover it. 00:30:10.285 [2024-07-13 10:16:15.833158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.833277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.833302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.285 qpair failed and we were unable to recover it. 00:30:10.285 [2024-07-13 10:16:15.833483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.833640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.833664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.285 qpair failed and we were unable to recover it. 00:30:10.285 [2024-07-13 10:16:15.833814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.833936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.833961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.285 qpair failed and we were unable to recover it. 00:30:10.285 [2024-07-13 10:16:15.834103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.834223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.834247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.285 qpair failed and we were unable to recover it. 00:30:10.285 [2024-07-13 10:16:15.834363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.834485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.834509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.285 qpair failed and we were unable to recover it. 00:30:10.285 [2024-07-13 10:16:15.834652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.834772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.834798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.285 qpair failed and we were unable to recover it. 00:30:10.285 [2024-07-13 10:16:15.834954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.835079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.835105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.285 qpair failed and we were unable to recover it. 00:30:10.285 [2024-07-13 10:16:15.835243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.835414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.835440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.285 qpair failed and we were unable to recover it. 00:30:10.285 [2024-07-13 10:16:15.835558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.835697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.835722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.285 qpair failed and we were unable to recover it. 00:30:10.285 [2024-07-13 10:16:15.835901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.836027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.836052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.285 qpair failed and we were unable to recover it. 00:30:10.285 [2024-07-13 10:16:15.836170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.836291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.836315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.285 qpair failed and we were unable to recover it. 00:30:10.285 [2024-07-13 10:16:15.836467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.836582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.836606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.285 qpair failed and we were unable to recover it. 00:30:10.285 [2024-07-13 10:16:15.836762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.836915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.836941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.285 qpair failed and we were unable to recover it. 00:30:10.285 [2024-07-13 10:16:15.837082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.837202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.837227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.285 qpair failed and we were unable to recover it. 00:30:10.285 [2024-07-13 10:16:15.837374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.837496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.837521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.285 qpair failed and we were unable to recover it. 00:30:10.285 [2024-07-13 10:16:15.837698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.837820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.837844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.285 qpair failed and we were unable to recover it. 00:30:10.285 [2024-07-13 10:16:15.838001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.838123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.838148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.285 qpair failed and we were unable to recover it. 00:30:10.285 [2024-07-13 10:16:15.838322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.838471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.838496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.285 qpair failed and we were unable to recover it. 00:30:10.285 [2024-07-13 10:16:15.838623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.838767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.838793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.285 qpair failed and we were unable to recover it. 00:30:10.285 [2024-07-13 10:16:15.838918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.839061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.839086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.285 qpair failed and we were unable to recover it. 00:30:10.285 [2024-07-13 10:16:15.839212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.839327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.839352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.285 qpair failed and we were unable to recover it. 00:30:10.285 [2024-07-13 10:16:15.839498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.839652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.839678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.285 qpair failed and we were unable to recover it. 00:30:10.285 [2024-07-13 10:16:15.839799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.839944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.839970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.285 qpair failed and we were unable to recover it. 00:30:10.285 [2024-07-13 10:16:15.840084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.840216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.840241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.285 qpair failed and we were unable to recover it. 00:30:10.285 [2024-07-13 10:16:15.840355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.840497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.840522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.285 qpair failed and we were unable to recover it. 00:30:10.285 [2024-07-13 10:16:15.840674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.840816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.840841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.285 qpair failed and we were unable to recover it. 00:30:10.285 [2024-07-13 10:16:15.841005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.841124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.841149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.285 qpair failed and we were unable to recover it. 00:30:10.285 [2024-07-13 10:16:15.841301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.841427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.841452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.285 qpair failed and we were unable to recover it. 00:30:10.285 [2024-07-13 10:16:15.841589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.841732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.841757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.285 qpair failed and we were unable to recover it. 00:30:10.285 [2024-07-13 10:16:15.841904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.285 [2024-07-13 10:16:15.842065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.842091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.286 qpair failed and we were unable to recover it. 00:30:10.286 [2024-07-13 10:16:15.842243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.842358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.842383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.286 qpair failed and we were unable to recover it. 00:30:10.286 [2024-07-13 10:16:15.842499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.842638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.842663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.286 qpair failed and we were unable to recover it. 00:30:10.286 [2024-07-13 10:16:15.842784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.842902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.842928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.286 qpair failed and we were unable to recover it. 00:30:10.286 [2024-07-13 10:16:15.843077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.843251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.843275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.286 qpair failed and we were unable to recover it. 00:30:10.286 [2024-07-13 10:16:15.843434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.843555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.843579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.286 qpair failed and we were unable to recover it. 00:30:10.286 [2024-07-13 10:16:15.843728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.843841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.843873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.286 qpair failed and we were unable to recover it. 00:30:10.286 [2024-07-13 10:16:15.844040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.844197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.844222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.286 qpair failed and we were unable to recover it. 00:30:10.286 [2024-07-13 10:16:15.844349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.844491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.844517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.286 qpair failed and we were unable to recover it. 00:30:10.286 [2024-07-13 10:16:15.844666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.844827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.844852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.286 qpair failed and we were unable to recover it. 00:30:10.286 [2024-07-13 10:16:15.844982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.845123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.845148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.286 qpair failed and we were unable to recover it. 00:30:10.286 [2024-07-13 10:16:15.845326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.845436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.845462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.286 qpair failed and we were unable to recover it. 00:30:10.286 [2024-07-13 10:16:15.845582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.845704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.845729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.286 qpair failed and we were unable to recover it. 00:30:10.286 [2024-07-13 10:16:15.845879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.846052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.846077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.286 qpair failed and we were unable to recover it. 00:30:10.286 [2024-07-13 10:16:15.846206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.846360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.846384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.286 qpair failed and we were unable to recover it. 00:30:10.286 [2024-07-13 10:16:15.846502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.846651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.846675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.286 qpair failed and we were unable to recover it. 00:30:10.286 [2024-07-13 10:16:15.846824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.846975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.847001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.286 qpair failed and we were unable to recover it. 00:30:10.286 [2024-07-13 10:16:15.847121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.847264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.847289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.286 qpair failed and we were unable to recover it. 00:30:10.286 [2024-07-13 10:16:15.847410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.847561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.847586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.286 qpair failed and we were unable to recover it. 00:30:10.286 [2024-07-13 10:16:15.847710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.847832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.847860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.286 qpair failed and we were unable to recover it. 00:30:10.286 [2024-07-13 10:16:15.847998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.848138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.848163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.286 qpair failed and we were unable to recover it. 00:30:10.286 [2024-07-13 10:16:15.848277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.848421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.848445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.286 qpair failed and we were unable to recover it. 00:30:10.286 [2024-07-13 10:16:15.848626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.848746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.848772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.286 qpair failed and we were unable to recover it. 00:30:10.286 [2024-07-13 10:16:15.848929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.849046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.849071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.286 qpair failed and we were unable to recover it. 00:30:10.286 [2024-07-13 10:16:15.849195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.849325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.849350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.286 qpair failed and we were unable to recover it. 00:30:10.286 [2024-07-13 10:16:15.849471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.849615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.849640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.286 qpair failed and we were unable to recover it. 00:30:10.286 [2024-07-13 10:16:15.849783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.849926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.849951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.286 qpair failed and we were unable to recover it. 00:30:10.286 [2024-07-13 10:16:15.850085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.850232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.850256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.286 qpair failed and we were unable to recover it. 00:30:10.286 [2024-07-13 10:16:15.850401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.850556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.850581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.286 qpair failed and we were unable to recover it. 00:30:10.286 [2024-07-13 10:16:15.850718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.850851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.850881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.286 qpair failed and we were unable to recover it. 00:30:10.286 [2024-07-13 10:16:15.851005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.851154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.286 [2024-07-13 10:16:15.851179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.286 qpair failed and we were unable to recover it. 00:30:10.286 [2024-07-13 10:16:15.851299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.851425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.851449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.287 qpair failed and we were unable to recover it. 00:30:10.287 [2024-07-13 10:16:15.851578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.851756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.851780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.287 qpair failed and we were unable to recover it. 00:30:10.287 [2024-07-13 10:16:15.851953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.852101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.852126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.287 qpair failed and we were unable to recover it. 00:30:10.287 [2024-07-13 10:16:15.852284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.852401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.852426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.287 qpair failed and we were unable to recover it. 00:30:10.287 [2024-07-13 10:16:15.852576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.852728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.852753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.287 qpair failed and we were unable to recover it. 00:30:10.287 [2024-07-13 10:16:15.852878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.853005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.853029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.287 qpair failed and we were unable to recover it. 00:30:10.287 [2024-07-13 10:16:15.853183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.853301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.853325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.287 qpair failed and we were unable to recover it. 00:30:10.287 [2024-07-13 10:16:15.853447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.853556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.853580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.287 qpair failed and we were unable to recover it. 00:30:10.287 [2024-07-13 10:16:15.853732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.853878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.853904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.287 qpair failed and we were unable to recover it. 00:30:10.287 [2024-07-13 10:16:15.854032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.854188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.854213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.287 qpair failed and we were unable to recover it. 00:30:10.287 [2024-07-13 10:16:15.854388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.854534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.854559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.287 qpair failed and we were unable to recover it. 00:30:10.287 [2024-07-13 10:16:15.854679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.854799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.854823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.287 qpair failed and we were unable to recover it. 00:30:10.287 [2024-07-13 10:16:15.854985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.855107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.855131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.287 qpair failed and we were unable to recover it. 00:30:10.287 [2024-07-13 10:16:15.855281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.855430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.855455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.287 qpair failed and we were unable to recover it. 00:30:10.287 [2024-07-13 10:16:15.855589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.855766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.855791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.287 qpair failed and we were unable to recover it. 00:30:10.287 [2024-07-13 10:16:15.855917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.856042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.856066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.287 qpair failed and we were unable to recover it. 00:30:10.287 [2024-07-13 10:16:15.856223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.856371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.856395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.287 qpair failed and we were unable to recover it. 00:30:10.287 [2024-07-13 10:16:15.856519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.856633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.856658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.287 qpair failed and we were unable to recover it. 00:30:10.287 [2024-07-13 10:16:15.856806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.856962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.856988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.287 qpair failed and we were unable to recover it. 00:30:10.287 [2024-07-13 10:16:15.857117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.857258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.857283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.287 qpair failed and we were unable to recover it. 00:30:10.287 [2024-07-13 10:16:15.857435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.857588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.857614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.287 qpair failed and we were unable to recover it. 00:30:10.287 [2024-07-13 10:16:15.857761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.857879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.857905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.287 qpair failed and we were unable to recover it. 00:30:10.287 [2024-07-13 10:16:15.858063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.858180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.858206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.287 qpair failed and we were unable to recover it. 00:30:10.287 [2024-07-13 10:16:15.858317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.858426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.858450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.287 qpair failed and we were unable to recover it. 00:30:10.287 [2024-07-13 10:16:15.858597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.858744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.858769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.287 qpair failed and we were unable to recover it. 00:30:10.287 [2024-07-13 10:16:15.858918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.859044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.859068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.287 qpair failed and we were unable to recover it. 00:30:10.287 [2024-07-13 10:16:15.859217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.859340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.287 [2024-07-13 10:16:15.859364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.287 qpair failed and we were unable to recover it. 00:30:10.288 [2024-07-13 10:16:15.859484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.859654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.859679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.288 qpair failed and we were unable to recover it. 00:30:10.288 [2024-07-13 10:16:15.859794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.859917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.859943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.288 qpair failed and we were unable to recover it. 00:30:10.288 [2024-07-13 10:16:15.860057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.860243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.860268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.288 qpair failed and we were unable to recover it. 00:30:10.288 [2024-07-13 10:16:15.860407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.860518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.860542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.288 qpair failed and we were unable to recover it. 00:30:10.288 [2024-07-13 10:16:15.860659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.860772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.860797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.288 qpair failed and we were unable to recover it. 00:30:10.288 [2024-07-13 10:16:15.860958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.861102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.861126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.288 qpair failed and we were unable to recover it. 00:30:10.288 [2024-07-13 10:16:15.861261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.861389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.861414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.288 qpair failed and we were unable to recover it. 00:30:10.288 [2024-07-13 10:16:15.861528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.861658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.861682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.288 qpair failed and we were unable to recover it. 00:30:10.288 [2024-07-13 10:16:15.861836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.861962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.861987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.288 qpair failed and we were unable to recover it. 00:30:10.288 [2024-07-13 10:16:15.862106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.862227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.862252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.288 qpair failed and we were unable to recover it. 00:30:10.288 [2024-07-13 10:16:15.862382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.862508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.862533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.288 qpair failed and we were unable to recover it. 00:30:10.288 [2024-07-13 10:16:15.862688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.862839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.862864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.288 qpair failed and we were unable to recover it. 00:30:10.288 [2024-07-13 10:16:15.863002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.863125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.863153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.288 qpair failed and we were unable to recover it. 00:30:10.288 [2024-07-13 10:16:15.863310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.863483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.863508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.288 qpair failed and we were unable to recover it. 00:30:10.288 [2024-07-13 10:16:15.863660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.863789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.863814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.288 qpair failed and we were unable to recover it. 00:30:10.288 [2024-07-13 10:16:15.863952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.864109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.864135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.288 qpair failed and we were unable to recover it. 00:30:10.288 [2024-07-13 10:16:15.864258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.864380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.864405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.288 qpair failed and we were unable to recover it. 00:30:10.288 [2024-07-13 10:16:15.864521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.864703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.864727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.288 qpair failed and we were unable to recover it. 00:30:10.288 [2024-07-13 10:16:15.864842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.864965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.864992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.288 qpair failed and we were unable to recover it. 00:30:10.288 [2024-07-13 10:16:15.865147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.865267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.865292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.288 qpair failed and we were unable to recover it. 00:30:10.288 [2024-07-13 10:16:15.865439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.865583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.865608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.288 qpair failed and we were unable to recover it. 00:30:10.288 [2024-07-13 10:16:15.865731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.865870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.865896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.288 qpair failed and we were unable to recover it. 00:30:10.288 [2024-07-13 10:16:15.866017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.866138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.866163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.288 qpair failed and we were unable to recover it. 00:30:10.288 [2024-07-13 10:16:15.866315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.866458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.866483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.288 qpair failed and we were unable to recover it. 00:30:10.288 [2024-07-13 10:16:15.866596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.866724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.866750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.288 qpair failed and we were unable to recover it. 00:30:10.288 [2024-07-13 10:16:15.866925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.867065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.867090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.288 qpair failed and we were unable to recover it. 00:30:10.288 [2024-07-13 10:16:15.867223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.867343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.867368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.288 qpair failed and we were unable to recover it. 00:30:10.288 [2024-07-13 10:16:15.867506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.867633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.867658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.288 qpair failed and we were unable to recover it. 00:30:10.288 [2024-07-13 10:16:15.867804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.867926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.867952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.288 qpair failed and we were unable to recover it. 00:30:10.288 [2024-07-13 10:16:15.868076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.868237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.868262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.288 qpair failed and we were unable to recover it. 00:30:10.288 [2024-07-13 10:16:15.868385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.288 [2024-07-13 10:16:15.868526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.868551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.289 qpair failed and we were unable to recover it. 00:30:10.289 [2024-07-13 10:16:15.868679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.868826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.868851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.289 qpair failed and we were unable to recover it. 00:30:10.289 [2024-07-13 10:16:15.869002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.869128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.869152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.289 qpair failed and we were unable to recover it. 00:30:10.289 [2024-07-13 10:16:15.869274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.869414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.869440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.289 qpair failed and we were unable to recover it. 00:30:10.289 [2024-07-13 10:16:15.869614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.869729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.869753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.289 qpair failed and we were unable to recover it. 00:30:10.289 [2024-07-13 10:16:15.869882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.870031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.870057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.289 qpair failed and we were unable to recover it. 00:30:10.289 [2024-07-13 10:16:15.870209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.870332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.870357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.289 qpair failed and we were unable to recover it. 00:30:10.289 [2024-07-13 10:16:15.870510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.870631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.870655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.289 qpair failed and we were unable to recover it. 00:30:10.289 [2024-07-13 10:16:15.870777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.870911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.870937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.289 qpair failed and we were unable to recover it. 00:30:10.289 [2024-07-13 10:16:15.871058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.871235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.871260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.289 qpair failed and we were unable to recover it. 00:30:10.289 [2024-07-13 10:16:15.871407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.871547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.871572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.289 qpair failed and we were unable to recover it. 00:30:10.289 [2024-07-13 10:16:15.871697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.871831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.871856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.289 qpair failed and we were unable to recover it. 00:30:10.289 [2024-07-13 10:16:15.871987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.872134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.872159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.289 qpair failed and we were unable to recover it. 00:30:10.289 [2024-07-13 10:16:15.872310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.872424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.872449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.289 qpair failed and we were unable to recover it. 00:30:10.289 [2024-07-13 10:16:15.872560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.872680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.872704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.289 qpair failed and we were unable to recover it. 00:30:10.289 [2024-07-13 10:16:15.872856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.873020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.873044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.289 qpair failed and we were unable to recover it. 00:30:10.289 [2024-07-13 10:16:15.873168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.873314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.873339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.289 qpair failed and we were unable to recover it. 00:30:10.289 [2024-07-13 10:16:15.873467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.873580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.873605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.289 qpair failed and we were unable to recover it. 00:30:10.289 [2024-07-13 10:16:15.873723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.873899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.873925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.289 qpair failed and we were unable to recover it. 00:30:10.289 [2024-07-13 10:16:15.874048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.874197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.874222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.289 qpair failed and we were unable to recover it. 00:30:10.289 [2024-07-13 10:16:15.874365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.874503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.874527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.289 qpair failed and we were unable to recover it. 00:30:10.289 [2024-07-13 10:16:15.874647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.874761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.874785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.289 qpair failed and we were unable to recover it. 00:30:10.289 [2024-07-13 10:16:15.874915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.875037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.875062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.289 qpair failed and we were unable to recover it. 00:30:10.289 [2024-07-13 10:16:15.875192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.875308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.875333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.289 qpair failed and we were unable to recover it. 00:30:10.289 [2024-07-13 10:16:15.875448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.875561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.875585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.289 qpair failed and we were unable to recover it. 00:30:10.289 [2024-07-13 10:16:15.875718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.875894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.875919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.289 qpair failed and we were unable to recover it. 00:30:10.289 [2024-07-13 10:16:15.876035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.876163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.876188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.289 qpair failed and we were unable to recover it. 00:30:10.289 [2024-07-13 10:16:15.876306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.876454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.876479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.289 qpair failed and we were unable to recover it. 00:30:10.289 [2024-07-13 10:16:15.876654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.876798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.876823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.289 qpair failed and we were unable to recover it. 00:30:10.289 [2024-07-13 10:16:15.876961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.877117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.877142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.289 qpair failed and we were unable to recover it. 00:30:10.289 [2024-07-13 10:16:15.877269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.877397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.877422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.289 qpair failed and we were unable to recover it. 00:30:10.289 [2024-07-13 10:16:15.877541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.289 [2024-07-13 10:16:15.877668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.877693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.290 qpair failed and we were unable to recover it. 00:30:10.290 [2024-07-13 10:16:15.877818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.877974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.878000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.290 qpair failed and we were unable to recover it. 00:30:10.290 [2024-07-13 10:16:15.878146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.878294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.878323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.290 qpair failed and we were unable to recover it. 00:30:10.290 [2024-07-13 10:16:15.878449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.878566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.878591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.290 qpair failed and we were unable to recover it. 00:30:10.290 [2024-07-13 10:16:15.878739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.878850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.878881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.290 qpair failed and we were unable to recover it. 00:30:10.290 [2024-07-13 10:16:15.879012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.879166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.879191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.290 qpair failed and we were unable to recover it. 00:30:10.290 [2024-07-13 10:16:15.879347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.879470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.879495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.290 qpair failed and we were unable to recover it. 00:30:10.290 [2024-07-13 10:16:15.879628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.879773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.879798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.290 qpair failed and we were unable to recover it. 00:30:10.290 [2024-07-13 10:16:15.879920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.880049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.880074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.290 qpair failed and we were unable to recover it. 00:30:10.290 [2024-07-13 10:16:15.880229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.880344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.880370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.290 qpair failed and we were unable to recover it. 00:30:10.290 [2024-07-13 10:16:15.880523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.880655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.880680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.290 qpair failed and we were unable to recover it. 00:30:10.290 [2024-07-13 10:16:15.880810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.880926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.880952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.290 qpair failed and we were unable to recover it. 00:30:10.290 [2024-07-13 10:16:15.881078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.881235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.881265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.290 qpair failed and we were unable to recover it. 00:30:10.290 [2024-07-13 10:16:15.881387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.881529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.881566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.290 qpair failed and we were unable to recover it. 00:30:10.290 [2024-07-13 10:16:15.881750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.881896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.881933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.290 qpair failed and we were unable to recover it. 00:30:10.290 [2024-07-13 10:16:15.882120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.882260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.882294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.290 qpair failed and we were unable to recover it. 00:30:10.290 [2024-07-13 10:16:15.882439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.882599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.882634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.290 qpair failed and we were unable to recover it. 00:30:10.290 [2024-07-13 10:16:15.882809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.882999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.883036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.290 qpair failed and we were unable to recover it. 00:30:10.290 [2024-07-13 10:16:15.883216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.883392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.883429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.290 qpair failed and we were unable to recover it. 00:30:10.290 [2024-07-13 10:16:15.883586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.883749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.883785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.290 qpair failed and we were unable to recover it. 00:30:10.290 [2024-07-13 10:16:15.883968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.884116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.884150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.290 qpair failed and we were unable to recover it. 00:30:10.290 [2024-07-13 10:16:15.884278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.884427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.884453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.290 qpair failed and we were unable to recover it. 00:30:10.290 [2024-07-13 10:16:15.884583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.884759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.884786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.290 qpair failed and we were unable to recover it. 00:30:10.290 [2024-07-13 10:16:15.884915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.885064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.885090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.290 qpair failed and we were unable to recover it. 00:30:10.290 [2024-07-13 10:16:15.885247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.885391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.885417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.290 qpair failed and we were unable to recover it. 00:30:10.290 [2024-07-13 10:16:15.885555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.885683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.885709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.290 qpair failed and we were unable to recover it. 00:30:10.290 [2024-07-13 10:16:15.885832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.885963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.885989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.290 qpair failed and we were unable to recover it. 00:30:10.290 [2024-07-13 10:16:15.886102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.886226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.886252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.290 qpair failed and we were unable to recover it. 00:30:10.290 [2024-07-13 10:16:15.886398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.886510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.886535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.290 qpair failed and we were unable to recover it. 00:30:10.290 [2024-07-13 10:16:15.886660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.886804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.886829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.290 qpair failed and we were unable to recover it. 00:30:10.290 [2024-07-13 10:16:15.886998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.887144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.290 [2024-07-13 10:16:15.887170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.290 qpair failed and we were unable to recover it. 00:30:10.291 [2024-07-13 10:16:15.887295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.887417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.887442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.291 qpair failed and we were unable to recover it. 00:30:10.291 [2024-07-13 10:16:15.887561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.887720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.887745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.291 qpair failed and we were unable to recover it. 00:30:10.291 [2024-07-13 10:16:15.887862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.887993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.888017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.291 qpair failed and we were unable to recover it. 00:30:10.291 [2024-07-13 10:16:15.888195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.888337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.888362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.291 qpair failed and we were unable to recover it. 00:30:10.291 [2024-07-13 10:16:15.888484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.888629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.888654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.291 qpair failed and we were unable to recover it. 00:30:10.291 [2024-07-13 10:16:15.888787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.888912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.888938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.291 qpair failed and we were unable to recover it. 00:30:10.291 [2024-07-13 10:16:15.889095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.889213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.889237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.291 qpair failed and we were unable to recover it. 00:30:10.291 [2024-07-13 10:16:15.889385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.889498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.889522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.291 qpair failed and we were unable to recover it. 00:30:10.291 [2024-07-13 10:16:15.889716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.889869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.889895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.291 qpair failed and we were unable to recover it. 00:30:10.291 [2024-07-13 10:16:15.890029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.890145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.890170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.291 qpair failed and we were unable to recover it. 00:30:10.291 [2024-07-13 10:16:15.890321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.890475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.890500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.291 qpair failed and we were unable to recover it. 00:30:10.291 [2024-07-13 10:16:15.890645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.890788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.890812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.291 qpair failed and we were unable to recover it. 00:30:10.291 [2024-07-13 10:16:15.890967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.891093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.891118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.291 qpair failed and we were unable to recover it. 00:30:10.291 [2024-07-13 10:16:15.891239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.891385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.891409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.291 qpair failed and we were unable to recover it. 00:30:10.291 [2024-07-13 10:16:15.891585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.891733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.891759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.291 qpair failed and we were unable to recover it. 00:30:10.291 [2024-07-13 10:16:15.891937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.892080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.892105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.291 qpair failed and we were unable to recover it. 00:30:10.291 [2024-07-13 10:16:15.892221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.892341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.892366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.291 qpair failed and we were unable to recover it. 00:30:10.291 [2024-07-13 10:16:15.892479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.892655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.892680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.291 qpair failed and we were unable to recover it. 00:30:10.291 [2024-07-13 10:16:15.892794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.892922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.892948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.291 qpair failed and we were unable to recover it. 00:30:10.291 [2024-07-13 10:16:15.893101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.893225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.893249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.291 qpair failed and we were unable to recover it. 00:30:10.291 [2024-07-13 10:16:15.893392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.893535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.893559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.291 qpair failed and we were unable to recover it. 00:30:10.291 [2024-07-13 10:16:15.893713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.893853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.893882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.291 qpair failed and we were unable to recover it. 00:30:10.291 [2024-07-13 10:16:15.894006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.894161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.894187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.291 qpair failed and we were unable to recover it. 00:30:10.291 [2024-07-13 10:16:15.894303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.894431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.894456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.291 qpair failed and we were unable to recover it. 00:30:10.291 [2024-07-13 10:16:15.894636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.894747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.894772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.291 qpair failed and we were unable to recover it. 00:30:10.291 [2024-07-13 10:16:15.894920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.895056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.895080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.291 qpair failed and we were unable to recover it. 00:30:10.291 [2024-07-13 10:16:15.895201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.291 [2024-07-13 10:16:15.895348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.895374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.292 qpair failed and we were unable to recover it. 00:30:10.292 [2024-07-13 10:16:15.895521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.895644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.895669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.292 qpair failed and we were unable to recover it. 00:30:10.292 [2024-07-13 10:16:15.895824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.895979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.896005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.292 qpair failed and we were unable to recover it. 00:30:10.292 [2024-07-13 10:16:15.896155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.896298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.896322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.292 qpair failed and we were unable to recover it. 00:30:10.292 [2024-07-13 10:16:15.896435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.896574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.896599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.292 qpair failed and we were unable to recover it. 00:30:10.292 [2024-07-13 10:16:15.896756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.896908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.896934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.292 qpair failed and we were unable to recover it. 00:30:10.292 [2024-07-13 10:16:15.897079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.897201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.897230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.292 qpair failed and we were unable to recover it. 00:30:10.292 [2024-07-13 10:16:15.897348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.897491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.897515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.292 qpair failed and we were unable to recover it. 00:30:10.292 [2024-07-13 10:16:15.897645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.897783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.897809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.292 qpair failed and we were unable to recover it. 00:30:10.292 [2024-07-13 10:16:15.897961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.898121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.898147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.292 qpair failed and we were unable to recover it. 00:30:10.292 [2024-07-13 10:16:15.898300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.898422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.898447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.292 qpair failed and we were unable to recover it. 00:30:10.292 [2024-07-13 10:16:15.898594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.898738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.898763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.292 qpair failed and we were unable to recover it. 00:30:10.292 [2024-07-13 10:16:15.898886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.899002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.899027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.292 qpair failed and we were unable to recover it. 00:30:10.292 [2024-07-13 10:16:15.899157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.899282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.899306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.292 qpair failed and we were unable to recover it. 00:30:10.292 [2024-07-13 10:16:15.899424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.899563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.899587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.292 qpair failed and we were unable to recover it. 00:30:10.292 [2024-07-13 10:16:15.899761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.899884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.899910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.292 qpair failed and we were unable to recover it. 00:30:10.292 [2024-07-13 10:16:15.900041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.900166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.900200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.292 qpair failed and we were unable to recover it. 00:30:10.292 [2024-07-13 10:16:15.900348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.900493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.900517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.292 qpair failed and we were unable to recover it. 00:30:10.292 [2024-07-13 10:16:15.900635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.900759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.900783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.292 qpair failed and we were unable to recover it. 00:30:10.292 [2024-07-13 10:16:15.900907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.901022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.901048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.292 qpair failed and we were unable to recover it. 00:30:10.292 [2024-07-13 10:16:15.901177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.901326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.901350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.292 qpair failed and we were unable to recover it. 00:30:10.292 [2024-07-13 10:16:15.901470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.901588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.901613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.292 qpair failed and we were unable to recover it. 00:30:10.292 [2024-07-13 10:16:15.901761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.901885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.901910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.292 qpair failed and we were unable to recover it. 00:30:10.292 [2024-07-13 10:16:15.902056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.902233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.902258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.292 qpair failed and we were unable to recover it. 00:30:10.292 [2024-07-13 10:16:15.902385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.902559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.902584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.292 qpair failed and we were unable to recover it. 00:30:10.292 [2024-07-13 10:16:15.902698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.902884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.902910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.292 qpair failed and we were unable to recover it. 00:30:10.292 [2024-07-13 10:16:15.903041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.903177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.903202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.292 qpair failed and we were unable to recover it. 00:30:10.292 [2024-07-13 10:16:15.903330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.903455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.903480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.292 qpair failed and we were unable to recover it. 00:30:10.292 [2024-07-13 10:16:15.903633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.903747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.903772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.292 qpair failed and we were unable to recover it. 00:30:10.292 [2024-07-13 10:16:15.903922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.904050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.904075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.292 qpair failed and we were unable to recover it. 00:30:10.292 [2024-07-13 10:16:15.904207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.904321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.904346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.292 qpair failed and we were unable to recover it. 00:30:10.292 [2024-07-13 10:16:15.904503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.292 [2024-07-13 10:16:15.904649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.904674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.293 qpair failed and we were unable to recover it. 00:30:10.293 [2024-07-13 10:16:15.904807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.904947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.904973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.293 qpair failed and we were unable to recover it. 00:30:10.293 [2024-07-13 10:16:15.905086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.905218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.905242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.293 qpair failed and we were unable to recover it. 00:30:10.293 [2024-07-13 10:16:15.905370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.905511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.905536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.293 qpair failed and we were unable to recover it. 00:30:10.293 [2024-07-13 10:16:15.905659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.905808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.905832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.293 qpair failed and we were unable to recover it. 00:30:10.293 [2024-07-13 10:16:15.905967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.906083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.906107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.293 qpair failed and we were unable to recover it. 00:30:10.293 [2024-07-13 10:16:15.906225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.906374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.906398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.293 qpair failed and we were unable to recover it. 00:30:10.293 [2024-07-13 10:16:15.906556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.906678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.906703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.293 qpair failed and we were unable to recover it. 00:30:10.293 [2024-07-13 10:16:15.906848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.906971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.906996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.293 qpair failed and we were unable to recover it. 00:30:10.293 [2024-07-13 10:16:15.907127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.907251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.907276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.293 qpair failed and we were unable to recover it. 00:30:10.293 [2024-07-13 10:16:15.907432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.907553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.907579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.293 qpair failed and we were unable to recover it. 00:30:10.293 [2024-07-13 10:16:15.907701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.907842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.907872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.293 qpair failed and we were unable to recover it. 00:30:10.293 [2024-07-13 10:16:15.907997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.908142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.908167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.293 qpair failed and we were unable to recover it. 00:30:10.293 [2024-07-13 10:16:15.908332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.908453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.908479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.293 qpair failed and we were unable to recover it. 00:30:10.293 [2024-07-13 10:16:15.908602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.908743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.908767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.293 qpair failed and we were unable to recover it. 00:30:10.293 [2024-07-13 10:16:15.908907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.909054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.909079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.293 qpair failed and we were unable to recover it. 00:30:10.293 [2024-07-13 10:16:15.909249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.909402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.909428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.293 qpair failed and we were unable to recover it. 00:30:10.293 [2024-07-13 10:16:15.909575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.909727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.909752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.293 qpair failed and we were unable to recover it. 00:30:10.293 [2024-07-13 10:16:15.909896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.910015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.910040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.293 qpair failed and we were unable to recover it. 00:30:10.293 [2024-07-13 10:16:15.910163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.910304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.910329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.293 qpair failed and we were unable to recover it. 00:30:10.293 [2024-07-13 10:16:15.910441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.910558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.910582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.293 qpair failed and we were unable to recover it. 00:30:10.293 [2024-07-13 10:16:15.910708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.910846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.910883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.293 qpair failed and we were unable to recover it. 00:30:10.293 [2024-07-13 10:16:15.911010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.911163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.911188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.293 qpair failed and we were unable to recover it. 00:30:10.293 [2024-07-13 10:16:15.911309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.911486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.911511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.293 qpair failed and we were unable to recover it. 00:30:10.293 [2024-07-13 10:16:15.911635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.911781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.911805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.293 qpair failed and we were unable to recover it. 00:30:10.293 [2024-07-13 10:16:15.911931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.912089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.912114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.293 qpair failed and we were unable to recover it. 00:30:10.293 [2024-07-13 10:16:15.912240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.912374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.912405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.293 qpair failed and we were unable to recover it. 00:30:10.293 [2024-07-13 10:16:15.912554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.912703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.912729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.293 qpair failed and we were unable to recover it. 00:30:10.293 [2024-07-13 10:16:15.912847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.912967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.912993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.293 qpair failed and we were unable to recover it. 00:30:10.293 [2024-07-13 10:16:15.913124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.913253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.913278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.293 qpair failed and we were unable to recover it. 00:30:10.293 [2024-07-13 10:16:15.913426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.913553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.293 [2024-07-13 10:16:15.913578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.293 qpair failed and we were unable to recover it. 00:30:10.294 [2024-07-13 10:16:15.913707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.913847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.913878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.294 qpair failed and we were unable to recover it. 00:30:10.294 [2024-07-13 10:16:15.914038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.914157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.914182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.294 qpair failed and we were unable to recover it. 00:30:10.294 [2024-07-13 10:16:15.914312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.914437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.914462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.294 qpair failed and we were unable to recover it. 00:30:10.294 [2024-07-13 10:16:15.914607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.914781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.914807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.294 qpair failed and we were unable to recover it. 00:30:10.294 [2024-07-13 10:16:15.914938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.915093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.915119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.294 qpair failed and we were unable to recover it. 00:30:10.294 [2024-07-13 10:16:15.915240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.915350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.915375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.294 qpair failed and we were unable to recover it. 00:30:10.294 [2024-07-13 10:16:15.915505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.915638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.915663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.294 qpair failed and we were unable to recover it. 00:30:10.294 [2024-07-13 10:16:15.915814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.915959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.915985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.294 qpair failed and we were unable to recover it. 00:30:10.294 [2024-07-13 10:16:15.916136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.916277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.916302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.294 qpair failed and we were unable to recover it. 00:30:10.294 [2024-07-13 10:16:15.916430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.916557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.916582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.294 qpair failed and we were unable to recover it. 00:30:10.294 [2024-07-13 10:16:15.916708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.916821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.916846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.294 qpair failed and we were unable to recover it. 00:30:10.294 [2024-07-13 10:16:15.917003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.917132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.917156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.294 qpair failed and we were unable to recover it. 00:30:10.294 [2024-07-13 10:16:15.917284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.917459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.917483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.294 qpair failed and we were unable to recover it. 00:30:10.294 [2024-07-13 10:16:15.917620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.917792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.917817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.294 qpair failed and we were unable to recover it. 00:30:10.294 [2024-07-13 10:16:15.917943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.918070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.918095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.294 qpair failed and we were unable to recover it. 00:30:10.294 [2024-07-13 10:16:15.918218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.918337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.918365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.294 qpair failed and we were unable to recover it. 00:30:10.294 [2024-07-13 10:16:15.918520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.918646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.918671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.294 qpair failed and we were unable to recover it. 00:30:10.294 [2024-07-13 10:16:15.918831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.918964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.918989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.294 qpair failed and we were unable to recover it. 00:30:10.294 [2024-07-13 10:16:15.919135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.919258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.919282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.294 qpair failed and we were unable to recover it. 00:30:10.294 [2024-07-13 10:16:15.919440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.919611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.919637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.294 qpair failed and we were unable to recover it. 00:30:10.294 [2024-07-13 10:16:15.919790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.919915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.919942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.294 qpair failed and we were unable to recover it. 00:30:10.294 [2024-07-13 10:16:15.920093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.920210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.920236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.294 qpair failed and we were unable to recover it. 00:30:10.294 [2024-07-13 10:16:15.920392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.920539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.920564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.294 qpair failed and we were unable to recover it. 00:30:10.294 [2024-07-13 10:16:15.920676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.920824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.920848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.294 qpair failed and we were unable to recover it. 00:30:10.294 [2024-07-13 10:16:15.920984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.921126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.921150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.294 qpair failed and we were unable to recover it. 00:30:10.294 [2024-07-13 10:16:15.921273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.921421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.921447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.294 qpair failed and we were unable to recover it. 00:30:10.294 [2024-07-13 10:16:15.921614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.921726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.921751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.294 qpair failed and we were unable to recover it. 00:30:10.294 [2024-07-13 10:16:15.921881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.922058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.922083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.294 qpair failed and we were unable to recover it. 00:30:10.294 [2024-07-13 10:16:15.922203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.922348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.922372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.294 qpair failed and we were unable to recover it. 00:30:10.294 [2024-07-13 10:16:15.922489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.922643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.922667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.294 qpair failed and we were unable to recover it. 00:30:10.294 [2024-07-13 10:16:15.922824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.922979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.294 [2024-07-13 10:16:15.923005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.294 qpair failed and we were unable to recover it. 00:30:10.295 [2024-07-13 10:16:15.923136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.923265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.923290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.295 qpair failed and we were unable to recover it. 00:30:10.295 [2024-07-13 10:16:15.923434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.923608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.923633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.295 qpair failed and we were unable to recover it. 00:30:10.295 [2024-07-13 10:16:15.923780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.923914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.923940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.295 qpair failed and we were unable to recover it. 00:30:10.295 [2024-07-13 10:16:15.924059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.924180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.924205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.295 qpair failed and we were unable to recover it. 00:30:10.295 [2024-07-13 10:16:15.924333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.924451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.924477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.295 qpair failed and we were unable to recover it. 00:30:10.295 [2024-07-13 10:16:15.924619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.924777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.924801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.295 qpair failed and we were unable to recover it. 00:30:10.295 [2024-07-13 10:16:15.924926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.925058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.925083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.295 qpair failed and we were unable to recover it. 00:30:10.295 [2024-07-13 10:16:15.925227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.925399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.925424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.295 qpair failed and we were unable to recover it. 00:30:10.295 [2024-07-13 10:16:15.925546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.925690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.925715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.295 qpair failed and we were unable to recover it. 00:30:10.295 [2024-07-13 10:16:15.925841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.926019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.926045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.295 qpair failed and we were unable to recover it. 00:30:10.295 [2024-07-13 10:16:15.926168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.926283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.926309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.295 qpair failed and we were unable to recover it. 00:30:10.295 [2024-07-13 10:16:15.926440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.926592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.926617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.295 qpair failed and we were unable to recover it. 00:30:10.295 [2024-07-13 10:16:15.926746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.926894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.926919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.295 qpair failed and we were unable to recover it. 00:30:10.295 [2024-07-13 10:16:15.927038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.927150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.927175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.295 qpair failed and we were unable to recover it. 00:30:10.295 [2024-07-13 10:16:15.927321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.927443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.927467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.295 qpair failed and we were unable to recover it. 00:30:10.295 [2024-07-13 10:16:15.927616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.927736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.927764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.295 qpair failed and we were unable to recover it. 00:30:10.295 [2024-07-13 10:16:15.927906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.928035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.928060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.295 qpair failed and we were unable to recover it. 00:30:10.295 [2024-07-13 10:16:15.928223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.928397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.928423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.295 qpair failed and we were unable to recover it. 00:30:10.295 [2024-07-13 10:16:15.928574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.928750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.928774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.295 qpair failed and we were unable to recover it. 00:30:10.295 [2024-07-13 10:16:15.928923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.929049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.929074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.295 qpair failed and we were unable to recover it. 00:30:10.295 [2024-07-13 10:16:15.929230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.929373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.929399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.295 qpair failed and we were unable to recover it. 00:30:10.295 [2024-07-13 10:16:15.929524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.929678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.929702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.295 qpair failed and we were unable to recover it. 00:30:10.295 [2024-07-13 10:16:15.929818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.929936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.929962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.295 qpair failed and we were unable to recover it. 00:30:10.295 [2024-07-13 10:16:15.930073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.930225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.930249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.295 qpair failed and we were unable to recover it. 00:30:10.295 [2024-07-13 10:16:15.930374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.930488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.930513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.295 qpair failed and we were unable to recover it. 00:30:10.295 [2024-07-13 10:16:15.930639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.930782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.930810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.295 qpair failed and we were unable to recover it. 00:30:10.295 [2024-07-13 10:16:15.930971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.295 [2024-07-13 10:16:15.931108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.931133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.296 qpair failed and we were unable to recover it. 00:30:10.296 [2024-07-13 10:16:15.931286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.931460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.931485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.296 qpair failed and we were unable to recover it. 00:30:10.296 [2024-07-13 10:16:15.931611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.931730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.931754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.296 qpair failed and we were unable to recover it. 00:30:10.296 [2024-07-13 10:16:15.931882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.932011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.932036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.296 qpair failed and we were unable to recover it. 00:30:10.296 [2024-07-13 10:16:15.932183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.932308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.932333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.296 qpair failed and we were unable to recover it. 00:30:10.296 [2024-07-13 10:16:15.932507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.932626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.932650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.296 qpair failed and we were unable to recover it. 00:30:10.296 [2024-07-13 10:16:15.932774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.932950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.932976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.296 qpair failed and we were unable to recover it. 00:30:10.296 [2024-07-13 10:16:15.933128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.933243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.933268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.296 qpair failed and we were unable to recover it. 00:30:10.296 [2024-07-13 10:16:15.933414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.933528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.933552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.296 qpair failed and we were unable to recover it. 00:30:10.296 [2024-07-13 10:16:15.933706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.933858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.933888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.296 qpair failed and we were unable to recover it. 00:30:10.296 [2024-07-13 10:16:15.934017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.934137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.934162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.296 qpair failed and we were unable to recover it. 00:30:10.296 [2024-07-13 10:16:15.934299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.934433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.934458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.296 qpair failed and we were unable to recover it. 00:30:10.296 [2024-07-13 10:16:15.934590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.934724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.934749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.296 qpair failed and we were unable to recover it. 00:30:10.296 [2024-07-13 10:16:15.934907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.935051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.935076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.296 qpair failed and we were unable to recover it. 00:30:10.296 [2024-07-13 10:16:15.935229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.935353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.935378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.296 qpair failed and we were unable to recover it. 00:30:10.296 [2024-07-13 10:16:15.935557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.935681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.935706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.296 qpair failed and we were unable to recover it. 00:30:10.296 [2024-07-13 10:16:15.935844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.935966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.935991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.296 qpair failed and we were unable to recover it. 00:30:10.296 [2024-07-13 10:16:15.936120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.936274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.936299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.296 qpair failed and we were unable to recover it. 00:30:10.296 [2024-07-13 10:16:15.936458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.936574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.936599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.296 qpair failed and we were unable to recover it. 00:30:10.296 [2024-07-13 10:16:15.936730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.936850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.936882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.296 qpair failed and we were unable to recover it. 00:30:10.296 [2024-07-13 10:16:15.937008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.937141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.937166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.296 qpair failed and we were unable to recover it. 00:30:10.296 [2024-07-13 10:16:15.937287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.937435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.937460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.296 qpair failed and we were unable to recover it. 00:30:10.296 [2024-07-13 10:16:15.937578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.937730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.937755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.296 qpair failed and we were unable to recover it. 00:30:10.296 [2024-07-13 10:16:15.937886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.938003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.938029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.296 qpair failed and we were unable to recover it. 00:30:10.296 [2024-07-13 10:16:15.938145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.938263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.938290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.296 qpair failed and we were unable to recover it. 00:30:10.296 [2024-07-13 10:16:15.938417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.938569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.938594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.296 qpair failed and we were unable to recover it. 00:30:10.296 [2024-07-13 10:16:15.938710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.938833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.938858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.296 qpair failed and we were unable to recover it. 00:30:10.296 [2024-07-13 10:16:15.938977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.939127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.939153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.296 qpair failed and we were unable to recover it. 00:30:10.296 [2024-07-13 10:16:15.939280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.939409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.939435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.296 qpair failed and we were unable to recover it. 00:30:10.296 [2024-07-13 10:16:15.939559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.939733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.939758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.296 qpair failed and we were unable to recover it. 00:30:10.296 [2024-07-13 10:16:15.939875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.940006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.296 [2024-07-13 10:16:15.940032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.296 qpair failed and we were unable to recover it. 00:30:10.297 [2024-07-13 10:16:15.940149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.940296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.940321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.297 qpair failed and we were unable to recover it. 00:30:10.297 [2024-07-13 10:16:15.940448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.940567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.940592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.297 qpair failed and we were unable to recover it. 00:30:10.297 [2024-07-13 10:16:15.940740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.940890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.940917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.297 qpair failed and we were unable to recover it. 00:30:10.297 [2024-07-13 10:16:15.941046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.941193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.941218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.297 qpair failed and we were unable to recover it. 00:30:10.297 [2024-07-13 10:16:15.941378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.941491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.941516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.297 qpair failed and we were unable to recover it. 00:30:10.297 [2024-07-13 10:16:15.941663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.941776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.941802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.297 qpair failed and we were unable to recover it. 00:30:10.297 [2024-07-13 10:16:15.941922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.942058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.942087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.297 qpair failed and we were unable to recover it. 00:30:10.297 [2024-07-13 10:16:15.942232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.942417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.942443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.297 qpair failed and we were unable to recover it. 00:30:10.297 [2024-07-13 10:16:15.942554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.942712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.942738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.297 qpair failed and we were unable to recover it. 00:30:10.297 [2024-07-13 10:16:15.942857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.943032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.943057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.297 qpair failed and we were unable to recover it. 00:30:10.297 [2024-07-13 10:16:15.943181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.943309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.943334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.297 qpair failed and we were unable to recover it. 00:30:10.297 [2024-07-13 10:16:15.943512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.943660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.943685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.297 qpair failed and we were unable to recover it. 00:30:10.297 [2024-07-13 10:16:15.943838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.943971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.943996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.297 qpair failed and we were unable to recover it. 00:30:10.297 [2024-07-13 10:16:15.944118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.944245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.944272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.297 qpair failed and we were unable to recover it. 00:30:10.297 [2024-07-13 10:16:15.944397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.944534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.944558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.297 qpair failed and we were unable to recover it. 00:30:10.297 [2024-07-13 10:16:15.944687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.944829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.944855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.297 qpair failed and we were unable to recover it. 00:30:10.297 [2024-07-13 10:16:15.944986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.945105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.945132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.297 qpair failed and we were unable to recover it. 00:30:10.297 [2024-07-13 10:16:15.945275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.945432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.945458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.297 qpair failed and we were unable to recover it. 00:30:10.297 [2024-07-13 10:16:15.945604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.945748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.945772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.297 qpair failed and we were unable to recover it. 00:30:10.297 [2024-07-13 10:16:15.945928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.946048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.946076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.297 qpair failed and we were unable to recover it. 00:30:10.297 [2024-07-13 10:16:15.946200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.946356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.946381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.297 qpair failed and we were unable to recover it. 00:30:10.297 [2024-07-13 10:16:15.946524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.946647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.946672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.297 qpair failed and we were unable to recover it. 00:30:10.297 [2024-07-13 10:16:15.946815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.946963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.946989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.297 qpair failed and we were unable to recover it. 00:30:10.297 [2024-07-13 10:16:15.947148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.947276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.947300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.297 qpair failed and we were unable to recover it. 00:30:10.297 [2024-07-13 10:16:15.947435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.947548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.947573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.297 qpair failed and we were unable to recover it. 00:30:10.297 [2024-07-13 10:16:15.947690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.947845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.947875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.297 qpair failed and we were unable to recover it. 00:30:10.297 [2024-07-13 10:16:15.948027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.948174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.948200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.297 qpair failed and we were unable to recover it. 00:30:10.297 [2024-07-13 10:16:15.948317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.948450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.948475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.297 qpair failed and we were unable to recover it. 00:30:10.297 [2024-07-13 10:16:15.948654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.948802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.948827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.297 qpair failed and we were unable to recover it. 00:30:10.297 [2024-07-13 10:16:15.948961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.949134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.949159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.297 qpair failed and we were unable to recover it. 00:30:10.297 [2024-07-13 10:16:15.949287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.949404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.297 [2024-07-13 10:16:15.949428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.298 qpair failed and we were unable to recover it. 00:30:10.298 [2024-07-13 10:16:15.949574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.949697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.949722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.298 qpair failed and we were unable to recover it. 00:30:10.298 [2024-07-13 10:16:15.949896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.950019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.950044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.298 qpair failed and we were unable to recover it. 00:30:10.298 [2024-07-13 10:16:15.950171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.950287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.950311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.298 qpair failed and we were unable to recover it. 00:30:10.298 [2024-07-13 10:16:15.950474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.950586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.950611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.298 qpair failed and we were unable to recover it. 00:30:10.298 [2024-07-13 10:16:15.950731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.950853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.950900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.298 qpair failed and we were unable to recover it. 00:30:10.298 [2024-07-13 10:16:15.951059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.951204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.951229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.298 qpair failed and we were unable to recover it. 00:30:10.298 [2024-07-13 10:16:15.951359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.951531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.951555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.298 qpair failed and we were unable to recover it. 00:30:10.298 [2024-07-13 10:16:15.951669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.951812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.951837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.298 qpair failed and we were unable to recover it. 00:30:10.298 [2024-07-13 10:16:15.951966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.952129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.952154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.298 qpair failed and we were unable to recover it. 00:30:10.298 [2024-07-13 10:16:15.952274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.952420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.952445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.298 qpair failed and we were unable to recover it. 00:30:10.298 [2024-07-13 10:16:15.952561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.952738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.952763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.298 qpair failed and we were unable to recover it. 00:30:10.298 [2024-07-13 10:16:15.952915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.953067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.953091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.298 qpair failed and we were unable to recover it. 00:30:10.298 [2024-07-13 10:16:15.953207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.953350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.953374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.298 qpair failed and we were unable to recover it. 00:30:10.298 [2024-07-13 10:16:15.953502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.953628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.953654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.298 qpair failed and we were unable to recover it. 00:30:10.298 [2024-07-13 10:16:15.953807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.953953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.953980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.298 qpair failed and we were unable to recover it. 00:30:10.298 [2024-07-13 10:16:15.954106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.954223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.954248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.298 qpair failed and we were unable to recover it. 00:30:10.298 [2024-07-13 10:16:15.954397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.954522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.954546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.298 qpair failed and we were unable to recover it. 00:30:10.298 [2024-07-13 10:16:15.954698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.954808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.954833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.298 qpair failed and we were unable to recover it. 00:30:10.298 [2024-07-13 10:16:15.955009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.955153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.955178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.298 qpair failed and we were unable to recover it. 00:30:10.298 [2024-07-13 10:16:15.955310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.955457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.955482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.298 qpair failed and we were unable to recover it. 00:30:10.298 [2024-07-13 10:16:15.955598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.955743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.955768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.298 qpair failed and we were unable to recover it. 00:30:10.298 [2024-07-13 10:16:15.955898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.956057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.956082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.298 qpair failed and we were unable to recover it. 00:30:10.298 [2024-07-13 10:16:15.956232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.956359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.956383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.298 qpair failed and we were unable to recover it. 00:30:10.298 [2024-07-13 10:16:15.956504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.956647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.956671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.298 qpair failed and we were unable to recover it. 00:30:10.298 [2024-07-13 10:16:15.956821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.956969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.956994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.298 qpair failed and we were unable to recover it. 00:30:10.298 [2024-07-13 10:16:15.957147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.957283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.957308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.298 qpair failed and we were unable to recover it. 00:30:10.298 [2024-07-13 10:16:15.957419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.957562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.957587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.298 qpair failed and we were unable to recover it. 00:30:10.298 [2024-07-13 10:16:15.957765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.957890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.957916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.298 qpair failed and we were unable to recover it. 00:30:10.298 [2024-07-13 10:16:15.958053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.958173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.958200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.298 qpair failed and we were unable to recover it. 00:30:10.298 [2024-07-13 10:16:15.958367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.958492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.958518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.298 qpair failed and we were unable to recover it. 00:30:10.298 [2024-07-13 10:16:15.958644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.298 [2024-07-13 10:16:15.958788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.958813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.299 qpair failed and we were unable to recover it. 00:30:10.299 [2024-07-13 10:16:15.958962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.959087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.959112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.299 qpair failed and we were unable to recover it. 00:30:10.299 [2024-07-13 10:16:15.959290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.959439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.959465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.299 qpair failed and we were unable to recover it. 00:30:10.299 [2024-07-13 10:16:15.959588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.959734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.959761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.299 qpair failed and we were unable to recover it. 00:30:10.299 [2024-07-13 10:16:15.959921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.960038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.960064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.299 qpair failed and we were unable to recover it. 00:30:10.299 [2024-07-13 10:16:15.960188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.960309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.960335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.299 qpair failed and we were unable to recover it. 00:30:10.299 [2024-07-13 10:16:15.960461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.960591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.960617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.299 qpair failed and we were unable to recover it. 00:30:10.299 [2024-07-13 10:16:15.960770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.960890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.960917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.299 qpair failed and we were unable to recover it. 00:30:10.299 [2024-07-13 10:16:15.961074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.961197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.961224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.299 qpair failed and we were unable to recover it. 00:30:10.299 [2024-07-13 10:16:15.961369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.961492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.961524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.299 qpair failed and we were unable to recover it. 00:30:10.299 [2024-07-13 10:16:15.961656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.961779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.961804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.299 qpair failed and we were unable to recover it. 00:30:10.299 [2024-07-13 10:16:15.961940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.962079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.962105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.299 qpair failed and we were unable to recover it. 00:30:10.299 [2024-07-13 10:16:15.962252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.962373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.962398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.299 qpair failed and we were unable to recover it. 00:30:10.299 [2024-07-13 10:16:15.962561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.962708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.962735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.299 qpair failed and we were unable to recover it. 00:30:10.299 [2024-07-13 10:16:15.962847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.963005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.963032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.299 qpair failed and we were unable to recover it. 00:30:10.299 [2024-07-13 10:16:15.963185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.963333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.963359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.299 qpair failed and we were unable to recover it. 00:30:10.299 [2024-07-13 10:16:15.963519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.963677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.963702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.299 qpair failed and we were unable to recover it. 00:30:10.299 [2024-07-13 10:16:15.963826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.963981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.964007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.299 qpair failed and we were unable to recover it. 00:30:10.299 [2024-07-13 10:16:15.964157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.964278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.964304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.299 qpair failed and we were unable to recover it. 00:30:10.299 [2024-07-13 10:16:15.964460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.964573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.964599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.299 qpair failed and we were unable to recover it. 00:30:10.299 [2024-07-13 10:16:15.964748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.964899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.964925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.299 qpair failed and we were unable to recover it. 00:30:10.299 [2024-07-13 10:16:15.965049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.965170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.965197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.299 qpair failed and we were unable to recover it. 00:30:10.299 [2024-07-13 10:16:15.965310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.965437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.965462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.299 qpair failed and we were unable to recover it. 00:30:10.299 [2024-07-13 10:16:15.965592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.965718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.965744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.299 qpair failed and we were unable to recover it. 00:30:10.299 [2024-07-13 10:16:15.965874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.966002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.966027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.299 qpair failed and we were unable to recover it. 00:30:10.299 [2024-07-13 10:16:15.966146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.966295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.966321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.299 qpair failed and we were unable to recover it. 00:30:10.299 [2024-07-13 10:16:15.966436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.966553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.966579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.299 qpair failed and we were unable to recover it. 00:30:10.299 [2024-07-13 10:16:15.966736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.966889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.966916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.299 qpair failed and we were unable to recover it. 00:30:10.299 [2024-07-13 10:16:15.967077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.967235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.967261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.299 qpair failed and we were unable to recover it. 00:30:10.299 [2024-07-13 10:16:15.967406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.967554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.299 [2024-07-13 10:16:15.967580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.300 qpair failed and we were unable to recover it. 00:30:10.300 [2024-07-13 10:16:15.967705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.967850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.967881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.300 qpair failed and we were unable to recover it. 00:30:10.300 [2024-07-13 10:16:15.967997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.968148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.968176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.300 qpair failed and we were unable to recover it. 00:30:10.300 [2024-07-13 10:16:15.968323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.968461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.968488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.300 qpair failed and we were unable to recover it. 00:30:10.300 [2024-07-13 10:16:15.968616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.968786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.968812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.300 qpair failed and we were unable to recover it. 00:30:10.300 [2024-07-13 10:16:15.968937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.969086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.969112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.300 qpair failed and we were unable to recover it. 00:30:10.300 [2024-07-13 10:16:15.969260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.969411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.969437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.300 qpair failed and we were unable to recover it. 00:30:10.300 [2024-07-13 10:16:15.969591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.969736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.969763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.300 qpair failed and we were unable to recover it. 00:30:10.300 [2024-07-13 10:16:15.969917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.970040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.970067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.300 qpair failed and we were unable to recover it. 00:30:10.300 [2024-07-13 10:16:15.970190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.970306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.970331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.300 qpair failed and we were unable to recover it. 00:30:10.300 [2024-07-13 10:16:15.970481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.970641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.970666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.300 qpair failed and we were unable to recover it. 00:30:10.300 [2024-07-13 10:16:15.970822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.970951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.970979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.300 qpair failed and we were unable to recover it. 00:30:10.300 [2024-07-13 10:16:15.971105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.971227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.971252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.300 qpair failed and we were unable to recover it. 00:30:10.300 [2024-07-13 10:16:15.971399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.971529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.971556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.300 qpair failed and we were unable to recover it. 00:30:10.300 [2024-07-13 10:16:15.971675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.971806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.971832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.300 qpair failed and we were unable to recover it. 00:30:10.300 [2024-07-13 10:16:15.971987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.972132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.972157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.300 qpair failed and we were unable to recover it. 00:30:10.300 [2024-07-13 10:16:15.972306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.972426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.972452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.300 qpair failed and we were unable to recover it. 00:30:10.300 [2024-07-13 10:16:15.972597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.972743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.972769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.300 qpair failed and we were unable to recover it. 00:30:10.300 [2024-07-13 10:16:15.972922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.973043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.973070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.300 qpair failed and we were unable to recover it. 00:30:10.300 [2024-07-13 10:16:15.973228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.973380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.973406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.300 qpair failed and we were unable to recover it. 00:30:10.300 [2024-07-13 10:16:15.973552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.973686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.973712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.300 qpair failed and we were unable to recover it. 00:30:10.300 [2024-07-13 10:16:15.973859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.973990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.974016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.300 qpair failed and we were unable to recover it. 00:30:10.300 [2024-07-13 10:16:15.974167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.974286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.974311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.300 qpair failed and we were unable to recover it. 00:30:10.300 [2024-07-13 10:16:15.974435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.974591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.974617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.300 qpair failed and we were unable to recover it. 00:30:10.300 [2024-07-13 10:16:15.974767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.974895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.974923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.300 qpair failed and we were unable to recover it. 00:30:10.300 [2024-07-13 10:16:15.975042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.975168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.975194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.300 qpair failed and we were unable to recover it. 00:30:10.300 [2024-07-13 10:16:15.975341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.975457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.975482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.300 qpair failed and we were unable to recover it. 00:30:10.300 [2024-07-13 10:16:15.975598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 10:16:15 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:30:10.300 [2024-07-13 10:16:15.975747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.975775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.300 qpair failed and we were unable to recover it. 00:30:10.300 [2024-07-13 10:16:15.975897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 10:16:15 -- common/autotest_common.sh@852 -- # return 0 00:30:10.300 [2024-07-13 10:16:15.976026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.300 [2024-07-13 10:16:15.976059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.301 qpair failed and we were unable to recover it. 00:30:10.301 [2024-07-13 10:16:15.976216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.976326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.976353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.301 10:16:15 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:10.301 qpair failed and we were unable to recover it. 00:30:10.301 [2024-07-13 10:16:15.976472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.976582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.976609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.301 qpair failed and we were unable to recover it. 00:30:10.301 10:16:15 -- common/autotest_common.sh@718 -- # xtrace_disable 00:30:10.301 [2024-07-13 10:16:15.976759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.976906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.976934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 wit 10:16:15 -- common/autotest_common.sh@10 -- # set +x 00:30:10.301 h addr=10.0.0.2, port=4420 00:30:10.301 qpair failed and we were unable to recover it. 00:30:10.301 [2024-07-13 10:16:15.977118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.977265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.977291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.301 qpair failed and we were unable to recover it. 00:30:10.301 [2024-07-13 10:16:15.977440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.977552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.977578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.301 qpair failed and we were unable to recover it. 00:30:10.301 [2024-07-13 10:16:15.977712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.977871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.977897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.301 qpair failed and we were unable to recover it. 00:30:10.301 [2024-07-13 10:16:15.978024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.978166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.978191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.301 qpair failed and we were unable to recover it. 00:30:10.301 [2024-07-13 10:16:15.978310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.978451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.978476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.301 qpair failed and we were unable to recover it. 00:30:10.301 [2024-07-13 10:16:15.978602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.978722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.978747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.301 qpair failed and we were unable to recover it. 00:30:10.301 [2024-07-13 10:16:15.978875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.979015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.979041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.301 qpair failed and we were unable to recover it. 00:30:10.301 [2024-07-13 10:16:15.979160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.979276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.979302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.301 qpair failed and we were unable to recover it. 00:30:10.301 [2024-07-13 10:16:15.979429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.979552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.979578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.301 qpair failed and we were unable to recover it. 00:30:10.301 [2024-07-13 10:16:15.979746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.979898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.979926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.301 qpair failed and we were unable to recover it. 00:30:10.301 [2024-07-13 10:16:15.980076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.980201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.980228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.301 qpair failed and we were unable to recover it. 00:30:10.301 [2024-07-13 10:16:15.980383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.980508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.980533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.301 qpair failed and we were unable to recover it. 00:30:10.301 [2024-07-13 10:16:15.980651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.980765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.980790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.301 qpair failed and we were unable to recover it. 00:30:10.301 [2024-07-13 10:16:15.980942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.981056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.981081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.301 qpair failed and we were unable to recover it. 00:30:10.301 [2024-07-13 10:16:15.981221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.981367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.981393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.301 qpair failed and we were unable to recover it. 00:30:10.301 [2024-07-13 10:16:15.981506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.981669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.981695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.301 qpair failed and we were unable to recover it. 00:30:10.301 [2024-07-13 10:16:15.981839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.981989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.982014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.301 qpair failed and we were unable to recover it. 00:30:10.301 [2024-07-13 10:16:15.982142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.982258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.982283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.301 qpair failed and we were unable to recover it. 00:30:10.301 [2024-07-13 10:16:15.982428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.982537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.982562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.301 qpair failed and we were unable to recover it. 00:30:10.301 [2024-07-13 10:16:15.982724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.982834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.982860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.301 qpair failed and we were unable to recover it. 00:30:10.301 [2024-07-13 10:16:15.983017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.983140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.983166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.301 qpair failed and we were unable to recover it. 00:30:10.301 [2024-07-13 10:16:15.983320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.983440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.983465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.301 qpair failed and we were unable to recover it. 00:30:10.301 [2024-07-13 10:16:15.983592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.983738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.983764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.301 qpair failed and we were unable to recover it. 00:30:10.301 [2024-07-13 10:16:15.983909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.984038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.984064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.301 qpair failed and we were unable to recover it. 00:30:10.301 [2024-07-13 10:16:15.984220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.984355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.984381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.301 qpair failed and we were unable to recover it. 00:30:10.301 [2024-07-13 10:16:15.984530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.984677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.984702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.301 qpair failed and we were unable to recover it. 00:30:10.301 [2024-07-13 10:16:15.984832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.984968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.301 [2024-07-13 10:16:15.984994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.301 qpair failed and we were unable to recover it. 00:30:10.302 [2024-07-13 10:16:15.985153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.985294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.985319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.302 qpair failed and we were unable to recover it. 00:30:10.302 [2024-07-13 10:16:15.985435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.985577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.985602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.302 qpair failed and we were unable to recover it. 00:30:10.302 [2024-07-13 10:16:15.985720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.985864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.985904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.302 qpair failed and we were unable to recover it. 00:30:10.302 [2024-07-13 10:16:15.986022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.986144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.986169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.302 qpair failed and we were unable to recover it. 00:30:10.302 [2024-07-13 10:16:15.986299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.986422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.986446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.302 qpair failed and we were unable to recover it. 00:30:10.302 [2024-07-13 10:16:15.986621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.986774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.986800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.302 qpair failed and we were unable to recover it. 00:30:10.302 [2024-07-13 10:16:15.986974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.987106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.987130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.302 qpair failed and we were unable to recover it. 00:30:10.302 [2024-07-13 10:16:15.987298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.987454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.987479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.302 qpair failed and we were unable to recover it. 00:30:10.302 [2024-07-13 10:16:15.987627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.987778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.987804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.302 qpair failed and we were unable to recover it. 00:30:10.302 [2024-07-13 10:16:15.987922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.988064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.988089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.302 qpair failed and we were unable to recover it. 00:30:10.302 [2024-07-13 10:16:15.988236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.988382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.988409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.302 qpair failed and we were unable to recover it. 00:30:10.302 [2024-07-13 10:16:15.988531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.988646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.988672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.302 qpair failed and we were unable to recover it. 00:30:10.302 [2024-07-13 10:16:15.988819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.988945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.988974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.302 qpair failed and we were unable to recover it. 00:30:10.302 [2024-07-13 10:16:15.989114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.989227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.989253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.302 qpair failed and we were unable to recover it. 00:30:10.302 [2024-07-13 10:16:15.989396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.989540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.989565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.302 qpair failed and we were unable to recover it. 00:30:10.302 [2024-07-13 10:16:15.989678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.989794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.989819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.302 qpair failed and we were unable to recover it. 00:30:10.302 [2024-07-13 10:16:15.989984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.990098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.990123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.302 qpair failed and we were unable to recover it. 00:30:10.302 [2024-07-13 10:16:15.990303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.990448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.990474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.302 qpair failed and we were unable to recover it. 00:30:10.302 [2024-07-13 10:16:15.990633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.990764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.990789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.302 qpair failed and we were unable to recover it. 00:30:10.302 [2024-07-13 10:16:15.990938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.991068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.991093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.302 qpair failed and we were unable to recover it. 00:30:10.302 [2024-07-13 10:16:15.991236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.991386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.991411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.302 qpair failed and we were unable to recover it. 00:30:10.302 [2024-07-13 10:16:15.991525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.991641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.991666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.302 qpair failed and we were unable to recover it. 00:30:10.302 [2024-07-13 10:16:15.991802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.991956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.991982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.302 qpair failed and we were unable to recover it. 00:30:10.302 [2024-07-13 10:16:15.992119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.992248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.992274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.302 qpair failed and we were unable to recover it. 00:30:10.302 [2024-07-13 10:16:15.992398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.992522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.992547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.302 qpair failed and we were unable to recover it. 00:30:10.302 [2024-07-13 10:16:15.992664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.992785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.992810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.302 qpair failed and we were unable to recover it. 00:30:10.302 [2024-07-13 10:16:15.992975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.993160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.993184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.302 qpair failed and we were unable to recover it. 00:30:10.302 [2024-07-13 10:16:15.993310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.993432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.993457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.302 qpair failed and we were unable to recover it. 00:30:10.302 [2024-07-13 10:16:15.993605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.993745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.993771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.302 qpair failed and we were unable to recover it. 00:30:10.302 [2024-07-13 10:16:15.993932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.994055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.994081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.302 qpair failed and we were unable to recover it. 00:30:10.302 [2024-07-13 10:16:15.994202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.994329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.302 [2024-07-13 10:16:15.994354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.302 qpair failed and we were unable to recover it. 00:30:10.303 [2024-07-13 10:16:15.994467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:15.994638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:15.994665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.303 qpair failed and we were unable to recover it. 00:30:10.303 [2024-07-13 10:16:15.994785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:15.994937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:15.994963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.303 qpair failed and we were unable to recover it. 00:30:10.303 [2024-07-13 10:16:15.995091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:15.995259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:15.995284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.303 qpair failed and we were unable to recover it. 00:30:10.303 [2024-07-13 10:16:15.995399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:15.995539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:15.995566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.303 qpair failed and we were unable to recover it. 00:30:10.303 [2024-07-13 10:16:15.995714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:15.995876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:15.995903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.303 qpair failed and we were unable to recover it. 00:30:10.303 [2024-07-13 10:16:15.996022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:15.996146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:15.996172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.303 qpair failed and we were unable to recover it. 00:30:10.303 [2024-07-13 10:16:15.996291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:15.996420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:15.996456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.303 qpair failed and we were unable to recover it. 00:30:10.303 [2024-07-13 10:16:15.996609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:15.996717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:15.996743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.303 qpair failed and we were unable to recover it. 00:30:10.303 [2024-07-13 10:16:15.996859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:15.997038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:15.997063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.303 qpair failed and we were unable to recover it. 00:30:10.303 [2024-07-13 10:16:15.997180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:15.997308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:15.997332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.303 qpair failed and we were unable to recover it. 00:30:10.303 [2024-07-13 10:16:15.997483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:15.997637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:15.997663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.303 qpair failed and we were unable to recover it. 00:30:10.303 [2024-07-13 10:16:15.997810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:15.997960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:15.997988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.303 qpair failed and we were unable to recover it. 00:30:10.303 [2024-07-13 10:16:15.998144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:15.998295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:15.998320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.303 qpair failed and we were unable to recover it. 00:30:10.303 [2024-07-13 10:16:15.998442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:15.998576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:15.998601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.303 qpair failed and we were unable to recover it. 00:30:10.303 [2024-07-13 10:16:15.998718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:15.998877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:15.998902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.303 qpair failed and we were unable to recover it. 00:30:10.303 [2024-07-13 10:16:15.999023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:15.999137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:15.999162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.303 qpair failed and we were unable to recover it. 00:30:10.303 [2024-07-13 10:16:15.999320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:15.999439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:15.999464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.303 qpair failed and we were unable to recover it. 00:30:10.303 [2024-07-13 10:16:15.999597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:15.999735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:15.999761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.303 qpair failed and we were unable to recover it. 00:30:10.303 [2024-07-13 10:16:15.999895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 10:16:15 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:10.303 [2024-07-13 10:16:16.000061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:16.000086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.303 qpair failed and we were unable to recover it. 00:30:10.303 10:16:15 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:10.303 [2024-07-13 10:16:16.000200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:16.000345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:16.000370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.303 qpair failed and we were unable to recover it. 00:30:10.303 [2024-07-13 10:16:16.000492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 10:16:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:10.303 [2024-07-13 10:16:16.000612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:16.000638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.303 qpair failed and we were unable to recover it. 00:30:10.303 10:16:15 -- common/autotest_common.sh@10 -- # set +x 00:30:10.303 [2024-07-13 10:16:16.000782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:16.000914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:16.000943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.303 qpair failed and we were unable to recover it. 00:30:10.303 [2024-07-13 10:16:16.001067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:16.001212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:16.001236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.303 qpair failed and we were unable to recover it. 00:30:10.303 [2024-07-13 10:16:16.001381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:16.001493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:16.001519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.303 qpair failed and we were unable to recover it. 00:30:10.303 [2024-07-13 10:16:16.001666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:16.001779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:16.001804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.303 qpair failed and we were unable to recover it. 00:30:10.303 [2024-07-13 10:16:16.001957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:16.002071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:16.002097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.303 qpair failed and we were unable to recover it. 00:30:10.303 [2024-07-13 10:16:16.002211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:16.002362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:16.002388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.303 qpair failed and we were unable to recover it. 00:30:10.303 [2024-07-13 10:16:16.002525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:16.002642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:16.002666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.303 qpair failed and we were unable to recover it. 00:30:10.303 [2024-07-13 10:16:16.002811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:16.002973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:16.002998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.303 qpair failed and we were unable to recover it. 00:30:10.303 [2024-07-13 10:16:16.003116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:16.003280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.303 [2024-07-13 10:16:16.003307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.303 qpair failed and we were unable to recover it. 00:30:10.304 [2024-07-13 10:16:16.003438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.003591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.003617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.304 qpair failed and we were unable to recover it. 00:30:10.304 [2024-07-13 10:16:16.003741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.003873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.003902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.304 qpair failed and we were unable to recover it. 00:30:10.304 [2024-07-13 10:16:16.004032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.004189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.004227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.304 qpair failed and we were unable to recover it. 00:30:10.304 [2024-07-13 10:16:16.004363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.004481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.004507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.304 qpair failed and we were unable to recover it. 00:30:10.304 [2024-07-13 10:16:16.004652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.004783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.004808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.304 qpair failed and we were unable to recover it. 00:30:10.304 [2024-07-13 10:16:16.004924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.005094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.005119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.304 qpair failed and we were unable to recover it. 00:30:10.304 [2024-07-13 10:16:16.005245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.005387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.005413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.304 qpair failed and we were unable to recover it. 00:30:10.304 [2024-07-13 10:16:16.005553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.005722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.005748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.304 qpair failed and we were unable to recover it. 00:30:10.304 [2024-07-13 10:16:16.005891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.006004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.006029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.304 qpair failed and we were unable to recover it. 00:30:10.304 [2024-07-13 10:16:16.006159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.006292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.006317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.304 qpair failed and we were unable to recover it. 00:30:10.304 [2024-07-13 10:16:16.006440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.006590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.006616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.304 qpair failed and we were unable to recover it. 00:30:10.304 [2024-07-13 10:16:16.006730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.006850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.006883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.304 qpair failed and we were unable to recover it. 00:30:10.304 [2024-07-13 10:16:16.007021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.007167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.007201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.304 qpair failed and we were unable to recover it. 00:30:10.304 [2024-07-13 10:16:16.007327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.007478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.007505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.304 qpair failed and we were unable to recover it. 00:30:10.304 [2024-07-13 10:16:16.007655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.007766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.007791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.304 qpair failed and we were unable to recover it. 00:30:10.304 [2024-07-13 10:16:16.007950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.008081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.008105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.304 qpair failed and we were unable to recover it. 00:30:10.304 [2024-07-13 10:16:16.008301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.008448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.008474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.304 qpair failed and we were unable to recover it. 00:30:10.304 [2024-07-13 10:16:16.008636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.008752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.008778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.304 qpair failed and we were unable to recover it. 00:30:10.304 [2024-07-13 10:16:16.008931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.009086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.009111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.304 qpair failed and we were unable to recover it. 00:30:10.304 [2024-07-13 10:16:16.009257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.009399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.009425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.304 qpair failed and we were unable to recover it. 00:30:10.304 [2024-07-13 10:16:16.009576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.009718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.009744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.304 qpair failed and we were unable to recover it. 00:30:10.304 [2024-07-13 10:16:16.009931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.010083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.010108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.304 qpair failed and we were unable to recover it. 00:30:10.304 [2024-07-13 10:16:16.010269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.010448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.010473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.304 qpair failed and we were unable to recover it. 00:30:10.304 [2024-07-13 10:16:16.010592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.010712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.010737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.304 qpair failed and we were unable to recover it. 00:30:10.304 [2024-07-13 10:16:16.010887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.011009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.011035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.304 qpair failed and we were unable to recover it. 00:30:10.304 [2024-07-13 10:16:16.011244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.011370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.011397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.304 qpair failed and we were unable to recover it. 00:30:10.304 [2024-07-13 10:16:16.011513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.011655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.304 [2024-07-13 10:16:16.011680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.305 qpair failed and we were unable to recover it. 00:30:10.305 [2024-07-13 10:16:16.011834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.012016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.012044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.305 qpair failed and we were unable to recover it. 00:30:10.305 [2024-07-13 10:16:16.012210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.012361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.012386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.305 qpair failed and we were unable to recover it. 00:30:10.305 [2024-07-13 10:16:16.012535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.012693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.012718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.305 qpair failed and we were unable to recover it. 00:30:10.305 [2024-07-13 10:16:16.012912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.013027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.013052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.305 qpair failed and we were unable to recover it. 00:30:10.305 [2024-07-13 10:16:16.013208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.013391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.013418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.305 qpair failed and we were unable to recover it. 00:30:10.305 [2024-07-13 10:16:16.013537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.013662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.013689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.305 qpair failed and we were unable to recover it. 00:30:10.305 [2024-07-13 10:16:16.013851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.014006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.014031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.305 qpair failed and we were unable to recover it. 00:30:10.305 [2024-07-13 10:16:16.014208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.014326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.014352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.305 qpair failed and we were unable to recover it. 00:30:10.305 [2024-07-13 10:16:16.014530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.014655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.014681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.305 qpair failed and we were unable to recover it. 00:30:10.305 [2024-07-13 10:16:16.014810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.014964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.014989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.305 qpair failed and we were unable to recover it. 00:30:10.305 [2024-07-13 10:16:16.015210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.015339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.015365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.305 qpair failed and we were unable to recover it. 00:30:10.305 [2024-07-13 10:16:16.015515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.015674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.015700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.305 qpair failed and we were unable to recover it. 00:30:10.305 [2024-07-13 10:16:16.015848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.016019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.016044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.305 qpair failed and we were unable to recover it. 00:30:10.305 [2024-07-13 10:16:16.016171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.016339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.016365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.305 qpair failed and we were unable to recover it. 00:30:10.305 [2024-07-13 10:16:16.016494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.016652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.016679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.305 qpair failed and we were unable to recover it. 00:30:10.305 [2024-07-13 10:16:16.016795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.016950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.016976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.305 qpair failed and we were unable to recover it. 00:30:10.305 [2024-07-13 10:16:16.017107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.017263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.017289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.305 qpair failed and we were unable to recover it. 00:30:10.305 [2024-07-13 10:16:16.017408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.017561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.017587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.305 qpair failed and we were unable to recover it. 00:30:10.305 [2024-07-13 10:16:16.017742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.017874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.017900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.305 qpair failed and we were unable to recover it. 00:30:10.305 [2024-07-13 10:16:16.018028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.018148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.018173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.305 qpair failed and we were unable to recover it. 00:30:10.305 [2024-07-13 10:16:16.018310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.018439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.018466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.305 qpair failed and we were unable to recover it. 00:30:10.305 [2024-07-13 10:16:16.018642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.018769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.018795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.305 qpair failed and we were unable to recover it. 00:30:10.305 [2024-07-13 10:16:16.018931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.019122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.019147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.305 qpair failed and we were unable to recover it. 00:30:10.305 [2024-07-13 10:16:16.019266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.019391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.019418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.305 qpair failed and we were unable to recover it. 00:30:10.305 [2024-07-13 10:16:16.019566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.019716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.019742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.305 qpair failed and we were unable to recover it. 00:30:10.305 [2024-07-13 10:16:16.019973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.020093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.020123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.305 qpair failed and we were unable to recover it. 00:30:10.305 [2024-07-13 10:16:16.020289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.020437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.020463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.305 qpair failed and we were unable to recover it. 00:30:10.305 [2024-07-13 10:16:16.020583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.020702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.020728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.305 qpair failed and we were unable to recover it. 00:30:10.305 [2024-07-13 10:16:16.020846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.020979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.021005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.305 qpair failed and we were unable to recover it. 00:30:10.305 [2024-07-13 10:16:16.021170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.021297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.021323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.305 qpair failed and we were unable to recover it. 00:30:10.305 [2024-07-13 10:16:16.021474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.305 [2024-07-13 10:16:16.021598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.021624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.306 qpair failed and we were unable to recover it. 00:30:10.306 [2024-07-13 10:16:16.021775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.021893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.021932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.306 qpair failed and we were unable to recover it. 00:30:10.306 [2024-07-13 10:16:16.022064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.022212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.022238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.306 qpair failed and we were unable to recover it. 00:30:10.306 [2024-07-13 10:16:16.022363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.022508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.022534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.306 qpair failed and we were unable to recover it. 00:30:10.306 [2024-07-13 10:16:16.022652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.022803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.022829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.306 qpair failed and we were unable to recover it. 00:30:10.306 [2024-07-13 10:16:16.023018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.023165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.023202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.306 qpair failed and we were unable to recover it. 00:30:10.306 [2024-07-13 10:16:16.023365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.023482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.023508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.306 qpair failed and we were unable to recover it. 00:30:10.306 [2024-07-13 10:16:16.023627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.023802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.023828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.306 qpair failed and we were unable to recover it. 00:30:10.306 [2024-07-13 10:16:16.023999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.024137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.024162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.306 qpair failed and we were unable to recover it. 00:30:10.306 [2024-07-13 10:16:16.024320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.024442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.024468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.306 qpair failed and we were unable to recover it. 00:30:10.306 [2024-07-13 10:16:16.024587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.024706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.024733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.306 qpair failed and we were unable to recover it. 00:30:10.306 [2024-07-13 10:16:16.024883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.025070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.025095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.306 qpair failed and we were unable to recover it. 00:30:10.306 [2024-07-13 10:16:16.025227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.025348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.025374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.306 qpair failed and we were unable to recover it. 00:30:10.306 [2024-07-13 10:16:16.025504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.025680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.025706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.306 qpair failed and we were unable to recover it. 00:30:10.306 [2024-07-13 10:16:16.025827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.025998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.026024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.306 qpair failed and we were unable to recover it. 00:30:10.306 [2024-07-13 10:16:16.026174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.026323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.026350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.306 qpair failed and we were unable to recover it. 00:30:10.306 [2024-07-13 10:16:16.026478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.026601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.026628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.306 qpair failed and we were unable to recover it. 00:30:10.306 [2024-07-13 10:16:16.026756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.026906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.026935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.306 qpair failed and we were unable to recover it. 00:30:10.306 [2024-07-13 10:16:16.027082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.027261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.027288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.306 qpair failed and we were unable to recover it. 00:30:10.306 [2024-07-13 10:16:16.027413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.027536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.027562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.306 qpair failed and we were unable to recover it. 00:30:10.306 [2024-07-13 10:16:16.027717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.027832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.027858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.306 qpair failed and we were unable to recover it. 00:30:10.306 [2024-07-13 10:16:16.028000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.028144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.028169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.306 qpair failed and we were unable to recover it. 00:30:10.306 [2024-07-13 10:16:16.028307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 Malloc0 00:30:10.306 [2024-07-13 10:16:16.028427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.028453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.306 qpair failed and we were unable to recover it. 00:30:10.306 [2024-07-13 10:16:16.028575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 10:16:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:10.306 [2024-07-13 10:16:16.028716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.028742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.306 qpair failed and we were unable to recover it. 00:30:10.306 10:16:16 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:30:10.306 [2024-07-13 10:16:16.028904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 10:16:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:10.306 10:16:16 -- common/autotest_common.sh@10 -- # set +x 00:30:10.306 [2024-07-13 10:16:16.029086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.029111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.306 qpair failed and we were unable to recover it. 00:30:10.306 [2024-07-13 10:16:16.029234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.029368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.029397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.306 qpair failed and we were unable to recover it. 00:30:10.306 [2024-07-13 10:16:16.029530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.029667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.029694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.306 qpair failed and we were unable to recover it. 00:30:10.306 [2024-07-13 10:16:16.029831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.029986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.030012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.306 qpair failed and we were unable to recover it. 00:30:10.306 [2024-07-13 10:16:16.030140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.030293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.030318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.306 qpair failed and we were unable to recover it. 00:30:10.306 [2024-07-13 10:16:16.030474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.030598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.030624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.306 qpair failed and we were unable to recover it. 00:30:10.306 [2024-07-13 10:16:16.030754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.306 [2024-07-13 10:16:16.030888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.030926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.307 qpair failed and we were unable to recover it. 00:30:10.307 [2024-07-13 10:16:16.031085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.031223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.031249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.307 qpair failed and we were unable to recover it. 00:30:10.307 [2024-07-13 10:16:16.031378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.031509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.031535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.307 qpair failed and we were unable to recover it. 00:30:10.307 [2024-07-13 10:16:16.031681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.031833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.031858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.307 qpair failed and we were unable to recover it. 00:30:10.307 [2024-07-13 10:16:16.031996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.032034] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:10.307 [2024-07-13 10:16:16.032123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.032147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.307 qpair failed and we were unable to recover it. 00:30:10.307 [2024-07-13 10:16:16.032269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.032391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.032416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.307 qpair failed and we were unable to recover it. 00:30:10.307 [2024-07-13 10:16:16.032566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.032694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.032720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.307 qpair failed and we were unable to recover it. 00:30:10.307 [2024-07-13 10:16:16.032840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.032998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.033023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.307 qpair failed and we were unable to recover it. 00:30:10.307 [2024-07-13 10:16:16.033176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.033298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.033324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.307 qpair failed and we were unable to recover it. 00:30:10.307 [2024-07-13 10:16:16.033475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.033620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.033646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.307 qpair failed and we were unable to recover it. 00:30:10.307 [2024-07-13 10:16:16.033805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.033950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.033975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.307 qpair failed and we were unable to recover it. 00:30:10.307 [2024-07-13 10:16:16.034152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.034284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.034309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.307 qpair failed and we were unable to recover it. 00:30:10.307 [2024-07-13 10:16:16.034454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.034601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.034627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.307 qpair failed and we were unable to recover it. 00:30:10.307 [2024-07-13 10:16:16.034745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.034892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.034927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.307 qpair failed and we were unable to recover it. 00:30:10.307 [2024-07-13 10:16:16.035075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.035225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.035250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.307 qpair failed and we were unable to recover it. 00:30:10.307 [2024-07-13 10:16:16.035371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.035523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.035553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.307 qpair failed and we were unable to recover it. 00:30:10.307 [2024-07-13 10:16:16.035673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.035820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.035846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.307 qpair failed and we were unable to recover it. 00:30:10.307 [2024-07-13 10:16:16.036011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.036140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.036164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.307 qpair failed and we were unable to recover it. 00:30:10.307 [2024-07-13 10:16:16.036288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.036413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.036439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.307 qpair failed and we were unable to recover it. 00:30:10.307 [2024-07-13 10:16:16.036617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.036800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.036825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.307 qpair failed and we were unable to recover it. 00:30:10.307 [2024-07-13 10:16:16.036992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.037112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.037138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.307 qpair failed and we were unable to recover it. 00:30:10.307 [2024-07-13 10:16:16.037289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.037439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.037464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.307 qpair failed and we were unable to recover it. 00:30:10.307 [2024-07-13 10:16:16.037602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.037750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.037777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.307 qpair failed and we were unable to recover it. 00:30:10.307 [2024-07-13 10:16:16.037907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.038026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.038050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.307 qpair failed and we were unable to recover it. 00:30:10.307 [2024-07-13 10:16:16.038198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.038344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.038369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.307 qpair failed and we were unable to recover it. 00:30:10.307 [2024-07-13 10:16:16.038488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.038663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.038688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.307 qpair failed and we were unable to recover it. 00:30:10.307 [2024-07-13 10:16:16.038818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.038934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.038960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.307 qpair failed and we were unable to recover it. 00:30:10.307 [2024-07-13 10:16:16.039108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.039263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.039290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.307 qpair failed and we were unable to recover it. 00:30:10.307 [2024-07-13 10:16:16.039436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.039588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.039614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.307 qpair failed and we were unable to recover it. 00:30:10.307 [2024-07-13 10:16:16.039744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.039864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.039896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.307 qpair failed and we were unable to recover it. 00:30:10.307 [2024-07-13 10:16:16.040037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.040156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.307 [2024-07-13 10:16:16.040183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.307 qpair failed and we were unable to recover it. 00:30:10.308 10:16:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:10.308 [2024-07-13 10:16:16.040331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 10:16:16 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:10.308 [2024-07-13 10:16:16.040455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 10:16:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:10.308 [2024-07-13 10:16:16.040481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.308 qpair failed and we were unable to recover it. 00:30:10.308 10:16:16 -- common/autotest_common.sh@10 -- # set +x 00:30:10.308 [2024-07-13 10:16:16.040609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.040763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.040789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.308 qpair failed and we were unable to recover it. 00:30:10.308 [2024-07-13 10:16:16.040970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.041095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.041120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.308 qpair failed and we were unable to recover it. 00:30:10.308 [2024-07-13 10:16:16.041238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.041358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.041384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.308 qpair failed and we were unable to recover it. 00:30:10.308 [2024-07-13 10:16:16.041527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.041676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.041702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.308 qpair failed and we were unable to recover it. 00:30:10.308 [2024-07-13 10:16:16.041849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.042008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.042033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.308 qpair failed and we were unable to recover it. 00:30:10.308 [2024-07-13 10:16:16.042159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.042292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.042317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.308 qpair failed and we were unable to recover it. 00:30:10.308 [2024-07-13 10:16:16.042474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.042590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.042616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.308 qpair failed and we were unable to recover it. 00:30:10.308 [2024-07-13 10:16:16.042731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.042879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.042906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.308 qpair failed and we were unable to recover it. 00:30:10.308 [2024-07-13 10:16:16.043027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.043150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.043175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.308 qpair failed and we were unable to recover it. 00:30:10.308 [2024-07-13 10:16:16.043308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.043434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.043460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.308 qpair failed and we were unable to recover it. 00:30:10.308 [2024-07-13 10:16:16.043580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.043695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.043720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.308 qpair failed and we were unable to recover it. 00:30:10.308 [2024-07-13 10:16:16.043854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.043985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.044011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.308 qpair failed and we were unable to recover it. 00:30:10.308 [2024-07-13 10:16:16.044168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.044311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.044336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.308 qpair failed and we were unable to recover it. 00:30:10.308 [2024-07-13 10:16:16.044464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.044597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.044622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.308 qpair failed and we were unable to recover it. 00:30:10.308 [2024-07-13 10:16:16.044773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.044906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.044934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.308 qpair failed and we were unable to recover it. 00:30:10.308 [2024-07-13 10:16:16.045063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.045189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.045215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.308 qpair failed and we were unable to recover it. 00:30:10.308 [2024-07-13 10:16:16.045338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.045485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.045511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.308 qpair failed and we were unable to recover it. 00:30:10.308 [2024-07-13 10:16:16.045661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.045791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.045816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.308 qpair failed and we were unable to recover it. 00:30:10.308 [2024-07-13 10:16:16.045936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.046085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.046109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.308 qpair failed and we were unable to recover it. 00:30:10.308 [2024-07-13 10:16:16.046263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.046409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.046436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.308 qpair failed and we were unable to recover it. 00:30:10.308 [2024-07-13 10:16:16.046553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.046705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.046732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.308 qpair failed and we were unable to recover it. 00:30:10.308 [2024-07-13 10:16:16.046851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.047013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.047039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.308 qpair failed and we were unable to recover it. 00:30:10.308 [2024-07-13 10:16:16.047166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.047323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.047348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.308 qpair failed and we were unable to recover it. 00:30:10.308 [2024-07-13 10:16:16.047495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.047611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.047640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.308 qpair failed and we were unable to recover it. 00:30:10.308 [2024-07-13 10:16:16.047786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.308 [2024-07-13 10:16:16.047972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.047998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.309 qpair failed and we were unable to recover it. 00:30:10.309 [2024-07-13 10:16:16.048121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.048257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.048283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.309 qpair failed and we were unable to recover it. 00:30:10.309 10:16:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:10.309 [2024-07-13 10:16:16.048404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 10:16:16 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:10.309 [2024-07-13 10:16:16.048553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 10:16:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:10.309 [2024-07-13 10:16:16.048579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.309 qpair failed and we were unable to recover it. 00:30:10.309 10:16:16 -- common/autotest_common.sh@10 -- # set +x 00:30:10.309 [2024-07-13 10:16:16.048706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.048830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.048856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.309 qpair failed and we were unable to recover it. 00:30:10.309 [2024-07-13 10:16:16.048986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.049109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.049134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.309 qpair failed and we were unable to recover it. 00:30:10.309 [2024-07-13 10:16:16.049290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.049466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.049492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.309 qpair failed and we were unable to recover it. 00:30:10.309 [2024-07-13 10:16:16.049626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.049750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.049776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.309 qpair failed and we were unable to recover it. 00:30:10.309 [2024-07-13 10:16:16.049950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.050098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.050124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.309 qpair failed and we were unable to recover it. 00:30:10.309 [2024-07-13 10:16:16.050243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.050364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.050390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.309 qpair failed and we were unable to recover it. 00:30:10.309 [2024-07-13 10:16:16.050515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.050667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.050693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.309 qpair failed and we were unable to recover it. 00:30:10.309 [2024-07-13 10:16:16.050822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.050981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.051007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.309 qpair failed and we were unable to recover it. 00:30:10.309 [2024-07-13 10:16:16.051141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.051269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.051295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.309 qpair failed and we were unable to recover it. 00:30:10.309 [2024-07-13 10:16:16.051438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.051572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.051598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.309 qpair failed and we were unable to recover it. 00:30:10.309 [2024-07-13 10:16:16.051741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.051887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.051913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.309 qpair failed and we were unable to recover it. 00:30:10.309 [2024-07-13 10:16:16.052048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.052169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.052195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.309 qpair failed and we were unable to recover it. 00:30:10.309 [2024-07-13 10:16:16.052329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.052471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.052498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.309 qpair failed and we were unable to recover it. 00:30:10.309 [2024-07-13 10:16:16.052637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.052793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.052818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.309 qpair failed and we were unable to recover it. 00:30:10.309 [2024-07-13 10:16:16.052973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.053095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.053121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.309 qpair failed and we were unable to recover it. 00:30:10.309 [2024-07-13 10:16:16.053293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.053452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.053476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.309 qpair failed and we were unable to recover it. 00:30:10.309 [2024-07-13 10:16:16.053653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.053801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.053828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.309 qpair failed and we were unable to recover it. 00:30:10.309 [2024-07-13 10:16:16.053986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.054105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.054130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.309 qpair failed and we were unable to recover it. 00:30:10.309 [2024-07-13 10:16:16.054285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.054430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.054456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.309 qpair failed and we were unable to recover it. 00:30:10.309 [2024-07-13 10:16:16.054577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.054700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.054726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.309 qpair failed and we were unable to recover it. 00:30:10.309 [2024-07-13 10:16:16.054840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.054981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.055007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.309 qpair failed and we were unable to recover it. 00:30:10.309 [2024-07-13 10:16:16.055146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.055281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.055306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.309 qpair failed and we were unable to recover it. 00:30:10.309 [2024-07-13 10:16:16.055463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.055582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.055607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.309 qpair failed and we were unable to recover it. 00:30:10.309 [2024-07-13 10:16:16.055761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.055884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.055911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.309 qpair failed and we were unable to recover it. 00:30:10.309 [2024-07-13 10:16:16.056072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.056217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.056243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.309 qpair failed and we were unable to recover it. 00:30:10.309 10:16:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:10.309 [2024-07-13 10:16:16.056392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 10:16:16 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:10.309 [2024-07-13 10:16:16.056532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.056557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.309 qpair failed and we were unable to recover it. 00:30:10.309 10:16:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:10.309 10:16:16 -- common/autotest_common.sh@10 -- # set +x 00:30:10.309 [2024-07-13 10:16:16.056708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.056882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.309 [2024-07-13 10:16:16.056908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.309 qpair failed and we were unable to recover it. 00:30:10.310 [2024-07-13 10:16:16.057033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.310 [2024-07-13 10:16:16.057175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.310 [2024-07-13 10:16:16.057200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.310 qpair failed and we were unable to recover it. 00:30:10.310 [2024-07-13 10:16:16.057348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.310 [2024-07-13 10:16:16.057489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.310 [2024-07-13 10:16:16.057515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.310 qpair failed and we were unable to recover it. 00:30:10.310 [2024-07-13 10:16:16.057692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.310 [2024-07-13 10:16:16.057836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.310 [2024-07-13 10:16:16.057861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.310 qpair failed and we were unable to recover it. 00:30:10.310 [2024-07-13 10:16:16.057997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.310 [2024-07-13 10:16:16.058118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.310 [2024-07-13 10:16:16.058143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.310 qpair failed and we were unable to recover it. 00:30:10.310 [2024-07-13 10:16:16.058322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.310 [2024-07-13 10:16:16.058440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.310 [2024-07-13 10:16:16.058465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.310 qpair failed and we were unable to recover it. 00:30:10.310 [2024-07-13 10:16:16.058627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.310 [2024-07-13 10:16:16.058745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.310 [2024-07-13 10:16:16.058771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.310 qpair failed and we were unable to recover it. 00:30:10.310 [2024-07-13 10:16:16.058934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.310 [2024-07-13 10:16:16.059076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.310 [2024-07-13 10:16:16.059101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.310 qpair failed and we were unable to recover it. 00:30:10.310 [2024-07-13 10:16:16.059227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.310 [2024-07-13 10:16:16.059342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.310 [2024-07-13 10:16:16.059367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.310 qpair failed and we were unable to recover it. 00:30:10.310 [2024-07-13 10:16:16.059496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.310 [2024-07-13 10:16:16.059656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.310 [2024-07-13 10:16:16.059681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.310 qpair failed and we were unable to recover it. 00:30:10.310 [2024-07-13 10:16:16.059808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.310 [2024-07-13 10:16:16.059962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.310 [2024-07-13 10:16:16.059988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f8350 with addr=10.0.0.2, port=4420 00:30:10.310 qpair failed and we were unable to recover it. 00:30:10.310 [2024-07-13 10:16:16.060141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:10.310 [2024-07-13 10:16:16.060274] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:10.310 [2024-07-13 10:16:16.063120] posix.c: 670:posix_sock_psk_use_session_client_cb: *ERROR*: PSK is not set 00:30:10.310 [2024-07-13 10:16:16.063186] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x17f8350 (107): Transport endpoint is not connected 00:30:10.310 [2024-07-13 10:16:16.063255] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.310 qpair failed and we were unable to recover it. 00:30:10.310 10:16:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:10.310 10:16:16 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:30:10.310 10:16:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:10.310 10:16:16 -- common/autotest_common.sh@10 -- # set +x 00:30:10.310 10:16:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:10.310 10:16:16 -- host/target_disconnect.sh@58 -- # wait 2941919 00:30:10.310 [2024-07-13 10:16:16.072777] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.310 [2024-07-13 10:16:16.072950] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.310 [2024-07-13 10:16:16.072981] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.310 [2024-07-13 10:16:16.072998] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.310 [2024-07-13 10:16:16.073012] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.310 [2024-07-13 10:16:16.073042] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.310 qpair failed and we were unable to recover it. 00:30:10.571 [2024-07-13 10:16:16.082619] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.572 [2024-07-13 10:16:16.082744] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.572 [2024-07-13 10:16:16.082772] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.572 [2024-07-13 10:16:16.082788] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.572 [2024-07-13 10:16:16.082802] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.572 [2024-07-13 10:16:16.082832] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.572 qpair failed and we were unable to recover it. 00:30:10.572 [2024-07-13 10:16:16.092649] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.572 [2024-07-13 10:16:16.092781] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.572 [2024-07-13 10:16:16.092808] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.572 [2024-07-13 10:16:16.092824] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.572 [2024-07-13 10:16:16.092838] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.572 [2024-07-13 10:16:16.092881] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.572 qpair failed and we were unable to recover it. 00:30:10.572 [2024-07-13 10:16:16.102650] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.572 [2024-07-13 10:16:16.102791] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.572 [2024-07-13 10:16:16.102819] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.572 [2024-07-13 10:16:16.102834] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.572 [2024-07-13 10:16:16.102847] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.572 [2024-07-13 10:16:16.102882] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.572 qpair failed and we were unable to recover it. 00:30:10.572 [2024-07-13 10:16:16.112634] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.572 [2024-07-13 10:16:16.112760] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.572 [2024-07-13 10:16:16.112787] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.572 [2024-07-13 10:16:16.112802] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.572 [2024-07-13 10:16:16.112816] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.572 [2024-07-13 10:16:16.112846] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.572 qpair failed and we were unable to recover it. 00:30:10.572 [2024-07-13 10:16:16.122676] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.572 [2024-07-13 10:16:16.122812] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.572 [2024-07-13 10:16:16.122839] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.572 [2024-07-13 10:16:16.122854] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.572 [2024-07-13 10:16:16.122883] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.572 [2024-07-13 10:16:16.122915] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.572 qpair failed and we were unable to recover it. 00:30:10.572 [2024-07-13 10:16:16.132736] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.572 [2024-07-13 10:16:16.132879] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.572 [2024-07-13 10:16:16.132906] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.572 [2024-07-13 10:16:16.132922] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.572 [2024-07-13 10:16:16.132936] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.572 [2024-07-13 10:16:16.132966] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.572 qpair failed and we were unable to recover it. 00:30:10.572 [2024-07-13 10:16:16.142736] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.572 [2024-07-13 10:16:16.142860] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.572 [2024-07-13 10:16:16.142896] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.572 [2024-07-13 10:16:16.142912] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.572 [2024-07-13 10:16:16.142926] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.572 [2024-07-13 10:16:16.142955] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.572 qpair failed and we were unable to recover it. 00:30:10.572 [2024-07-13 10:16:16.152790] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.572 [2024-07-13 10:16:16.152930] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.572 [2024-07-13 10:16:16.152958] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.572 [2024-07-13 10:16:16.152974] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.572 [2024-07-13 10:16:16.152988] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.572 [2024-07-13 10:16:16.153016] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.572 qpair failed and we were unable to recover it. 00:30:10.572 [2024-07-13 10:16:16.162812] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.572 [2024-07-13 10:16:16.162939] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.572 [2024-07-13 10:16:16.162974] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.572 [2024-07-13 10:16:16.162990] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.572 [2024-07-13 10:16:16.163004] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.572 [2024-07-13 10:16:16.163033] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.572 qpair failed and we were unable to recover it. 00:30:10.572 [2024-07-13 10:16:16.172785] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.572 [2024-07-13 10:16:16.172933] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.572 [2024-07-13 10:16:16.172959] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.572 [2024-07-13 10:16:16.172975] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.572 [2024-07-13 10:16:16.172989] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.572 [2024-07-13 10:16:16.173018] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.572 qpair failed and we were unable to recover it. 00:30:10.572 [2024-07-13 10:16:16.182925] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.572 [2024-07-13 10:16:16.183063] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.572 [2024-07-13 10:16:16.183089] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.572 [2024-07-13 10:16:16.183105] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.572 [2024-07-13 10:16:16.183123] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.572 [2024-07-13 10:16:16.183152] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.572 qpair failed and we were unable to recover it. 00:30:10.572 [2024-07-13 10:16:16.192891] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.572 [2024-07-13 10:16:16.193016] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.572 [2024-07-13 10:16:16.193043] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.572 [2024-07-13 10:16:16.193059] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.572 [2024-07-13 10:16:16.193072] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.572 [2024-07-13 10:16:16.193101] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.572 qpair failed and we were unable to recover it. 00:30:10.572 [2024-07-13 10:16:16.202882] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.572 [2024-07-13 10:16:16.203015] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.572 [2024-07-13 10:16:16.203042] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.572 [2024-07-13 10:16:16.203058] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.572 [2024-07-13 10:16:16.203071] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.572 [2024-07-13 10:16:16.203100] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.572 qpair failed and we were unable to recover it. 00:30:10.572 [2024-07-13 10:16:16.212930] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.572 [2024-07-13 10:16:16.213063] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.572 [2024-07-13 10:16:16.213088] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.572 [2024-07-13 10:16:16.213103] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.572 [2024-07-13 10:16:16.213116] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.572 [2024-07-13 10:16:16.213144] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.572 qpair failed and we were unable to recover it. 00:30:10.572 [2024-07-13 10:16:16.222987] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.572 [2024-07-13 10:16:16.223114] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.573 [2024-07-13 10:16:16.223141] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.573 [2024-07-13 10:16:16.223156] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.573 [2024-07-13 10:16:16.223180] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.573 [2024-07-13 10:16:16.223210] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.573 qpair failed and we were unable to recover it. 00:30:10.573 [2024-07-13 10:16:16.233125] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.573 [2024-07-13 10:16:16.233263] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.573 [2024-07-13 10:16:16.233296] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.573 [2024-07-13 10:16:16.233312] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.573 [2024-07-13 10:16:16.233326] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.573 [2024-07-13 10:16:16.233355] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.573 qpair failed and we were unable to recover it. 00:30:10.573 [2024-07-13 10:16:16.243079] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.573 [2024-07-13 10:16:16.243200] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.573 [2024-07-13 10:16:16.243226] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.573 [2024-07-13 10:16:16.243241] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.573 [2024-07-13 10:16:16.243255] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.573 [2024-07-13 10:16:16.243284] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.573 qpair failed and we were unable to recover it. 00:30:10.573 [2024-07-13 10:16:16.253111] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.573 [2024-07-13 10:16:16.253247] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.573 [2024-07-13 10:16:16.253273] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.573 [2024-07-13 10:16:16.253288] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.573 [2024-07-13 10:16:16.253302] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.573 [2024-07-13 10:16:16.253346] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.573 qpair failed and we were unable to recover it. 00:30:10.573 [2024-07-13 10:16:16.263128] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.573 [2024-07-13 10:16:16.263263] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.573 [2024-07-13 10:16:16.263289] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.573 [2024-07-13 10:16:16.263304] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.573 [2024-07-13 10:16:16.263318] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.573 [2024-07-13 10:16:16.263361] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.573 qpair failed and we were unable to recover it. 00:30:10.573 [2024-07-13 10:16:16.273203] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.573 [2024-07-13 10:16:16.273332] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.573 [2024-07-13 10:16:16.273373] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.573 [2024-07-13 10:16:16.273388] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.573 [2024-07-13 10:16:16.273406] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.573 [2024-07-13 10:16:16.273449] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.573 qpair failed and we were unable to recover it. 00:30:10.573 [2024-07-13 10:16:16.283144] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.573 [2024-07-13 10:16:16.283266] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.573 [2024-07-13 10:16:16.283291] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.573 [2024-07-13 10:16:16.283306] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.573 [2024-07-13 10:16:16.283319] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.573 [2024-07-13 10:16:16.283347] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.573 qpair failed and we were unable to recover it. 00:30:10.573 [2024-07-13 10:16:16.293167] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.573 [2024-07-13 10:16:16.293300] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.573 [2024-07-13 10:16:16.293326] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.573 [2024-07-13 10:16:16.293341] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.573 [2024-07-13 10:16:16.293355] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.573 [2024-07-13 10:16:16.293382] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.573 qpair failed and we were unable to recover it. 00:30:10.573 [2024-07-13 10:16:16.303197] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.573 [2024-07-13 10:16:16.303372] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.573 [2024-07-13 10:16:16.303397] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.573 [2024-07-13 10:16:16.303413] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.573 [2024-07-13 10:16:16.303427] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.573 [2024-07-13 10:16:16.303455] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.573 qpair failed and we were unable to recover it. 00:30:10.573 [2024-07-13 10:16:16.313219] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.573 [2024-07-13 10:16:16.313353] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.573 [2024-07-13 10:16:16.313379] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.573 [2024-07-13 10:16:16.313394] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.573 [2024-07-13 10:16:16.313408] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.573 [2024-07-13 10:16:16.313436] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.573 qpair failed and we were unable to recover it. 00:30:10.573 [2024-07-13 10:16:16.323319] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.573 [2024-07-13 10:16:16.323459] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.573 [2024-07-13 10:16:16.323486] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.573 [2024-07-13 10:16:16.323501] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.573 [2024-07-13 10:16:16.323514] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.573 [2024-07-13 10:16:16.323559] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.573 qpair failed and we were unable to recover it. 00:30:10.573 [2024-07-13 10:16:16.333246] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.573 [2024-07-13 10:16:16.333374] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.573 [2024-07-13 10:16:16.333400] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.573 [2024-07-13 10:16:16.333415] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.573 [2024-07-13 10:16:16.333429] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.573 [2024-07-13 10:16:16.333457] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.573 qpair failed and we were unable to recover it. 00:30:10.573 [2024-07-13 10:16:16.343329] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.573 [2024-07-13 10:16:16.343455] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.573 [2024-07-13 10:16:16.343480] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.573 [2024-07-13 10:16:16.343495] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.573 [2024-07-13 10:16:16.343509] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.573 [2024-07-13 10:16:16.343537] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.573 qpair failed and we were unable to recover it. 00:30:10.573 [2024-07-13 10:16:16.353329] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.573 [2024-07-13 10:16:16.353449] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.573 [2024-07-13 10:16:16.353475] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.573 [2024-07-13 10:16:16.353490] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.573 [2024-07-13 10:16:16.353504] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.573 [2024-07-13 10:16:16.353532] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.573 qpair failed and we were unable to recover it. 00:30:10.573 [2024-07-13 10:16:16.363377] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.573 [2024-07-13 10:16:16.363497] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.573 [2024-07-13 10:16:16.363522] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.573 [2024-07-13 10:16:16.363538] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.573 [2024-07-13 10:16:16.363557] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.574 [2024-07-13 10:16:16.363585] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.574 qpair failed and we were unable to recover it. 00:30:10.574 [2024-07-13 10:16:16.373347] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.574 [2024-07-13 10:16:16.373524] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.574 [2024-07-13 10:16:16.373550] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.574 [2024-07-13 10:16:16.373565] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.574 [2024-07-13 10:16:16.373579] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.574 [2024-07-13 10:16:16.373607] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.574 qpair failed and we were unable to recover it. 00:30:10.574 [2024-07-13 10:16:16.383423] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.574 [2024-07-13 10:16:16.383546] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.574 [2024-07-13 10:16:16.383572] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.574 [2024-07-13 10:16:16.383588] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.574 [2024-07-13 10:16:16.383602] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.574 [2024-07-13 10:16:16.383630] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.574 qpair failed and we were unable to recover it. 00:30:10.833 [2024-07-13 10:16:16.393463] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.833 [2024-07-13 10:16:16.393598] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.833 [2024-07-13 10:16:16.393627] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.833 [2024-07-13 10:16:16.393643] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.833 [2024-07-13 10:16:16.393657] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.833 [2024-07-13 10:16:16.393701] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.833 qpair failed and we were unable to recover it. 00:30:10.833 [2024-07-13 10:16:16.403453] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.833 [2024-07-13 10:16:16.403579] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.833 [2024-07-13 10:16:16.403606] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.833 [2024-07-13 10:16:16.403621] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.833 [2024-07-13 10:16:16.403635] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.833 [2024-07-13 10:16:16.403663] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.833 qpair failed and we were unable to recover it. 00:30:10.833 [2024-07-13 10:16:16.413501] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.833 [2024-07-13 10:16:16.413649] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.833 [2024-07-13 10:16:16.413675] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.833 [2024-07-13 10:16:16.413691] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.833 [2024-07-13 10:16:16.413704] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.833 [2024-07-13 10:16:16.413733] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.834 qpair failed and we were unable to recover it. 00:30:10.834 [2024-07-13 10:16:16.423594] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.834 [2024-07-13 10:16:16.423743] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.834 [2024-07-13 10:16:16.423771] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.834 [2024-07-13 10:16:16.423786] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.834 [2024-07-13 10:16:16.423800] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.834 [2024-07-13 10:16:16.423827] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.834 qpair failed and we were unable to recover it. 00:30:10.834 [2024-07-13 10:16:16.433513] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.834 [2024-07-13 10:16:16.433637] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.834 [2024-07-13 10:16:16.433664] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.834 [2024-07-13 10:16:16.433680] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.834 [2024-07-13 10:16:16.433694] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.834 [2024-07-13 10:16:16.433723] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.834 qpair failed and we were unable to recover it. 00:30:10.834 [2024-07-13 10:16:16.443541] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.834 [2024-07-13 10:16:16.443667] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.834 [2024-07-13 10:16:16.443693] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.834 [2024-07-13 10:16:16.443709] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.834 [2024-07-13 10:16:16.443722] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.834 [2024-07-13 10:16:16.443751] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.834 qpair failed and we were unable to recover it. 00:30:10.834 [2024-07-13 10:16:16.453605] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.834 [2024-07-13 10:16:16.453733] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.834 [2024-07-13 10:16:16.453760] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.834 [2024-07-13 10:16:16.453776] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.834 [2024-07-13 10:16:16.453795] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.834 [2024-07-13 10:16:16.453825] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.834 qpair failed and we were unable to recover it. 00:30:10.834 [2024-07-13 10:16:16.463612] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.834 [2024-07-13 10:16:16.463737] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.834 [2024-07-13 10:16:16.463763] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.834 [2024-07-13 10:16:16.463779] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.834 [2024-07-13 10:16:16.463793] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.834 [2024-07-13 10:16:16.463823] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.834 qpair failed and we were unable to recover it. 00:30:10.834 [2024-07-13 10:16:16.473724] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.834 [2024-07-13 10:16:16.473860] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.834 [2024-07-13 10:16:16.473892] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.834 [2024-07-13 10:16:16.473908] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.834 [2024-07-13 10:16:16.473921] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.834 [2024-07-13 10:16:16.473950] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.834 qpair failed and we were unable to recover it. 00:30:10.834 [2024-07-13 10:16:16.483664] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.834 [2024-07-13 10:16:16.483794] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.834 [2024-07-13 10:16:16.483820] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.834 [2024-07-13 10:16:16.483835] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.834 [2024-07-13 10:16:16.483849] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.834 [2024-07-13 10:16:16.483885] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.834 qpair failed and we were unable to recover it. 00:30:10.834 [2024-07-13 10:16:16.493686] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.834 [2024-07-13 10:16:16.493836] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.834 [2024-07-13 10:16:16.493862] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.834 [2024-07-13 10:16:16.493884] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.834 [2024-07-13 10:16:16.493898] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.834 [2024-07-13 10:16:16.493926] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.834 qpair failed and we were unable to recover it. 00:30:10.834 [2024-07-13 10:16:16.503804] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.834 [2024-07-13 10:16:16.503960] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.834 [2024-07-13 10:16:16.503987] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.834 [2024-07-13 10:16:16.504003] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.834 [2024-07-13 10:16:16.504017] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.834 [2024-07-13 10:16:16.504045] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.834 qpair failed and we were unable to recover it. 00:30:10.834 [2024-07-13 10:16:16.513873] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.834 [2024-07-13 10:16:16.514003] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.834 [2024-07-13 10:16:16.514028] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.834 [2024-07-13 10:16:16.514044] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.834 [2024-07-13 10:16:16.514057] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.834 [2024-07-13 10:16:16.514085] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.834 qpair failed and we were unable to recover it. 00:30:10.834 [2024-07-13 10:16:16.523769] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.834 [2024-07-13 10:16:16.523898] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.834 [2024-07-13 10:16:16.523923] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.834 [2024-07-13 10:16:16.523937] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.834 [2024-07-13 10:16:16.523951] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.834 [2024-07-13 10:16:16.523979] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.834 qpair failed and we were unable to recover it. 00:30:10.834 [2024-07-13 10:16:16.533840] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.834 [2024-07-13 10:16:16.533998] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.834 [2024-07-13 10:16:16.534027] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.834 [2024-07-13 10:16:16.534043] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.834 [2024-07-13 10:16:16.534056] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.834 [2024-07-13 10:16:16.534086] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.834 qpair failed and we were unable to recover it. 00:30:10.834 [2024-07-13 10:16:16.543848] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.834 [2024-07-13 10:16:16.544001] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.834 [2024-07-13 10:16:16.544029] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.834 [2024-07-13 10:16:16.544049] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.834 [2024-07-13 10:16:16.544065] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.834 [2024-07-13 10:16:16.544094] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.834 qpair failed and we were unable to recover it. 00:30:10.834 [2024-07-13 10:16:16.553893] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.834 [2024-07-13 10:16:16.554020] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.834 [2024-07-13 10:16:16.554047] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.834 [2024-07-13 10:16:16.554062] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.834 [2024-07-13 10:16:16.554075] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.834 [2024-07-13 10:16:16.554104] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.834 qpair failed and we were unable to recover it. 00:30:10.834 [2024-07-13 10:16:16.563958] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.834 [2024-07-13 10:16:16.564114] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.835 [2024-07-13 10:16:16.564141] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.835 [2024-07-13 10:16:16.564156] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.835 [2024-07-13 10:16:16.564169] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.835 [2024-07-13 10:16:16.564198] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.835 qpair failed and we were unable to recover it. 00:30:10.835 [2024-07-13 10:16:16.573928] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.835 [2024-07-13 10:16:16.574055] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.835 [2024-07-13 10:16:16.574081] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.835 [2024-07-13 10:16:16.574096] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.835 [2024-07-13 10:16:16.574109] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.835 [2024-07-13 10:16:16.574138] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.835 qpair failed and we were unable to recover it. 00:30:10.835 [2024-07-13 10:16:16.583961] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.835 [2024-07-13 10:16:16.584094] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.835 [2024-07-13 10:16:16.584120] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.835 [2024-07-13 10:16:16.584135] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.835 [2024-07-13 10:16:16.584148] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.835 [2024-07-13 10:16:16.584176] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.835 qpair failed and we were unable to recover it. 00:30:10.835 [2024-07-13 10:16:16.593985] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.835 [2024-07-13 10:16:16.594113] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.835 [2024-07-13 10:16:16.594139] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.835 [2024-07-13 10:16:16.594154] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.835 [2024-07-13 10:16:16.594167] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.835 [2024-07-13 10:16:16.594196] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.835 qpair failed and we were unable to recover it. 00:30:10.835 [2024-07-13 10:16:16.603999] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.835 [2024-07-13 10:16:16.604121] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.835 [2024-07-13 10:16:16.604147] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.835 [2024-07-13 10:16:16.604162] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.835 [2024-07-13 10:16:16.604175] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.835 [2024-07-13 10:16:16.604204] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.835 qpair failed and we were unable to recover it. 00:30:10.835 [2024-07-13 10:16:16.614091] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.835 [2024-07-13 10:16:16.614225] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.835 [2024-07-13 10:16:16.614251] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.835 [2024-07-13 10:16:16.614266] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.835 [2024-07-13 10:16:16.614279] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.835 [2024-07-13 10:16:16.614322] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.835 qpair failed and we were unable to recover it. 00:30:10.835 [2024-07-13 10:16:16.624070] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.835 [2024-07-13 10:16:16.624225] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.835 [2024-07-13 10:16:16.624252] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.835 [2024-07-13 10:16:16.624267] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.835 [2024-07-13 10:16:16.624279] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.835 [2024-07-13 10:16:16.624308] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.835 qpair failed and we were unable to recover it. 00:30:10.835 [2024-07-13 10:16:16.634190] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.835 [2024-07-13 10:16:16.634344] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.835 [2024-07-13 10:16:16.634370] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.835 [2024-07-13 10:16:16.634393] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.835 [2024-07-13 10:16:16.634408] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.835 [2024-07-13 10:16:16.634437] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.835 qpair failed and we were unable to recover it. 00:30:10.835 [2024-07-13 10:16:16.644126] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:10.835 [2024-07-13 10:16:16.644251] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:10.835 [2024-07-13 10:16:16.644276] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:10.835 [2024-07-13 10:16:16.644292] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:10.835 [2024-07-13 10:16:16.644305] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:10.835 [2024-07-13 10:16:16.644334] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:10.835 qpair failed and we were unable to recover it. 00:30:11.094 [2024-07-13 10:16:16.654193] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.094 [2024-07-13 10:16:16.654341] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.094 [2024-07-13 10:16:16.654368] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.095 [2024-07-13 10:16:16.654384] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.095 [2024-07-13 10:16:16.654397] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.095 [2024-07-13 10:16:16.654426] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.095 qpair failed and we were unable to recover it. 00:30:11.095 [2024-07-13 10:16:16.664185] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.095 [2024-07-13 10:16:16.664332] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.095 [2024-07-13 10:16:16.664360] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.095 [2024-07-13 10:16:16.664376] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.095 [2024-07-13 10:16:16.664389] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.095 [2024-07-13 10:16:16.664434] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.095 qpair failed and we were unable to recover it. 00:30:11.095 [2024-07-13 10:16:16.674345] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.095 [2024-07-13 10:16:16.674493] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.095 [2024-07-13 10:16:16.674521] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.095 [2024-07-13 10:16:16.674537] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.095 [2024-07-13 10:16:16.674552] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.095 [2024-07-13 10:16:16.674597] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.095 qpair failed and we were unable to recover it. 00:30:11.095 [2024-07-13 10:16:16.684241] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.095 [2024-07-13 10:16:16.684364] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.095 [2024-07-13 10:16:16.684390] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.095 [2024-07-13 10:16:16.684406] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.095 [2024-07-13 10:16:16.684419] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.095 [2024-07-13 10:16:16.684448] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.095 qpair failed and we were unable to recover it. 00:30:11.095 [2024-07-13 10:16:16.694308] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.095 [2024-07-13 10:16:16.694443] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.095 [2024-07-13 10:16:16.694469] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.095 [2024-07-13 10:16:16.694484] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.095 [2024-07-13 10:16:16.694498] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.095 [2024-07-13 10:16:16.694527] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.095 qpair failed and we were unable to recover it. 00:30:11.095 [2024-07-13 10:16:16.704358] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.095 [2024-07-13 10:16:16.704486] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.095 [2024-07-13 10:16:16.704511] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.095 [2024-07-13 10:16:16.704526] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.095 [2024-07-13 10:16:16.704539] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.095 [2024-07-13 10:16:16.704569] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.095 qpair failed and we were unable to recover it. 00:30:11.095 [2024-07-13 10:16:16.714337] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.095 [2024-07-13 10:16:16.714461] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.095 [2024-07-13 10:16:16.714486] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.095 [2024-07-13 10:16:16.714501] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.095 [2024-07-13 10:16:16.714514] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.095 [2024-07-13 10:16:16.714543] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.095 qpair failed and we were unable to recover it. 00:30:11.095 [2024-07-13 10:16:16.724380] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.095 [2024-07-13 10:16:16.724510] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.095 [2024-07-13 10:16:16.724536] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.095 [2024-07-13 10:16:16.724557] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.095 [2024-07-13 10:16:16.724571] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.095 [2024-07-13 10:16:16.724600] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.095 qpair failed and we were unable to recover it. 00:30:11.095 [2024-07-13 10:16:16.734437] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.095 [2024-07-13 10:16:16.734568] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.095 [2024-07-13 10:16:16.734594] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.095 [2024-07-13 10:16:16.734609] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.095 [2024-07-13 10:16:16.734622] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.095 [2024-07-13 10:16:16.734652] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.095 qpair failed and we were unable to recover it. 00:30:11.095 [2024-07-13 10:16:16.744407] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.095 [2024-07-13 10:16:16.744540] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.095 [2024-07-13 10:16:16.744565] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.095 [2024-07-13 10:16:16.744579] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.095 [2024-07-13 10:16:16.744592] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.095 [2024-07-13 10:16:16.744621] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.095 qpair failed and we were unable to recover it. 00:30:11.095 [2024-07-13 10:16:16.754548] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.095 [2024-07-13 10:16:16.754668] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.095 [2024-07-13 10:16:16.754694] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.095 [2024-07-13 10:16:16.754724] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.095 [2024-07-13 10:16:16.754738] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.095 [2024-07-13 10:16:16.754766] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.095 qpair failed and we were unable to recover it. 00:30:11.095 [2024-07-13 10:16:16.764491] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.095 [2024-07-13 10:16:16.764633] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.095 [2024-07-13 10:16:16.764659] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.095 [2024-07-13 10:16:16.764674] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.095 [2024-07-13 10:16:16.764689] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.095 [2024-07-13 10:16:16.764732] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.095 qpair failed and we were unable to recover it. 00:30:11.095 [2024-07-13 10:16:16.774513] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.095 [2024-07-13 10:16:16.774655] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.095 [2024-07-13 10:16:16.774680] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.095 [2024-07-13 10:16:16.774695] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.095 [2024-07-13 10:16:16.774709] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.095 [2024-07-13 10:16:16.774738] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.095 qpair failed and we were unable to recover it. 00:30:11.095 [2024-07-13 10:16:16.784543] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.095 [2024-07-13 10:16:16.784682] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.095 [2024-07-13 10:16:16.784708] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.095 [2024-07-13 10:16:16.784723] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.095 [2024-07-13 10:16:16.784737] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.095 [2024-07-13 10:16:16.784766] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.095 qpair failed and we were unable to recover it. 00:30:11.095 [2024-07-13 10:16:16.794592] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.095 [2024-07-13 10:16:16.794723] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.095 [2024-07-13 10:16:16.794749] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.095 [2024-07-13 10:16:16.794764] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.095 [2024-07-13 10:16:16.794778] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.095 [2024-07-13 10:16:16.794806] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.095 qpair failed and we were unable to recover it. 00:30:11.095 [2024-07-13 10:16:16.804614] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.096 [2024-07-13 10:16:16.804794] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.096 [2024-07-13 10:16:16.804820] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.096 [2024-07-13 10:16:16.804834] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.096 [2024-07-13 10:16:16.804858] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.096 [2024-07-13 10:16:16.804892] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.096 qpair failed and we were unable to recover it. 00:30:11.096 [2024-07-13 10:16:16.814660] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.096 [2024-07-13 10:16:16.814802] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.096 [2024-07-13 10:16:16.814828] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.096 [2024-07-13 10:16:16.814853] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.096 [2024-07-13 10:16:16.814874] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.096 [2024-07-13 10:16:16.814905] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.096 qpair failed and we were unable to recover it. 00:30:11.096 [2024-07-13 10:16:16.824660] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.096 [2024-07-13 10:16:16.824807] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.096 [2024-07-13 10:16:16.824832] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.096 [2024-07-13 10:16:16.824858] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.096 [2024-07-13 10:16:16.824879] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.096 [2024-07-13 10:16:16.824909] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.096 qpair failed and we were unable to recover it. 00:30:11.096 [2024-07-13 10:16:16.834693] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.096 [2024-07-13 10:16:16.834871] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.096 [2024-07-13 10:16:16.834897] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.096 [2024-07-13 10:16:16.834912] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.096 [2024-07-13 10:16:16.834926] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.096 [2024-07-13 10:16:16.834954] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.096 qpair failed and we were unable to recover it. 00:30:11.096 [2024-07-13 10:16:16.844767] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.096 [2024-07-13 10:16:16.844986] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.096 [2024-07-13 10:16:16.845019] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.096 [2024-07-13 10:16:16.845034] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.096 [2024-07-13 10:16:16.845048] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.096 [2024-07-13 10:16:16.845078] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.096 qpair failed and we were unable to recover it. 00:30:11.096 [2024-07-13 10:16:16.854776] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.096 [2024-07-13 10:16:16.854959] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.096 [2024-07-13 10:16:16.854985] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.096 [2024-07-13 10:16:16.855000] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.096 [2024-07-13 10:16:16.855013] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.096 [2024-07-13 10:16:16.855042] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.096 qpair failed and we were unable to recover it. 00:30:11.096 [2024-07-13 10:16:16.864785] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.096 [2024-07-13 10:16:16.864924] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.096 [2024-07-13 10:16:16.864949] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.096 [2024-07-13 10:16:16.864965] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.096 [2024-07-13 10:16:16.864979] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.096 [2024-07-13 10:16:16.865007] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.096 qpair failed and we were unable to recover it. 00:30:11.096 [2024-07-13 10:16:16.874814] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.096 [2024-07-13 10:16:16.874968] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.096 [2024-07-13 10:16:16.874995] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.096 [2024-07-13 10:16:16.875010] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.096 [2024-07-13 10:16:16.875024] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.096 [2024-07-13 10:16:16.875053] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.096 qpair failed and we were unable to recover it. 00:30:11.096 [2024-07-13 10:16:16.884829] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.096 [2024-07-13 10:16:16.884991] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.096 [2024-07-13 10:16:16.885016] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.096 [2024-07-13 10:16:16.885031] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.096 [2024-07-13 10:16:16.885045] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.096 [2024-07-13 10:16:16.885073] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.096 qpair failed and we were unable to recover it. 00:30:11.096 [2024-07-13 10:16:16.894903] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.096 [2024-07-13 10:16:16.895039] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.096 [2024-07-13 10:16:16.895063] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.096 [2024-07-13 10:16:16.895079] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.096 [2024-07-13 10:16:16.895093] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.096 [2024-07-13 10:16:16.895121] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.096 qpair failed and we were unable to recover it. 00:30:11.096 [2024-07-13 10:16:16.904926] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.096 [2024-07-13 10:16:16.905097] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.096 [2024-07-13 10:16:16.905123] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.096 [2024-07-13 10:16:16.905154] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.096 [2024-07-13 10:16:16.905169] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.096 [2024-07-13 10:16:16.905198] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.096 qpair failed and we were unable to recover it. 00:30:11.355 [2024-07-13 10:16:16.915005] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.355 [2024-07-13 10:16:16.915162] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.355 [2024-07-13 10:16:16.915189] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.355 [2024-07-13 10:16:16.915205] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.355 [2024-07-13 10:16:16.915233] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.356 [2024-07-13 10:16:16.915269] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.356 qpair failed and we were unable to recover it. 00:30:11.356 [2024-07-13 10:16:16.924953] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.356 [2024-07-13 10:16:16.925081] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.356 [2024-07-13 10:16:16.925107] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.356 [2024-07-13 10:16:16.925122] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.356 [2024-07-13 10:16:16.925136] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.356 [2024-07-13 10:16:16.925171] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.356 qpair failed and we were unable to recover it. 00:30:11.356 [2024-07-13 10:16:16.935000] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.356 [2024-07-13 10:16:16.935138] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.356 [2024-07-13 10:16:16.935163] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.356 [2024-07-13 10:16:16.935178] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.356 [2024-07-13 10:16:16.935192] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.356 [2024-07-13 10:16:16.935221] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.356 qpair failed and we were unable to recover it. 00:30:11.356 [2024-07-13 10:16:16.945008] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.356 [2024-07-13 10:16:16.945138] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.356 [2024-07-13 10:16:16.945164] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.356 [2024-07-13 10:16:16.945179] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.356 [2024-07-13 10:16:16.945192] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.356 [2024-07-13 10:16:16.945221] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.356 qpair failed and we were unable to recover it. 00:30:11.356 [2024-07-13 10:16:16.955033] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.356 [2024-07-13 10:16:16.955165] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.356 [2024-07-13 10:16:16.955191] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.356 [2024-07-13 10:16:16.955207] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.356 [2024-07-13 10:16:16.955220] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.356 [2024-07-13 10:16:16.955248] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.356 qpair failed and we were unable to recover it. 00:30:11.356 [2024-07-13 10:16:16.965091] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.356 [2024-07-13 10:16:16.965274] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.356 [2024-07-13 10:16:16.965299] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.356 [2024-07-13 10:16:16.965330] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.356 [2024-07-13 10:16:16.965344] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.356 [2024-07-13 10:16:16.965372] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.356 qpair failed and we were unable to recover it. 00:30:11.356 [2024-07-13 10:16:16.975131] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.356 [2024-07-13 10:16:16.975268] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.356 [2024-07-13 10:16:16.975295] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.356 [2024-07-13 10:16:16.975310] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.356 [2024-07-13 10:16:16.975324] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.356 [2024-07-13 10:16:16.975352] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.356 qpair failed and we were unable to recover it. 00:30:11.356 [2024-07-13 10:16:16.985168] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.356 [2024-07-13 10:16:16.985338] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.356 [2024-07-13 10:16:16.985364] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.356 [2024-07-13 10:16:16.985379] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.356 [2024-07-13 10:16:16.985392] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.356 [2024-07-13 10:16:16.985421] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.356 qpair failed and we were unable to recover it. 00:30:11.356 [2024-07-13 10:16:16.995146] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.356 [2024-07-13 10:16:16.995273] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.356 [2024-07-13 10:16:16.995304] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.356 [2024-07-13 10:16:16.995320] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.356 [2024-07-13 10:16:16.995334] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.356 [2024-07-13 10:16:16.995362] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.356 qpair failed and we were unable to recover it. 00:30:11.356 [2024-07-13 10:16:17.005232] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.356 [2024-07-13 10:16:17.005386] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.356 [2024-07-13 10:16:17.005412] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.356 [2024-07-13 10:16:17.005426] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.356 [2024-07-13 10:16:17.005439] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.356 [2024-07-13 10:16:17.005466] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.356 qpair failed and we were unable to recover it. 00:30:11.356 [2024-07-13 10:16:17.015206] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.356 [2024-07-13 10:16:17.015345] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.356 [2024-07-13 10:16:17.015371] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.356 [2024-07-13 10:16:17.015385] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.356 [2024-07-13 10:16:17.015399] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.356 [2024-07-13 10:16:17.015427] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.356 qpair failed and we were unable to recover it. 00:30:11.356 [2024-07-13 10:16:17.025258] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.356 [2024-07-13 10:16:17.025394] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.356 [2024-07-13 10:16:17.025420] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.356 [2024-07-13 10:16:17.025435] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.356 [2024-07-13 10:16:17.025448] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.356 [2024-07-13 10:16:17.025476] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.356 qpair failed and we were unable to recover it. 00:30:11.356 [2024-07-13 10:16:17.035311] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.356 [2024-07-13 10:16:17.035476] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.356 [2024-07-13 10:16:17.035501] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.356 [2024-07-13 10:16:17.035516] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.356 [2024-07-13 10:16:17.035530] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.356 [2024-07-13 10:16:17.035558] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.356 qpair failed and we were unable to recover it. 00:30:11.356 [2024-07-13 10:16:17.045294] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.356 [2024-07-13 10:16:17.045456] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.356 [2024-07-13 10:16:17.045481] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.356 [2024-07-13 10:16:17.045496] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.356 [2024-07-13 10:16:17.045510] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.356 [2024-07-13 10:16:17.045538] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.356 qpair failed and we were unable to recover it. 00:30:11.356 [2024-07-13 10:16:17.055328] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.356 [2024-07-13 10:16:17.055472] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.356 [2024-07-13 10:16:17.055499] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.356 [2024-07-13 10:16:17.055514] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.356 [2024-07-13 10:16:17.055528] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.356 [2024-07-13 10:16:17.055556] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.356 qpair failed and we were unable to recover it. 00:30:11.356 [2024-07-13 10:16:17.065358] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.357 [2024-07-13 10:16:17.065493] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.357 [2024-07-13 10:16:17.065517] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.357 [2024-07-13 10:16:17.065532] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.357 [2024-07-13 10:16:17.065544] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.357 [2024-07-13 10:16:17.065572] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.357 qpair failed and we were unable to recover it. 00:30:11.357 [2024-07-13 10:16:17.075409] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.357 [2024-07-13 10:16:17.075545] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.357 [2024-07-13 10:16:17.075570] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.357 [2024-07-13 10:16:17.075585] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.357 [2024-07-13 10:16:17.075599] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.357 [2024-07-13 10:16:17.075627] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.357 qpair failed and we were unable to recover it. 00:30:11.357 [2024-07-13 10:16:17.085396] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.357 [2024-07-13 10:16:17.085521] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.357 [2024-07-13 10:16:17.085552] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.357 [2024-07-13 10:16:17.085568] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.357 [2024-07-13 10:16:17.085582] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.357 [2024-07-13 10:16:17.085611] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.357 qpair failed and we were unable to recover it. 00:30:11.357 [2024-07-13 10:16:17.095469] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.357 [2024-07-13 10:16:17.095658] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.357 [2024-07-13 10:16:17.095701] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.357 [2024-07-13 10:16:17.095719] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.357 [2024-07-13 10:16:17.095733] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.357 [2024-07-13 10:16:17.095777] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.357 qpair failed and we were unable to recover it. 00:30:11.357 [2024-07-13 10:16:17.105468] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.357 [2024-07-13 10:16:17.105602] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.357 [2024-07-13 10:16:17.105628] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.357 [2024-07-13 10:16:17.105643] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.357 [2024-07-13 10:16:17.105657] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.357 [2024-07-13 10:16:17.105701] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.357 qpair failed and we were unable to recover it. 00:30:11.357 [2024-07-13 10:16:17.115520] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.357 [2024-07-13 10:16:17.115649] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.357 [2024-07-13 10:16:17.115675] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.357 [2024-07-13 10:16:17.115690] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.357 [2024-07-13 10:16:17.115703] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.357 [2024-07-13 10:16:17.115731] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.357 qpair failed and we were unable to recover it. 00:30:11.357 [2024-07-13 10:16:17.125569] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.357 [2024-07-13 10:16:17.125700] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.357 [2024-07-13 10:16:17.125727] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.357 [2024-07-13 10:16:17.125747] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.357 [2024-07-13 10:16:17.125762] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.357 [2024-07-13 10:16:17.125798] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.357 qpair failed and we were unable to recover it. 00:30:11.357 [2024-07-13 10:16:17.135578] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.357 [2024-07-13 10:16:17.135738] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.357 [2024-07-13 10:16:17.135764] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.357 [2024-07-13 10:16:17.135794] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.357 [2024-07-13 10:16:17.135808] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.357 [2024-07-13 10:16:17.135836] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.357 qpair failed and we were unable to recover it. 00:30:11.357 [2024-07-13 10:16:17.145697] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.357 [2024-07-13 10:16:17.145845] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.357 [2024-07-13 10:16:17.145878] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.357 [2024-07-13 10:16:17.145909] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.357 [2024-07-13 10:16:17.145924] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.357 [2024-07-13 10:16:17.145953] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.357 qpair failed and we were unable to recover it. 00:30:11.357 [2024-07-13 10:16:17.155652] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.357 [2024-07-13 10:16:17.155791] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.357 [2024-07-13 10:16:17.155817] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.357 [2024-07-13 10:16:17.155837] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.357 [2024-07-13 10:16:17.155853] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.357 [2024-07-13 10:16:17.155892] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.357 qpair failed and we were unable to recover it. 00:30:11.357 [2024-07-13 10:16:17.165646] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.357 [2024-07-13 10:16:17.165777] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.357 [2024-07-13 10:16:17.165803] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.357 [2024-07-13 10:16:17.165818] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.357 [2024-07-13 10:16:17.165832] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.357 [2024-07-13 10:16:17.165860] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.357 qpair failed and we were unable to recover it. 00:30:11.616 [2024-07-13 10:16:17.175711] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.617 [2024-07-13 10:16:17.175908] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.617 [2024-07-13 10:16:17.175940] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.617 [2024-07-13 10:16:17.175956] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.617 [2024-07-13 10:16:17.175970] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.617 [2024-07-13 10:16:17.176000] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.617 qpair failed and we were unable to recover it. 00:30:11.617 [2024-07-13 10:16:17.185810] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.617 [2024-07-13 10:16:17.185957] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.617 [2024-07-13 10:16:17.185985] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.617 [2024-07-13 10:16:17.186000] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.617 [2024-07-13 10:16:17.186018] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.617 [2024-07-13 10:16:17.186049] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.617 qpair failed and we were unable to recover it. 00:30:11.617 [2024-07-13 10:16:17.195707] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.617 [2024-07-13 10:16:17.195880] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.617 [2024-07-13 10:16:17.195913] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.617 [2024-07-13 10:16:17.195931] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.617 [2024-07-13 10:16:17.195944] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.617 [2024-07-13 10:16:17.195973] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.617 qpair failed and we were unable to recover it. 00:30:11.617 [2024-07-13 10:16:17.205755] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.617 [2024-07-13 10:16:17.205894] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.617 [2024-07-13 10:16:17.205919] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.617 [2024-07-13 10:16:17.205934] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.617 [2024-07-13 10:16:17.205948] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.617 [2024-07-13 10:16:17.205978] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.617 qpair failed and we were unable to recover it. 00:30:11.617 [2024-07-13 10:16:17.215767] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.617 [2024-07-13 10:16:17.215906] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.617 [2024-07-13 10:16:17.215932] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.617 [2024-07-13 10:16:17.215947] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.617 [2024-07-13 10:16:17.215961] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.617 [2024-07-13 10:16:17.215997] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.617 qpair failed and we were unable to recover it. 00:30:11.617 [2024-07-13 10:16:17.225787] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.617 [2024-07-13 10:16:17.225921] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.617 [2024-07-13 10:16:17.225947] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.617 [2024-07-13 10:16:17.225963] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.617 [2024-07-13 10:16:17.225977] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.617 [2024-07-13 10:16:17.226006] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.617 qpair failed and we were unable to recover it. 00:30:11.617 [2024-07-13 10:16:17.235903] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.617 [2024-07-13 10:16:17.236038] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.617 [2024-07-13 10:16:17.236063] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.617 [2024-07-13 10:16:17.236078] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.617 [2024-07-13 10:16:17.236092] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.617 [2024-07-13 10:16:17.236120] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.617 qpair failed and we were unable to recover it. 00:30:11.617 [2024-07-13 10:16:17.245845] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.617 [2024-07-13 10:16:17.246022] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.617 [2024-07-13 10:16:17.246050] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.617 [2024-07-13 10:16:17.246066] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.617 [2024-07-13 10:16:17.246084] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.617 [2024-07-13 10:16:17.246114] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.617 qpair failed and we were unable to recover it. 00:30:11.617 [2024-07-13 10:16:17.255905] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.617 [2024-07-13 10:16:17.256037] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.617 [2024-07-13 10:16:17.256064] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.617 [2024-07-13 10:16:17.256079] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.617 [2024-07-13 10:16:17.256093] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.617 [2024-07-13 10:16:17.256122] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.617 qpair failed and we were unable to recover it. 00:30:11.617 [2024-07-13 10:16:17.265922] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.617 [2024-07-13 10:16:17.266051] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.617 [2024-07-13 10:16:17.266083] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.617 [2024-07-13 10:16:17.266099] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.617 [2024-07-13 10:16:17.266113] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.617 [2024-07-13 10:16:17.266143] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.617 qpair failed and we were unable to recover it. 00:30:11.617 [2024-07-13 10:16:17.275944] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.617 [2024-07-13 10:16:17.276112] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.617 [2024-07-13 10:16:17.276138] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.617 [2024-07-13 10:16:17.276153] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.617 [2024-07-13 10:16:17.276167] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.617 [2024-07-13 10:16:17.276195] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.617 qpair failed and we were unable to recover it. 00:30:11.617 [2024-07-13 10:16:17.286005] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.617 [2024-07-13 10:16:17.286191] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.617 [2024-07-13 10:16:17.286217] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.617 [2024-07-13 10:16:17.286247] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.617 [2024-07-13 10:16:17.286260] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.617 [2024-07-13 10:16:17.286304] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.617 qpair failed and we were unable to recover it. 00:30:11.617 [2024-07-13 10:16:17.295999] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.617 [2024-07-13 10:16:17.296137] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.617 [2024-07-13 10:16:17.296162] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.617 [2024-07-13 10:16:17.296177] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.617 [2024-07-13 10:16:17.296191] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.617 [2024-07-13 10:16:17.296219] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.617 qpair failed and we were unable to recover it. 00:30:11.617 [2024-07-13 10:16:17.306032] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.617 [2024-07-13 10:16:17.306167] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.617 [2024-07-13 10:16:17.306193] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.617 [2024-07-13 10:16:17.306208] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.617 [2024-07-13 10:16:17.306222] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.617 [2024-07-13 10:16:17.306260] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.617 qpair failed and we were unable to recover it. 00:30:11.617 [2024-07-13 10:16:17.316146] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.617 [2024-07-13 10:16:17.316308] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.617 [2024-07-13 10:16:17.316332] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.617 [2024-07-13 10:16:17.316348] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.618 [2024-07-13 10:16:17.316361] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.618 [2024-07-13 10:16:17.316403] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.618 qpair failed and we were unable to recover it. 00:30:11.618 [2024-07-13 10:16:17.326068] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.618 [2024-07-13 10:16:17.326200] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.618 [2024-07-13 10:16:17.326226] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.618 [2024-07-13 10:16:17.326241] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.618 [2024-07-13 10:16:17.326255] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.618 [2024-07-13 10:16:17.326284] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.618 qpair failed and we were unable to recover it. 00:30:11.618 [2024-07-13 10:16:17.336143] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.618 [2024-07-13 10:16:17.336339] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.618 [2024-07-13 10:16:17.336382] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.618 [2024-07-13 10:16:17.336397] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.618 [2024-07-13 10:16:17.336411] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.618 [2024-07-13 10:16:17.336462] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.618 qpair failed and we were unable to recover it. 00:30:11.618 [2024-07-13 10:16:17.346131] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.618 [2024-07-13 10:16:17.346270] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.618 [2024-07-13 10:16:17.346297] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.618 [2024-07-13 10:16:17.346311] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.618 [2024-07-13 10:16:17.346325] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.618 [2024-07-13 10:16:17.346355] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.618 qpair failed and we were unable to recover it. 00:30:11.618 [2024-07-13 10:16:17.356148] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.618 [2024-07-13 10:16:17.356274] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.618 [2024-07-13 10:16:17.356306] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.618 [2024-07-13 10:16:17.356322] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.618 [2024-07-13 10:16:17.356336] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.618 [2024-07-13 10:16:17.356364] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.618 qpair failed and we were unable to recover it. 00:30:11.618 [2024-07-13 10:16:17.366210] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.618 [2024-07-13 10:16:17.366338] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.618 [2024-07-13 10:16:17.366364] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.618 [2024-07-13 10:16:17.366379] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.618 [2024-07-13 10:16:17.366393] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.618 [2024-07-13 10:16:17.366422] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.618 qpair failed and we were unable to recover it. 00:30:11.618 [2024-07-13 10:16:17.376291] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.618 [2024-07-13 10:16:17.376441] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.618 [2024-07-13 10:16:17.376467] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.618 [2024-07-13 10:16:17.376482] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.618 [2024-07-13 10:16:17.376496] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.618 [2024-07-13 10:16:17.376541] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.618 qpair failed and we were unable to recover it. 00:30:11.618 [2024-07-13 10:16:17.386246] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.618 [2024-07-13 10:16:17.386384] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.618 [2024-07-13 10:16:17.386410] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.618 [2024-07-13 10:16:17.386425] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.618 [2024-07-13 10:16:17.386439] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.618 [2024-07-13 10:16:17.386468] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.618 qpair failed and we were unable to recover it. 00:30:11.618 [2024-07-13 10:16:17.396298] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.618 [2024-07-13 10:16:17.396474] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.618 [2024-07-13 10:16:17.396500] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.618 [2024-07-13 10:16:17.396515] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.618 [2024-07-13 10:16:17.396534] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.618 [2024-07-13 10:16:17.396563] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.618 qpair failed and we were unable to recover it. 00:30:11.618 [2024-07-13 10:16:17.406308] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.618 [2024-07-13 10:16:17.406440] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.618 [2024-07-13 10:16:17.406465] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.618 [2024-07-13 10:16:17.406479] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.618 [2024-07-13 10:16:17.406493] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.618 [2024-07-13 10:16:17.406522] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.618 qpair failed and we were unable to recover it. 00:30:11.618 [2024-07-13 10:16:17.416382] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.618 [2024-07-13 10:16:17.416543] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.618 [2024-07-13 10:16:17.416569] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.618 [2024-07-13 10:16:17.416584] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.618 [2024-07-13 10:16:17.416613] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.618 [2024-07-13 10:16:17.416641] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.618 qpair failed and we were unable to recover it. 00:30:11.618 [2024-07-13 10:16:17.426367] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.618 [2024-07-13 10:16:17.426553] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.618 [2024-07-13 10:16:17.426578] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.618 [2024-07-13 10:16:17.426594] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.618 [2024-07-13 10:16:17.426608] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.618 [2024-07-13 10:16:17.426637] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.618 qpair failed and we were unable to recover it. 00:30:11.877 [2024-07-13 10:16:17.436416] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.877 [2024-07-13 10:16:17.436558] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.877 [2024-07-13 10:16:17.436596] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.877 [2024-07-13 10:16:17.436612] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.877 [2024-07-13 10:16:17.436626] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.877 [2024-07-13 10:16:17.436656] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.877 qpair failed and we were unable to recover it. 00:30:11.877 [2024-07-13 10:16:17.446441] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.877 [2024-07-13 10:16:17.446584] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.877 [2024-07-13 10:16:17.446616] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.878 [2024-07-13 10:16:17.446631] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.878 [2024-07-13 10:16:17.446645] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.878 [2024-07-13 10:16:17.446674] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.878 qpair failed and we were unable to recover it. 00:30:11.878 [2024-07-13 10:16:17.456503] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.878 [2024-07-13 10:16:17.456636] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.878 [2024-07-13 10:16:17.456662] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.878 [2024-07-13 10:16:17.456677] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.878 [2024-07-13 10:16:17.456691] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.878 [2024-07-13 10:16:17.456734] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.878 qpair failed and we were unable to recover it. 00:30:11.878 [2024-07-13 10:16:17.466495] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.878 [2024-07-13 10:16:17.466641] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.878 [2024-07-13 10:16:17.466666] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.878 [2024-07-13 10:16:17.466682] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.878 [2024-07-13 10:16:17.466696] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.878 [2024-07-13 10:16:17.466724] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.878 qpair failed and we were unable to recover it. 00:30:11.878 [2024-07-13 10:16:17.476545] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.878 [2024-07-13 10:16:17.476677] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.878 [2024-07-13 10:16:17.476703] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.878 [2024-07-13 10:16:17.476718] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.878 [2024-07-13 10:16:17.476732] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.878 [2024-07-13 10:16:17.476760] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.878 qpair failed and we were unable to recover it. 00:30:11.878 [2024-07-13 10:16:17.486638] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.878 [2024-07-13 10:16:17.486768] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.878 [2024-07-13 10:16:17.486794] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.878 [2024-07-13 10:16:17.486810] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.878 [2024-07-13 10:16:17.486829] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.878 [2024-07-13 10:16:17.486858] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.878 qpair failed and we were unable to recover it. 00:30:11.878 [2024-07-13 10:16:17.496585] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.878 [2024-07-13 10:16:17.496727] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.878 [2024-07-13 10:16:17.496753] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.878 [2024-07-13 10:16:17.496768] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.878 [2024-07-13 10:16:17.496782] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.878 [2024-07-13 10:16:17.496811] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.878 qpair failed and we were unable to recover it. 00:30:11.878 [2024-07-13 10:16:17.506658] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.878 [2024-07-13 10:16:17.506803] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.878 [2024-07-13 10:16:17.506828] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.878 [2024-07-13 10:16:17.506844] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.878 [2024-07-13 10:16:17.506857] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.878 [2024-07-13 10:16:17.506897] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.878 qpair failed and we were unable to recover it. 00:30:11.878 [2024-07-13 10:16:17.516635] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.878 [2024-07-13 10:16:17.516768] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.878 [2024-07-13 10:16:17.516795] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.878 [2024-07-13 10:16:17.516811] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.878 [2024-07-13 10:16:17.516824] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.878 [2024-07-13 10:16:17.516853] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.878 qpair failed and we were unable to recover it. 00:30:11.878 [2024-07-13 10:16:17.526686] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.878 [2024-07-13 10:16:17.526812] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.878 [2024-07-13 10:16:17.526836] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.878 [2024-07-13 10:16:17.526852] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.878 [2024-07-13 10:16:17.526871] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.878 [2024-07-13 10:16:17.526901] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.878 qpair failed and we were unable to recover it. 00:30:11.878 [2024-07-13 10:16:17.536726] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.878 [2024-07-13 10:16:17.536872] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.878 [2024-07-13 10:16:17.536897] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.878 [2024-07-13 10:16:17.536912] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.878 [2024-07-13 10:16:17.536925] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.878 [2024-07-13 10:16:17.536954] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.878 qpair failed and we were unable to recover it. 00:30:11.878 [2024-07-13 10:16:17.546842] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.878 [2024-07-13 10:16:17.546987] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.878 [2024-07-13 10:16:17.547014] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.878 [2024-07-13 10:16:17.547029] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.878 [2024-07-13 10:16:17.547042] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.878 [2024-07-13 10:16:17.547071] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.878 qpair failed and we were unable to recover it. 00:30:11.878 [2024-07-13 10:16:17.556785] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.878 [2024-07-13 10:16:17.556919] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.878 [2024-07-13 10:16:17.556943] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.878 [2024-07-13 10:16:17.556958] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.878 [2024-07-13 10:16:17.556971] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.878 [2024-07-13 10:16:17.557000] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.878 qpair failed and we were unable to recover it. 00:30:11.878 [2024-07-13 10:16:17.566803] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.878 [2024-07-13 10:16:17.566923] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.878 [2024-07-13 10:16:17.566948] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.878 [2024-07-13 10:16:17.566962] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.878 [2024-07-13 10:16:17.566976] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.878 [2024-07-13 10:16:17.567004] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.878 qpair failed and we were unable to recover it. 00:30:11.878 [2024-07-13 10:16:17.576842] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.878 [2024-07-13 10:16:17.576976] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.878 [2024-07-13 10:16:17.577000] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.878 [2024-07-13 10:16:17.577015] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.878 [2024-07-13 10:16:17.577035] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.878 [2024-07-13 10:16:17.577064] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.878 qpair failed and we were unable to recover it. 00:30:11.878 [2024-07-13 10:16:17.586889] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.878 [2024-07-13 10:16:17.587011] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.878 [2024-07-13 10:16:17.587045] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.878 [2024-07-13 10:16:17.587060] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.878 [2024-07-13 10:16:17.587074] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.879 [2024-07-13 10:16:17.587103] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.879 qpair failed and we were unable to recover it. 00:30:11.879 [2024-07-13 10:16:17.596905] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.879 [2024-07-13 10:16:17.597029] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.879 [2024-07-13 10:16:17.597053] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.879 [2024-07-13 10:16:17.597068] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.879 [2024-07-13 10:16:17.597082] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.879 [2024-07-13 10:16:17.597111] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.879 qpair failed and we were unable to recover it. 00:30:11.879 [2024-07-13 10:16:17.606903] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.879 [2024-07-13 10:16:17.607025] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.879 [2024-07-13 10:16:17.607049] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.879 [2024-07-13 10:16:17.607064] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.879 [2024-07-13 10:16:17.607078] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.879 [2024-07-13 10:16:17.607107] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.879 qpair failed and we were unable to recover it. 00:30:11.879 [2024-07-13 10:16:17.616952] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.879 [2024-07-13 10:16:17.617080] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.879 [2024-07-13 10:16:17.617106] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.879 [2024-07-13 10:16:17.617121] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.879 [2024-07-13 10:16:17.617135] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.879 [2024-07-13 10:16:17.617164] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.879 qpair failed and we were unable to recover it. 00:30:11.879 [2024-07-13 10:16:17.626996] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.879 [2024-07-13 10:16:17.627124] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.879 [2024-07-13 10:16:17.627148] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.879 [2024-07-13 10:16:17.627163] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.879 [2024-07-13 10:16:17.627176] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.879 [2024-07-13 10:16:17.627205] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.879 qpair failed and we were unable to recover it. 00:30:11.879 [2024-07-13 10:16:17.637000] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.879 [2024-07-13 10:16:17.637129] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.879 [2024-07-13 10:16:17.637156] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.879 [2024-07-13 10:16:17.637171] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.879 [2024-07-13 10:16:17.637184] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.879 [2024-07-13 10:16:17.637213] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.879 qpair failed and we were unable to recover it. 00:30:11.879 [2024-07-13 10:16:17.647047] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.879 [2024-07-13 10:16:17.647171] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.879 [2024-07-13 10:16:17.647198] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.879 [2024-07-13 10:16:17.647213] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.879 [2024-07-13 10:16:17.647227] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.879 [2024-07-13 10:16:17.647255] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.879 qpair failed and we were unable to recover it. 00:30:11.879 [2024-07-13 10:16:17.657125] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.879 [2024-07-13 10:16:17.657271] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.879 [2024-07-13 10:16:17.657300] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.879 [2024-07-13 10:16:17.657319] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.879 [2024-07-13 10:16:17.657333] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.879 [2024-07-13 10:16:17.657378] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.879 qpair failed and we were unable to recover it. 00:30:11.879 [2024-07-13 10:16:17.667135] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.879 [2024-07-13 10:16:17.667265] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.879 [2024-07-13 10:16:17.667291] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.879 [2024-07-13 10:16:17.667307] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.879 [2024-07-13 10:16:17.667326] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.879 [2024-07-13 10:16:17.667357] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.879 qpair failed and we were unable to recover it. 00:30:11.879 [2024-07-13 10:16:17.677120] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.879 [2024-07-13 10:16:17.677244] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.879 [2024-07-13 10:16:17.677271] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.879 [2024-07-13 10:16:17.677288] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.879 [2024-07-13 10:16:17.677301] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.879 [2024-07-13 10:16:17.677332] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.879 qpair failed and we were unable to recover it. 00:30:11.879 [2024-07-13 10:16:17.687149] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:11.879 [2024-07-13 10:16:17.687284] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:11.879 [2024-07-13 10:16:17.687310] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:11.879 [2024-07-13 10:16:17.687325] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:11.879 [2024-07-13 10:16:17.687338] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:11.879 [2024-07-13 10:16:17.687367] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:11.879 qpair failed and we were unable to recover it. 00:30:12.140 [2024-07-13 10:16:17.697211] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.140 [2024-07-13 10:16:17.697383] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.140 [2024-07-13 10:16:17.697412] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.140 [2024-07-13 10:16:17.697441] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.140 [2024-07-13 10:16:17.697477] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.140 [2024-07-13 10:16:17.697507] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.140 qpair failed and we were unable to recover it. 00:30:12.140 [2024-07-13 10:16:17.707207] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.140 [2024-07-13 10:16:17.707332] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.140 [2024-07-13 10:16:17.707358] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.140 [2024-07-13 10:16:17.707373] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.141 [2024-07-13 10:16:17.707387] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.141 [2024-07-13 10:16:17.707416] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.141 qpair failed and we were unable to recover it. 00:30:12.141 [2024-07-13 10:16:17.717218] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.141 [2024-07-13 10:16:17.717348] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.141 [2024-07-13 10:16:17.717374] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.141 [2024-07-13 10:16:17.717389] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.141 [2024-07-13 10:16:17.717402] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.141 [2024-07-13 10:16:17.717431] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.141 qpair failed and we were unable to recover it. 00:30:12.141 [2024-07-13 10:16:17.727237] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.141 [2024-07-13 10:16:17.727365] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.141 [2024-07-13 10:16:17.727391] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.141 [2024-07-13 10:16:17.727407] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.141 [2024-07-13 10:16:17.727420] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.141 [2024-07-13 10:16:17.727448] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.141 qpair failed and we were unable to recover it. 00:30:12.141 [2024-07-13 10:16:17.737341] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.141 [2024-07-13 10:16:17.737511] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.141 [2024-07-13 10:16:17.737537] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.141 [2024-07-13 10:16:17.737566] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.141 [2024-07-13 10:16:17.737581] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.141 [2024-07-13 10:16:17.737609] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.141 qpair failed and we were unable to recover it. 00:30:12.141 [2024-07-13 10:16:17.747324] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.141 [2024-07-13 10:16:17.747493] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.141 [2024-07-13 10:16:17.747519] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.141 [2024-07-13 10:16:17.747533] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.141 [2024-07-13 10:16:17.747547] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.141 [2024-07-13 10:16:17.747574] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.141 qpair failed and we were unable to recover it. 00:30:12.141 [2024-07-13 10:16:17.757345] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.141 [2024-07-13 10:16:17.757473] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.141 [2024-07-13 10:16:17.757501] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.141 [2024-07-13 10:16:17.757525] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.141 [2024-07-13 10:16:17.757540] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.141 [2024-07-13 10:16:17.757585] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.141 qpair failed and we were unable to recover it. 00:30:12.141 [2024-07-13 10:16:17.767374] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.141 [2024-07-13 10:16:17.767497] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.141 [2024-07-13 10:16:17.767525] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.141 [2024-07-13 10:16:17.767540] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.141 [2024-07-13 10:16:17.767553] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.141 [2024-07-13 10:16:17.767582] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.141 qpair failed and we were unable to recover it. 00:30:12.141 [2024-07-13 10:16:17.777438] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.141 [2024-07-13 10:16:17.777587] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.141 [2024-07-13 10:16:17.777613] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.141 [2024-07-13 10:16:17.777628] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.141 [2024-07-13 10:16:17.777641] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.141 [2024-07-13 10:16:17.777686] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.141 qpair failed and we were unable to recover it. 00:30:12.141 [2024-07-13 10:16:17.787519] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.141 [2024-07-13 10:16:17.787649] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.141 [2024-07-13 10:16:17.787674] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.141 [2024-07-13 10:16:17.787689] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.141 [2024-07-13 10:16:17.787702] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.141 [2024-07-13 10:16:17.787731] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.141 qpair failed and we were unable to recover it. 00:30:12.141 [2024-07-13 10:16:17.797451] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.141 [2024-07-13 10:16:17.797577] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.141 [2024-07-13 10:16:17.797603] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.141 [2024-07-13 10:16:17.797618] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.141 [2024-07-13 10:16:17.797631] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.141 [2024-07-13 10:16:17.797659] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.141 qpair failed and we were unable to recover it. 00:30:12.141 [2024-07-13 10:16:17.807469] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.141 [2024-07-13 10:16:17.807600] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.141 [2024-07-13 10:16:17.807626] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.141 [2024-07-13 10:16:17.807641] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.141 [2024-07-13 10:16:17.807653] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.141 [2024-07-13 10:16:17.807681] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.141 qpair failed and we were unable to recover it. 00:30:12.141 [2024-07-13 10:16:17.817540] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.141 [2024-07-13 10:16:17.817673] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.141 [2024-07-13 10:16:17.817698] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.141 [2024-07-13 10:16:17.817714] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.141 [2024-07-13 10:16:17.817727] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.141 [2024-07-13 10:16:17.817772] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.141 qpair failed and we were unable to recover it. 00:30:12.141 [2024-07-13 10:16:17.827535] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.141 [2024-07-13 10:16:17.827660] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.141 [2024-07-13 10:16:17.827685] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.141 [2024-07-13 10:16:17.827701] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.141 [2024-07-13 10:16:17.827714] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.141 [2024-07-13 10:16:17.827743] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.141 qpair failed and we were unable to recover it. 00:30:12.141 [2024-07-13 10:16:17.837569] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.141 [2024-07-13 10:16:17.837703] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.141 [2024-07-13 10:16:17.837729] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.141 [2024-07-13 10:16:17.837745] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.141 [2024-07-13 10:16:17.837758] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.141 [2024-07-13 10:16:17.837786] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.141 qpair failed and we were unable to recover it. 00:30:12.141 [2024-07-13 10:16:17.847591] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.141 [2024-07-13 10:16:17.847712] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.141 [2024-07-13 10:16:17.847738] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.141 [2024-07-13 10:16:17.847759] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.141 [2024-07-13 10:16:17.847773] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.142 [2024-07-13 10:16:17.847801] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.142 qpair failed and we were unable to recover it. 00:30:12.142 [2024-07-13 10:16:17.857681] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.142 [2024-07-13 10:16:17.857833] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.142 [2024-07-13 10:16:17.857860] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.142 [2024-07-13 10:16:17.857882] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.142 [2024-07-13 10:16:17.857896] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.142 [2024-07-13 10:16:17.857927] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.142 qpair failed and we were unable to recover it. 00:30:12.142 [2024-07-13 10:16:17.867651] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.142 [2024-07-13 10:16:17.867792] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.142 [2024-07-13 10:16:17.867819] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.142 [2024-07-13 10:16:17.867835] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.142 [2024-07-13 10:16:17.867848] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.142 [2024-07-13 10:16:17.867883] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.142 qpair failed and we were unable to recover it. 00:30:12.142 [2024-07-13 10:16:17.877681] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.142 [2024-07-13 10:16:17.877799] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.142 [2024-07-13 10:16:17.877825] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.142 [2024-07-13 10:16:17.877840] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.142 [2024-07-13 10:16:17.877853] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.142 [2024-07-13 10:16:17.877888] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.142 qpair failed and we were unable to recover it. 00:30:12.142 [2024-07-13 10:16:17.887720] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.142 [2024-07-13 10:16:17.887849] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.142 [2024-07-13 10:16:17.887883] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.142 [2024-07-13 10:16:17.887900] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.142 [2024-07-13 10:16:17.887913] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.142 [2024-07-13 10:16:17.887943] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.142 qpair failed and we were unable to recover it. 00:30:12.142 [2024-07-13 10:16:17.897795] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.142 [2024-07-13 10:16:17.897933] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.142 [2024-07-13 10:16:17.897959] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.142 [2024-07-13 10:16:17.897974] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.142 [2024-07-13 10:16:17.897988] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.142 [2024-07-13 10:16:17.898018] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.142 qpair failed and we were unable to recover it. 00:30:12.142 [2024-07-13 10:16:17.907768] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.142 [2024-07-13 10:16:17.907903] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.142 [2024-07-13 10:16:17.907929] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.142 [2024-07-13 10:16:17.907945] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.142 [2024-07-13 10:16:17.907958] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.142 [2024-07-13 10:16:17.907987] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.142 qpair failed and we were unable to recover it. 00:30:12.142 [2024-07-13 10:16:17.917803] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.142 [2024-07-13 10:16:17.917930] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.142 [2024-07-13 10:16:17.917956] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.142 [2024-07-13 10:16:17.917971] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.142 [2024-07-13 10:16:17.917984] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.142 [2024-07-13 10:16:17.918014] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.142 qpair failed and we were unable to recover it. 00:30:12.142 [2024-07-13 10:16:17.927825] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.142 [2024-07-13 10:16:17.927952] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.142 [2024-07-13 10:16:17.927977] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.142 [2024-07-13 10:16:17.927993] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.142 [2024-07-13 10:16:17.928008] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.142 [2024-07-13 10:16:17.928036] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.142 qpair failed and we were unable to recover it. 00:30:12.142 [2024-07-13 10:16:17.937864] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.142 [2024-07-13 10:16:17.938006] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.142 [2024-07-13 10:16:17.938032] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.142 [2024-07-13 10:16:17.938053] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.142 [2024-07-13 10:16:17.938067] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.142 [2024-07-13 10:16:17.938096] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.142 qpair failed and we were unable to recover it. 00:30:12.142 [2024-07-13 10:16:17.947960] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.142 [2024-07-13 10:16:17.948088] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.142 [2024-07-13 10:16:17.948114] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.142 [2024-07-13 10:16:17.948128] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.142 [2024-07-13 10:16:17.948141] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.142 [2024-07-13 10:16:17.948170] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.142 qpair failed and we were unable to recover it. 00:30:12.404 [2024-07-13 10:16:17.957913] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.404 [2024-07-13 10:16:17.958044] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.404 [2024-07-13 10:16:17.958071] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.404 [2024-07-13 10:16:17.958086] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.404 [2024-07-13 10:16:17.958099] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.404 [2024-07-13 10:16:17.958128] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.404 qpair failed and we were unable to recover it. 00:30:12.404 [2024-07-13 10:16:17.967952] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.404 [2024-07-13 10:16:17.968075] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.404 [2024-07-13 10:16:17.968102] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.404 [2024-07-13 10:16:17.968127] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.404 [2024-07-13 10:16:17.968139] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.404 [2024-07-13 10:16:17.968168] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.404 qpair failed and we were unable to recover it. 00:30:12.404 [2024-07-13 10:16:17.978005] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.404 [2024-07-13 10:16:17.978161] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.404 [2024-07-13 10:16:17.978187] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.404 [2024-07-13 10:16:17.978202] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.404 [2024-07-13 10:16:17.978232] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.404 [2024-07-13 10:16:17.978261] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.404 qpair failed and we were unable to recover it. 00:30:12.404 [2024-07-13 10:16:17.988011] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.404 [2024-07-13 10:16:17.988139] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.404 [2024-07-13 10:16:17.988165] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.404 [2024-07-13 10:16:17.988180] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.404 [2024-07-13 10:16:17.988193] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.404 [2024-07-13 10:16:17.988222] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.404 qpair failed and we were unable to recover it. 00:30:12.404 [2024-07-13 10:16:17.998042] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.404 [2024-07-13 10:16:17.998203] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.404 [2024-07-13 10:16:17.998229] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.404 [2024-07-13 10:16:17.998244] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.404 [2024-07-13 10:16:17.998258] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.404 [2024-07-13 10:16:17.998303] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.404 qpair failed and we were unable to recover it. 00:30:12.404 [2024-07-13 10:16:18.008061] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.404 [2024-07-13 10:16:18.008198] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.404 [2024-07-13 10:16:18.008224] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.404 [2024-07-13 10:16:18.008239] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.404 [2024-07-13 10:16:18.008253] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.404 [2024-07-13 10:16:18.008280] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.404 qpair failed and we were unable to recover it. 00:30:12.404 [2024-07-13 10:16:18.018107] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.404 [2024-07-13 10:16:18.018252] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.404 [2024-07-13 10:16:18.018277] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.404 [2024-07-13 10:16:18.018292] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.404 [2024-07-13 10:16:18.018304] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.404 [2024-07-13 10:16:18.018333] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.404 qpair failed and we were unable to recover it. 00:30:12.404 [2024-07-13 10:16:18.028151] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.404 [2024-07-13 10:16:18.028279] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.404 [2024-07-13 10:16:18.028306] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.404 [2024-07-13 10:16:18.028326] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.404 [2024-07-13 10:16:18.028340] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.404 [2024-07-13 10:16:18.028369] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.404 qpair failed and we were unable to recover it. 00:30:12.404 [2024-07-13 10:16:18.038192] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.405 [2024-07-13 10:16:18.038322] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.405 [2024-07-13 10:16:18.038349] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.405 [2024-07-13 10:16:18.038364] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.405 [2024-07-13 10:16:18.038378] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.405 [2024-07-13 10:16:18.038407] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.405 qpair failed and we were unable to recover it. 00:30:12.405 [2024-07-13 10:16:18.048195] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.405 [2024-07-13 10:16:18.048317] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.405 [2024-07-13 10:16:18.048344] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.405 [2024-07-13 10:16:18.048359] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.405 [2024-07-13 10:16:18.048372] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.405 [2024-07-13 10:16:18.048401] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.405 qpair failed and we were unable to recover it. 00:30:12.405 [2024-07-13 10:16:18.058251] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.405 [2024-07-13 10:16:18.058413] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.405 [2024-07-13 10:16:18.058440] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.405 [2024-07-13 10:16:18.058470] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.405 [2024-07-13 10:16:18.058484] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.405 [2024-07-13 10:16:18.058512] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.405 qpair failed and we were unable to recover it. 00:30:12.405 [2024-07-13 10:16:18.068240] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.405 [2024-07-13 10:16:18.068365] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.405 [2024-07-13 10:16:18.068390] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.405 [2024-07-13 10:16:18.068405] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.405 [2024-07-13 10:16:18.068418] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.405 [2024-07-13 10:16:18.068446] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.405 qpair failed and we were unable to recover it. 00:30:12.405 [2024-07-13 10:16:18.078379] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.405 [2024-07-13 10:16:18.078508] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.405 [2024-07-13 10:16:18.078535] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.405 [2024-07-13 10:16:18.078566] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.405 [2024-07-13 10:16:18.078579] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.405 [2024-07-13 10:16:18.078609] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.405 qpair failed and we were unable to recover it. 00:30:12.405 [2024-07-13 10:16:18.088342] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.405 [2024-07-13 10:16:18.088472] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.405 [2024-07-13 10:16:18.088498] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.405 [2024-07-13 10:16:18.088514] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.405 [2024-07-13 10:16:18.088527] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.405 [2024-07-13 10:16:18.088556] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.405 qpair failed and we were unable to recover it. 00:30:12.405 [2024-07-13 10:16:18.098340] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.405 [2024-07-13 10:16:18.098475] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.405 [2024-07-13 10:16:18.098502] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.405 [2024-07-13 10:16:18.098518] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.405 [2024-07-13 10:16:18.098531] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.405 [2024-07-13 10:16:18.098560] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.405 qpair failed and we were unable to recover it. 00:30:12.405 [2024-07-13 10:16:18.108386] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.405 [2024-07-13 10:16:18.108514] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.405 [2024-07-13 10:16:18.108540] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.405 [2024-07-13 10:16:18.108555] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.405 [2024-07-13 10:16:18.108569] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.405 [2024-07-13 10:16:18.108597] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.405 qpair failed and we were unable to recover it. 00:30:12.405 [2024-07-13 10:16:18.118422] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.405 [2024-07-13 10:16:18.118553] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.405 [2024-07-13 10:16:18.118579] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.405 [2024-07-13 10:16:18.118603] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.405 [2024-07-13 10:16:18.118617] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.405 [2024-07-13 10:16:18.118646] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.405 qpair failed and we were unable to recover it. 00:30:12.405 [2024-07-13 10:16:18.128446] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.405 [2024-07-13 10:16:18.128569] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.405 [2024-07-13 10:16:18.128593] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.405 [2024-07-13 10:16:18.128608] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.405 [2024-07-13 10:16:18.128621] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.405 [2024-07-13 10:16:18.128650] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.405 qpair failed and we were unable to recover it. 00:30:12.405 [2024-07-13 10:16:18.138458] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.405 [2024-07-13 10:16:18.138582] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.405 [2024-07-13 10:16:18.138608] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.405 [2024-07-13 10:16:18.138623] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.405 [2024-07-13 10:16:18.138636] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.405 [2024-07-13 10:16:18.138665] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.405 qpair failed and we were unable to recover it. 00:30:12.405 [2024-07-13 10:16:18.148509] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.405 [2024-07-13 10:16:18.148686] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.405 [2024-07-13 10:16:18.148712] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.405 [2024-07-13 10:16:18.148728] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.405 [2024-07-13 10:16:18.148741] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.405 [2024-07-13 10:16:18.148769] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.405 qpair failed and we were unable to recover it. 00:30:12.405 [2024-07-13 10:16:18.158538] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.405 [2024-07-13 10:16:18.158670] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.405 [2024-07-13 10:16:18.158698] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.405 [2024-07-13 10:16:18.158717] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.405 [2024-07-13 10:16:18.158731] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.405 [2024-07-13 10:16:18.158761] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.405 qpair failed and we were unable to recover it. 00:30:12.405 [2024-07-13 10:16:18.168544] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.405 [2024-07-13 10:16:18.168672] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.405 [2024-07-13 10:16:18.168699] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.405 [2024-07-13 10:16:18.168715] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.405 [2024-07-13 10:16:18.168729] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.405 [2024-07-13 10:16:18.168758] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.405 qpair failed and we were unable to recover it. 00:30:12.405 [2024-07-13 10:16:18.178593] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.405 [2024-07-13 10:16:18.178724] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.405 [2024-07-13 10:16:18.178751] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.405 [2024-07-13 10:16:18.178766] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.406 [2024-07-13 10:16:18.178780] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.406 [2024-07-13 10:16:18.178808] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.406 qpair failed and we were unable to recover it. 00:30:12.406 [2024-07-13 10:16:18.188630] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.406 [2024-07-13 10:16:18.188779] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.406 [2024-07-13 10:16:18.188806] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.406 [2024-07-13 10:16:18.188821] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.406 [2024-07-13 10:16:18.188834] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.406 [2024-07-13 10:16:18.188862] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.406 qpair failed and we were unable to recover it. 00:30:12.406 [2024-07-13 10:16:18.198653] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.406 [2024-07-13 10:16:18.198790] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.406 [2024-07-13 10:16:18.198817] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.406 [2024-07-13 10:16:18.198831] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.406 [2024-07-13 10:16:18.198845] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.406 [2024-07-13 10:16:18.198879] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.406 qpair failed and we were unable to recover it. 00:30:12.406 [2024-07-13 10:16:18.208682] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.406 [2024-07-13 10:16:18.208809] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.406 [2024-07-13 10:16:18.208840] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.406 [2024-07-13 10:16:18.208856] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.406 [2024-07-13 10:16:18.208879] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.406 [2024-07-13 10:16:18.208909] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.406 qpair failed and we were unable to recover it. 00:30:12.406 [2024-07-13 10:16:18.218762] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.406 [2024-07-13 10:16:18.218914] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.406 [2024-07-13 10:16:18.218941] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.406 [2024-07-13 10:16:18.218957] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.406 [2024-07-13 10:16:18.218970] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.406 [2024-07-13 10:16:18.219000] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.406 qpair failed and we were unable to recover it. 00:30:12.667 [2024-07-13 10:16:18.228730] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.667 [2024-07-13 10:16:18.228859] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.667 [2024-07-13 10:16:18.228891] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.667 [2024-07-13 10:16:18.228907] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.667 [2024-07-13 10:16:18.228920] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.667 [2024-07-13 10:16:18.228949] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.667 qpair failed and we were unable to recover it. 00:30:12.667 [2024-07-13 10:16:18.238823] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.667 [2024-07-13 10:16:18.238980] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.667 [2024-07-13 10:16:18.239007] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.667 [2024-07-13 10:16:18.239023] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.667 [2024-07-13 10:16:18.239036] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.667 [2024-07-13 10:16:18.239064] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.667 qpair failed and we were unable to recover it. 00:30:12.667 [2024-07-13 10:16:18.248891] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.667 [2024-07-13 10:16:18.249063] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.667 [2024-07-13 10:16:18.249090] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.667 [2024-07-13 10:16:18.249105] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.667 [2024-07-13 10:16:18.249119] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.667 [2024-07-13 10:16:18.249148] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.667 qpair failed and we were unable to recover it. 00:30:12.667 [2024-07-13 10:16:18.258891] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.667 [2024-07-13 10:16:18.259020] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.667 [2024-07-13 10:16:18.259046] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.667 [2024-07-13 10:16:18.259061] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.667 [2024-07-13 10:16:18.259074] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.667 [2024-07-13 10:16:18.259104] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.667 qpair failed and we were unable to recover it. 00:30:12.667 [2024-07-13 10:16:18.268900] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.667 [2024-07-13 10:16:18.269029] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.667 [2024-07-13 10:16:18.269056] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.667 [2024-07-13 10:16:18.269071] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.667 [2024-07-13 10:16:18.269084] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.667 [2024-07-13 10:16:18.269113] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.667 qpair failed and we were unable to recover it. 00:30:12.667 [2024-07-13 10:16:18.278928] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.667 [2024-07-13 10:16:18.279056] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.667 [2024-07-13 10:16:18.279082] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.668 [2024-07-13 10:16:18.279096] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.668 [2024-07-13 10:16:18.279110] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.668 [2024-07-13 10:16:18.279139] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.668 qpair failed and we were unable to recover it. 00:30:12.668 [2024-07-13 10:16:18.288912] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.668 [2024-07-13 10:16:18.289038] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.668 [2024-07-13 10:16:18.289063] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.668 [2024-07-13 10:16:18.289078] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.668 [2024-07-13 10:16:18.289092] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.668 [2024-07-13 10:16:18.289120] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.668 qpair failed and we were unable to recover it. 00:30:12.668 [2024-07-13 10:16:18.298985] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.668 [2024-07-13 10:16:18.299117] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.668 [2024-07-13 10:16:18.299148] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.668 [2024-07-13 10:16:18.299164] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.668 [2024-07-13 10:16:18.299177] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.668 [2024-07-13 10:16:18.299206] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.668 qpair failed and we were unable to recover it. 00:30:12.668 [2024-07-13 10:16:18.308985] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.668 [2024-07-13 10:16:18.309160] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.668 [2024-07-13 10:16:18.309188] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.668 [2024-07-13 10:16:18.309203] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.668 [2024-07-13 10:16:18.309231] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.668 [2024-07-13 10:16:18.309260] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.668 qpair failed and we were unable to recover it. 00:30:12.668 [2024-07-13 10:16:18.319074] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.668 [2024-07-13 10:16:18.319225] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.668 [2024-07-13 10:16:18.319251] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.668 [2024-07-13 10:16:18.319266] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.668 [2024-07-13 10:16:18.319280] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.668 [2024-07-13 10:16:18.319307] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.668 qpair failed and we were unable to recover it. 00:30:12.668 [2024-07-13 10:16:18.329035] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.668 [2024-07-13 10:16:18.329169] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.668 [2024-07-13 10:16:18.329195] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.668 [2024-07-13 10:16:18.329211] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.668 [2024-07-13 10:16:18.329225] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.668 [2024-07-13 10:16:18.329253] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.668 qpair failed and we were unable to recover it. 00:30:12.668 [2024-07-13 10:16:18.339068] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.668 [2024-07-13 10:16:18.339224] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.668 [2024-07-13 10:16:18.339251] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.668 [2024-07-13 10:16:18.339266] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.668 [2024-07-13 10:16:18.339295] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.668 [2024-07-13 10:16:18.339329] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.668 qpair failed and we were unable to recover it. 00:30:12.668 [2024-07-13 10:16:18.349093] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.668 [2024-07-13 10:16:18.349277] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.668 [2024-07-13 10:16:18.349302] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.668 [2024-07-13 10:16:18.349332] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.668 [2024-07-13 10:16:18.349345] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.668 [2024-07-13 10:16:18.349373] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.668 qpair failed and we were unable to recover it. 00:30:12.668 [2024-07-13 10:16:18.359168] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.668 [2024-07-13 10:16:18.359341] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.668 [2024-07-13 10:16:18.359367] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.668 [2024-07-13 10:16:18.359383] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.668 [2024-07-13 10:16:18.359411] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.668 [2024-07-13 10:16:18.359440] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.668 qpair failed and we were unable to recover it. 00:30:12.668 [2024-07-13 10:16:18.369149] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.668 [2024-07-13 10:16:18.369273] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.668 [2024-07-13 10:16:18.369299] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.668 [2024-07-13 10:16:18.369314] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.668 [2024-07-13 10:16:18.369328] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.668 [2024-07-13 10:16:18.369356] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.668 qpair failed and we were unable to recover it. 00:30:12.668 [2024-07-13 10:16:18.379238] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.668 [2024-07-13 10:16:18.379397] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.668 [2024-07-13 10:16:18.379423] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.668 [2024-07-13 10:16:18.379438] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.668 [2024-07-13 10:16:18.379466] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.668 [2024-07-13 10:16:18.379494] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.668 qpair failed and we were unable to recover it. 00:30:12.668 [2024-07-13 10:16:18.389280] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.668 [2024-07-13 10:16:18.389408] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.668 [2024-07-13 10:16:18.389439] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.668 [2024-07-13 10:16:18.389456] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.668 [2024-07-13 10:16:18.389469] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.668 [2024-07-13 10:16:18.389498] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.668 qpair failed and we were unable to recover it. 00:30:12.668 [2024-07-13 10:16:18.399223] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.668 [2024-07-13 10:16:18.399348] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.668 [2024-07-13 10:16:18.399374] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.668 [2024-07-13 10:16:18.399390] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.668 [2024-07-13 10:16:18.399403] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.668 [2024-07-13 10:16:18.399431] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.668 qpair failed and we were unable to recover it. 00:30:12.668 [2024-07-13 10:16:18.409263] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.668 [2024-07-13 10:16:18.409390] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.668 [2024-07-13 10:16:18.409416] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.668 [2024-07-13 10:16:18.409431] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.668 [2024-07-13 10:16:18.409445] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.668 [2024-07-13 10:16:18.409474] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.668 qpair failed and we were unable to recover it. 00:30:12.668 [2024-07-13 10:16:18.419318] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.668 [2024-07-13 10:16:18.419482] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.668 [2024-07-13 10:16:18.419507] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.668 [2024-07-13 10:16:18.419523] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.668 [2024-07-13 10:16:18.419536] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.668 [2024-07-13 10:16:18.419564] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.668 qpair failed and we were unable to recover it. 00:30:12.669 [2024-07-13 10:16:18.429353] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.669 [2024-07-13 10:16:18.429481] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.669 [2024-07-13 10:16:18.429507] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.669 [2024-07-13 10:16:18.429522] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.669 [2024-07-13 10:16:18.429535] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.669 [2024-07-13 10:16:18.429585] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.669 qpair failed and we were unable to recover it. 00:30:12.669 [2024-07-13 10:16:18.439322] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.669 [2024-07-13 10:16:18.439447] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.669 [2024-07-13 10:16:18.439473] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.669 [2024-07-13 10:16:18.439488] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.669 [2024-07-13 10:16:18.439501] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.669 [2024-07-13 10:16:18.439530] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.669 qpair failed and we were unable to recover it. 00:30:12.669 [2024-07-13 10:16:18.449351] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.669 [2024-07-13 10:16:18.449474] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.669 [2024-07-13 10:16:18.449500] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.669 [2024-07-13 10:16:18.449515] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.669 [2024-07-13 10:16:18.449529] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.669 [2024-07-13 10:16:18.449557] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.669 qpair failed and we were unable to recover it. 00:30:12.669 [2024-07-13 10:16:18.459454] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.669 [2024-07-13 10:16:18.459588] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.669 [2024-07-13 10:16:18.459614] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.669 [2024-07-13 10:16:18.459629] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.669 [2024-07-13 10:16:18.459643] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.669 [2024-07-13 10:16:18.459671] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.669 qpair failed and we were unable to recover it. 00:30:12.669 [2024-07-13 10:16:18.469449] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.669 [2024-07-13 10:16:18.469581] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.669 [2024-07-13 10:16:18.469607] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.669 [2024-07-13 10:16:18.469622] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.669 [2024-07-13 10:16:18.469636] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.669 [2024-07-13 10:16:18.469679] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.669 qpair failed and we were unable to recover it. 00:30:12.669 [2024-07-13 10:16:18.479477] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.669 [2024-07-13 10:16:18.479615] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.669 [2024-07-13 10:16:18.479648] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.669 [2024-07-13 10:16:18.479678] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.669 [2024-07-13 10:16:18.479711] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.669 [2024-07-13 10:16:18.479742] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.669 qpair failed and we were unable to recover it. 00:30:12.928 [2024-07-13 10:16:18.489516] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.928 [2024-07-13 10:16:18.489649] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.928 [2024-07-13 10:16:18.489677] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.928 [2024-07-13 10:16:18.489692] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.928 [2024-07-13 10:16:18.489705] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.928 [2024-07-13 10:16:18.489734] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.928 qpair failed and we were unable to recover it. 00:30:12.928 [2024-07-13 10:16:18.499548] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.929 [2024-07-13 10:16:18.499724] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.929 [2024-07-13 10:16:18.499750] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.929 [2024-07-13 10:16:18.499767] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.929 [2024-07-13 10:16:18.499780] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.929 [2024-07-13 10:16:18.499808] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.929 qpair failed and we were unable to recover it. 00:30:12.929 [2024-07-13 10:16:18.509603] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.929 [2024-07-13 10:16:18.509733] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.929 [2024-07-13 10:16:18.509760] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.929 [2024-07-13 10:16:18.509776] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.929 [2024-07-13 10:16:18.509788] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.929 [2024-07-13 10:16:18.509818] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.929 qpair failed and we were unable to recover it. 00:30:12.929 [2024-07-13 10:16:18.519633] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.929 [2024-07-13 10:16:18.519798] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.929 [2024-07-13 10:16:18.519824] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.929 [2024-07-13 10:16:18.519839] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.929 [2024-07-13 10:16:18.519873] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.929 [2024-07-13 10:16:18.519910] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.929 qpair failed and we were unable to recover it. 00:30:12.929 [2024-07-13 10:16:18.529656] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.929 [2024-07-13 10:16:18.529783] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.929 [2024-07-13 10:16:18.529809] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.929 [2024-07-13 10:16:18.529824] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.929 [2024-07-13 10:16:18.529837] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.929 [2024-07-13 10:16:18.529874] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.929 qpair failed and we were unable to recover it. 00:30:12.929 [2024-07-13 10:16:18.539648] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.929 [2024-07-13 10:16:18.539824] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.929 [2024-07-13 10:16:18.539850] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.929 [2024-07-13 10:16:18.539871] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.929 [2024-07-13 10:16:18.539885] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.929 [2024-07-13 10:16:18.539914] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.929 qpair failed and we were unable to recover it. 00:30:12.929 [2024-07-13 10:16:18.549682] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.929 [2024-07-13 10:16:18.549863] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.929 [2024-07-13 10:16:18.549895] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.929 [2024-07-13 10:16:18.549910] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.929 [2024-07-13 10:16:18.549923] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.929 [2024-07-13 10:16:18.549954] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.929 qpair failed and we were unable to recover it. 00:30:12.929 [2024-07-13 10:16:18.559710] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.929 [2024-07-13 10:16:18.559842] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.929 [2024-07-13 10:16:18.559876] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.929 [2024-07-13 10:16:18.559893] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.929 [2024-07-13 10:16:18.559905] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.929 [2024-07-13 10:16:18.559935] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.929 qpair failed and we were unable to recover it. 00:30:12.929 [2024-07-13 10:16:18.569722] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.929 [2024-07-13 10:16:18.569898] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.929 [2024-07-13 10:16:18.569928] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.929 [2024-07-13 10:16:18.569943] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.929 [2024-07-13 10:16:18.569957] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.929 [2024-07-13 10:16:18.569987] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.929 qpair failed and we were unable to recover it. 00:30:12.929 [2024-07-13 10:16:18.579752] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.929 [2024-07-13 10:16:18.579914] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.929 [2024-07-13 10:16:18.579939] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.929 [2024-07-13 10:16:18.579954] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.929 [2024-07-13 10:16:18.579967] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.929 [2024-07-13 10:16:18.579996] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.929 qpair failed and we were unable to recover it. 00:30:12.929 [2024-07-13 10:16:18.589815] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.929 [2024-07-13 10:16:18.589951] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.929 [2024-07-13 10:16:18.589976] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.929 [2024-07-13 10:16:18.589991] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.929 [2024-07-13 10:16:18.590004] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.929 [2024-07-13 10:16:18.590033] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.929 qpair failed and we were unable to recover it. 00:30:12.929 [2024-07-13 10:16:18.599802] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.929 [2024-07-13 10:16:18.599942] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.929 [2024-07-13 10:16:18.599967] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.929 [2024-07-13 10:16:18.599983] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.929 [2024-07-13 10:16:18.599996] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.929 [2024-07-13 10:16:18.600025] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.929 qpair failed and we were unable to recover it. 00:30:12.929 [2024-07-13 10:16:18.609860] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.929 [2024-07-13 10:16:18.610007] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.929 [2024-07-13 10:16:18.610032] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.929 [2024-07-13 10:16:18.610047] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.929 [2024-07-13 10:16:18.610067] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.929 [2024-07-13 10:16:18.610096] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.929 qpair failed and we were unable to recover it. 00:30:12.929 [2024-07-13 10:16:18.619898] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.929 [2024-07-13 10:16:18.620033] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.929 [2024-07-13 10:16:18.620058] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.929 [2024-07-13 10:16:18.620073] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.929 [2024-07-13 10:16:18.620086] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.929 [2024-07-13 10:16:18.620116] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.929 qpair failed and we were unable to recover it. 00:30:12.929 [2024-07-13 10:16:18.629944] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.929 [2024-07-13 10:16:18.630094] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.929 [2024-07-13 10:16:18.630119] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.930 [2024-07-13 10:16:18.630134] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.930 [2024-07-13 10:16:18.630147] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.930 [2024-07-13 10:16:18.630192] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.930 qpair failed and we were unable to recover it. 00:30:12.930 [2024-07-13 10:16:18.639943] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.930 [2024-07-13 10:16:18.640119] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.930 [2024-07-13 10:16:18.640144] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.930 [2024-07-13 10:16:18.640159] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.930 [2024-07-13 10:16:18.640172] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.930 [2024-07-13 10:16:18.640201] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.930 qpair failed and we were unable to recover it. 00:30:12.930 [2024-07-13 10:16:18.649996] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.930 [2024-07-13 10:16:18.650121] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.930 [2024-07-13 10:16:18.650146] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.930 [2024-07-13 10:16:18.650161] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.930 [2024-07-13 10:16:18.650174] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.930 [2024-07-13 10:16:18.650204] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.930 qpair failed and we were unable to recover it. 00:30:12.930 [2024-07-13 10:16:18.660045] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.930 [2024-07-13 10:16:18.660182] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.930 [2024-07-13 10:16:18.660213] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.930 [2024-07-13 10:16:18.660229] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.930 [2024-07-13 10:16:18.660242] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.930 [2024-07-13 10:16:18.660286] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.930 qpair failed and we were unable to recover it. 00:30:12.930 [2024-07-13 10:16:18.670073] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.930 [2024-07-13 10:16:18.670216] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.930 [2024-07-13 10:16:18.670241] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.930 [2024-07-13 10:16:18.670256] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.930 [2024-07-13 10:16:18.670269] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.930 [2024-07-13 10:16:18.670298] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.930 qpair failed and we were unable to recover it. 00:30:12.930 [2024-07-13 10:16:18.680032] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.930 [2024-07-13 10:16:18.680163] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.930 [2024-07-13 10:16:18.680188] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.930 [2024-07-13 10:16:18.680202] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.930 [2024-07-13 10:16:18.680215] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.930 [2024-07-13 10:16:18.680245] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.930 qpair failed and we were unable to recover it. 00:30:12.930 [2024-07-13 10:16:18.690099] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.930 [2024-07-13 10:16:18.690222] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.930 [2024-07-13 10:16:18.690247] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.930 [2024-07-13 10:16:18.690262] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.930 [2024-07-13 10:16:18.690275] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.930 [2024-07-13 10:16:18.690303] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.930 qpair failed and we were unable to recover it. 00:30:12.930 [2024-07-13 10:16:18.700154] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.930 [2024-07-13 10:16:18.700285] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.930 [2024-07-13 10:16:18.700311] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.930 [2024-07-13 10:16:18.700327] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.930 [2024-07-13 10:16:18.700346] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.930 [2024-07-13 10:16:18.700390] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.930 qpair failed and we were unable to recover it. 00:30:12.930 [2024-07-13 10:16:18.710135] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.930 [2024-07-13 10:16:18.710308] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.930 [2024-07-13 10:16:18.710335] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.930 [2024-07-13 10:16:18.710350] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.930 [2024-07-13 10:16:18.710363] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.930 [2024-07-13 10:16:18.710391] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.930 qpair failed and we were unable to recover it. 00:30:12.930 [2024-07-13 10:16:18.720137] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.930 [2024-07-13 10:16:18.720259] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.930 [2024-07-13 10:16:18.720285] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.930 [2024-07-13 10:16:18.720300] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.930 [2024-07-13 10:16:18.720313] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.930 [2024-07-13 10:16:18.720342] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.930 qpair failed and we were unable to recover it. 00:30:12.930 [2024-07-13 10:16:18.730210] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.930 [2024-07-13 10:16:18.730354] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.930 [2024-07-13 10:16:18.730381] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.930 [2024-07-13 10:16:18.730396] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.930 [2024-07-13 10:16:18.730409] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.930 [2024-07-13 10:16:18.730439] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.930 qpair failed and we were unable to recover it. 00:30:12.930 [2024-07-13 10:16:18.740268] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:12.930 [2024-07-13 10:16:18.740399] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:12.930 [2024-07-13 10:16:18.740426] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:12.930 [2024-07-13 10:16:18.740441] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:12.930 [2024-07-13 10:16:18.740454] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:12.930 [2024-07-13 10:16:18.740483] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:12.930 qpair failed and we were unable to recover it. 00:30:13.191 [2024-07-13 10:16:18.750236] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.191 [2024-07-13 10:16:18.750384] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.191 [2024-07-13 10:16:18.750410] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.191 [2024-07-13 10:16:18.750426] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.191 [2024-07-13 10:16:18.750439] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.191 [2024-07-13 10:16:18.750469] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.191 qpair failed and we were unable to recover it. 00:30:13.191 [2024-07-13 10:16:18.760284] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.191 [2024-07-13 10:16:18.760411] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.191 [2024-07-13 10:16:18.760437] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.191 [2024-07-13 10:16:18.760452] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.191 [2024-07-13 10:16:18.760465] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.191 [2024-07-13 10:16:18.760495] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.191 qpair failed and we were unable to recover it. 00:30:13.191 [2024-07-13 10:16:18.770293] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.191 [2024-07-13 10:16:18.770434] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.191 [2024-07-13 10:16:18.770460] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.191 [2024-07-13 10:16:18.770475] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.191 [2024-07-13 10:16:18.770489] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.191 [2024-07-13 10:16:18.770519] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.191 qpair failed and we were unable to recover it. 00:30:13.191 [2024-07-13 10:16:18.780369] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.191 [2024-07-13 10:16:18.780545] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.191 [2024-07-13 10:16:18.780570] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.191 [2024-07-13 10:16:18.780585] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.191 [2024-07-13 10:16:18.780598] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.191 [2024-07-13 10:16:18.780628] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.191 qpair failed and we were unable to recover it. 00:30:13.191 [2024-07-13 10:16:18.790403] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.191 [2024-07-13 10:16:18.790566] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.191 [2024-07-13 10:16:18.790592] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.191 [2024-07-13 10:16:18.790606] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.191 [2024-07-13 10:16:18.790627] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.191 [2024-07-13 10:16:18.790656] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.191 qpair failed and we were unable to recover it. 00:30:13.191 [2024-07-13 10:16:18.800495] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.191 [2024-07-13 10:16:18.800629] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.191 [2024-07-13 10:16:18.800655] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.191 [2024-07-13 10:16:18.800670] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.191 [2024-07-13 10:16:18.800683] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.191 [2024-07-13 10:16:18.800713] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.191 qpair failed and we were unable to recover it. 00:30:13.191 [2024-07-13 10:16:18.810453] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.191 [2024-07-13 10:16:18.810582] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.191 [2024-07-13 10:16:18.810608] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.191 [2024-07-13 10:16:18.810622] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.191 [2024-07-13 10:16:18.810636] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.191 [2024-07-13 10:16:18.810666] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.191 qpair failed and we were unable to recover it. 00:30:13.191 [2024-07-13 10:16:18.820499] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.191 [2024-07-13 10:16:18.820631] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.191 [2024-07-13 10:16:18.820657] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.191 [2024-07-13 10:16:18.820672] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.191 [2024-07-13 10:16:18.820685] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.191 [2024-07-13 10:16:18.820714] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.191 qpair failed and we were unable to recover it. 00:30:13.191 [2024-07-13 10:16:18.830536] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.191 [2024-07-13 10:16:18.830662] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.191 [2024-07-13 10:16:18.830688] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.191 [2024-07-13 10:16:18.830703] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.191 [2024-07-13 10:16:18.830716] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.191 [2024-07-13 10:16:18.830745] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.191 qpair failed and we were unable to recover it. 00:30:13.191 [2024-07-13 10:16:18.840495] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.191 [2024-07-13 10:16:18.840663] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.191 [2024-07-13 10:16:18.840689] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.191 [2024-07-13 10:16:18.840704] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.191 [2024-07-13 10:16:18.840717] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.191 [2024-07-13 10:16:18.840746] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.191 qpair failed and we were unable to recover it. 00:30:13.191 [2024-07-13 10:16:18.850527] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.191 [2024-07-13 10:16:18.850649] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.191 [2024-07-13 10:16:18.850674] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.191 [2024-07-13 10:16:18.850689] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.191 [2024-07-13 10:16:18.850701] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.191 [2024-07-13 10:16:18.850731] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.191 qpair failed and we were unable to recover it. 00:30:13.191 [2024-07-13 10:16:18.860595] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.191 [2024-07-13 10:16:18.860732] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.191 [2024-07-13 10:16:18.860758] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.191 [2024-07-13 10:16:18.860773] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.191 [2024-07-13 10:16:18.860785] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.191 [2024-07-13 10:16:18.860830] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.191 qpair failed and we were unable to recover it. 00:30:13.191 [2024-07-13 10:16:18.870600] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.191 [2024-07-13 10:16:18.870752] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.191 [2024-07-13 10:16:18.870780] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.191 [2024-07-13 10:16:18.870795] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.192 [2024-07-13 10:16:18.870813] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.192 [2024-07-13 10:16:18.870859] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.192 qpair failed and we were unable to recover it. 00:30:13.192 [2024-07-13 10:16:18.880643] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.192 [2024-07-13 10:16:18.880782] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.192 [2024-07-13 10:16:18.880808] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.192 [2024-07-13 10:16:18.880823] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.192 [2024-07-13 10:16:18.880846] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.192 [2024-07-13 10:16:18.880883] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.192 qpair failed and we were unable to recover it. 00:30:13.192 [2024-07-13 10:16:18.890678] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.192 [2024-07-13 10:16:18.890804] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.192 [2024-07-13 10:16:18.890830] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.192 [2024-07-13 10:16:18.890845] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.192 [2024-07-13 10:16:18.890860] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.192 [2024-07-13 10:16:18.890899] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.192 qpair failed and we were unable to recover it. 00:30:13.192 [2024-07-13 10:16:18.900694] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.192 [2024-07-13 10:16:18.900823] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.192 [2024-07-13 10:16:18.900849] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.192 [2024-07-13 10:16:18.900872] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.192 [2024-07-13 10:16:18.900887] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.192 [2024-07-13 10:16:18.900917] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.192 qpair failed and we were unable to recover it. 00:30:13.192 [2024-07-13 10:16:18.910773] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.192 [2024-07-13 10:16:18.910921] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.192 [2024-07-13 10:16:18.910947] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.192 [2024-07-13 10:16:18.910962] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.192 [2024-07-13 10:16:18.910975] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.192 [2024-07-13 10:16:18.911005] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.192 qpair failed and we were unable to recover it. 00:30:13.192 [2024-07-13 10:16:18.920743] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.192 [2024-07-13 10:16:18.920891] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.192 [2024-07-13 10:16:18.920918] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.192 [2024-07-13 10:16:18.920932] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.192 [2024-07-13 10:16:18.920945] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.192 [2024-07-13 10:16:18.920975] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.192 qpair failed and we were unable to recover it. 00:30:13.192 [2024-07-13 10:16:18.930785] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.192 [2024-07-13 10:16:18.930943] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.192 [2024-07-13 10:16:18.930971] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.192 [2024-07-13 10:16:18.930987] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.192 [2024-07-13 10:16:18.931009] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.192 [2024-07-13 10:16:18.931042] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.192 qpair failed and we were unable to recover it. 00:30:13.192 [2024-07-13 10:16:18.940805] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.192 [2024-07-13 10:16:18.940961] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.192 [2024-07-13 10:16:18.940987] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.192 [2024-07-13 10:16:18.941003] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.192 [2024-07-13 10:16:18.941018] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.192 [2024-07-13 10:16:18.941046] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.192 qpair failed and we were unable to recover it. 00:30:13.192 [2024-07-13 10:16:18.950851] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.192 [2024-07-13 10:16:18.950988] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.192 [2024-07-13 10:16:18.951013] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.192 [2024-07-13 10:16:18.951028] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.192 [2024-07-13 10:16:18.951042] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.192 [2024-07-13 10:16:18.951070] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.192 qpair failed and we were unable to recover it. 00:30:13.192 [2024-07-13 10:16:18.960878] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.192 [2024-07-13 10:16:18.961005] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.192 [2024-07-13 10:16:18.961031] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.192 [2024-07-13 10:16:18.961046] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.192 [2024-07-13 10:16:18.961059] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.192 [2024-07-13 10:16:18.961088] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.192 qpair failed and we were unable to recover it. 00:30:13.192 [2024-07-13 10:16:18.970857] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.192 [2024-07-13 10:16:18.970991] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.192 [2024-07-13 10:16:18.971016] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.192 [2024-07-13 10:16:18.971036] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.192 [2024-07-13 10:16:18.971051] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.192 [2024-07-13 10:16:18.971080] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.192 qpair failed and we were unable to recover it. 00:30:13.192 [2024-07-13 10:16:18.980924] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.192 [2024-07-13 10:16:18.981050] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.192 [2024-07-13 10:16:18.981076] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.192 [2024-07-13 10:16:18.981091] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.192 [2024-07-13 10:16:18.981104] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.192 [2024-07-13 10:16:18.981133] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.192 qpair failed and we were unable to recover it. 00:30:13.192 [2024-07-13 10:16:18.990943] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.192 [2024-07-13 10:16:18.991068] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.192 [2024-07-13 10:16:18.991093] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.192 [2024-07-13 10:16:18.991109] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.192 [2024-07-13 10:16:18.991123] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.192 [2024-07-13 10:16:18.991151] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.192 qpair failed and we were unable to recover it. 00:30:13.192 [2024-07-13 10:16:19.000987] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.192 [2024-07-13 10:16:19.001142] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.192 [2024-07-13 10:16:19.001168] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.192 [2024-07-13 10:16:19.001183] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.192 [2024-07-13 10:16:19.001196] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.192 [2024-07-13 10:16:19.001240] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.192 qpair failed and we were unable to recover it. 00:30:13.452 [2024-07-13 10:16:19.010996] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.452 [2024-07-13 10:16:19.011128] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.452 [2024-07-13 10:16:19.011154] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.452 [2024-07-13 10:16:19.011169] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.452 [2024-07-13 10:16:19.011181] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.452 [2024-07-13 10:16:19.011210] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.452 qpair failed and we were unable to recover it. 00:30:13.452 [2024-07-13 10:16:19.021026] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.452 [2024-07-13 10:16:19.021155] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.452 [2024-07-13 10:16:19.021181] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.452 [2024-07-13 10:16:19.021196] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.452 [2024-07-13 10:16:19.021209] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.452 [2024-07-13 10:16:19.021238] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.452 qpair failed and we were unable to recover it. 00:30:13.452 [2024-07-13 10:16:19.031068] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.452 [2024-07-13 10:16:19.031197] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.452 [2024-07-13 10:16:19.031223] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.452 [2024-07-13 10:16:19.031238] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.452 [2024-07-13 10:16:19.031251] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.452 [2024-07-13 10:16:19.031280] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.452 qpair failed and we were unable to recover it. 00:30:13.452 [2024-07-13 10:16:19.041078] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.452 [2024-07-13 10:16:19.041208] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.452 [2024-07-13 10:16:19.041234] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.452 [2024-07-13 10:16:19.041249] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.452 [2024-07-13 10:16:19.041262] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.452 [2024-07-13 10:16:19.041291] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.452 qpair failed and we were unable to recover it. 00:30:13.452 [2024-07-13 10:16:19.051153] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.452 [2024-07-13 10:16:19.051276] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.452 [2024-07-13 10:16:19.051302] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.452 [2024-07-13 10:16:19.051317] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.452 [2024-07-13 10:16:19.051330] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.452 [2024-07-13 10:16:19.051360] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.452 qpair failed and we were unable to recover it. 00:30:13.452 [2024-07-13 10:16:19.061286] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.452 [2024-07-13 10:16:19.061440] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.453 [2024-07-13 10:16:19.061468] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.453 [2024-07-13 10:16:19.061491] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.453 [2024-07-13 10:16:19.061506] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.453 [2024-07-13 10:16:19.061549] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.453 qpair failed and we were unable to recover it. 00:30:13.453 [2024-07-13 10:16:19.071250] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.453 [2024-07-13 10:16:19.071399] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.453 [2024-07-13 10:16:19.071424] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.453 [2024-07-13 10:16:19.071438] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.453 [2024-07-13 10:16:19.071451] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.453 [2024-07-13 10:16:19.071493] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.453 qpair failed and we were unable to recover it. 00:30:13.453 [2024-07-13 10:16:19.081236] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.453 [2024-07-13 10:16:19.081369] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.453 [2024-07-13 10:16:19.081395] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.453 [2024-07-13 10:16:19.081410] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.453 [2024-07-13 10:16:19.081424] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.453 [2024-07-13 10:16:19.081453] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.453 qpair failed and we were unable to recover it. 00:30:13.453 [2024-07-13 10:16:19.091243] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.453 [2024-07-13 10:16:19.091374] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.453 [2024-07-13 10:16:19.091401] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.453 [2024-07-13 10:16:19.091416] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.453 [2024-07-13 10:16:19.091430] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.453 [2024-07-13 10:16:19.091458] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.453 qpair failed and we were unable to recover it. 00:30:13.453 [2024-07-13 10:16:19.101260] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.453 [2024-07-13 10:16:19.101400] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.453 [2024-07-13 10:16:19.101426] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.453 [2024-07-13 10:16:19.101441] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.453 [2024-07-13 10:16:19.101455] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.453 [2024-07-13 10:16:19.101484] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.453 qpair failed and we were unable to recover it. 00:30:13.453 [2024-07-13 10:16:19.111373] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.453 [2024-07-13 10:16:19.111512] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.453 [2024-07-13 10:16:19.111537] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.453 [2024-07-13 10:16:19.111552] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.453 [2024-07-13 10:16:19.111566] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.453 [2024-07-13 10:16:19.111595] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.453 qpair failed and we were unable to recover it. 00:30:13.453 [2024-07-13 10:16:19.121322] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.453 [2024-07-13 10:16:19.121452] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.453 [2024-07-13 10:16:19.121478] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.453 [2024-07-13 10:16:19.121493] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.453 [2024-07-13 10:16:19.121508] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.453 [2024-07-13 10:16:19.121536] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.453 qpair failed and we were unable to recover it. 00:30:13.453 [2024-07-13 10:16:19.131349] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.453 [2024-07-13 10:16:19.131484] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.453 [2024-07-13 10:16:19.131509] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.453 [2024-07-13 10:16:19.131525] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.453 [2024-07-13 10:16:19.131538] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.453 [2024-07-13 10:16:19.131567] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.453 qpair failed and we were unable to recover it. 00:30:13.453 [2024-07-13 10:16:19.141418] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.453 [2024-07-13 10:16:19.141573] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.453 [2024-07-13 10:16:19.141599] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.453 [2024-07-13 10:16:19.141614] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.453 [2024-07-13 10:16:19.141628] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.453 [2024-07-13 10:16:19.141656] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.453 qpair failed and we were unable to recover it. 00:30:13.453 [2024-07-13 10:16:19.151468] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.453 [2024-07-13 10:16:19.151601] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.453 [2024-07-13 10:16:19.151626] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.453 [2024-07-13 10:16:19.151647] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.453 [2024-07-13 10:16:19.151661] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.453 [2024-07-13 10:16:19.151690] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.453 qpair failed and we were unable to recover it. 00:30:13.453 [2024-07-13 10:16:19.161462] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.453 [2024-07-13 10:16:19.161589] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.453 [2024-07-13 10:16:19.161615] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.453 [2024-07-13 10:16:19.161630] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.453 [2024-07-13 10:16:19.161644] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.453 [2024-07-13 10:16:19.161672] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.453 qpair failed and we were unable to recover it. 00:30:13.453 [2024-07-13 10:16:19.171458] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.453 [2024-07-13 10:16:19.171594] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.453 [2024-07-13 10:16:19.171619] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.453 [2024-07-13 10:16:19.171635] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.453 [2024-07-13 10:16:19.171649] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.453 [2024-07-13 10:16:19.171677] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.453 qpair failed and we were unable to recover it. 00:30:13.453 [2024-07-13 10:16:19.181540] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.453 [2024-07-13 10:16:19.181695] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.453 [2024-07-13 10:16:19.181721] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.453 [2024-07-13 10:16:19.181736] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.453 [2024-07-13 10:16:19.181765] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.453 [2024-07-13 10:16:19.181794] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.453 qpair failed and we were unable to recover it. 00:30:13.453 [2024-07-13 10:16:19.191516] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.453 [2024-07-13 10:16:19.191662] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.453 [2024-07-13 10:16:19.191688] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.453 [2024-07-13 10:16:19.191703] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.453 [2024-07-13 10:16:19.191717] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.453 [2024-07-13 10:16:19.191745] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.453 qpair failed and we were unable to recover it. 00:30:13.453 [2024-07-13 10:16:19.201562] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.453 [2024-07-13 10:16:19.201701] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.453 [2024-07-13 10:16:19.201726] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.453 [2024-07-13 10:16:19.201741] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.454 [2024-07-13 10:16:19.201755] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.454 [2024-07-13 10:16:19.201784] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.454 qpair failed and we were unable to recover it. 00:30:13.454 [2024-07-13 10:16:19.211603] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.454 [2024-07-13 10:16:19.211728] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.454 [2024-07-13 10:16:19.211754] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.454 [2024-07-13 10:16:19.211768] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.454 [2024-07-13 10:16:19.211782] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.454 [2024-07-13 10:16:19.211810] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.454 qpair failed and we were unable to recover it. 00:30:13.454 [2024-07-13 10:16:19.221623] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.454 [2024-07-13 10:16:19.221779] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.454 [2024-07-13 10:16:19.221804] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.454 [2024-07-13 10:16:19.221820] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.454 [2024-07-13 10:16:19.221833] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.454 [2024-07-13 10:16:19.221880] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.454 qpair failed and we were unable to recover it. 00:30:13.454 [2024-07-13 10:16:19.231695] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.454 [2024-07-13 10:16:19.231864] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.454 [2024-07-13 10:16:19.231896] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.454 [2024-07-13 10:16:19.231911] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.454 [2024-07-13 10:16:19.231926] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.454 [2024-07-13 10:16:19.231954] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.454 qpair failed and we were unable to recover it. 00:30:13.454 [2024-07-13 10:16:19.241672] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.454 [2024-07-13 10:16:19.241823] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.454 [2024-07-13 10:16:19.241859] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.454 [2024-07-13 10:16:19.241888] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.454 [2024-07-13 10:16:19.241903] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.454 [2024-07-13 10:16:19.241932] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.454 qpair failed and we were unable to recover it. 00:30:13.454 [2024-07-13 10:16:19.251704] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.454 [2024-07-13 10:16:19.251856] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.454 [2024-07-13 10:16:19.251887] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.454 [2024-07-13 10:16:19.251903] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.454 [2024-07-13 10:16:19.251917] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.454 [2024-07-13 10:16:19.251945] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.454 qpair failed and we were unable to recover it. 00:30:13.454 [2024-07-13 10:16:19.261766] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.454 [2024-07-13 10:16:19.261940] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.454 [2024-07-13 10:16:19.261965] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.454 [2024-07-13 10:16:19.261981] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.454 [2024-07-13 10:16:19.261994] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.454 [2024-07-13 10:16:19.262022] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.454 qpair failed and we were unable to recover it. 00:30:13.715 [2024-07-13 10:16:19.271791] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.715 [2024-07-13 10:16:19.271955] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.715 [2024-07-13 10:16:19.271982] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.715 [2024-07-13 10:16:19.271998] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.715 [2024-07-13 10:16:19.272012] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.715 [2024-07-13 10:16:19.272040] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.715 qpair failed and we were unable to recover it. 00:30:13.715 [2024-07-13 10:16:19.281808] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.715 [2024-07-13 10:16:19.281943] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.715 [2024-07-13 10:16:19.281969] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.715 [2024-07-13 10:16:19.281984] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.715 [2024-07-13 10:16:19.281998] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.715 [2024-07-13 10:16:19.282027] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.715 qpair failed and we were unable to recover it. 00:30:13.715 [2024-07-13 10:16:19.291826] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.715 [2024-07-13 10:16:19.291962] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.715 [2024-07-13 10:16:19.291988] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.716 [2024-07-13 10:16:19.292003] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.716 [2024-07-13 10:16:19.292017] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.716 [2024-07-13 10:16:19.292045] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.716 qpair failed and we were unable to recover it. 00:30:13.716 [2024-07-13 10:16:19.301863] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.716 [2024-07-13 10:16:19.302003] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.716 [2024-07-13 10:16:19.302029] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.716 [2024-07-13 10:16:19.302044] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.716 [2024-07-13 10:16:19.302058] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.716 [2024-07-13 10:16:19.302086] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.716 qpair failed and we were unable to recover it. 00:30:13.716 [2024-07-13 10:16:19.311889] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.716 [2024-07-13 10:16:19.312032] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.716 [2024-07-13 10:16:19.312057] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.716 [2024-07-13 10:16:19.312072] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.716 [2024-07-13 10:16:19.312086] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.716 [2024-07-13 10:16:19.312114] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.716 qpair failed and we were unable to recover it. 00:30:13.716 [2024-07-13 10:16:19.321964] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.716 [2024-07-13 10:16:19.322146] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.716 [2024-07-13 10:16:19.322172] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.716 [2024-07-13 10:16:19.322202] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.716 [2024-07-13 10:16:19.322217] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.716 [2024-07-13 10:16:19.322245] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.716 qpair failed and we were unable to recover it. 00:30:13.716 [2024-07-13 10:16:19.331979] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.716 [2024-07-13 10:16:19.332120] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.716 [2024-07-13 10:16:19.332150] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.716 [2024-07-13 10:16:19.332166] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.716 [2024-07-13 10:16:19.332180] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.716 [2024-07-13 10:16:19.332223] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.716 qpair failed and we were unable to recover it. 00:30:13.716 [2024-07-13 10:16:19.341980] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.716 [2024-07-13 10:16:19.342138] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.716 [2024-07-13 10:16:19.342165] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.716 [2024-07-13 10:16:19.342180] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.716 [2024-07-13 10:16:19.342194] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.716 [2024-07-13 10:16:19.342223] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.716 qpair failed and we were unable to recover it. 00:30:13.716 [2024-07-13 10:16:19.352006] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.716 [2024-07-13 10:16:19.352147] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.716 [2024-07-13 10:16:19.352174] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.716 [2024-07-13 10:16:19.352189] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.716 [2024-07-13 10:16:19.352204] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.716 [2024-07-13 10:16:19.352248] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.716 qpair failed and we were unable to recover it. 00:30:13.716 [2024-07-13 10:16:19.362050] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.716 [2024-07-13 10:16:19.362179] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.716 [2024-07-13 10:16:19.362205] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.716 [2024-07-13 10:16:19.362219] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.716 [2024-07-13 10:16:19.362232] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.716 [2024-07-13 10:16:19.362261] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.716 qpair failed and we were unable to recover it. 00:30:13.716 [2024-07-13 10:16:19.372113] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.716 [2024-07-13 10:16:19.372270] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.716 [2024-07-13 10:16:19.372295] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.716 [2024-07-13 10:16:19.372310] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.716 [2024-07-13 10:16:19.372325] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.716 [2024-07-13 10:16:19.372353] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.716 qpair failed and we were unable to recover it. 00:30:13.716 [2024-07-13 10:16:19.382100] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.716 [2024-07-13 10:16:19.382250] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.716 [2024-07-13 10:16:19.382278] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.716 [2024-07-13 10:16:19.382293] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.716 [2024-07-13 10:16:19.382307] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.716 [2024-07-13 10:16:19.382336] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.716 qpair failed and we were unable to recover it. 00:30:13.716 [2024-07-13 10:16:19.392113] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.716 [2024-07-13 10:16:19.392244] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.716 [2024-07-13 10:16:19.392270] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.716 [2024-07-13 10:16:19.392285] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.716 [2024-07-13 10:16:19.392299] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.716 [2024-07-13 10:16:19.392327] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.716 qpair failed and we were unable to recover it. 00:30:13.716 [2024-07-13 10:16:19.402206] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.716 [2024-07-13 10:16:19.402341] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.716 [2024-07-13 10:16:19.402367] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.716 [2024-07-13 10:16:19.402382] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.716 [2024-07-13 10:16:19.402395] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.716 [2024-07-13 10:16:19.402423] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.716 qpair failed and we were unable to recover it. 00:30:13.716 [2024-07-13 10:16:19.412219] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.716 [2024-07-13 10:16:19.412353] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.716 [2024-07-13 10:16:19.412379] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.716 [2024-07-13 10:16:19.412394] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.716 [2024-07-13 10:16:19.412407] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.716 [2024-07-13 10:16:19.412437] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.716 qpair failed and we were unable to recover it. 00:30:13.716 [2024-07-13 10:16:19.422267] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.716 [2024-07-13 10:16:19.422406] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.716 [2024-07-13 10:16:19.422437] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.716 [2024-07-13 10:16:19.422453] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.716 [2024-07-13 10:16:19.422467] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.716 [2024-07-13 10:16:19.422495] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.716 qpair failed and we were unable to recover it. 00:30:13.716 [2024-07-13 10:16:19.432291] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.716 [2024-07-13 10:16:19.432419] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.716 [2024-07-13 10:16:19.432445] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.716 [2024-07-13 10:16:19.432461] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.717 [2024-07-13 10:16:19.432475] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.717 [2024-07-13 10:16:19.432503] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.717 qpair failed and we were unable to recover it. 00:30:13.717 [2024-07-13 10:16:19.442380] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.717 [2024-07-13 10:16:19.442514] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.717 [2024-07-13 10:16:19.442554] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.717 [2024-07-13 10:16:19.442569] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.717 [2024-07-13 10:16:19.442583] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.717 [2024-07-13 10:16:19.442611] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.717 qpair failed and we were unable to recover it. 00:30:13.717 [2024-07-13 10:16:19.452281] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.717 [2024-07-13 10:16:19.452408] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.717 [2024-07-13 10:16:19.452434] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.717 [2024-07-13 10:16:19.452450] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.717 [2024-07-13 10:16:19.452463] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.717 [2024-07-13 10:16:19.452491] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.717 qpair failed and we were unable to recover it. 00:30:13.717 [2024-07-13 10:16:19.462347] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.717 [2024-07-13 10:16:19.462498] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.717 [2024-07-13 10:16:19.462524] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.717 [2024-07-13 10:16:19.462540] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.717 [2024-07-13 10:16:19.462553] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.717 [2024-07-13 10:16:19.462581] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.717 qpair failed and we were unable to recover it. 00:30:13.717 [2024-07-13 10:16:19.472343] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.717 [2024-07-13 10:16:19.472470] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.717 [2024-07-13 10:16:19.472496] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.717 [2024-07-13 10:16:19.472511] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.717 [2024-07-13 10:16:19.472525] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.717 [2024-07-13 10:16:19.472554] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.717 qpair failed and we were unable to recover it. 00:30:13.717 [2024-07-13 10:16:19.482377] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.717 [2024-07-13 10:16:19.482500] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.717 [2024-07-13 10:16:19.482526] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.717 [2024-07-13 10:16:19.482541] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.717 [2024-07-13 10:16:19.482555] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.717 [2024-07-13 10:16:19.482583] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.717 qpair failed and we were unable to recover it. 00:30:13.717 [2024-07-13 10:16:19.492443] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.717 [2024-07-13 10:16:19.492612] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.717 [2024-07-13 10:16:19.492638] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.717 [2024-07-13 10:16:19.492654] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.717 [2024-07-13 10:16:19.492683] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.717 [2024-07-13 10:16:19.492711] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.717 qpair failed and we were unable to recover it. 00:30:13.717 [2024-07-13 10:16:19.502454] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.717 [2024-07-13 10:16:19.502597] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.717 [2024-07-13 10:16:19.502622] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.717 [2024-07-13 10:16:19.502638] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.717 [2024-07-13 10:16:19.502652] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.717 [2024-07-13 10:16:19.502680] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.717 qpair failed and we were unable to recover it. 00:30:13.717 [2024-07-13 10:16:19.512509] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.717 [2024-07-13 10:16:19.512635] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.717 [2024-07-13 10:16:19.512666] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.717 [2024-07-13 10:16:19.512683] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.717 [2024-07-13 10:16:19.512696] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.717 [2024-07-13 10:16:19.512740] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.717 qpair failed and we were unable to recover it. 00:30:13.717 [2024-07-13 10:16:19.522516] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.717 [2024-07-13 10:16:19.522639] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.717 [2024-07-13 10:16:19.522674] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.717 [2024-07-13 10:16:19.522689] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.717 [2024-07-13 10:16:19.522702] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.717 [2024-07-13 10:16:19.522730] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.717 qpair failed and we were unable to recover it. 00:30:13.980 [2024-07-13 10:16:19.532622] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.980 [2024-07-13 10:16:19.532753] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.980 [2024-07-13 10:16:19.532781] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.980 [2024-07-13 10:16:19.532797] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.980 [2024-07-13 10:16:19.532810] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.980 [2024-07-13 10:16:19.532839] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.980 qpair failed and we were unable to recover it. 00:30:13.980 [2024-07-13 10:16:19.542583] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.980 [2024-07-13 10:16:19.542754] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.980 [2024-07-13 10:16:19.542781] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.980 [2024-07-13 10:16:19.542813] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.980 [2024-07-13 10:16:19.542826] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.980 [2024-07-13 10:16:19.542855] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.980 qpair failed and we were unable to recover it. 00:30:13.980 [2024-07-13 10:16:19.552633] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.980 [2024-07-13 10:16:19.552765] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.980 [2024-07-13 10:16:19.552793] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.980 [2024-07-13 10:16:19.552808] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.980 [2024-07-13 10:16:19.552822] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.980 [2024-07-13 10:16:19.552857] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.980 qpair failed and we were unable to recover it. 00:30:13.980 [2024-07-13 10:16:19.562642] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.980 [2024-07-13 10:16:19.562765] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.980 [2024-07-13 10:16:19.562793] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.980 [2024-07-13 10:16:19.562809] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.980 [2024-07-13 10:16:19.562822] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.980 [2024-07-13 10:16:19.562871] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.980 qpair failed and we were unable to recover it. 00:30:13.980 [2024-07-13 10:16:19.572674] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.980 [2024-07-13 10:16:19.572799] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.980 [2024-07-13 10:16:19.572826] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.980 [2024-07-13 10:16:19.572841] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.980 [2024-07-13 10:16:19.572855] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.980 [2024-07-13 10:16:19.572894] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.980 qpair failed and we were unable to recover it. 00:30:13.980 [2024-07-13 10:16:19.582729] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.980 [2024-07-13 10:16:19.582876] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.980 [2024-07-13 10:16:19.582901] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.980 [2024-07-13 10:16:19.582917] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.980 [2024-07-13 10:16:19.582930] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.980 [2024-07-13 10:16:19.582960] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.980 qpair failed and we were unable to recover it. 00:30:13.980 [2024-07-13 10:16:19.592761] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.980 [2024-07-13 10:16:19.592894] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.980 [2024-07-13 10:16:19.592918] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.980 [2024-07-13 10:16:19.592932] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.980 [2024-07-13 10:16:19.592946] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.980 [2024-07-13 10:16:19.592974] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.980 qpair failed and we were unable to recover it. 00:30:13.980 [2024-07-13 10:16:19.602745] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.980 [2024-07-13 10:16:19.602875] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.980 [2024-07-13 10:16:19.602909] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.980 [2024-07-13 10:16:19.602924] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.980 [2024-07-13 10:16:19.602938] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.980 [2024-07-13 10:16:19.602969] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.980 qpair failed and we were unable to recover it. 00:30:13.980 [2024-07-13 10:16:19.612819] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.980 [2024-07-13 10:16:19.612985] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.980 [2024-07-13 10:16:19.613012] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.980 [2024-07-13 10:16:19.613028] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.980 [2024-07-13 10:16:19.613041] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.980 [2024-07-13 10:16:19.613070] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.980 qpair failed and we were unable to recover it. 00:30:13.980 [2024-07-13 10:16:19.622814] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.980 [2024-07-13 10:16:19.622958] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.980 [2024-07-13 10:16:19.622986] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.980 [2024-07-13 10:16:19.623001] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.980 [2024-07-13 10:16:19.623014] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.980 [2024-07-13 10:16:19.623042] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.980 qpair failed and we were unable to recover it. 00:30:13.980 [2024-07-13 10:16:19.632827] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.980 [2024-07-13 10:16:19.633013] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.980 [2024-07-13 10:16:19.633040] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.980 [2024-07-13 10:16:19.633055] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.980 [2024-07-13 10:16:19.633069] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.980 [2024-07-13 10:16:19.633097] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.980 qpair failed and we were unable to recover it. 00:30:13.980 [2024-07-13 10:16:19.642848] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.980 [2024-07-13 10:16:19.642976] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.980 [2024-07-13 10:16:19.643003] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.980 [2024-07-13 10:16:19.643018] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.980 [2024-07-13 10:16:19.643032] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.980 [2024-07-13 10:16:19.643066] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.980 qpair failed and we were unable to recover it. 00:30:13.981 [2024-07-13 10:16:19.652910] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.981 [2024-07-13 10:16:19.653030] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.981 [2024-07-13 10:16:19.653057] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.981 [2024-07-13 10:16:19.653072] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.981 [2024-07-13 10:16:19.653086] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.981 [2024-07-13 10:16:19.653114] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.981 qpair failed and we were unable to recover it. 00:30:13.981 [2024-07-13 10:16:19.662923] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.981 [2024-07-13 10:16:19.663084] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.981 [2024-07-13 10:16:19.663110] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.981 [2024-07-13 10:16:19.663125] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.981 [2024-07-13 10:16:19.663139] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.981 [2024-07-13 10:16:19.663167] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.981 qpair failed and we were unable to recover it. 00:30:13.981 [2024-07-13 10:16:19.672965] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.981 [2024-07-13 10:16:19.673090] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.981 [2024-07-13 10:16:19.673125] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.981 [2024-07-13 10:16:19.673141] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.981 [2024-07-13 10:16:19.673154] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.981 [2024-07-13 10:16:19.673182] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.981 qpair failed and we were unable to recover it. 00:30:13.981 [2024-07-13 10:16:19.683035] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.981 [2024-07-13 10:16:19.683170] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.981 [2024-07-13 10:16:19.683197] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.981 [2024-07-13 10:16:19.683213] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.981 [2024-07-13 10:16:19.683226] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.981 [2024-07-13 10:16:19.683254] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.981 qpair failed and we were unable to recover it. 00:30:13.981 [2024-07-13 10:16:19.693004] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.981 [2024-07-13 10:16:19.693139] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.981 [2024-07-13 10:16:19.693170] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.981 [2024-07-13 10:16:19.693187] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.981 [2024-07-13 10:16:19.693201] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.981 [2024-07-13 10:16:19.693230] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.981 qpair failed and we were unable to recover it. 00:30:13.981 [2024-07-13 10:16:19.703065] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.981 [2024-07-13 10:16:19.703199] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.981 [2024-07-13 10:16:19.703225] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.981 [2024-07-13 10:16:19.703239] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.981 [2024-07-13 10:16:19.703253] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.981 [2024-07-13 10:16:19.703281] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.981 qpair failed and we were unable to recover it. 00:30:13.981 [2024-07-13 10:16:19.713084] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.981 [2024-07-13 10:16:19.713229] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.981 [2024-07-13 10:16:19.713255] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.981 [2024-07-13 10:16:19.713271] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.981 [2024-07-13 10:16:19.713284] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.981 [2024-07-13 10:16:19.713312] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.981 qpair failed and we were unable to recover it. 00:30:13.981 [2024-07-13 10:16:19.723098] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.981 [2024-07-13 10:16:19.723234] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.981 [2024-07-13 10:16:19.723260] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.981 [2024-07-13 10:16:19.723276] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.981 [2024-07-13 10:16:19.723289] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.981 [2024-07-13 10:16:19.723318] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.981 qpair failed and we were unable to recover it. 00:30:13.981 [2024-07-13 10:16:19.733120] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.981 [2024-07-13 10:16:19.733266] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.981 [2024-07-13 10:16:19.733292] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.981 [2024-07-13 10:16:19.733308] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.981 [2024-07-13 10:16:19.733321] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.981 [2024-07-13 10:16:19.733371] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.981 qpair failed and we were unable to recover it. 00:30:13.981 [2024-07-13 10:16:19.743139] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.981 [2024-07-13 10:16:19.743267] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.981 [2024-07-13 10:16:19.743294] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.981 [2024-07-13 10:16:19.743309] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.981 [2024-07-13 10:16:19.743322] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.981 [2024-07-13 10:16:19.743350] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.981 qpair failed and we were unable to recover it. 00:30:13.981 [2024-07-13 10:16:19.753186] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.981 [2024-07-13 10:16:19.753312] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.981 [2024-07-13 10:16:19.753339] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.981 [2024-07-13 10:16:19.753354] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.981 [2024-07-13 10:16:19.753368] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.981 [2024-07-13 10:16:19.753396] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.981 qpair failed and we were unable to recover it. 00:30:13.981 [2024-07-13 10:16:19.763217] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.981 [2024-07-13 10:16:19.763349] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.981 [2024-07-13 10:16:19.763375] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.981 [2024-07-13 10:16:19.763391] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.981 [2024-07-13 10:16:19.763405] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.981 [2024-07-13 10:16:19.763433] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.981 qpair failed and we were unable to recover it. 00:30:13.981 [2024-07-13 10:16:19.773337] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.981 [2024-07-13 10:16:19.773485] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.981 [2024-07-13 10:16:19.773511] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.981 [2024-07-13 10:16:19.773527] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.981 [2024-07-13 10:16:19.773540] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.981 [2024-07-13 10:16:19.773568] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.981 qpair failed and we were unable to recover it. 00:30:13.981 [2024-07-13 10:16:19.783259] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.981 [2024-07-13 10:16:19.783400] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.981 [2024-07-13 10:16:19.783431] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.981 [2024-07-13 10:16:19.783447] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.981 [2024-07-13 10:16:19.783460] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.981 [2024-07-13 10:16:19.783504] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.981 qpair failed and we were unable to recover it. 00:30:13.981 [2024-07-13 10:16:19.793279] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:13.982 [2024-07-13 10:16:19.793403] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:13.982 [2024-07-13 10:16:19.793431] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:13.982 [2024-07-13 10:16:19.793447] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:13.982 [2024-07-13 10:16:19.793461] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:13.982 [2024-07-13 10:16:19.793489] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:13.982 qpair failed and we were unable to recover it. 00:30:14.241 [2024-07-13 10:16:19.803351] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.241 [2024-07-13 10:16:19.803512] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.241 [2024-07-13 10:16:19.803542] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.241 [2024-07-13 10:16:19.803559] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.241 [2024-07-13 10:16:19.803573] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.241 [2024-07-13 10:16:19.803618] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.241 qpair failed and we were unable to recover it. 00:30:14.241 [2024-07-13 10:16:19.813318] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.241 [2024-07-13 10:16:19.813441] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.241 [2024-07-13 10:16:19.813468] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.241 [2024-07-13 10:16:19.813484] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.241 [2024-07-13 10:16:19.813497] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.241 [2024-07-13 10:16:19.813526] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.241 qpair failed and we were unable to recover it. 00:30:14.241 [2024-07-13 10:16:19.823425] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.241 [2024-07-13 10:16:19.823575] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.241 [2024-07-13 10:16:19.823602] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.241 [2024-07-13 10:16:19.823617] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.241 [2024-07-13 10:16:19.823636] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.241 [2024-07-13 10:16:19.823681] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.241 qpair failed and we were unable to recover it. 00:30:14.241 [2024-07-13 10:16:19.833419] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.241 [2024-07-13 10:16:19.833592] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.241 [2024-07-13 10:16:19.833619] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.241 [2024-07-13 10:16:19.833650] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.241 [2024-07-13 10:16:19.833664] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.241 [2024-07-13 10:16:19.833692] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.241 qpair failed and we were unable to recover it. 00:30:14.241 [2024-07-13 10:16:19.843476] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.241 [2024-07-13 10:16:19.843631] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.241 [2024-07-13 10:16:19.843659] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.241 [2024-07-13 10:16:19.843679] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.241 [2024-07-13 10:16:19.843708] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.241 [2024-07-13 10:16:19.843739] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.241 qpair failed and we were unable to recover it. 00:30:14.241 [2024-07-13 10:16:19.853443] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.241 [2024-07-13 10:16:19.853577] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.241 [2024-07-13 10:16:19.853604] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.241 [2024-07-13 10:16:19.853621] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.241 [2024-07-13 10:16:19.853635] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.241 [2024-07-13 10:16:19.853663] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.241 qpair failed and we were unable to recover it. 00:30:14.241 [2024-07-13 10:16:19.863569] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.241 [2024-07-13 10:16:19.863712] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.241 [2024-07-13 10:16:19.863738] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.241 [2024-07-13 10:16:19.863754] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.241 [2024-07-13 10:16:19.863767] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.241 [2024-07-13 10:16:19.863796] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.241 qpair failed and we were unable to recover it. 00:30:14.241 [2024-07-13 10:16:19.873516] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.241 [2024-07-13 10:16:19.873655] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.241 [2024-07-13 10:16:19.873686] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.241 [2024-07-13 10:16:19.873702] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.241 [2024-07-13 10:16:19.873716] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.241 [2024-07-13 10:16:19.873745] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.241 qpair failed and we were unable to recover it. 00:30:14.241 [2024-07-13 10:16:19.883527] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.241 [2024-07-13 10:16:19.883668] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.241 [2024-07-13 10:16:19.883695] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.241 [2024-07-13 10:16:19.883711] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.241 [2024-07-13 10:16:19.883724] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.241 [2024-07-13 10:16:19.883754] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.241 qpair failed and we were unable to recover it. 00:30:14.241 [2024-07-13 10:16:19.893542] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.241 [2024-07-13 10:16:19.893671] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.241 [2024-07-13 10:16:19.893698] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.241 [2024-07-13 10:16:19.893713] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.241 [2024-07-13 10:16:19.893726] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.241 [2024-07-13 10:16:19.893754] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.241 qpair failed and we were unable to recover it. 00:30:14.241 [2024-07-13 10:16:19.903623] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.241 [2024-07-13 10:16:19.903757] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.241 [2024-07-13 10:16:19.903783] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.241 [2024-07-13 10:16:19.903798] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.241 [2024-07-13 10:16:19.903812] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.241 [2024-07-13 10:16:19.903855] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.241 qpair failed and we were unable to recover it. 00:30:14.241 [2024-07-13 10:16:19.913624] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.242 [2024-07-13 10:16:19.913761] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.242 [2024-07-13 10:16:19.913787] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.242 [2024-07-13 10:16:19.913802] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.242 [2024-07-13 10:16:19.913821] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.242 [2024-07-13 10:16:19.913851] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.242 qpair failed and we were unable to recover it. 00:30:14.242 [2024-07-13 10:16:19.923657] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.242 [2024-07-13 10:16:19.923787] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.242 [2024-07-13 10:16:19.923814] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.242 [2024-07-13 10:16:19.923831] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.242 [2024-07-13 10:16:19.923844] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.242 [2024-07-13 10:16:19.923878] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.242 qpair failed and we were unable to recover it. 00:30:14.242 [2024-07-13 10:16:19.933762] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.242 [2024-07-13 10:16:19.933890] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.242 [2024-07-13 10:16:19.933914] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.242 [2024-07-13 10:16:19.933929] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.242 [2024-07-13 10:16:19.933943] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.242 [2024-07-13 10:16:19.933972] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.242 qpair failed and we were unable to recover it. 00:30:14.242 [2024-07-13 10:16:19.943743] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.242 [2024-07-13 10:16:19.943948] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.242 [2024-07-13 10:16:19.943977] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.242 [2024-07-13 10:16:19.943993] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.242 [2024-07-13 10:16:19.944010] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.242 [2024-07-13 10:16:19.944041] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.242 qpair failed and we were unable to recover it. 00:30:14.242 [2024-07-13 10:16:19.953752] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.242 [2024-07-13 10:16:19.953885] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.242 [2024-07-13 10:16:19.953917] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.242 [2024-07-13 10:16:19.953932] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.242 [2024-07-13 10:16:19.953944] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.242 [2024-07-13 10:16:19.953973] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.242 qpair failed and we were unable to recover it. 00:30:14.242 [2024-07-13 10:16:19.963772] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.242 [2024-07-13 10:16:19.963946] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.242 [2024-07-13 10:16:19.963972] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.242 [2024-07-13 10:16:19.963988] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.242 [2024-07-13 10:16:19.964001] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.242 [2024-07-13 10:16:19.964030] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.242 qpair failed and we were unable to recover it. 00:30:14.242 [2024-07-13 10:16:19.973786] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.242 [2024-07-13 10:16:19.973915] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.242 [2024-07-13 10:16:19.973941] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.242 [2024-07-13 10:16:19.973957] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.242 [2024-07-13 10:16:19.973970] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.242 [2024-07-13 10:16:19.973999] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.242 qpair failed and we were unable to recover it. 00:30:14.242 [2024-07-13 10:16:19.983884] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.242 [2024-07-13 10:16:19.984022] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.242 [2024-07-13 10:16:19.984047] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.242 [2024-07-13 10:16:19.984062] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.242 [2024-07-13 10:16:19.984075] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.242 [2024-07-13 10:16:19.984108] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.242 qpair failed and we were unable to recover it. 00:30:14.242 [2024-07-13 10:16:19.993850] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.242 [2024-07-13 10:16:19.993983] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.242 [2024-07-13 10:16:19.994009] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.242 [2024-07-13 10:16:19.994024] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.242 [2024-07-13 10:16:19.994037] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.242 [2024-07-13 10:16:19.994065] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.242 qpair failed and we were unable to recover it. 00:30:14.242 [2024-07-13 10:16:20.004069] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.242 [2024-07-13 10:16:20.004274] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.242 [2024-07-13 10:16:20.004315] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.242 [2024-07-13 10:16:20.004339] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.242 [2024-07-13 10:16:20.004368] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.242 [2024-07-13 10:16:20.004413] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.242 qpair failed and we were unable to recover it. 00:30:14.242 [2024-07-13 10:16:20.013999] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.242 [2024-07-13 10:16:20.014192] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.242 [2024-07-13 10:16:20.014228] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.242 [2024-07-13 10:16:20.014252] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.242 [2024-07-13 10:16:20.014273] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.242 [2024-07-13 10:16:20.014316] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.242 qpair failed and we were unable to recover it. 00:30:14.242 [2024-07-13 10:16:20.024043] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.242 [2024-07-13 10:16:20.024205] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.242 [2024-07-13 10:16:20.024242] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.242 [2024-07-13 10:16:20.024284] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.242 [2024-07-13 10:16:20.024308] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.242 [2024-07-13 10:16:20.024368] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.242 qpair failed and we were unable to recover it. 00:30:14.242 [2024-07-13 10:16:20.034013] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.242 [2024-07-13 10:16:20.034168] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.242 [2024-07-13 10:16:20.034202] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.242 [2024-07-13 10:16:20.034225] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.242 [2024-07-13 10:16:20.034244] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.242 [2024-07-13 10:16:20.034282] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.242 qpair failed and we were unable to recover it. 00:30:14.242 [2024-07-13 10:16:20.044025] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.242 [2024-07-13 10:16:20.044190] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.242 [2024-07-13 10:16:20.044225] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.242 [2024-07-13 10:16:20.044246] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.242 [2024-07-13 10:16:20.044266] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.242 [2024-07-13 10:16:20.044317] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.242 qpair failed and we were unable to recover it. 00:30:14.242 [2024-07-13 10:16:20.054071] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.242 [2024-07-13 10:16:20.054254] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.242 [2024-07-13 10:16:20.054284] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.242 [2024-07-13 10:16:20.054301] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.243 [2024-07-13 10:16:20.054314] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.243 [2024-07-13 10:16:20.054344] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.243 qpair failed and we were unable to recover it. 00:30:14.502 [2024-07-13 10:16:20.064075] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.502 [2024-07-13 10:16:20.064204] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.502 [2024-07-13 10:16:20.064232] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.502 [2024-07-13 10:16:20.064248] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.502 [2024-07-13 10:16:20.064261] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.502 [2024-07-13 10:16:20.064291] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.502 qpair failed and we were unable to recover it. 00:30:14.502 [2024-07-13 10:16:20.074136] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.502 [2024-07-13 10:16:20.074270] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.502 [2024-07-13 10:16:20.074297] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.502 [2024-07-13 10:16:20.074311] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.502 [2024-07-13 10:16:20.074324] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.502 [2024-07-13 10:16:20.074353] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.502 qpair failed and we were unable to recover it. 00:30:14.502 [2024-07-13 10:16:20.084139] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.502 [2024-07-13 10:16:20.084279] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.502 [2024-07-13 10:16:20.084306] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.502 [2024-07-13 10:16:20.084321] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.502 [2024-07-13 10:16:20.084333] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.502 [2024-07-13 10:16:20.084362] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.502 qpair failed and we were unable to recover it. 00:30:14.502 [2024-07-13 10:16:20.094153] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.502 [2024-07-13 10:16:20.094281] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.502 [2024-07-13 10:16:20.094308] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.502 [2024-07-13 10:16:20.094323] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.502 [2024-07-13 10:16:20.094344] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.502 [2024-07-13 10:16:20.094374] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.502 qpair failed and we were unable to recover it. 00:30:14.502 [2024-07-13 10:16:20.104230] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.502 [2024-07-13 10:16:20.104383] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.502 [2024-07-13 10:16:20.104410] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.502 [2024-07-13 10:16:20.104425] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.502 [2024-07-13 10:16:20.104438] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.502 [2024-07-13 10:16:20.104466] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.502 qpair failed and we were unable to recover it. 00:30:14.502 [2024-07-13 10:16:20.114219] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.502 [2024-07-13 10:16:20.114345] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.502 [2024-07-13 10:16:20.114369] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.502 [2024-07-13 10:16:20.114383] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.502 [2024-07-13 10:16:20.114396] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.502 [2024-07-13 10:16:20.114425] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.502 qpair failed and we were unable to recover it. 00:30:14.502 [2024-07-13 10:16:20.124259] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.502 [2024-07-13 10:16:20.124426] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.502 [2024-07-13 10:16:20.124453] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.502 [2024-07-13 10:16:20.124468] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.502 [2024-07-13 10:16:20.124482] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.502 [2024-07-13 10:16:20.124510] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.502 qpair failed and we were unable to recover it. 00:30:14.502 [2024-07-13 10:16:20.134248] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.502 [2024-07-13 10:16:20.134379] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.502 [2024-07-13 10:16:20.134406] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.502 [2024-07-13 10:16:20.134421] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.502 [2024-07-13 10:16:20.134435] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.502 [2024-07-13 10:16:20.134463] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.502 qpair failed and we were unable to recover it. 00:30:14.502 [2024-07-13 10:16:20.144290] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.502 [2024-07-13 10:16:20.144440] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.502 [2024-07-13 10:16:20.144466] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.502 [2024-07-13 10:16:20.144481] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.502 [2024-07-13 10:16:20.144495] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.502 [2024-07-13 10:16:20.144539] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.502 qpair failed and we were unable to recover it. 00:30:14.502 [2024-07-13 10:16:20.154357] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.502 [2024-07-13 10:16:20.154487] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.502 [2024-07-13 10:16:20.154514] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.502 [2024-07-13 10:16:20.154530] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.502 [2024-07-13 10:16:20.154543] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.502 [2024-07-13 10:16:20.154572] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.502 qpair failed and we were unable to recover it. 00:30:14.502 [2024-07-13 10:16:20.164377] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.502 [2024-07-13 10:16:20.164498] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.502 [2024-07-13 10:16:20.164523] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.502 [2024-07-13 10:16:20.164538] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.502 [2024-07-13 10:16:20.164551] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.503 [2024-07-13 10:16:20.164580] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.503 qpair failed and we were unable to recover it. 00:30:14.503 [2024-07-13 10:16:20.174409] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.503 [2024-07-13 10:16:20.174547] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.503 [2024-07-13 10:16:20.174575] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.503 [2024-07-13 10:16:20.174590] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.503 [2024-07-13 10:16:20.174604] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.503 [2024-07-13 10:16:20.174633] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.503 qpair failed and we were unable to recover it. 00:30:14.503 [2024-07-13 10:16:20.184422] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.503 [2024-07-13 10:16:20.184555] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.503 [2024-07-13 10:16:20.184581] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.503 [2024-07-13 10:16:20.184602] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.503 [2024-07-13 10:16:20.184617] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.503 [2024-07-13 10:16:20.184645] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.503 qpair failed and we were unable to recover it. 00:30:14.503 [2024-07-13 10:16:20.194432] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.503 [2024-07-13 10:16:20.194557] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.503 [2024-07-13 10:16:20.194583] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.503 [2024-07-13 10:16:20.194599] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.503 [2024-07-13 10:16:20.194613] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.503 [2024-07-13 10:16:20.194642] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.503 qpair failed and we were unable to recover it. 00:30:14.503 [2024-07-13 10:16:20.204484] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.503 [2024-07-13 10:16:20.204637] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.503 [2024-07-13 10:16:20.204662] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.503 [2024-07-13 10:16:20.204677] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.503 [2024-07-13 10:16:20.204691] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.503 [2024-07-13 10:16:20.204720] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.503 qpair failed and we were unable to recover it. 00:30:14.503 [2024-07-13 10:16:20.214514] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.503 [2024-07-13 10:16:20.214643] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.503 [2024-07-13 10:16:20.214669] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.503 [2024-07-13 10:16:20.214684] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.503 [2024-07-13 10:16:20.214697] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.503 [2024-07-13 10:16:20.214726] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.503 qpair failed and we were unable to recover it. 00:30:14.503 [2024-07-13 10:16:20.224573] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.503 [2024-07-13 10:16:20.224707] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.503 [2024-07-13 10:16:20.224733] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.503 [2024-07-13 10:16:20.224749] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.503 [2024-07-13 10:16:20.224762] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.503 [2024-07-13 10:16:20.224805] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.503 qpair failed and we were unable to recover it. 00:30:14.503 [2024-07-13 10:16:20.234545] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.503 [2024-07-13 10:16:20.234666] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.503 [2024-07-13 10:16:20.234691] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.503 [2024-07-13 10:16:20.234706] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.503 [2024-07-13 10:16:20.234719] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.503 [2024-07-13 10:16:20.234748] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.503 qpair failed and we were unable to recover it. 00:30:14.503 [2024-07-13 10:16:20.244591] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.503 [2024-07-13 10:16:20.244728] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.503 [2024-07-13 10:16:20.244754] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.503 [2024-07-13 10:16:20.244769] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.503 [2024-07-13 10:16:20.244782] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.503 [2024-07-13 10:16:20.244811] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.503 qpair failed and we were unable to recover it. 00:30:14.503 [2024-07-13 10:16:20.254702] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.503 [2024-07-13 10:16:20.254855] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.503 [2024-07-13 10:16:20.254889] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.503 [2024-07-13 10:16:20.254905] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.503 [2024-07-13 10:16:20.254918] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.503 [2024-07-13 10:16:20.254947] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.503 qpair failed and we were unable to recover it. 00:30:14.503 [2024-07-13 10:16:20.264697] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.503 [2024-07-13 10:16:20.264826] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.503 [2024-07-13 10:16:20.264851] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.503 [2024-07-13 10:16:20.264872] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.503 [2024-07-13 10:16:20.264887] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.503 [2024-07-13 10:16:20.264920] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.503 qpair failed and we were unable to recover it. 00:30:14.503 [2024-07-13 10:16:20.274674] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.503 [2024-07-13 10:16:20.274803] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.503 [2024-07-13 10:16:20.274828] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.503 [2024-07-13 10:16:20.274848] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.503 [2024-07-13 10:16:20.274863] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.503 [2024-07-13 10:16:20.274911] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.503 qpair failed and we were unable to recover it. 00:30:14.503 [2024-07-13 10:16:20.284740] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.503 [2024-07-13 10:16:20.284861] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.503 [2024-07-13 10:16:20.284893] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.503 [2024-07-13 10:16:20.284909] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.503 [2024-07-13 10:16:20.284923] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.503 [2024-07-13 10:16:20.284952] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.503 qpair failed and we were unable to recover it. 00:30:14.503 [2024-07-13 10:16:20.294730] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.503 [2024-07-13 10:16:20.294852] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.503 [2024-07-13 10:16:20.294885] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.503 [2024-07-13 10:16:20.294902] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.503 [2024-07-13 10:16:20.294915] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.503 [2024-07-13 10:16:20.294945] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.503 qpair failed and we were unable to recover it. 00:30:14.503 [2024-07-13 10:16:20.304784] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.503 [2024-07-13 10:16:20.304943] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.503 [2024-07-13 10:16:20.304969] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.503 [2024-07-13 10:16:20.304984] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.503 [2024-07-13 10:16:20.304997] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.503 [2024-07-13 10:16:20.305027] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.503 qpair failed and we were unable to recover it. 00:30:14.503 [2024-07-13 10:16:20.314782] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.504 [2024-07-13 10:16:20.314915] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.504 [2024-07-13 10:16:20.314941] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.504 [2024-07-13 10:16:20.314964] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.504 [2024-07-13 10:16:20.314977] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.504 [2024-07-13 10:16:20.315006] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.504 qpair failed and we were unable to recover it. 00:30:14.762 [2024-07-13 10:16:20.324858] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.762 [2024-07-13 10:16:20.325010] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.762 [2024-07-13 10:16:20.325037] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.762 [2024-07-13 10:16:20.325052] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.762 [2024-07-13 10:16:20.325066] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.762 [2024-07-13 10:16:20.325095] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.762 qpair failed and we were unable to recover it. 00:30:14.762 [2024-07-13 10:16:20.334843] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.762 [2024-07-13 10:16:20.334973] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.762 [2024-07-13 10:16:20.335000] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.762 [2024-07-13 10:16:20.335016] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.762 [2024-07-13 10:16:20.335029] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.762 [2024-07-13 10:16:20.335058] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.762 qpair failed and we were unable to recover it. 00:30:14.762 [2024-07-13 10:16:20.344913] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.762 [2024-07-13 10:16:20.345053] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.762 [2024-07-13 10:16:20.345079] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.762 [2024-07-13 10:16:20.345094] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.762 [2024-07-13 10:16:20.345107] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.762 [2024-07-13 10:16:20.345136] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.762 qpair failed and we were unable to recover it. 00:30:14.762 [2024-07-13 10:16:20.354970] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.762 [2024-07-13 10:16:20.355107] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.762 [2024-07-13 10:16:20.355134] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.762 [2024-07-13 10:16:20.355149] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.762 [2024-07-13 10:16:20.355163] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.762 [2024-07-13 10:16:20.355207] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.762 qpair failed and we were unable to recover it. 00:30:14.762 [2024-07-13 10:16:20.364958] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.762 [2024-07-13 10:16:20.365086] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.762 [2024-07-13 10:16:20.365111] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.762 [2024-07-13 10:16:20.365132] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.762 [2024-07-13 10:16:20.365148] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.762 [2024-07-13 10:16:20.365177] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.762 qpair failed and we were unable to recover it. 00:30:14.762 [2024-07-13 10:16:20.375075] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.762 [2024-07-13 10:16:20.375198] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.762 [2024-07-13 10:16:20.375224] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.762 [2024-07-13 10:16:20.375240] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.762 [2024-07-13 10:16:20.375254] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.762 [2024-07-13 10:16:20.375282] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.762 qpair failed and we were unable to recover it. 00:30:14.762 [2024-07-13 10:16:20.385045] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.762 [2024-07-13 10:16:20.385182] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.762 [2024-07-13 10:16:20.385209] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.762 [2024-07-13 10:16:20.385224] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.762 [2024-07-13 10:16:20.385238] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.762 [2024-07-13 10:16:20.385267] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.762 qpair failed and we were unable to recover it. 00:30:14.762 [2024-07-13 10:16:20.395045] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.762 [2024-07-13 10:16:20.395178] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.762 [2024-07-13 10:16:20.395204] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.762 [2024-07-13 10:16:20.395219] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.762 [2024-07-13 10:16:20.395233] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.762 [2024-07-13 10:16:20.395261] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.762 qpair failed and we were unable to recover it. 00:30:14.762 [2024-07-13 10:16:20.405084] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.762 [2024-07-13 10:16:20.405213] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.762 [2024-07-13 10:16:20.405239] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.763 [2024-07-13 10:16:20.405254] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.763 [2024-07-13 10:16:20.405267] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.763 [2024-07-13 10:16:20.405297] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.763 qpair failed and we were unable to recover it. 00:30:14.763 [2024-07-13 10:16:20.415089] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.763 [2024-07-13 10:16:20.415264] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.763 [2024-07-13 10:16:20.415291] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.763 [2024-07-13 10:16:20.415306] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.763 [2024-07-13 10:16:20.415318] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.763 [2024-07-13 10:16:20.415347] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.763 qpair failed and we were unable to recover it. 00:30:14.763 [2024-07-13 10:16:20.425162] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.763 [2024-07-13 10:16:20.425327] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.763 [2024-07-13 10:16:20.425352] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.763 [2024-07-13 10:16:20.425367] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.763 [2024-07-13 10:16:20.425396] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.763 [2024-07-13 10:16:20.425424] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.763 qpair failed and we were unable to recover it. 00:30:14.763 [2024-07-13 10:16:20.435155] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.763 [2024-07-13 10:16:20.435285] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.763 [2024-07-13 10:16:20.435311] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.763 [2024-07-13 10:16:20.435326] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.763 [2024-07-13 10:16:20.435339] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.763 [2024-07-13 10:16:20.435369] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.763 qpair failed and we were unable to recover it. 00:30:14.763 [2024-07-13 10:16:20.445185] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.763 [2024-07-13 10:16:20.445314] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.763 [2024-07-13 10:16:20.445340] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.763 [2024-07-13 10:16:20.445355] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.763 [2024-07-13 10:16:20.445368] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.763 [2024-07-13 10:16:20.445396] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.763 qpair failed and we were unable to recover it. 00:30:14.763 [2024-07-13 10:16:20.455300] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.763 [2024-07-13 10:16:20.455429] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.763 [2024-07-13 10:16:20.455455] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.763 [2024-07-13 10:16:20.455475] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.763 [2024-07-13 10:16:20.455490] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.763 [2024-07-13 10:16:20.455518] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.763 qpair failed and we were unable to recover it. 00:30:14.763 [2024-07-13 10:16:20.465305] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.763 [2024-07-13 10:16:20.465452] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.763 [2024-07-13 10:16:20.465478] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.763 [2024-07-13 10:16:20.465493] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.763 [2024-07-13 10:16:20.465506] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.763 [2024-07-13 10:16:20.465535] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.763 qpair failed and we were unable to recover it. 00:30:14.763 [2024-07-13 10:16:20.475330] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.763 [2024-07-13 10:16:20.475462] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.763 [2024-07-13 10:16:20.475488] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.763 [2024-07-13 10:16:20.475503] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.763 [2024-07-13 10:16:20.475516] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.763 [2024-07-13 10:16:20.475546] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.763 qpair failed and we were unable to recover it. 00:30:14.763 [2024-07-13 10:16:20.485316] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.763 [2024-07-13 10:16:20.485446] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.763 [2024-07-13 10:16:20.485471] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.763 [2024-07-13 10:16:20.485486] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.763 [2024-07-13 10:16:20.485499] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.763 [2024-07-13 10:16:20.485529] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.763 qpair failed and we were unable to recover it. 00:30:14.763 [2024-07-13 10:16:20.495345] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.763 [2024-07-13 10:16:20.495472] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.763 [2024-07-13 10:16:20.495497] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.763 [2024-07-13 10:16:20.495513] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.763 [2024-07-13 10:16:20.495525] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.763 [2024-07-13 10:16:20.495555] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.763 qpair failed and we were unable to recover it. 00:30:14.763 [2024-07-13 10:16:20.505385] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.763 [2024-07-13 10:16:20.505524] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.763 [2024-07-13 10:16:20.505549] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.763 [2024-07-13 10:16:20.505564] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.763 [2024-07-13 10:16:20.505577] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.763 [2024-07-13 10:16:20.505607] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.763 qpair failed and we were unable to recover it. 00:30:14.763 [2024-07-13 10:16:20.515375] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.763 [2024-07-13 10:16:20.515502] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.763 [2024-07-13 10:16:20.515528] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.763 [2024-07-13 10:16:20.515543] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.763 [2024-07-13 10:16:20.515557] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.763 [2024-07-13 10:16:20.515586] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.763 qpair failed and we were unable to recover it. 00:30:14.763 [2024-07-13 10:16:20.525406] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.763 [2024-07-13 10:16:20.525532] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.763 [2024-07-13 10:16:20.525558] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.763 [2024-07-13 10:16:20.525573] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.763 [2024-07-13 10:16:20.525586] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.763 [2024-07-13 10:16:20.525615] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.763 qpair failed and we were unable to recover it. 00:30:14.763 [2024-07-13 10:16:20.535461] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.763 [2024-07-13 10:16:20.535581] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.763 [2024-07-13 10:16:20.535607] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.763 [2024-07-13 10:16:20.535622] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.763 [2024-07-13 10:16:20.535635] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.763 [2024-07-13 10:16:20.535665] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.763 qpair failed and we were unable to recover it. 00:30:14.763 [2024-07-13 10:16:20.545575] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.763 [2024-07-13 10:16:20.545740] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.763 [2024-07-13 10:16:20.545769] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.763 [2024-07-13 10:16:20.545785] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.763 [2024-07-13 10:16:20.545798] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.763 [2024-07-13 10:16:20.545842] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.764 qpair failed and we were unable to recover it. 00:30:14.764 [2024-07-13 10:16:20.555536] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.764 [2024-07-13 10:16:20.555681] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.764 [2024-07-13 10:16:20.555707] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.764 [2024-07-13 10:16:20.555722] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.764 [2024-07-13 10:16:20.555736] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.764 [2024-07-13 10:16:20.555765] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.764 qpair failed and we were unable to recover it. 00:30:14.764 [2024-07-13 10:16:20.565575] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.764 [2024-07-13 10:16:20.565731] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.764 [2024-07-13 10:16:20.565757] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.764 [2024-07-13 10:16:20.565772] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.764 [2024-07-13 10:16:20.565785] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.764 [2024-07-13 10:16:20.565814] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.764 qpair failed and we were unable to recover it. 00:30:14.764 [2024-07-13 10:16:20.575555] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:14.764 [2024-07-13 10:16:20.575688] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:14.764 [2024-07-13 10:16:20.575715] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:14.764 [2024-07-13 10:16:20.575730] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:14.764 [2024-07-13 10:16:20.575744] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:14.764 [2024-07-13 10:16:20.575775] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:14.764 qpair failed and we were unable to recover it. 00:30:15.021 [2024-07-13 10:16:20.585603] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.021 [2024-07-13 10:16:20.585729] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.021 [2024-07-13 10:16:20.585756] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.021 [2024-07-13 10:16:20.585772] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.021 [2024-07-13 10:16:20.585786] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.021 [2024-07-13 10:16:20.585816] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.021 qpair failed and we were unable to recover it. 00:30:15.021 [2024-07-13 10:16:20.595627] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.021 [2024-07-13 10:16:20.595763] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.021 [2024-07-13 10:16:20.595790] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.021 [2024-07-13 10:16:20.595805] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.021 [2024-07-13 10:16:20.595818] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.021 [2024-07-13 10:16:20.595848] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.021 qpair failed and we were unable to recover it. 00:30:15.021 [2024-07-13 10:16:20.605664] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.021 [2024-07-13 10:16:20.605801] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.021 [2024-07-13 10:16:20.605826] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.021 [2024-07-13 10:16:20.605841] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.021 [2024-07-13 10:16:20.605855] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.021 [2024-07-13 10:16:20.605891] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.021 qpair failed and we were unable to recover it. 00:30:15.021 [2024-07-13 10:16:20.615684] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.021 [2024-07-13 10:16:20.615837] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.021 [2024-07-13 10:16:20.615863] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.021 [2024-07-13 10:16:20.615885] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.021 [2024-07-13 10:16:20.615899] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.021 [2024-07-13 10:16:20.615929] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.021 qpair failed and we were unable to recover it. 00:30:15.021 [2024-07-13 10:16:20.625731] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.022 [2024-07-13 10:16:20.625862] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.022 [2024-07-13 10:16:20.625894] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.022 [2024-07-13 10:16:20.625909] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.022 [2024-07-13 10:16:20.625923] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.022 [2024-07-13 10:16:20.625953] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.022 qpair failed and we were unable to recover it. 00:30:15.022 [2024-07-13 10:16:20.635744] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.022 [2024-07-13 10:16:20.635878] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.022 [2024-07-13 10:16:20.635909] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.022 [2024-07-13 10:16:20.635924] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.022 [2024-07-13 10:16:20.635937] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.022 [2024-07-13 10:16:20.635967] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.022 qpair failed and we were unable to recover it. 00:30:15.022 [2024-07-13 10:16:20.645879] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.022 [2024-07-13 10:16:20.646010] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.022 [2024-07-13 10:16:20.646036] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.022 [2024-07-13 10:16:20.646051] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.022 [2024-07-13 10:16:20.646064] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.022 [2024-07-13 10:16:20.646093] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.022 qpair failed and we were unable to recover it. 00:30:15.022 [2024-07-13 10:16:20.655824] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.022 [2024-07-13 10:16:20.655953] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.022 [2024-07-13 10:16:20.655979] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.022 [2024-07-13 10:16:20.655994] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.022 [2024-07-13 10:16:20.656007] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.022 [2024-07-13 10:16:20.656037] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.022 qpair failed and we were unable to recover it. 00:30:15.022 [2024-07-13 10:16:20.665828] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.022 [2024-07-13 10:16:20.665964] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.022 [2024-07-13 10:16:20.665990] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.022 [2024-07-13 10:16:20.666005] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.022 [2024-07-13 10:16:20.666018] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.022 [2024-07-13 10:16:20.666047] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.022 qpair failed and we were unable to recover it. 00:30:15.022 [2024-07-13 10:16:20.675849] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.022 [2024-07-13 10:16:20.675981] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.022 [2024-07-13 10:16:20.676007] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.022 [2024-07-13 10:16:20.676022] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.022 [2024-07-13 10:16:20.676036] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.022 [2024-07-13 10:16:20.676065] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.022 qpair failed and we were unable to recover it. 00:30:15.022 [2024-07-13 10:16:20.685925] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.022 [2024-07-13 10:16:20.686048] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.022 [2024-07-13 10:16:20.686073] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.022 [2024-07-13 10:16:20.686088] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.022 [2024-07-13 10:16:20.686101] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.022 [2024-07-13 10:16:20.686131] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.022 qpair failed and we were unable to recover it. 00:30:15.022 [2024-07-13 10:16:20.695913] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.022 [2024-07-13 10:16:20.696052] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.022 [2024-07-13 10:16:20.696077] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.022 [2024-07-13 10:16:20.696093] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.022 [2024-07-13 10:16:20.696105] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.022 [2024-07-13 10:16:20.696135] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.022 qpair failed and we were unable to recover it. 00:30:15.022 [2024-07-13 10:16:20.705994] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.022 [2024-07-13 10:16:20.706125] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.022 [2024-07-13 10:16:20.706151] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.022 [2024-07-13 10:16:20.706166] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.022 [2024-07-13 10:16:20.706179] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.022 [2024-07-13 10:16:20.706209] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.022 qpair failed and we were unable to recover it. 00:30:15.022 [2024-07-13 10:16:20.715980] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.022 [2024-07-13 10:16:20.716142] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.022 [2024-07-13 10:16:20.716167] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.022 [2024-07-13 10:16:20.716182] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.022 [2024-07-13 10:16:20.716196] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.022 [2024-07-13 10:16:20.716225] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.022 qpair failed and we were unable to recover it. 00:30:15.022 [2024-07-13 10:16:20.726020] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.022 [2024-07-13 10:16:20.726151] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.022 [2024-07-13 10:16:20.726182] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.022 [2024-07-13 10:16:20.726198] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.022 [2024-07-13 10:16:20.726214] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.022 [2024-07-13 10:16:20.726258] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.022 qpair failed and we were unable to recover it. 00:30:15.022 [2024-07-13 10:16:20.736040] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.022 [2024-07-13 10:16:20.736161] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.022 [2024-07-13 10:16:20.736186] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.022 [2024-07-13 10:16:20.736201] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.022 [2024-07-13 10:16:20.736214] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.022 [2024-07-13 10:16:20.736244] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.022 qpair failed and we were unable to recover it. 00:30:15.022 [2024-07-13 10:16:20.746091] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.022 [2024-07-13 10:16:20.746228] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.022 [2024-07-13 10:16:20.746254] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.022 [2024-07-13 10:16:20.746269] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.022 [2024-07-13 10:16:20.746282] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.022 [2024-07-13 10:16:20.746311] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.022 qpair failed and we were unable to recover it. 00:30:15.022 [2024-07-13 10:16:20.756118] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.022 [2024-07-13 10:16:20.756244] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.022 [2024-07-13 10:16:20.756269] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.022 [2024-07-13 10:16:20.756284] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.022 [2024-07-13 10:16:20.756296] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.022 [2024-07-13 10:16:20.756326] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.022 qpair failed and we were unable to recover it. 00:30:15.022 [2024-07-13 10:16:20.766107] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.022 [2024-07-13 10:16:20.766226] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.022 [2024-07-13 10:16:20.766251] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.023 [2024-07-13 10:16:20.766266] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.023 [2024-07-13 10:16:20.766279] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.023 [2024-07-13 10:16:20.766314] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.023 qpair failed and we were unable to recover it. 00:30:15.023 [2024-07-13 10:16:20.776152] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.023 [2024-07-13 10:16:20.776311] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.023 [2024-07-13 10:16:20.776337] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.023 [2024-07-13 10:16:20.776353] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.023 [2024-07-13 10:16:20.776366] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.023 [2024-07-13 10:16:20.776395] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.023 qpair failed and we were unable to recover it. 00:30:15.023 [2024-07-13 10:16:20.786196] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.023 [2024-07-13 10:16:20.786322] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.023 [2024-07-13 10:16:20.786348] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.023 [2024-07-13 10:16:20.786362] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.023 [2024-07-13 10:16:20.786376] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.023 [2024-07-13 10:16:20.786405] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.023 qpair failed and we were unable to recover it. 00:30:15.023 [2024-07-13 10:16:20.796222] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.023 [2024-07-13 10:16:20.796348] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.023 [2024-07-13 10:16:20.796374] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.023 [2024-07-13 10:16:20.796389] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.023 [2024-07-13 10:16:20.796404] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.023 [2024-07-13 10:16:20.796433] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.023 qpair failed and we were unable to recover it. 00:30:15.023 [2024-07-13 10:16:20.806317] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.023 [2024-07-13 10:16:20.806442] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.023 [2024-07-13 10:16:20.806467] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.023 [2024-07-13 10:16:20.806483] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.023 [2024-07-13 10:16:20.806495] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.023 [2024-07-13 10:16:20.806524] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.023 qpair failed and we were unable to recover it. 00:30:15.023 [2024-07-13 10:16:20.816275] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.023 [2024-07-13 10:16:20.816408] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.023 [2024-07-13 10:16:20.816442] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.023 [2024-07-13 10:16:20.816460] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.023 [2024-07-13 10:16:20.816475] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.023 [2024-07-13 10:16:20.816519] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.023 qpair failed and we were unable to recover it. 00:30:15.023 [2024-07-13 10:16:20.826308] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.023 [2024-07-13 10:16:20.826440] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.023 [2024-07-13 10:16:20.826466] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.023 [2024-07-13 10:16:20.826481] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.023 [2024-07-13 10:16:20.826494] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.023 [2024-07-13 10:16:20.826523] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.023 qpair failed and we were unable to recover it. 00:30:15.023 [2024-07-13 10:16:20.836330] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.023 [2024-07-13 10:16:20.836454] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.023 [2024-07-13 10:16:20.836482] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.023 [2024-07-13 10:16:20.836497] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.023 [2024-07-13 10:16:20.836510] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.023 [2024-07-13 10:16:20.836540] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.023 qpair failed and we were unable to recover it. 00:30:15.281 [2024-07-13 10:16:20.846351] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.281 [2024-07-13 10:16:20.846474] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.281 [2024-07-13 10:16:20.846500] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.281 [2024-07-13 10:16:20.846515] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.281 [2024-07-13 10:16:20.846529] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.281 [2024-07-13 10:16:20.846558] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.281 qpair failed and we were unable to recover it. 00:30:15.281 [2024-07-13 10:16:20.856418] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.281 [2024-07-13 10:16:20.856549] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.281 [2024-07-13 10:16:20.856574] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.281 [2024-07-13 10:16:20.856590] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.281 [2024-07-13 10:16:20.856603] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.281 [2024-07-13 10:16:20.856638] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.281 qpair failed and we were unable to recover it. 00:30:15.281 [2024-07-13 10:16:20.866462] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.281 [2024-07-13 10:16:20.866592] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.281 [2024-07-13 10:16:20.866617] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.281 [2024-07-13 10:16:20.866632] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.281 [2024-07-13 10:16:20.866645] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.281 [2024-07-13 10:16:20.866675] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.281 qpair failed and we were unable to recover it. 00:30:15.281 [2024-07-13 10:16:20.876464] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.282 [2024-07-13 10:16:20.876601] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.282 [2024-07-13 10:16:20.876626] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.282 [2024-07-13 10:16:20.876641] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.282 [2024-07-13 10:16:20.876654] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.282 [2024-07-13 10:16:20.876698] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.282 qpair failed and we were unable to recover it. 00:30:15.282 [2024-07-13 10:16:20.886476] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.282 [2024-07-13 10:16:20.886610] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.282 [2024-07-13 10:16:20.886635] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.282 [2024-07-13 10:16:20.886650] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.282 [2024-07-13 10:16:20.886664] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.282 [2024-07-13 10:16:20.886693] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.282 qpair failed and we were unable to recover it. 00:30:15.282 [2024-07-13 10:16:20.896499] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.282 [2024-07-13 10:16:20.896621] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.282 [2024-07-13 10:16:20.896647] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.282 [2024-07-13 10:16:20.896662] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.282 [2024-07-13 10:16:20.896675] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.282 [2024-07-13 10:16:20.896705] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.282 qpair failed and we were unable to recover it. 00:30:15.282 [2024-07-13 10:16:20.906542] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.282 [2024-07-13 10:16:20.906673] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.282 [2024-07-13 10:16:20.906703] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.282 [2024-07-13 10:16:20.906719] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.282 [2024-07-13 10:16:20.906732] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.282 [2024-07-13 10:16:20.906762] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.282 qpair failed and we were unable to recover it. 00:30:15.282 [2024-07-13 10:16:20.916559] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.282 [2024-07-13 10:16:20.916691] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.282 [2024-07-13 10:16:20.916716] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.282 [2024-07-13 10:16:20.916731] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.282 [2024-07-13 10:16:20.916744] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.282 [2024-07-13 10:16:20.916774] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.282 qpair failed and we were unable to recover it. 00:30:15.282 [2024-07-13 10:16:20.926621] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.282 [2024-07-13 10:16:20.926761] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.282 [2024-07-13 10:16:20.926787] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.282 [2024-07-13 10:16:20.926802] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.282 [2024-07-13 10:16:20.926815] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.282 [2024-07-13 10:16:20.926860] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.282 qpair failed and we were unable to recover it. 00:30:15.282 [2024-07-13 10:16:20.936624] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.282 [2024-07-13 10:16:20.936759] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.282 [2024-07-13 10:16:20.936785] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.282 [2024-07-13 10:16:20.936800] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.282 [2024-07-13 10:16:20.936813] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.282 [2024-07-13 10:16:20.936842] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.282 qpair failed and we were unable to recover it. 00:30:15.282 [2024-07-13 10:16:20.946652] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.282 [2024-07-13 10:16:20.946781] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.282 [2024-07-13 10:16:20.946805] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.282 [2024-07-13 10:16:20.946820] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.282 [2024-07-13 10:16:20.946833] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.282 [2024-07-13 10:16:20.946874] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.282 qpair failed and we were unable to recover it. 00:30:15.282 [2024-07-13 10:16:20.956688] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.282 [2024-07-13 10:16:20.956829] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.282 [2024-07-13 10:16:20.956854] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.282 [2024-07-13 10:16:20.956880] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.282 [2024-07-13 10:16:20.956896] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.282 [2024-07-13 10:16:20.956925] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.282 qpair failed and we were unable to recover it. 00:30:15.282 [2024-07-13 10:16:20.966736] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.282 [2024-07-13 10:16:20.966859] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.282 [2024-07-13 10:16:20.966893] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.282 [2024-07-13 10:16:20.966909] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.282 [2024-07-13 10:16:20.966922] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.282 [2024-07-13 10:16:20.966952] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.282 qpair failed and we were unable to recover it. 00:30:15.282 [2024-07-13 10:16:20.976791] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.282 [2024-07-13 10:16:20.976922] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.282 [2024-07-13 10:16:20.976948] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.282 [2024-07-13 10:16:20.976963] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.282 [2024-07-13 10:16:20.976976] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.282 [2024-07-13 10:16:20.977006] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.282 qpair failed and we were unable to recover it. 00:30:15.282 [2024-07-13 10:16:20.986802] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.282 [2024-07-13 10:16:20.986939] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.282 [2024-07-13 10:16:20.986964] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.282 [2024-07-13 10:16:20.986979] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.282 [2024-07-13 10:16:20.986992] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.282 [2024-07-13 10:16:20.987022] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.282 qpair failed and we were unable to recover it. 00:30:15.282 [2024-07-13 10:16:20.996809] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.282 [2024-07-13 10:16:20.996945] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.282 [2024-07-13 10:16:20.996976] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.282 [2024-07-13 10:16:20.996992] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.282 [2024-07-13 10:16:20.997005] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.282 [2024-07-13 10:16:20.997035] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.282 qpair failed and we were unable to recover it. 00:30:15.282 [2024-07-13 10:16:21.006849] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.282 [2024-07-13 10:16:21.006982] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.282 [2024-07-13 10:16:21.007008] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.282 [2024-07-13 10:16:21.007024] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.282 [2024-07-13 10:16:21.007038] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.282 [2024-07-13 10:16:21.007067] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.282 qpair failed and we were unable to recover it. 00:30:15.282 [2024-07-13 10:16:21.016880] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.282 [2024-07-13 10:16:21.017004] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.282 [2024-07-13 10:16:21.017030] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.282 [2024-07-13 10:16:21.017046] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.283 [2024-07-13 10:16:21.017058] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.283 [2024-07-13 10:16:21.017086] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.283 qpair failed and we were unable to recover it. 00:30:15.283 [2024-07-13 10:16:21.026882] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.283 [2024-07-13 10:16:21.027010] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.283 [2024-07-13 10:16:21.027035] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.283 [2024-07-13 10:16:21.027050] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.283 [2024-07-13 10:16:21.027064] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.283 [2024-07-13 10:16:21.027092] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.283 qpair failed and we were unable to recover it. 00:30:15.283 [2024-07-13 10:16:21.036917] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.283 [2024-07-13 10:16:21.037046] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.283 [2024-07-13 10:16:21.037071] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.283 [2024-07-13 10:16:21.037086] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.283 [2024-07-13 10:16:21.037105] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.283 [2024-07-13 10:16:21.037134] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.283 qpair failed and we were unable to recover it. 00:30:15.283 [2024-07-13 10:16:21.046978] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.283 [2024-07-13 10:16:21.047105] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.283 [2024-07-13 10:16:21.047130] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.283 [2024-07-13 10:16:21.047145] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.283 [2024-07-13 10:16:21.047158] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.283 [2024-07-13 10:16:21.047203] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.283 qpair failed and we were unable to recover it. 00:30:15.283 [2024-07-13 10:16:21.057002] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.283 [2024-07-13 10:16:21.057127] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.283 [2024-07-13 10:16:21.057152] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.283 [2024-07-13 10:16:21.057167] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.283 [2024-07-13 10:16:21.057180] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.283 [2024-07-13 10:16:21.057210] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.283 qpair failed and we were unable to recover it. 00:30:15.283 [2024-07-13 10:16:21.067036] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.283 [2024-07-13 10:16:21.067163] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.283 [2024-07-13 10:16:21.067188] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.283 [2024-07-13 10:16:21.067204] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.283 [2024-07-13 10:16:21.067217] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.283 [2024-07-13 10:16:21.067246] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.283 qpair failed and we were unable to recover it. 00:30:15.283 [2024-07-13 10:16:21.077031] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.283 [2024-07-13 10:16:21.077158] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.283 [2024-07-13 10:16:21.077182] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.283 [2024-07-13 10:16:21.077197] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.283 [2024-07-13 10:16:21.077209] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.283 [2024-07-13 10:16:21.077237] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.283 qpair failed and we were unable to recover it. 00:30:15.283 [2024-07-13 10:16:21.087185] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.283 [2024-07-13 10:16:21.087341] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.283 [2024-07-13 10:16:21.087365] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.283 [2024-07-13 10:16:21.087380] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.283 [2024-07-13 10:16:21.087393] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.283 [2024-07-13 10:16:21.087436] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.283 qpair failed and we were unable to recover it. 00:30:15.283 [2024-07-13 10:16:21.097080] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.283 [2024-07-13 10:16:21.097216] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.283 [2024-07-13 10:16:21.097243] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.283 [2024-07-13 10:16:21.097258] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.283 [2024-07-13 10:16:21.097271] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.283 [2024-07-13 10:16:21.097302] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.283 qpair failed and we were unable to recover it. 00:30:15.542 [2024-07-13 10:16:21.107167] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.542 [2024-07-13 10:16:21.107300] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.542 [2024-07-13 10:16:21.107328] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.542 [2024-07-13 10:16:21.107347] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.542 [2024-07-13 10:16:21.107362] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.542 [2024-07-13 10:16:21.107392] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.542 qpair failed and we were unable to recover it. 00:30:15.542 [2024-07-13 10:16:21.117137] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.542 [2024-07-13 10:16:21.117272] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.542 [2024-07-13 10:16:21.117298] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.542 [2024-07-13 10:16:21.117313] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.542 [2024-07-13 10:16:21.117328] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.542 [2024-07-13 10:16:21.117356] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.542 qpair failed and we were unable to recover it. 00:30:15.542 [2024-07-13 10:16:21.127202] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.543 [2024-07-13 10:16:21.127330] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.543 [2024-07-13 10:16:21.127356] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.543 [2024-07-13 10:16:21.127371] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.543 [2024-07-13 10:16:21.127394] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.543 [2024-07-13 10:16:21.127424] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.543 qpair failed and we were unable to recover it. 00:30:15.543 [2024-07-13 10:16:21.137189] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.543 [2024-07-13 10:16:21.137313] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.543 [2024-07-13 10:16:21.137339] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.543 [2024-07-13 10:16:21.137354] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.543 [2024-07-13 10:16:21.137369] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.543 [2024-07-13 10:16:21.137397] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.543 qpair failed and we were unable to recover it. 00:30:15.543 [2024-07-13 10:16:21.147235] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.543 [2024-07-13 10:16:21.147359] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.543 [2024-07-13 10:16:21.147384] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.543 [2024-07-13 10:16:21.147399] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.543 [2024-07-13 10:16:21.147413] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.543 [2024-07-13 10:16:21.147441] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.543 qpair failed and we were unable to recover it. 00:30:15.543 [2024-07-13 10:16:21.157270] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.543 [2024-07-13 10:16:21.157397] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.543 [2024-07-13 10:16:21.157422] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.543 [2024-07-13 10:16:21.157437] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.543 [2024-07-13 10:16:21.157450] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.543 [2024-07-13 10:16:21.157478] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.543 qpair failed and we were unable to recover it. 00:30:15.543 [2024-07-13 10:16:21.167277] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.543 [2024-07-13 10:16:21.167401] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.543 [2024-07-13 10:16:21.167426] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.543 [2024-07-13 10:16:21.167441] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.543 [2024-07-13 10:16:21.167454] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.543 [2024-07-13 10:16:21.167482] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.543 qpair failed and we were unable to recover it. 00:30:15.543 [2024-07-13 10:16:21.177336] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.543 [2024-07-13 10:16:21.177461] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.543 [2024-07-13 10:16:21.177487] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.543 [2024-07-13 10:16:21.177502] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.543 [2024-07-13 10:16:21.177515] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.543 [2024-07-13 10:16:21.177543] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.543 qpair failed and we were unable to recover it. 00:30:15.543 [2024-07-13 10:16:21.187351] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.543 [2024-07-13 10:16:21.187484] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.543 [2024-07-13 10:16:21.187509] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.543 [2024-07-13 10:16:21.187524] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.543 [2024-07-13 10:16:21.187537] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.543 [2024-07-13 10:16:21.187565] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.543 qpair failed and we were unable to recover it. 00:30:15.543 [2024-07-13 10:16:21.197411] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.543 [2024-07-13 10:16:21.197530] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.543 [2024-07-13 10:16:21.197556] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.543 [2024-07-13 10:16:21.197570] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.543 [2024-07-13 10:16:21.197582] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.543 [2024-07-13 10:16:21.197609] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.543 qpair failed and we were unable to recover it. 00:30:15.543 [2024-07-13 10:16:21.207444] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.543 [2024-07-13 10:16:21.207610] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.543 [2024-07-13 10:16:21.207635] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.543 [2024-07-13 10:16:21.207649] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.543 [2024-07-13 10:16:21.207662] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.543 [2024-07-13 10:16:21.207690] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.543 qpair failed and we were unable to recover it. 00:30:15.543 [2024-07-13 10:16:21.217422] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.543 [2024-07-13 10:16:21.217544] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.543 [2024-07-13 10:16:21.217571] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.543 [2024-07-13 10:16:21.217585] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.543 [2024-07-13 10:16:21.217604] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.543 [2024-07-13 10:16:21.217632] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.543 qpair failed and we were unable to recover it. 00:30:15.543 [2024-07-13 10:16:21.227492] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.543 [2024-07-13 10:16:21.227620] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.543 [2024-07-13 10:16:21.227646] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.543 [2024-07-13 10:16:21.227660] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.543 [2024-07-13 10:16:21.227673] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.543 [2024-07-13 10:16:21.227701] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.543 qpair failed and we were unable to recover it. 00:30:15.543 [2024-07-13 10:16:21.237501] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:15.543 [2024-07-13 10:16:21.237621] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:15.543 [2024-07-13 10:16:21.237646] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:15.543 [2024-07-13 10:16:21.237660] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:15.543 [2024-07-13 10:16:21.237673] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x17f8350 00:30:15.543 [2024-07-13 10:16:21.237701] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:15.543 qpair failed and we were unable to recover it. 00:30:15.543 [2024-07-13 10:16:21.237801] nvme_ctrlr.c:4339:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:30:15.543 A controller has encountered a failure and is being reset. 00:30:15.803 Controller properly reset. 00:30:15.803 Initializing NVMe Controllers 00:30:15.803 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:30:15.803 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:30:15.803 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:30:15.803 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:30:15.803 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:30:15.803 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:30:15.803 Initialization complete. Launching workers. 00:30:15.803 Starting thread on core 1 00:30:15.803 Starting thread on core 2 00:30:15.803 Starting thread on core 3 00:30:15.803 Starting thread on core 0 00:30:15.803 10:16:21 -- host/target_disconnect.sh@59 -- # sync 00:30:15.803 00:30:15.803 real 0m11.537s 00:30:15.803 user 0m21.130s 00:30:15.803 sys 0m5.404s 00:30:15.803 10:16:21 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:30:15.803 10:16:21 -- common/autotest_common.sh@10 -- # set +x 00:30:15.803 ************************************ 00:30:15.803 END TEST nvmf_target_disconnect_tc2 00:30:15.803 ************************************ 00:30:15.803 10:16:21 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:30:15.803 10:16:21 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:30:15.803 10:16:21 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:30:15.803 10:16:21 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:15.803 10:16:21 -- nvmf/common.sh@116 -- # sync 00:30:15.803 10:16:21 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:15.803 10:16:21 -- nvmf/common.sh@119 -- # set +e 00:30:15.803 10:16:21 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:15.803 10:16:21 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:15.803 rmmod nvme_tcp 00:30:15.803 rmmod nvme_fabrics 00:30:15.803 rmmod nvme_keyring 00:30:15.803 10:16:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:15.803 10:16:21 -- nvmf/common.sh@123 -- # set -e 00:30:15.803 10:16:21 -- nvmf/common.sh@124 -- # return 0 00:30:15.803 10:16:21 -- nvmf/common.sh@477 -- # '[' -n 2942344 ']' 00:30:15.803 10:16:21 -- nvmf/common.sh@478 -- # killprocess 2942344 00:30:15.803 10:16:21 -- common/autotest_common.sh@926 -- # '[' -z 2942344 ']' 00:30:15.803 10:16:21 -- common/autotest_common.sh@930 -- # kill -0 2942344 00:30:15.803 10:16:21 -- common/autotest_common.sh@931 -- # uname 00:30:15.803 10:16:21 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:30:15.803 10:16:21 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2942344 00:30:15.803 10:16:21 -- common/autotest_common.sh@932 -- # process_name=reactor_4 00:30:15.803 10:16:21 -- common/autotest_common.sh@936 -- # '[' reactor_4 = sudo ']' 00:30:15.803 10:16:21 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2942344' 00:30:15.803 killing process with pid 2942344 00:30:15.803 10:16:21 -- common/autotest_common.sh@945 -- # kill 2942344 00:30:15.803 10:16:21 -- common/autotest_common.sh@950 -- # wait 2942344 00:30:16.062 10:16:21 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:16.062 10:16:21 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:16.062 10:16:21 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:16.062 10:16:21 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:16.062 10:16:21 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:16.062 10:16:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:16.062 10:16:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:16.062 10:16:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:18.596 10:16:23 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:18.596 00:30:18.596 real 0m16.124s 00:30:18.596 user 0m47.455s 00:30:18.596 sys 0m7.242s 00:30:18.596 10:16:23 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:30:18.596 10:16:23 -- common/autotest_common.sh@10 -- # set +x 00:30:18.596 ************************************ 00:30:18.596 END TEST nvmf_target_disconnect 00:30:18.596 ************************************ 00:30:18.596 10:16:23 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:30:18.596 10:16:23 -- common/autotest_common.sh@718 -- # xtrace_disable 00:30:18.596 10:16:23 -- common/autotest_common.sh@10 -- # set +x 00:30:18.596 10:16:23 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:30:18.596 00:30:18.596 real 22m27.537s 00:30:18.596 user 64m45.981s 00:30:18.596 sys 5m38.199s 00:30:18.596 10:16:23 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:30:18.596 10:16:23 -- common/autotest_common.sh@10 -- # set +x 00:30:18.596 ************************************ 00:30:18.596 END TEST nvmf_tcp 00:30:18.596 ************************************ 00:30:18.596 10:16:23 -- spdk/autotest.sh@296 -- # [[ 0 -eq 0 ]] 00:30:18.596 10:16:23 -- spdk/autotest.sh@297 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:30:18.596 10:16:23 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:30:18.596 10:16:23 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:30:18.596 10:16:23 -- common/autotest_common.sh@10 -- # set +x 00:30:18.596 ************************************ 00:30:18.596 START TEST spdkcli_nvmf_tcp 00:30:18.596 ************************************ 00:30:18.596 10:16:23 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:30:18.596 * Looking for test storage... 00:30:18.596 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:30:18.596 10:16:23 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:30:18.596 10:16:23 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:30:18.596 10:16:23 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:30:18.596 10:16:23 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:18.596 10:16:23 -- nvmf/common.sh@7 -- # uname -s 00:30:18.596 10:16:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:18.596 10:16:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:18.596 10:16:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:18.596 10:16:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:18.596 10:16:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:18.596 10:16:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:18.596 10:16:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:18.596 10:16:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:18.596 10:16:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:18.596 10:16:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:18.596 10:16:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:18.596 10:16:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:18.596 10:16:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:18.596 10:16:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:18.596 10:16:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:18.596 10:16:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:18.596 10:16:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:18.596 10:16:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:18.596 10:16:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:18.596 10:16:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:18.596 10:16:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:18.596 10:16:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:18.596 10:16:23 -- paths/export.sh@5 -- # export PATH 00:30:18.596 10:16:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:18.596 10:16:23 -- nvmf/common.sh@46 -- # : 0 00:30:18.596 10:16:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:18.596 10:16:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:18.596 10:16:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:18.596 10:16:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:18.596 10:16:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:18.596 10:16:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:18.596 10:16:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:18.596 10:16:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:18.596 10:16:23 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:30:18.596 10:16:23 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:30:18.596 10:16:23 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:30:18.596 10:16:23 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:30:18.596 10:16:23 -- common/autotest_common.sh@712 -- # xtrace_disable 00:30:18.596 10:16:23 -- common/autotest_common.sh@10 -- # set +x 00:30:18.596 10:16:23 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:30:18.596 10:16:23 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=2943565 00:30:18.596 10:16:23 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:30:18.596 10:16:23 -- spdkcli/common.sh@34 -- # waitforlisten 2943565 00:30:18.596 10:16:23 -- common/autotest_common.sh@819 -- # '[' -z 2943565 ']' 00:30:18.596 10:16:23 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:18.596 10:16:23 -- common/autotest_common.sh@824 -- # local max_retries=100 00:30:18.596 10:16:23 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:18.596 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:18.596 10:16:23 -- common/autotest_common.sh@828 -- # xtrace_disable 00:30:18.596 10:16:23 -- common/autotest_common.sh@10 -- # set +x 00:30:18.596 [2024-07-13 10:16:23.999442] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:30:18.596 [2024-07-13 10:16:23.999538] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2943565 ] 00:30:18.596 EAL: No free 2048 kB hugepages reported on node 1 00:30:18.596 [2024-07-13 10:16:24.056351] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:30:18.596 [2024-07-13 10:16:24.138784] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:18.596 [2024-07-13 10:16:24.139003] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:18.596 [2024-07-13 10:16:24.139008] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:19.160 10:16:24 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:30:19.160 10:16:24 -- common/autotest_common.sh@852 -- # return 0 00:30:19.160 10:16:24 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:30:19.160 10:16:24 -- common/autotest_common.sh@718 -- # xtrace_disable 00:30:19.160 10:16:24 -- common/autotest_common.sh@10 -- # set +x 00:30:19.160 10:16:24 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:30:19.160 10:16:24 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:30:19.160 10:16:24 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:30:19.160 10:16:24 -- common/autotest_common.sh@712 -- # xtrace_disable 00:30:19.160 10:16:24 -- common/autotest_common.sh@10 -- # set +x 00:30:19.160 10:16:24 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:30:19.160 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:30:19.160 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:30:19.160 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:30:19.160 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:30:19.160 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:30:19.160 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:30:19.160 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:30:19.160 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:30:19.160 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:30:19.160 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:19.160 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:19.160 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:30:19.160 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:19.160 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:19.160 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:30:19.160 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:19.160 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:30:19.160 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:30:19.160 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:19.160 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:30:19.160 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:30:19.161 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:30:19.161 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:30:19.161 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:19.161 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:30:19.161 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:30:19.161 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:30:19.161 ' 00:30:19.725 [2024-07-13 10:16:25.299552] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:30:22.253 [2024-07-13 10:16:27.458263] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:23.185 [2024-07-13 10:16:28.682549] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:30:25.772 [2024-07-13 10:16:30.973994] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:30:27.144 [2024-07-13 10:16:32.944323] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:30:29.040 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:30:29.040 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:30:29.040 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:30:29.040 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:30:29.040 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:30:29.040 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:30:29.040 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:30:29.040 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:30:29.040 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:30:29.040 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:30:29.040 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:30:29.040 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:29.040 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:30:29.040 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:30:29.040 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:29.040 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:30:29.040 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:30:29.040 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:30:29.040 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:30:29.040 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:29.040 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:30:29.040 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:30:29.040 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:30:29.040 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:30:29.040 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:29.040 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:30:29.040 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:30:29.040 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:30:29.040 10:16:34 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:30:29.040 10:16:34 -- common/autotest_common.sh@718 -- # xtrace_disable 00:30:29.040 10:16:34 -- common/autotest_common.sh@10 -- # set +x 00:30:29.040 10:16:34 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:30:29.040 10:16:34 -- common/autotest_common.sh@712 -- # xtrace_disable 00:30:29.040 10:16:34 -- common/autotest_common.sh@10 -- # set +x 00:30:29.040 10:16:34 -- spdkcli/nvmf.sh@69 -- # check_match 00:30:29.040 10:16:34 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:30:29.297 10:16:34 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:30:29.297 10:16:35 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:30:29.297 10:16:35 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:30:29.297 10:16:35 -- common/autotest_common.sh@718 -- # xtrace_disable 00:30:29.297 10:16:35 -- common/autotest_common.sh@10 -- # set +x 00:30:29.297 10:16:35 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:30:29.297 10:16:35 -- common/autotest_common.sh@712 -- # xtrace_disable 00:30:29.297 10:16:35 -- common/autotest_common.sh@10 -- # set +x 00:30:29.297 10:16:35 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:30:29.297 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:30:29.297 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:30:29.297 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:30:29.297 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:30:29.297 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:30:29.297 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:30:29.297 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:30:29.297 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:30:29.297 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:30:29.297 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:30:29.297 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:30:29.297 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:30:29.297 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:30:29.297 ' 00:30:34.552 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:30:34.552 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:30:34.552 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:30:34.552 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:30:34.552 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:30:34.552 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:30:34.552 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:30:34.552 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:30:34.552 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:30:34.552 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:30:34.552 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:30:34.552 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:30:34.552 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:30:34.552 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:30:34.552 10:16:40 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:30:34.552 10:16:40 -- common/autotest_common.sh@718 -- # xtrace_disable 00:30:34.552 10:16:40 -- common/autotest_common.sh@10 -- # set +x 00:30:34.552 10:16:40 -- spdkcli/nvmf.sh@90 -- # killprocess 2943565 00:30:34.552 10:16:40 -- common/autotest_common.sh@926 -- # '[' -z 2943565 ']' 00:30:34.552 10:16:40 -- common/autotest_common.sh@930 -- # kill -0 2943565 00:30:34.552 10:16:40 -- common/autotest_common.sh@931 -- # uname 00:30:34.552 10:16:40 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:30:34.552 10:16:40 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2943565 00:30:34.552 10:16:40 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:30:34.552 10:16:40 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:30:34.552 10:16:40 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2943565' 00:30:34.552 killing process with pid 2943565 00:30:34.552 10:16:40 -- common/autotest_common.sh@945 -- # kill 2943565 00:30:34.552 [2024-07-13 10:16:40.285091] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:30:34.552 10:16:40 -- common/autotest_common.sh@950 -- # wait 2943565 00:30:34.811 10:16:40 -- spdkcli/nvmf.sh@1 -- # cleanup 00:30:34.811 10:16:40 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:30:34.811 10:16:40 -- spdkcli/common.sh@13 -- # '[' -n 2943565 ']' 00:30:34.811 10:16:40 -- spdkcli/common.sh@14 -- # killprocess 2943565 00:30:34.811 10:16:40 -- common/autotest_common.sh@926 -- # '[' -z 2943565 ']' 00:30:34.811 10:16:40 -- common/autotest_common.sh@930 -- # kill -0 2943565 00:30:34.811 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (2943565) - No such process 00:30:34.811 10:16:40 -- common/autotest_common.sh@953 -- # echo 'Process with pid 2943565 is not found' 00:30:34.811 Process with pid 2943565 is not found 00:30:34.811 10:16:40 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:30:34.811 10:16:40 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:30:34.811 10:16:40 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:30:34.811 00:30:34.811 real 0m16.605s 00:30:34.811 user 0m35.171s 00:30:34.811 sys 0m0.805s 00:30:34.811 10:16:40 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:30:34.811 10:16:40 -- common/autotest_common.sh@10 -- # set +x 00:30:34.811 ************************************ 00:30:34.811 END TEST spdkcli_nvmf_tcp 00:30:34.811 ************************************ 00:30:34.811 10:16:40 -- spdk/autotest.sh@298 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:30:34.811 10:16:40 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:30:34.811 10:16:40 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:30:34.811 10:16:40 -- common/autotest_common.sh@10 -- # set +x 00:30:34.811 ************************************ 00:30:34.811 START TEST nvmf_identify_passthru 00:30:34.811 ************************************ 00:30:34.811 10:16:40 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:30:34.811 * Looking for test storage... 00:30:34.811 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:30:34.811 10:16:40 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:34.811 10:16:40 -- nvmf/common.sh@7 -- # uname -s 00:30:34.811 10:16:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:34.811 10:16:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:34.811 10:16:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:34.811 10:16:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:34.811 10:16:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:34.811 10:16:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:34.811 10:16:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:34.811 10:16:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:34.811 10:16:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:34.811 10:16:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:34.811 10:16:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:34.811 10:16:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:34.811 10:16:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:34.811 10:16:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:34.811 10:16:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:34.811 10:16:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:34.811 10:16:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:34.811 10:16:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:34.811 10:16:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:34.811 10:16:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:34.811 10:16:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:34.811 10:16:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:34.811 10:16:40 -- paths/export.sh@5 -- # export PATH 00:30:34.811 10:16:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:34.811 10:16:40 -- nvmf/common.sh@46 -- # : 0 00:30:34.811 10:16:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:34.811 10:16:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:34.811 10:16:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:34.811 10:16:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:34.811 10:16:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:34.812 10:16:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:34.812 10:16:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:34.812 10:16:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:34.812 10:16:40 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:34.812 10:16:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:34.812 10:16:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:34.812 10:16:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:34.812 10:16:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:34.812 10:16:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:34.812 10:16:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:34.812 10:16:40 -- paths/export.sh@5 -- # export PATH 00:30:34.812 10:16:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:34.812 10:16:40 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:30:34.812 10:16:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:34.812 10:16:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:34.812 10:16:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:34.812 10:16:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:34.812 10:16:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:34.812 10:16:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:34.812 10:16:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:30:34.812 10:16:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:34.812 10:16:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:34.812 10:16:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:34.812 10:16:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:34.812 10:16:40 -- common/autotest_common.sh@10 -- # set +x 00:30:36.714 10:16:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:36.714 10:16:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:36.714 10:16:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:36.714 10:16:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:36.714 10:16:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:36.714 10:16:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:36.714 10:16:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:36.714 10:16:42 -- nvmf/common.sh@294 -- # net_devs=() 00:30:36.714 10:16:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:36.714 10:16:42 -- nvmf/common.sh@295 -- # e810=() 00:30:36.714 10:16:42 -- nvmf/common.sh@295 -- # local -ga e810 00:30:36.714 10:16:42 -- nvmf/common.sh@296 -- # x722=() 00:30:36.714 10:16:42 -- nvmf/common.sh@296 -- # local -ga x722 00:30:36.714 10:16:42 -- nvmf/common.sh@297 -- # mlx=() 00:30:36.714 10:16:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:36.714 10:16:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:36.714 10:16:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:36.714 10:16:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:36.714 10:16:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:36.714 10:16:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:36.714 10:16:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:36.714 10:16:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:36.714 10:16:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:36.714 10:16:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:36.714 10:16:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:36.714 10:16:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:36.714 10:16:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:36.714 10:16:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:36.714 10:16:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:36.714 10:16:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:36.714 10:16:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:36.714 10:16:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:36.714 10:16:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:36.714 10:16:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:30:36.714 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:30:36.714 10:16:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:36.714 10:16:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:36.714 10:16:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:36.714 10:16:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:36.714 10:16:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:36.714 10:16:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:36.714 10:16:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:30:36.714 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:30:36.714 10:16:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:36.714 10:16:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:36.714 10:16:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:36.714 10:16:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:36.714 10:16:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:36.714 10:16:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:36.714 10:16:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:36.714 10:16:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:36.714 10:16:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:36.714 10:16:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:36.714 10:16:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:36.714 10:16:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:36.715 10:16:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:30:36.715 Found net devices under 0000:0a:00.0: cvl_0_0 00:30:36.715 10:16:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:36.715 10:16:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:36.715 10:16:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:36.715 10:16:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:36.715 10:16:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:36.715 10:16:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:30:36.715 Found net devices under 0000:0a:00.1: cvl_0_1 00:30:36.715 10:16:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:36.715 10:16:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:36.715 10:16:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:36.715 10:16:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:36.715 10:16:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:36.715 10:16:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:36.715 10:16:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:36.715 10:16:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:36.715 10:16:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:36.715 10:16:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:36.715 10:16:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:36.715 10:16:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:36.715 10:16:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:36.715 10:16:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:36.715 10:16:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:36.715 10:16:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:36.715 10:16:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:36.715 10:16:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:36.715 10:16:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:36.715 10:16:42 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:36.715 10:16:42 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:36.715 10:16:42 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:36.715 10:16:42 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:36.975 10:16:42 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:36.975 10:16:42 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:36.975 10:16:42 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:36.975 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:36.975 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.106 ms 00:30:36.975 00:30:36.975 --- 10.0.0.2 ping statistics --- 00:30:36.975 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:36.975 rtt min/avg/max/mdev = 0.106/0.106/0.106/0.000 ms 00:30:36.975 10:16:42 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:36.975 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:36.975 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.120 ms 00:30:36.975 00:30:36.975 --- 10.0.0.1 ping statistics --- 00:30:36.975 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:36.975 rtt min/avg/max/mdev = 0.120/0.120/0.120/0.000 ms 00:30:36.975 10:16:42 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:36.975 10:16:42 -- nvmf/common.sh@410 -- # return 0 00:30:36.975 10:16:42 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:36.975 10:16:42 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:36.975 10:16:42 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:36.975 10:16:42 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:36.975 10:16:42 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:36.975 10:16:42 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:36.975 10:16:42 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:36.975 10:16:42 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:30:36.975 10:16:42 -- common/autotest_common.sh@712 -- # xtrace_disable 00:30:36.975 10:16:42 -- common/autotest_common.sh@10 -- # set +x 00:30:36.975 10:16:42 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:30:36.975 10:16:42 -- common/autotest_common.sh@1509 -- # bdfs=() 00:30:36.975 10:16:42 -- common/autotest_common.sh@1509 -- # local bdfs 00:30:36.975 10:16:42 -- common/autotest_common.sh@1510 -- # bdfs=($(get_nvme_bdfs)) 00:30:36.975 10:16:42 -- common/autotest_common.sh@1510 -- # get_nvme_bdfs 00:30:36.975 10:16:42 -- common/autotest_common.sh@1498 -- # bdfs=() 00:30:36.975 10:16:42 -- common/autotest_common.sh@1498 -- # local bdfs 00:30:36.975 10:16:42 -- common/autotest_common.sh@1499 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:30:36.975 10:16:42 -- common/autotest_common.sh@1499 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:30:36.975 10:16:42 -- common/autotest_common.sh@1499 -- # jq -r '.config[].params.traddr' 00:30:36.975 10:16:42 -- common/autotest_common.sh@1500 -- # (( 1 == 0 )) 00:30:36.975 10:16:42 -- common/autotest_common.sh@1504 -- # printf '%s\n' 0000:88:00.0 00:30:36.975 10:16:42 -- common/autotest_common.sh@1512 -- # echo 0000:88:00.0 00:30:36.975 10:16:42 -- target/identify_passthru.sh@16 -- # bdf=0000:88:00.0 00:30:36.975 10:16:42 -- target/identify_passthru.sh@17 -- # '[' -z 0000:88:00.0 ']' 00:30:36.975 10:16:42 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:30:36.975 10:16:42 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:30:36.975 10:16:42 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:30:36.975 EAL: No free 2048 kB hugepages reported on node 1 00:30:41.160 10:16:46 -- target/identify_passthru.sh@23 -- # nvme_serial_number=PHLJ916004901P0FGN 00:30:41.160 10:16:46 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:30:41.160 10:16:46 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:30:41.160 10:16:46 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:30:41.160 EAL: No free 2048 kB hugepages reported on node 1 00:30:45.343 10:16:51 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:30:45.343 10:16:51 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:30:45.343 10:16:51 -- common/autotest_common.sh@718 -- # xtrace_disable 00:30:45.343 10:16:51 -- common/autotest_common.sh@10 -- # set +x 00:30:45.343 10:16:51 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:30:45.343 10:16:51 -- common/autotest_common.sh@712 -- # xtrace_disable 00:30:45.343 10:16:51 -- common/autotest_common.sh@10 -- # set +x 00:30:45.343 10:16:51 -- target/identify_passthru.sh@31 -- # nvmfpid=2948287 00:30:45.343 10:16:51 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:30:45.343 10:16:51 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:30:45.343 10:16:51 -- target/identify_passthru.sh@35 -- # waitforlisten 2948287 00:30:45.343 10:16:51 -- common/autotest_common.sh@819 -- # '[' -z 2948287 ']' 00:30:45.343 10:16:51 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:45.343 10:16:51 -- common/autotest_common.sh@824 -- # local max_retries=100 00:30:45.343 10:16:51 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:45.343 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:45.343 10:16:51 -- common/autotest_common.sh@828 -- # xtrace_disable 00:30:45.343 10:16:51 -- common/autotest_common.sh@10 -- # set +x 00:30:45.343 [2024-07-13 10:16:51.106130] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:30:45.343 [2024-07-13 10:16:51.106225] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:45.343 EAL: No free 2048 kB hugepages reported on node 1 00:30:45.602 [2024-07-13 10:16:51.171904] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:45.602 [2024-07-13 10:16:51.257504] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:45.602 [2024-07-13 10:16:51.257646] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:45.602 [2024-07-13 10:16:51.257663] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:45.602 [2024-07-13 10:16:51.257675] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:45.602 [2024-07-13 10:16:51.257727] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:45.602 [2024-07-13 10:16:51.257759] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:30:45.602 [2024-07-13 10:16:51.257881] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:30:45.602 [2024-07-13 10:16:51.257885] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:45.602 10:16:51 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:30:45.602 10:16:51 -- common/autotest_common.sh@852 -- # return 0 00:30:45.602 10:16:51 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:30:45.602 10:16:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:45.602 10:16:51 -- common/autotest_common.sh@10 -- # set +x 00:30:45.602 INFO: Log level set to 20 00:30:45.602 INFO: Requests: 00:30:45.602 { 00:30:45.602 "jsonrpc": "2.0", 00:30:45.602 "method": "nvmf_set_config", 00:30:45.602 "id": 1, 00:30:45.602 "params": { 00:30:45.602 "admin_cmd_passthru": { 00:30:45.602 "identify_ctrlr": true 00:30:45.602 } 00:30:45.602 } 00:30:45.602 } 00:30:45.602 00:30:45.602 INFO: response: 00:30:45.602 { 00:30:45.602 "jsonrpc": "2.0", 00:30:45.602 "id": 1, 00:30:45.602 "result": true 00:30:45.602 } 00:30:45.602 00:30:45.602 10:16:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:45.602 10:16:51 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:30:45.602 10:16:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:45.602 10:16:51 -- common/autotest_common.sh@10 -- # set +x 00:30:45.602 INFO: Setting log level to 20 00:30:45.602 INFO: Setting log level to 20 00:30:45.602 INFO: Log level set to 20 00:30:45.602 INFO: Log level set to 20 00:30:45.602 INFO: Requests: 00:30:45.602 { 00:30:45.602 "jsonrpc": "2.0", 00:30:45.602 "method": "framework_start_init", 00:30:45.602 "id": 1 00:30:45.602 } 00:30:45.602 00:30:45.602 INFO: Requests: 00:30:45.602 { 00:30:45.602 "jsonrpc": "2.0", 00:30:45.602 "method": "framework_start_init", 00:30:45.602 "id": 1 00:30:45.602 } 00:30:45.602 00:30:45.860 [2024-07-13 10:16:51.443141] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:30:45.860 INFO: response: 00:30:45.860 { 00:30:45.860 "jsonrpc": "2.0", 00:30:45.860 "id": 1, 00:30:45.860 "result": true 00:30:45.860 } 00:30:45.860 00:30:45.860 INFO: response: 00:30:45.860 { 00:30:45.860 "jsonrpc": "2.0", 00:30:45.860 "id": 1, 00:30:45.860 "result": true 00:30:45.860 } 00:30:45.860 00:30:45.860 10:16:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:45.860 10:16:51 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:45.860 10:16:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:45.861 10:16:51 -- common/autotest_common.sh@10 -- # set +x 00:30:45.861 INFO: Setting log level to 40 00:30:45.861 INFO: Setting log level to 40 00:30:45.861 INFO: Setting log level to 40 00:30:45.861 [2024-07-13 10:16:51.453069] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:45.861 10:16:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:45.861 10:16:51 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:30:45.861 10:16:51 -- common/autotest_common.sh@718 -- # xtrace_disable 00:30:45.861 10:16:51 -- common/autotest_common.sh@10 -- # set +x 00:30:45.861 10:16:51 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 00:30:45.861 10:16:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:45.861 10:16:51 -- common/autotest_common.sh@10 -- # set +x 00:30:49.168 Nvme0n1 00:30:49.168 10:16:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:49.168 10:16:54 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:30:49.168 10:16:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:49.168 10:16:54 -- common/autotest_common.sh@10 -- # set +x 00:30:49.168 10:16:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:49.168 10:16:54 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:30:49.168 10:16:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:49.168 10:16:54 -- common/autotest_common.sh@10 -- # set +x 00:30:49.168 10:16:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:49.168 10:16:54 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:49.169 10:16:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:49.169 10:16:54 -- common/autotest_common.sh@10 -- # set +x 00:30:49.169 [2024-07-13 10:16:54.336177] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:49.169 10:16:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:49.169 10:16:54 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:30:49.169 10:16:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:49.169 10:16:54 -- common/autotest_common.sh@10 -- # set +x 00:30:49.169 [2024-07-13 10:16:54.343869] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:30:49.169 [ 00:30:49.169 { 00:30:49.169 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:30:49.169 "subtype": "Discovery", 00:30:49.169 "listen_addresses": [], 00:30:49.169 "allow_any_host": true, 00:30:49.169 "hosts": [] 00:30:49.169 }, 00:30:49.169 { 00:30:49.169 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:30:49.169 "subtype": "NVMe", 00:30:49.169 "listen_addresses": [ 00:30:49.169 { 00:30:49.169 "transport": "TCP", 00:30:49.169 "trtype": "TCP", 00:30:49.169 "adrfam": "IPv4", 00:30:49.169 "traddr": "10.0.0.2", 00:30:49.169 "trsvcid": "4420" 00:30:49.169 } 00:30:49.169 ], 00:30:49.169 "allow_any_host": true, 00:30:49.169 "hosts": [], 00:30:49.169 "serial_number": "SPDK00000000000001", 00:30:49.169 "model_number": "SPDK bdev Controller", 00:30:49.169 "max_namespaces": 1, 00:30:49.169 "min_cntlid": 1, 00:30:49.169 "max_cntlid": 65519, 00:30:49.169 "namespaces": [ 00:30:49.169 { 00:30:49.169 "nsid": 1, 00:30:49.169 "bdev_name": "Nvme0n1", 00:30:49.169 "name": "Nvme0n1", 00:30:49.169 "nguid": "57E4156FB5284038BF788A0443E02CC2", 00:30:49.169 "uuid": "57e4156f-b528-4038-bf78-8a0443e02cc2" 00:30:49.169 } 00:30:49.169 ] 00:30:49.169 } 00:30:49.169 ] 00:30:49.169 10:16:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:49.169 10:16:54 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:30:49.169 10:16:54 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:30:49.169 10:16:54 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:30:49.169 EAL: No free 2048 kB hugepages reported on node 1 00:30:49.169 10:16:54 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=PHLJ916004901P0FGN 00:30:49.169 10:16:54 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:30:49.169 10:16:54 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:30:49.169 10:16:54 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:30:49.169 EAL: No free 2048 kB hugepages reported on node 1 00:30:49.169 10:16:54 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:30:49.169 10:16:54 -- target/identify_passthru.sh@63 -- # '[' PHLJ916004901P0FGN '!=' PHLJ916004901P0FGN ']' 00:30:49.169 10:16:54 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:30:49.169 10:16:54 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:30:49.169 10:16:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:49.169 10:16:54 -- common/autotest_common.sh@10 -- # set +x 00:30:49.169 10:16:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:49.169 10:16:54 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:30:49.169 10:16:54 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:30:49.169 10:16:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:49.169 10:16:54 -- nvmf/common.sh@116 -- # sync 00:30:49.169 10:16:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:49.169 10:16:54 -- nvmf/common.sh@119 -- # set +e 00:30:49.169 10:16:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:49.169 10:16:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:49.169 rmmod nvme_tcp 00:30:49.169 rmmod nvme_fabrics 00:30:49.169 rmmod nvme_keyring 00:30:49.169 10:16:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:49.169 10:16:54 -- nvmf/common.sh@123 -- # set -e 00:30:49.169 10:16:54 -- nvmf/common.sh@124 -- # return 0 00:30:49.169 10:16:54 -- nvmf/common.sh@477 -- # '[' -n 2948287 ']' 00:30:49.169 10:16:54 -- nvmf/common.sh@478 -- # killprocess 2948287 00:30:49.169 10:16:54 -- common/autotest_common.sh@926 -- # '[' -z 2948287 ']' 00:30:49.169 10:16:54 -- common/autotest_common.sh@930 -- # kill -0 2948287 00:30:49.169 10:16:54 -- common/autotest_common.sh@931 -- # uname 00:30:49.169 10:16:54 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:30:49.169 10:16:54 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2948287 00:30:49.169 10:16:54 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:30:49.169 10:16:54 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:30:49.169 10:16:54 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2948287' 00:30:49.169 killing process with pid 2948287 00:30:49.169 10:16:54 -- common/autotest_common.sh@945 -- # kill 2948287 00:30:49.169 [2024-07-13 10:16:54.827543] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:30:49.169 10:16:54 -- common/autotest_common.sh@950 -- # wait 2948287 00:30:51.067 10:16:56 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:51.067 10:16:56 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:51.067 10:16:56 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:51.067 10:16:56 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:51.067 10:16:56 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:51.067 10:16:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:51.067 10:16:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:30:51.067 10:16:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:52.967 10:16:58 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:52.967 00:30:52.967 real 0m17.948s 00:30:52.967 user 0m26.983s 00:30:52.967 sys 0m2.243s 00:30:52.967 10:16:58 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:30:52.967 10:16:58 -- common/autotest_common.sh@10 -- # set +x 00:30:52.967 ************************************ 00:30:52.967 END TEST nvmf_identify_passthru 00:30:52.967 ************************************ 00:30:52.967 10:16:58 -- spdk/autotest.sh@300 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:30:52.967 10:16:58 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:30:52.967 10:16:58 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:30:52.967 10:16:58 -- common/autotest_common.sh@10 -- # set +x 00:30:52.967 ************************************ 00:30:52.967 START TEST nvmf_dif 00:30:52.967 ************************************ 00:30:52.967 10:16:58 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:30:52.967 * Looking for test storage... 00:30:52.967 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:30:52.967 10:16:58 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:52.967 10:16:58 -- nvmf/common.sh@7 -- # uname -s 00:30:52.967 10:16:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:52.967 10:16:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:52.967 10:16:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:52.967 10:16:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:52.967 10:16:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:52.967 10:16:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:52.967 10:16:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:52.967 10:16:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:52.967 10:16:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:52.967 10:16:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:52.967 10:16:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:52.967 10:16:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:52.967 10:16:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:52.967 10:16:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:52.967 10:16:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:52.967 10:16:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:52.967 10:16:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:52.967 10:16:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:52.967 10:16:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:52.967 10:16:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:52.967 10:16:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:52.967 10:16:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:52.967 10:16:58 -- paths/export.sh@5 -- # export PATH 00:30:52.967 10:16:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:52.967 10:16:58 -- nvmf/common.sh@46 -- # : 0 00:30:52.967 10:16:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:52.967 10:16:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:52.967 10:16:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:52.967 10:16:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:52.967 10:16:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:52.967 10:16:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:52.967 10:16:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:52.967 10:16:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:52.967 10:16:58 -- target/dif.sh@15 -- # NULL_META=16 00:30:52.967 10:16:58 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:30:52.967 10:16:58 -- target/dif.sh@15 -- # NULL_SIZE=64 00:30:52.967 10:16:58 -- target/dif.sh@15 -- # NULL_DIF=1 00:30:52.967 10:16:58 -- target/dif.sh@135 -- # nvmftestinit 00:30:52.967 10:16:58 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:52.967 10:16:58 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:52.967 10:16:58 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:52.967 10:16:58 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:52.967 10:16:58 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:52.967 10:16:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:52.967 10:16:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:30:52.967 10:16:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:52.967 10:16:58 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:52.967 10:16:58 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:52.967 10:16:58 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:52.967 10:16:58 -- common/autotest_common.sh@10 -- # set +x 00:30:54.865 10:17:00 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:54.865 10:17:00 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:54.865 10:17:00 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:54.865 10:17:00 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:54.865 10:17:00 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:54.865 10:17:00 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:54.865 10:17:00 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:54.865 10:17:00 -- nvmf/common.sh@294 -- # net_devs=() 00:30:54.865 10:17:00 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:54.865 10:17:00 -- nvmf/common.sh@295 -- # e810=() 00:30:54.865 10:17:00 -- nvmf/common.sh@295 -- # local -ga e810 00:30:54.865 10:17:00 -- nvmf/common.sh@296 -- # x722=() 00:30:54.865 10:17:00 -- nvmf/common.sh@296 -- # local -ga x722 00:30:54.865 10:17:00 -- nvmf/common.sh@297 -- # mlx=() 00:30:54.865 10:17:00 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:54.865 10:17:00 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:54.865 10:17:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:54.865 10:17:00 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:54.865 10:17:00 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:54.865 10:17:00 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:54.865 10:17:00 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:54.865 10:17:00 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:54.865 10:17:00 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:54.865 10:17:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:54.865 10:17:00 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:54.865 10:17:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:54.865 10:17:00 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:54.865 10:17:00 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:54.865 10:17:00 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:54.865 10:17:00 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:54.865 10:17:00 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:54.865 10:17:00 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:54.865 10:17:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:54.865 10:17:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:30:54.865 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:30:54.865 10:17:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:54.865 10:17:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:54.865 10:17:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:54.865 10:17:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:54.865 10:17:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:54.865 10:17:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:54.865 10:17:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:30:54.865 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:30:54.865 10:17:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:54.865 10:17:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:54.865 10:17:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:54.865 10:17:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:54.865 10:17:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:54.865 10:17:00 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:54.865 10:17:00 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:54.865 10:17:00 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:54.865 10:17:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:54.865 10:17:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:54.865 10:17:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:54.865 10:17:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:54.865 10:17:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:30:54.865 Found net devices under 0000:0a:00.0: cvl_0_0 00:30:54.865 10:17:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:54.865 10:17:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:54.865 10:17:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:54.865 10:17:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:54.865 10:17:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:54.865 10:17:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:30:54.865 Found net devices under 0000:0a:00.1: cvl_0_1 00:30:54.866 10:17:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:54.866 10:17:00 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:54.866 10:17:00 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:54.866 10:17:00 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:54.866 10:17:00 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:54.866 10:17:00 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:54.866 10:17:00 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:54.866 10:17:00 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:54.866 10:17:00 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:54.866 10:17:00 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:54.866 10:17:00 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:54.866 10:17:00 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:54.866 10:17:00 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:54.866 10:17:00 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:54.866 10:17:00 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:54.866 10:17:00 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:54.866 10:17:00 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:54.866 10:17:00 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:54.866 10:17:00 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:55.125 10:17:00 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:55.125 10:17:00 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:55.125 10:17:00 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:55.125 10:17:00 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:55.125 10:17:00 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:55.125 10:17:00 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:55.125 10:17:00 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:55.125 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:55.125 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.182 ms 00:30:55.125 00:30:55.125 --- 10.0.0.2 ping statistics --- 00:30:55.125 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:55.125 rtt min/avg/max/mdev = 0.182/0.182/0.182/0.000 ms 00:30:55.125 10:17:00 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:55.125 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:55.125 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.182 ms 00:30:55.125 00:30:55.125 --- 10.0.0.1 ping statistics --- 00:30:55.125 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:55.125 rtt min/avg/max/mdev = 0.182/0.182/0.182/0.000 ms 00:30:55.125 10:17:00 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:55.125 10:17:00 -- nvmf/common.sh@410 -- # return 0 00:30:55.125 10:17:00 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:30:55.125 10:17:00 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:30:56.502 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:30:56.502 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:30:56.502 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:30:56.502 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:30:56.502 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:30:56.502 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:30:56.502 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:30:56.502 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:30:56.502 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:30:56.502 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:30:56.502 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:30:56.502 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:30:56.502 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:30:56.502 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:30:56.502 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:30:56.502 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:30:56.502 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:30:56.502 10:17:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:56.502 10:17:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:56.502 10:17:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:56.502 10:17:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:56.502 10:17:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:56.502 10:17:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:56.502 10:17:02 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:30:56.502 10:17:02 -- target/dif.sh@137 -- # nvmfappstart 00:30:56.502 10:17:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:56.502 10:17:02 -- common/autotest_common.sh@712 -- # xtrace_disable 00:30:56.502 10:17:02 -- common/autotest_common.sh@10 -- # set +x 00:30:56.502 10:17:02 -- nvmf/common.sh@469 -- # nvmfpid=2951537 00:30:56.502 10:17:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:30:56.502 10:17:02 -- nvmf/common.sh@470 -- # waitforlisten 2951537 00:30:56.502 10:17:02 -- common/autotest_common.sh@819 -- # '[' -z 2951537 ']' 00:30:56.502 10:17:02 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:56.502 10:17:02 -- common/autotest_common.sh@824 -- # local max_retries=100 00:30:56.502 10:17:02 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:56.502 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:56.502 10:17:02 -- common/autotest_common.sh@828 -- # xtrace_disable 00:30:56.502 10:17:02 -- common/autotest_common.sh@10 -- # set +x 00:30:56.502 [2024-07-13 10:17:02.155287] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:30:56.502 [2024-07-13 10:17:02.155376] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:56.502 EAL: No free 2048 kB hugepages reported on node 1 00:30:56.502 [2024-07-13 10:17:02.224462] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:56.502 [2024-07-13 10:17:02.312459] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:56.502 [2024-07-13 10:17:02.312633] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:56.502 [2024-07-13 10:17:02.312655] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:56.502 [2024-07-13 10:17:02.312669] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:56.502 [2024-07-13 10:17:02.312700] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:57.434 10:17:03 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:30:57.434 10:17:03 -- common/autotest_common.sh@852 -- # return 0 00:30:57.434 10:17:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:57.434 10:17:03 -- common/autotest_common.sh@718 -- # xtrace_disable 00:30:57.434 10:17:03 -- common/autotest_common.sh@10 -- # set +x 00:30:57.434 10:17:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:57.434 10:17:03 -- target/dif.sh@139 -- # create_transport 00:30:57.434 10:17:03 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:30:57.434 10:17:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:57.434 10:17:03 -- common/autotest_common.sh@10 -- # set +x 00:30:57.434 [2024-07-13 10:17:03.099306] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:57.434 10:17:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:57.434 10:17:03 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:30:57.434 10:17:03 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:30:57.434 10:17:03 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:30:57.434 10:17:03 -- common/autotest_common.sh@10 -- # set +x 00:30:57.434 ************************************ 00:30:57.434 START TEST fio_dif_1_default 00:30:57.434 ************************************ 00:30:57.434 10:17:03 -- common/autotest_common.sh@1104 -- # fio_dif_1 00:30:57.434 10:17:03 -- target/dif.sh@86 -- # create_subsystems 0 00:30:57.434 10:17:03 -- target/dif.sh@28 -- # local sub 00:30:57.434 10:17:03 -- target/dif.sh@30 -- # for sub in "$@" 00:30:57.434 10:17:03 -- target/dif.sh@31 -- # create_subsystem 0 00:30:57.434 10:17:03 -- target/dif.sh@18 -- # local sub_id=0 00:30:57.434 10:17:03 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:30:57.434 10:17:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:57.434 10:17:03 -- common/autotest_common.sh@10 -- # set +x 00:30:57.434 bdev_null0 00:30:57.434 10:17:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:57.434 10:17:03 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:30:57.434 10:17:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:57.434 10:17:03 -- common/autotest_common.sh@10 -- # set +x 00:30:57.434 10:17:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:57.434 10:17:03 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:30:57.434 10:17:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:57.434 10:17:03 -- common/autotest_common.sh@10 -- # set +x 00:30:57.434 10:17:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:57.434 10:17:03 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:30:57.434 10:17:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:57.434 10:17:03 -- common/autotest_common.sh@10 -- # set +x 00:30:57.434 [2024-07-13 10:17:03.135567] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:57.435 10:17:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:57.435 10:17:03 -- target/dif.sh@87 -- # fio /dev/fd/62 00:30:57.435 10:17:03 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:30:57.435 10:17:03 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:30:57.435 10:17:03 -- nvmf/common.sh@520 -- # config=() 00:30:57.435 10:17:03 -- nvmf/common.sh@520 -- # local subsystem config 00:30:57.435 10:17:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:30:57.435 10:17:03 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:30:57.435 10:17:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:30:57.435 { 00:30:57.435 "params": { 00:30:57.435 "name": "Nvme$subsystem", 00:30:57.435 "trtype": "$TEST_TRANSPORT", 00:30:57.435 "traddr": "$NVMF_FIRST_TARGET_IP", 00:30:57.435 "adrfam": "ipv4", 00:30:57.435 "trsvcid": "$NVMF_PORT", 00:30:57.435 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:30:57.435 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:30:57.435 "hdgst": ${hdgst:-false}, 00:30:57.435 "ddgst": ${ddgst:-false} 00:30:57.435 }, 00:30:57.435 "method": "bdev_nvme_attach_controller" 00:30:57.435 } 00:30:57.435 EOF 00:30:57.435 )") 00:30:57.435 10:17:03 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:30:57.435 10:17:03 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:30:57.435 10:17:03 -- target/dif.sh@82 -- # gen_fio_conf 00:30:57.435 10:17:03 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:30:57.435 10:17:03 -- target/dif.sh@54 -- # local file 00:30:57.435 10:17:03 -- common/autotest_common.sh@1318 -- # local sanitizers 00:30:57.435 10:17:03 -- target/dif.sh@56 -- # cat 00:30:57.435 10:17:03 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:30:57.435 10:17:03 -- common/autotest_common.sh@1320 -- # shift 00:30:57.435 10:17:03 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:30:57.435 10:17:03 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:30:57.435 10:17:03 -- nvmf/common.sh@542 -- # cat 00:30:57.435 10:17:03 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:30:57.435 10:17:03 -- common/autotest_common.sh@1324 -- # grep libasan 00:30:57.435 10:17:03 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:30:57.435 10:17:03 -- target/dif.sh@72 -- # (( file = 1 )) 00:30:57.435 10:17:03 -- target/dif.sh@72 -- # (( file <= files )) 00:30:57.435 10:17:03 -- nvmf/common.sh@544 -- # jq . 00:30:57.435 10:17:03 -- nvmf/common.sh@545 -- # IFS=, 00:30:57.435 10:17:03 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:30:57.435 "params": { 00:30:57.435 "name": "Nvme0", 00:30:57.435 "trtype": "tcp", 00:30:57.435 "traddr": "10.0.0.2", 00:30:57.435 "adrfam": "ipv4", 00:30:57.435 "trsvcid": "4420", 00:30:57.435 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:30:57.435 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:30:57.435 "hdgst": false, 00:30:57.435 "ddgst": false 00:30:57.435 }, 00:30:57.435 "method": "bdev_nvme_attach_controller" 00:30:57.435 }' 00:30:57.435 10:17:03 -- common/autotest_common.sh@1324 -- # asan_lib= 00:30:57.435 10:17:03 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:30:57.435 10:17:03 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:30:57.435 10:17:03 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:30:57.435 10:17:03 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:30:57.435 10:17:03 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:30:57.435 10:17:03 -- common/autotest_common.sh@1324 -- # asan_lib= 00:30:57.435 10:17:03 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:30:57.435 10:17:03 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:30:57.435 10:17:03 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:30:57.692 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:30:57.692 fio-3.35 00:30:57.692 Starting 1 thread 00:30:57.692 EAL: No free 2048 kB hugepages reported on node 1 00:30:58.256 [2024-07-13 10:17:03.912926] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:30:58.256 [2024-07-13 10:17:03.912984] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:08.217 00:31:08.217 filename0: (groupid=0, jobs=1): err= 0: pid=2951856: Sat Jul 13 10:17:14 2024 00:31:08.217 read: IOPS=189, BW=757KiB/s (775kB/s)(7568KiB/10003msec) 00:31:08.217 slat (nsec): min=4620, max=76214, avg=9468.89, stdev=3522.79 00:31:08.217 clat (usec): min=721, max=47787, avg=21117.85, stdev=20178.13 00:31:08.217 lat (usec): min=729, max=47816, avg=21127.32, stdev=20178.23 00:31:08.217 clat percentiles (usec): 00:31:08.217 | 1.00th=[ 742], 5.00th=[ 766], 10.00th=[ 783], 20.00th=[ 807], 00:31:08.217 | 30.00th=[ 832], 40.00th=[ 857], 50.00th=[41157], 60.00th=[41157], 00:31:08.217 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:31:08.217 | 99.00th=[41157], 99.50th=[41681], 99.90th=[47973], 99.95th=[47973], 00:31:08.217 | 99.99th=[47973] 00:31:08.217 bw ( KiB/s): min= 704, max= 768, per=100.00%, avg=757.89, stdev=23.98, samples=19 00:31:08.217 iops : min= 176, max= 192, avg=189.47, stdev= 5.99, samples=19 00:31:08.217 lat (usec) : 750=2.22%, 1000=47.25% 00:31:08.217 lat (msec) : 2=0.21%, 50=50.32% 00:31:08.217 cpu : usr=90.21%, sys=9.52%, ctx=17, majf=0, minf=279 00:31:08.217 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:08.217 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:08.217 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:08.217 issued rwts: total=1892,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:08.217 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:08.217 00:31:08.218 Run status group 0 (all jobs): 00:31:08.218 READ: bw=757KiB/s (775kB/s), 757KiB/s-757KiB/s (775kB/s-775kB/s), io=7568KiB (7750kB), run=10003-10003msec 00:31:08.475 10:17:14 -- target/dif.sh@88 -- # destroy_subsystems 0 00:31:08.475 10:17:14 -- target/dif.sh@43 -- # local sub 00:31:08.475 10:17:14 -- target/dif.sh@45 -- # for sub in "$@" 00:31:08.475 10:17:14 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:08.475 10:17:14 -- target/dif.sh@36 -- # local sub_id=0 00:31:08.475 10:17:14 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:08.475 10:17:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:08.475 10:17:14 -- common/autotest_common.sh@10 -- # set +x 00:31:08.475 10:17:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:08.475 10:17:14 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:08.475 10:17:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:08.475 10:17:14 -- common/autotest_common.sh@10 -- # set +x 00:31:08.475 10:17:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:08.475 00:31:08.475 real 0m11.143s 00:31:08.475 user 0m10.153s 00:31:08.475 sys 0m1.240s 00:31:08.475 10:17:14 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:31:08.475 10:17:14 -- common/autotest_common.sh@10 -- # set +x 00:31:08.476 ************************************ 00:31:08.476 END TEST fio_dif_1_default 00:31:08.476 ************************************ 00:31:08.476 10:17:14 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:31:08.476 10:17:14 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:31:08.476 10:17:14 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:31:08.476 10:17:14 -- common/autotest_common.sh@10 -- # set +x 00:31:08.476 ************************************ 00:31:08.476 START TEST fio_dif_1_multi_subsystems 00:31:08.476 ************************************ 00:31:08.476 10:17:14 -- common/autotest_common.sh@1104 -- # fio_dif_1_multi_subsystems 00:31:08.476 10:17:14 -- target/dif.sh@92 -- # local files=1 00:31:08.476 10:17:14 -- target/dif.sh@94 -- # create_subsystems 0 1 00:31:08.476 10:17:14 -- target/dif.sh@28 -- # local sub 00:31:08.476 10:17:14 -- target/dif.sh@30 -- # for sub in "$@" 00:31:08.476 10:17:14 -- target/dif.sh@31 -- # create_subsystem 0 00:31:08.476 10:17:14 -- target/dif.sh@18 -- # local sub_id=0 00:31:08.476 10:17:14 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:08.476 10:17:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:08.476 10:17:14 -- common/autotest_common.sh@10 -- # set +x 00:31:08.476 bdev_null0 00:31:08.476 10:17:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:08.476 10:17:14 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:08.476 10:17:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:08.476 10:17:14 -- common/autotest_common.sh@10 -- # set +x 00:31:08.734 10:17:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:08.734 10:17:14 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:08.734 10:17:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:08.734 10:17:14 -- common/autotest_common.sh@10 -- # set +x 00:31:08.734 10:17:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:08.734 10:17:14 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:08.734 10:17:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:08.734 10:17:14 -- common/autotest_common.sh@10 -- # set +x 00:31:08.734 [2024-07-13 10:17:14.306512] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:08.734 10:17:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:08.734 10:17:14 -- target/dif.sh@30 -- # for sub in "$@" 00:31:08.734 10:17:14 -- target/dif.sh@31 -- # create_subsystem 1 00:31:08.734 10:17:14 -- target/dif.sh@18 -- # local sub_id=1 00:31:08.734 10:17:14 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:31:08.734 10:17:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:08.734 10:17:14 -- common/autotest_common.sh@10 -- # set +x 00:31:08.734 bdev_null1 00:31:08.734 10:17:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:08.734 10:17:14 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:31:08.734 10:17:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:08.734 10:17:14 -- common/autotest_common.sh@10 -- # set +x 00:31:08.734 10:17:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:08.734 10:17:14 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:31:08.734 10:17:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:08.734 10:17:14 -- common/autotest_common.sh@10 -- # set +x 00:31:08.734 10:17:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:08.734 10:17:14 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:08.734 10:17:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:08.734 10:17:14 -- common/autotest_common.sh@10 -- # set +x 00:31:08.734 10:17:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:08.734 10:17:14 -- target/dif.sh@95 -- # fio /dev/fd/62 00:31:08.734 10:17:14 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:31:08.734 10:17:14 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:31:08.734 10:17:14 -- nvmf/common.sh@520 -- # config=() 00:31:08.734 10:17:14 -- nvmf/common.sh@520 -- # local subsystem config 00:31:08.734 10:17:14 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:08.734 10:17:14 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:08.734 10:17:14 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:08.734 { 00:31:08.734 "params": { 00:31:08.734 "name": "Nvme$subsystem", 00:31:08.734 "trtype": "$TEST_TRANSPORT", 00:31:08.734 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:08.734 "adrfam": "ipv4", 00:31:08.734 "trsvcid": "$NVMF_PORT", 00:31:08.734 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:08.734 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:08.734 "hdgst": ${hdgst:-false}, 00:31:08.734 "ddgst": ${ddgst:-false} 00:31:08.734 }, 00:31:08.734 "method": "bdev_nvme_attach_controller" 00:31:08.734 } 00:31:08.734 EOF 00:31:08.734 )") 00:31:08.734 10:17:14 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:08.734 10:17:14 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:31:08.734 10:17:14 -- target/dif.sh@82 -- # gen_fio_conf 00:31:08.734 10:17:14 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:08.734 10:17:14 -- common/autotest_common.sh@1318 -- # local sanitizers 00:31:08.734 10:17:14 -- target/dif.sh@54 -- # local file 00:31:08.734 10:17:14 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:08.734 10:17:14 -- target/dif.sh@56 -- # cat 00:31:08.734 10:17:14 -- common/autotest_common.sh@1320 -- # shift 00:31:08.734 10:17:14 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:31:08.734 10:17:14 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:31:08.734 10:17:14 -- nvmf/common.sh@542 -- # cat 00:31:08.734 10:17:14 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:08.734 10:17:14 -- common/autotest_common.sh@1324 -- # grep libasan 00:31:08.734 10:17:14 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:08.734 10:17:14 -- target/dif.sh@72 -- # (( file <= files )) 00:31:08.734 10:17:14 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:31:08.734 10:17:14 -- target/dif.sh@73 -- # cat 00:31:08.734 10:17:14 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:08.734 10:17:14 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:08.734 { 00:31:08.734 "params": { 00:31:08.734 "name": "Nvme$subsystem", 00:31:08.734 "trtype": "$TEST_TRANSPORT", 00:31:08.734 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:08.734 "adrfam": "ipv4", 00:31:08.734 "trsvcid": "$NVMF_PORT", 00:31:08.734 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:08.734 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:08.734 "hdgst": ${hdgst:-false}, 00:31:08.734 "ddgst": ${ddgst:-false} 00:31:08.734 }, 00:31:08.734 "method": "bdev_nvme_attach_controller" 00:31:08.734 } 00:31:08.734 EOF 00:31:08.734 )") 00:31:08.734 10:17:14 -- nvmf/common.sh@542 -- # cat 00:31:08.734 10:17:14 -- target/dif.sh@72 -- # (( file++ )) 00:31:08.734 10:17:14 -- target/dif.sh@72 -- # (( file <= files )) 00:31:08.734 10:17:14 -- nvmf/common.sh@544 -- # jq . 00:31:08.734 10:17:14 -- nvmf/common.sh@545 -- # IFS=, 00:31:08.734 10:17:14 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:08.734 "params": { 00:31:08.734 "name": "Nvme0", 00:31:08.734 "trtype": "tcp", 00:31:08.734 "traddr": "10.0.0.2", 00:31:08.734 "adrfam": "ipv4", 00:31:08.734 "trsvcid": "4420", 00:31:08.734 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:08.734 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:08.734 "hdgst": false, 00:31:08.734 "ddgst": false 00:31:08.734 }, 00:31:08.734 "method": "bdev_nvme_attach_controller" 00:31:08.734 },{ 00:31:08.734 "params": { 00:31:08.734 "name": "Nvme1", 00:31:08.734 "trtype": "tcp", 00:31:08.734 "traddr": "10.0.0.2", 00:31:08.734 "adrfam": "ipv4", 00:31:08.734 "trsvcid": "4420", 00:31:08.734 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:08.734 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:08.734 "hdgst": false, 00:31:08.734 "ddgst": false 00:31:08.734 }, 00:31:08.734 "method": "bdev_nvme_attach_controller" 00:31:08.734 }' 00:31:08.734 10:17:14 -- common/autotest_common.sh@1324 -- # asan_lib= 00:31:08.734 10:17:14 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:31:08.734 10:17:14 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:31:08.734 10:17:14 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:08.734 10:17:14 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:31:08.734 10:17:14 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:31:08.734 10:17:14 -- common/autotest_common.sh@1324 -- # asan_lib= 00:31:08.734 10:17:14 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:31:08.734 10:17:14 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:08.734 10:17:14 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:08.992 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:08.992 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:08.992 fio-3.35 00:31:08.992 Starting 2 threads 00:31:08.992 EAL: No free 2048 kB hugepages reported on node 1 00:31:09.557 [2024-07-13 10:17:15.291726] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:09.557 [2024-07-13 10:17:15.291788] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:21.776 00:31:21.776 filename0: (groupid=0, jobs=1): err= 0: pid=2953295: Sat Jul 13 10:17:25 2024 00:31:21.776 read: IOPS=190, BW=760KiB/s (778kB/s)(7632KiB/10040msec) 00:31:21.776 slat (nsec): min=5020, max=72723, avg=9638.68, stdev=4230.16 00:31:21.776 clat (usec): min=700, max=42495, avg=21016.87, stdev=20154.93 00:31:21.776 lat (usec): min=707, max=42510, avg=21026.51, stdev=20154.33 00:31:21.776 clat percentiles (usec): 00:31:21.776 | 1.00th=[ 734], 5.00th=[ 758], 10.00th=[ 775], 20.00th=[ 807], 00:31:21.776 | 30.00th=[ 840], 40.00th=[ 865], 50.00th=[41157], 60.00th=[41157], 00:31:21.776 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:31:21.776 | 99.00th=[41157], 99.50th=[41157], 99.90th=[42730], 99.95th=[42730], 00:31:21.776 | 99.99th=[42730] 00:31:21.776 bw ( KiB/s): min= 704, max= 768, per=50.21%, avg=761.60, stdev=19.70, samples=20 00:31:21.776 iops : min= 176, max= 192, avg=190.40, stdev= 4.92, samples=20 00:31:21.776 lat (usec) : 750=2.88%, 1000=47.01% 00:31:21.776 lat (msec) : 50=50.10% 00:31:21.776 cpu : usr=96.67%, sys=2.97%, ctx=39, majf=0, minf=323 00:31:21.776 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:21.776 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:21.776 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:21.776 issued rwts: total=1908,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:21.776 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:21.776 filename1: (groupid=0, jobs=1): err= 0: pid=2953296: Sat Jul 13 10:17:25 2024 00:31:21.776 read: IOPS=189, BW=758KiB/s (777kB/s)(7584KiB/10001msec) 00:31:21.776 slat (nsec): min=5645, max=43298, avg=10218.08, stdev=3889.79 00:31:21.776 clat (usec): min=730, max=42557, avg=21066.09, stdev=20178.19 00:31:21.776 lat (usec): min=738, max=42585, avg=21076.31, stdev=20177.55 00:31:21.776 clat percentiles (usec): 00:31:21.776 | 1.00th=[ 750], 5.00th=[ 766], 10.00th=[ 775], 20.00th=[ 791], 00:31:21.776 | 30.00th=[ 807], 40.00th=[ 832], 50.00th=[41157], 60.00th=[41157], 00:31:21.776 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:31:21.776 | 99.00th=[41681], 99.50th=[42206], 99.90th=[42730], 99.95th=[42730], 00:31:21.776 | 99.99th=[42730] 00:31:21.776 bw ( KiB/s): min= 672, max= 768, per=50.08%, avg=759.58, stdev=23.47, samples=19 00:31:21.776 iops : min= 168, max= 192, avg=189.89, stdev= 5.87, samples=19 00:31:21.776 lat (usec) : 750=1.05%, 1000=47.89% 00:31:21.776 lat (msec) : 2=0.84%, 50=50.21% 00:31:21.776 cpu : usr=96.62%, sys=3.09%, ctx=12, majf=0, minf=137 00:31:21.776 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:21.776 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:21.776 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:21.776 issued rwts: total=1896,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:21.776 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:21.776 00:31:21.776 Run status group 0 (all jobs): 00:31:21.776 READ: bw=1516KiB/s (1552kB/s), 758KiB/s-760KiB/s (777kB/s-778kB/s), io=14.9MiB (15.6MB), run=10001-10040msec 00:31:21.777 10:17:25 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:31:21.777 10:17:25 -- target/dif.sh@43 -- # local sub 00:31:21.777 10:17:25 -- target/dif.sh@45 -- # for sub in "$@" 00:31:21.777 10:17:25 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:21.777 10:17:25 -- target/dif.sh@36 -- # local sub_id=0 00:31:21.777 10:17:25 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:21.777 10:17:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:21.777 10:17:25 -- common/autotest_common.sh@10 -- # set +x 00:31:21.777 10:17:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:21.777 10:17:25 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:21.777 10:17:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:21.777 10:17:25 -- common/autotest_common.sh@10 -- # set +x 00:31:21.777 10:17:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:21.777 10:17:25 -- target/dif.sh@45 -- # for sub in "$@" 00:31:21.777 10:17:25 -- target/dif.sh@46 -- # destroy_subsystem 1 00:31:21.777 10:17:25 -- target/dif.sh@36 -- # local sub_id=1 00:31:21.777 10:17:25 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:21.777 10:17:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:21.777 10:17:25 -- common/autotest_common.sh@10 -- # set +x 00:31:21.777 10:17:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:21.777 10:17:25 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:31:21.777 10:17:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:21.777 10:17:25 -- common/autotest_common.sh@10 -- # set +x 00:31:21.777 10:17:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:21.777 00:31:21.777 real 0m11.398s 00:31:21.777 user 0m20.791s 00:31:21.777 sys 0m0.937s 00:31:21.777 10:17:25 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:31:21.777 10:17:25 -- common/autotest_common.sh@10 -- # set +x 00:31:21.777 ************************************ 00:31:21.777 END TEST fio_dif_1_multi_subsystems 00:31:21.777 ************************************ 00:31:21.777 10:17:25 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:31:21.777 10:17:25 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:31:21.777 10:17:25 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:31:21.777 10:17:25 -- common/autotest_common.sh@10 -- # set +x 00:31:21.777 ************************************ 00:31:21.777 START TEST fio_dif_rand_params 00:31:21.777 ************************************ 00:31:21.777 10:17:25 -- common/autotest_common.sh@1104 -- # fio_dif_rand_params 00:31:21.777 10:17:25 -- target/dif.sh@100 -- # local NULL_DIF 00:31:21.777 10:17:25 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:31:21.777 10:17:25 -- target/dif.sh@103 -- # NULL_DIF=3 00:31:21.777 10:17:25 -- target/dif.sh@103 -- # bs=128k 00:31:21.777 10:17:25 -- target/dif.sh@103 -- # numjobs=3 00:31:21.777 10:17:25 -- target/dif.sh@103 -- # iodepth=3 00:31:21.777 10:17:25 -- target/dif.sh@103 -- # runtime=5 00:31:21.777 10:17:25 -- target/dif.sh@105 -- # create_subsystems 0 00:31:21.777 10:17:25 -- target/dif.sh@28 -- # local sub 00:31:21.777 10:17:25 -- target/dif.sh@30 -- # for sub in "$@" 00:31:21.777 10:17:25 -- target/dif.sh@31 -- # create_subsystem 0 00:31:21.777 10:17:25 -- target/dif.sh@18 -- # local sub_id=0 00:31:21.777 10:17:25 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:31:21.777 10:17:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:21.777 10:17:25 -- common/autotest_common.sh@10 -- # set +x 00:31:21.777 bdev_null0 00:31:21.777 10:17:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:21.777 10:17:25 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:21.777 10:17:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:21.777 10:17:25 -- common/autotest_common.sh@10 -- # set +x 00:31:21.777 10:17:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:21.777 10:17:25 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:21.777 10:17:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:21.777 10:17:25 -- common/autotest_common.sh@10 -- # set +x 00:31:21.777 10:17:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:21.777 10:17:25 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:21.777 10:17:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:21.777 10:17:25 -- common/autotest_common.sh@10 -- # set +x 00:31:21.777 [2024-07-13 10:17:25.735654] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:21.777 10:17:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:21.777 10:17:25 -- target/dif.sh@106 -- # fio /dev/fd/62 00:31:21.777 10:17:25 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:31:21.777 10:17:25 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:31:21.777 10:17:25 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:21.777 10:17:25 -- nvmf/common.sh@520 -- # config=() 00:31:21.777 10:17:25 -- nvmf/common.sh@520 -- # local subsystem config 00:31:21.777 10:17:25 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:21.777 10:17:25 -- target/dif.sh@82 -- # gen_fio_conf 00:31:21.777 10:17:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:21.777 10:17:25 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:31:21.777 10:17:25 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:21.777 10:17:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:21.777 { 00:31:21.777 "params": { 00:31:21.777 "name": "Nvme$subsystem", 00:31:21.777 "trtype": "$TEST_TRANSPORT", 00:31:21.777 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:21.777 "adrfam": "ipv4", 00:31:21.777 "trsvcid": "$NVMF_PORT", 00:31:21.777 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:21.777 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:21.777 "hdgst": ${hdgst:-false}, 00:31:21.777 "ddgst": ${ddgst:-false} 00:31:21.777 }, 00:31:21.777 "method": "bdev_nvme_attach_controller" 00:31:21.777 } 00:31:21.777 EOF 00:31:21.777 )") 00:31:21.777 10:17:25 -- target/dif.sh@54 -- # local file 00:31:21.777 10:17:25 -- common/autotest_common.sh@1318 -- # local sanitizers 00:31:21.777 10:17:25 -- target/dif.sh@56 -- # cat 00:31:21.777 10:17:25 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:21.777 10:17:25 -- common/autotest_common.sh@1320 -- # shift 00:31:21.777 10:17:25 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:31:21.777 10:17:25 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:31:21.777 10:17:25 -- nvmf/common.sh@542 -- # cat 00:31:21.777 10:17:25 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:21.777 10:17:25 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:21.777 10:17:25 -- common/autotest_common.sh@1324 -- # grep libasan 00:31:21.777 10:17:25 -- target/dif.sh@72 -- # (( file <= files )) 00:31:21.777 10:17:25 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:31:21.777 10:17:25 -- nvmf/common.sh@544 -- # jq . 00:31:21.777 10:17:25 -- nvmf/common.sh@545 -- # IFS=, 00:31:21.777 10:17:25 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:21.777 "params": { 00:31:21.777 "name": "Nvme0", 00:31:21.777 "trtype": "tcp", 00:31:21.777 "traddr": "10.0.0.2", 00:31:21.777 "adrfam": "ipv4", 00:31:21.777 "trsvcid": "4420", 00:31:21.777 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:21.777 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:21.777 "hdgst": false, 00:31:21.777 "ddgst": false 00:31:21.777 }, 00:31:21.777 "method": "bdev_nvme_attach_controller" 00:31:21.777 }' 00:31:21.777 10:17:25 -- common/autotest_common.sh@1324 -- # asan_lib= 00:31:21.777 10:17:25 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:31:21.777 10:17:25 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:31:21.777 10:17:25 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:21.777 10:17:25 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:31:21.777 10:17:25 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:31:21.777 10:17:25 -- common/autotest_common.sh@1324 -- # asan_lib= 00:31:21.777 10:17:25 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:31:21.777 10:17:25 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:21.777 10:17:25 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:21.777 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:31:21.777 ... 00:31:21.777 fio-3.35 00:31:21.777 Starting 3 threads 00:31:21.777 EAL: No free 2048 kB hugepages reported on node 1 00:31:21.777 [2024-07-13 10:17:26.476717] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:21.777 [2024-07-13 10:17:26.476802] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:25.959 00:31:25.959 filename0: (groupid=0, jobs=1): err= 0: pid=2954729: Sat Jul 13 10:17:31 2024 00:31:25.959 read: IOPS=196, BW=24.6MiB/s (25.8MB/s)(124MiB/5045msec) 00:31:25.959 slat (nsec): min=5140, max=34676, avg=12527.09, stdev=3410.21 00:31:25.959 clat (usec): min=5246, max=89843, avg=15183.55, stdev=14220.09 00:31:25.959 lat (usec): min=5257, max=89855, avg=15196.07, stdev=14220.31 00:31:25.959 clat percentiles (usec): 00:31:25.959 | 1.00th=[ 5604], 5.00th=[ 6063], 10.00th=[ 6456], 20.00th=[ 7963], 00:31:25.959 | 30.00th=[ 8848], 40.00th=[ 9372], 50.00th=[10028], 60.00th=[11338], 00:31:25.959 | 70.00th=[12518], 80.00th=[13960], 90.00th=[49021], 95.00th=[50594], 00:31:25.959 | 99.00th=[54264], 99.50th=[55837], 99.90th=[89654], 99.95th=[89654], 00:31:25.959 | 99.99th=[89654] 00:31:25.959 bw ( KiB/s): min=17152, max=34048, per=36.26%, avg=25347.80, stdev=5807.18, samples=10 00:31:25.959 iops : min= 134, max= 266, avg=198.00, stdev=45.40, samples=10 00:31:25.959 lat (msec) : 10=48.74%, 20=38.77%, 50=6.14%, 100=6.34% 00:31:25.959 cpu : usr=91.20%, sys=8.37%, ctx=14, majf=0, minf=64 00:31:25.959 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:25.959 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:25.959 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:25.959 issued rwts: total=993,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:25.959 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:25.959 filename0: (groupid=0, jobs=1): err= 0: pid=2954730: Sat Jul 13 10:17:31 2024 00:31:25.959 read: IOPS=189, BW=23.7MiB/s (24.8MB/s)(119MiB/5041msec) 00:31:25.960 slat (nsec): min=6039, max=40458, avg=12380.48, stdev=3410.33 00:31:25.960 clat (usec): min=5262, max=90606, avg=15817.51, stdev=15017.08 00:31:25.960 lat (usec): min=5273, max=90618, avg=15829.89, stdev=15017.09 00:31:25.960 clat percentiles (usec): 00:31:25.960 | 1.00th=[ 5669], 5.00th=[ 5997], 10.00th=[ 6587], 20.00th=[ 7439], 00:31:25.960 | 30.00th=[ 8586], 40.00th=[ 9241], 50.00th=[10290], 60.00th=[11600], 00:31:25.960 | 70.00th=[12256], 80.00th=[13698], 90.00th=[49546], 95.00th=[51643], 00:31:25.960 | 99.00th=[54264], 99.50th=[55313], 99.90th=[90702], 99.95th=[90702], 00:31:25.960 | 99.99th=[90702] 00:31:25.960 bw ( KiB/s): min=17152, max=32256, per=34.87%, avg=24371.20, stdev=4844.95, samples=10 00:31:25.960 iops : min= 134, max= 252, avg=190.40, stdev=37.85, samples=10 00:31:25.960 lat (msec) : 10=47.33%, 20=38.22%, 50=6.18%, 100=8.27% 00:31:25.960 cpu : usr=90.91%, sys=8.67%, ctx=8, majf=0, minf=105 00:31:25.960 IO depths : 1=0.5%, 2=99.5%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:25.960 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:25.960 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:25.960 issued rwts: total=955,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:25.960 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:25.960 filename0: (groupid=0, jobs=1): err= 0: pid=2954731: Sat Jul 13 10:17:31 2024 00:31:25.960 read: IOPS=161, BW=20.2MiB/s (21.1MB/s)(101MiB/5004msec) 00:31:25.960 slat (nsec): min=5751, max=80002, avg=12563.61, stdev=4632.20 00:31:25.960 clat (usec): min=5525, max=93553, avg=18580.06, stdev=17267.71 00:31:25.960 lat (usec): min=5537, max=93566, avg=18592.62, stdev=17267.54 00:31:25.960 clat percentiles (usec): 00:31:25.960 | 1.00th=[ 5932], 5.00th=[ 6390], 10.00th=[ 6783], 20.00th=[ 8455], 00:31:25.960 | 30.00th=[ 9241], 40.00th=[10028], 50.00th=[11338], 60.00th=[12518], 00:31:25.960 | 70.00th=[13566], 80.00th=[16909], 90.00th=[51119], 95.00th=[53216], 00:31:25.960 | 99.00th=[55837], 99.50th=[88605], 99.90th=[93848], 99.95th=[93848], 00:31:25.960 | 99.99th=[93848] 00:31:25.960 bw ( KiB/s): min=13824, max=32512, per=29.48%, avg=20608.00, stdev=5128.88, samples=10 00:31:25.960 iops : min= 108, max= 254, avg=161.00, stdev=40.07, samples=10 00:31:25.960 lat (msec) : 10=39.90%, 20=40.77%, 50=5.82%, 100=13.51% 00:31:25.960 cpu : usr=91.11%, sys=8.47%, ctx=10, majf=0, minf=141 00:31:25.960 IO depths : 1=2.5%, 2=97.5%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:25.960 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:25.960 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:25.960 issued rwts: total=807,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:25.960 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:25.960 00:31:25.960 Run status group 0 (all jobs): 00:31:25.960 READ: bw=68.3MiB/s (71.6MB/s), 20.2MiB/s-24.6MiB/s (21.1MB/s-25.8MB/s), io=344MiB (361MB), run=5004-5045msec 00:31:26.218 10:17:31 -- target/dif.sh@107 -- # destroy_subsystems 0 00:31:26.218 10:17:31 -- target/dif.sh@43 -- # local sub 00:31:26.218 10:17:31 -- target/dif.sh@45 -- # for sub in "$@" 00:31:26.218 10:17:31 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:26.218 10:17:31 -- target/dif.sh@36 -- # local sub_id=0 00:31:26.218 10:17:31 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:26.218 10:17:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:26.218 10:17:31 -- common/autotest_common.sh@10 -- # set +x 00:31:26.218 10:17:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:26.218 10:17:31 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:26.218 10:17:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:26.218 10:17:31 -- common/autotest_common.sh@10 -- # set +x 00:31:26.218 10:17:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:26.218 10:17:31 -- target/dif.sh@109 -- # NULL_DIF=2 00:31:26.218 10:17:31 -- target/dif.sh@109 -- # bs=4k 00:31:26.218 10:17:31 -- target/dif.sh@109 -- # numjobs=8 00:31:26.218 10:17:31 -- target/dif.sh@109 -- # iodepth=16 00:31:26.218 10:17:31 -- target/dif.sh@109 -- # runtime= 00:31:26.218 10:17:31 -- target/dif.sh@109 -- # files=2 00:31:26.218 10:17:31 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:31:26.218 10:17:31 -- target/dif.sh@28 -- # local sub 00:31:26.218 10:17:31 -- target/dif.sh@30 -- # for sub in "$@" 00:31:26.218 10:17:31 -- target/dif.sh@31 -- # create_subsystem 0 00:31:26.218 10:17:31 -- target/dif.sh@18 -- # local sub_id=0 00:31:26.218 10:17:31 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:31:26.218 10:17:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:26.218 10:17:31 -- common/autotest_common.sh@10 -- # set +x 00:31:26.218 bdev_null0 00:31:26.218 10:17:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:26.218 10:17:31 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:26.218 10:17:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:26.218 10:17:31 -- common/autotest_common.sh@10 -- # set +x 00:31:26.218 10:17:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:26.218 10:17:31 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:26.218 10:17:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:26.218 10:17:31 -- common/autotest_common.sh@10 -- # set +x 00:31:26.218 10:17:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:26.218 10:17:31 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:26.218 10:17:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:26.218 10:17:31 -- common/autotest_common.sh@10 -- # set +x 00:31:26.218 [2024-07-13 10:17:31.966038] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:26.218 10:17:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:26.218 10:17:31 -- target/dif.sh@30 -- # for sub in "$@" 00:31:26.218 10:17:31 -- target/dif.sh@31 -- # create_subsystem 1 00:31:26.218 10:17:31 -- target/dif.sh@18 -- # local sub_id=1 00:31:26.218 10:17:31 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:31:26.218 10:17:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:26.218 10:17:31 -- common/autotest_common.sh@10 -- # set +x 00:31:26.218 bdev_null1 00:31:26.218 10:17:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:26.218 10:17:31 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:31:26.218 10:17:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:26.218 10:17:31 -- common/autotest_common.sh@10 -- # set +x 00:31:26.218 10:17:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:26.218 10:17:31 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:31:26.218 10:17:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:26.218 10:17:31 -- common/autotest_common.sh@10 -- # set +x 00:31:26.218 10:17:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:26.218 10:17:31 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:26.218 10:17:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:26.218 10:17:31 -- common/autotest_common.sh@10 -- # set +x 00:31:26.218 10:17:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:26.218 10:17:32 -- target/dif.sh@30 -- # for sub in "$@" 00:31:26.218 10:17:32 -- target/dif.sh@31 -- # create_subsystem 2 00:31:26.218 10:17:32 -- target/dif.sh@18 -- # local sub_id=2 00:31:26.218 10:17:32 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:31:26.218 10:17:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:26.218 10:17:32 -- common/autotest_common.sh@10 -- # set +x 00:31:26.218 bdev_null2 00:31:26.218 10:17:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:26.218 10:17:32 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:31:26.218 10:17:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:26.218 10:17:32 -- common/autotest_common.sh@10 -- # set +x 00:31:26.218 10:17:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:26.218 10:17:32 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:31:26.218 10:17:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:26.218 10:17:32 -- common/autotest_common.sh@10 -- # set +x 00:31:26.218 10:17:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:26.218 10:17:32 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:31:26.218 10:17:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:26.218 10:17:32 -- common/autotest_common.sh@10 -- # set +x 00:31:26.218 10:17:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:26.477 10:17:32 -- target/dif.sh@112 -- # fio /dev/fd/62 00:31:26.477 10:17:32 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:31:26.477 10:17:32 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:31:26.477 10:17:32 -- nvmf/common.sh@520 -- # config=() 00:31:26.477 10:17:32 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:26.477 10:17:32 -- nvmf/common.sh@520 -- # local subsystem config 00:31:26.477 10:17:32 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:26.477 10:17:32 -- target/dif.sh@82 -- # gen_fio_conf 00:31:26.477 10:17:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:26.477 10:17:32 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:31:26.477 10:17:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:26.477 { 00:31:26.477 "params": { 00:31:26.477 "name": "Nvme$subsystem", 00:31:26.477 "trtype": "$TEST_TRANSPORT", 00:31:26.477 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:26.477 "adrfam": "ipv4", 00:31:26.477 "trsvcid": "$NVMF_PORT", 00:31:26.477 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:26.477 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:26.477 "hdgst": ${hdgst:-false}, 00:31:26.477 "ddgst": ${ddgst:-false} 00:31:26.477 }, 00:31:26.477 "method": "bdev_nvme_attach_controller" 00:31:26.477 } 00:31:26.477 EOF 00:31:26.477 )") 00:31:26.477 10:17:32 -- target/dif.sh@54 -- # local file 00:31:26.477 10:17:32 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:26.477 10:17:32 -- common/autotest_common.sh@1318 -- # local sanitizers 00:31:26.477 10:17:32 -- target/dif.sh@56 -- # cat 00:31:26.477 10:17:32 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:26.477 10:17:32 -- common/autotest_common.sh@1320 -- # shift 00:31:26.477 10:17:32 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:31:26.477 10:17:32 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:31:26.477 10:17:32 -- nvmf/common.sh@542 -- # cat 00:31:26.477 10:17:32 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:26.477 10:17:32 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:26.477 10:17:32 -- common/autotest_common.sh@1324 -- # grep libasan 00:31:26.477 10:17:32 -- target/dif.sh@72 -- # (( file <= files )) 00:31:26.477 10:17:32 -- target/dif.sh@73 -- # cat 00:31:26.477 10:17:32 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:31:26.477 10:17:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:26.477 10:17:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:26.477 { 00:31:26.477 "params": { 00:31:26.477 "name": "Nvme$subsystem", 00:31:26.477 "trtype": "$TEST_TRANSPORT", 00:31:26.477 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:26.477 "adrfam": "ipv4", 00:31:26.477 "trsvcid": "$NVMF_PORT", 00:31:26.477 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:26.477 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:26.477 "hdgst": ${hdgst:-false}, 00:31:26.477 "ddgst": ${ddgst:-false} 00:31:26.477 }, 00:31:26.477 "method": "bdev_nvme_attach_controller" 00:31:26.477 } 00:31:26.477 EOF 00:31:26.477 )") 00:31:26.477 10:17:32 -- target/dif.sh@72 -- # (( file++ )) 00:31:26.477 10:17:32 -- target/dif.sh@72 -- # (( file <= files )) 00:31:26.477 10:17:32 -- target/dif.sh@73 -- # cat 00:31:26.477 10:17:32 -- nvmf/common.sh@542 -- # cat 00:31:26.477 10:17:32 -- target/dif.sh@72 -- # (( file++ )) 00:31:26.477 10:17:32 -- target/dif.sh@72 -- # (( file <= files )) 00:31:26.477 10:17:32 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:26.477 10:17:32 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:26.477 { 00:31:26.477 "params": { 00:31:26.477 "name": "Nvme$subsystem", 00:31:26.477 "trtype": "$TEST_TRANSPORT", 00:31:26.477 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:26.477 "adrfam": "ipv4", 00:31:26.477 "trsvcid": "$NVMF_PORT", 00:31:26.477 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:26.477 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:26.477 "hdgst": ${hdgst:-false}, 00:31:26.477 "ddgst": ${ddgst:-false} 00:31:26.477 }, 00:31:26.477 "method": "bdev_nvme_attach_controller" 00:31:26.477 } 00:31:26.477 EOF 00:31:26.477 )") 00:31:26.477 10:17:32 -- nvmf/common.sh@542 -- # cat 00:31:26.477 10:17:32 -- nvmf/common.sh@544 -- # jq . 00:31:26.477 10:17:32 -- nvmf/common.sh@545 -- # IFS=, 00:31:26.477 10:17:32 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:26.477 "params": { 00:31:26.477 "name": "Nvme0", 00:31:26.477 "trtype": "tcp", 00:31:26.477 "traddr": "10.0.0.2", 00:31:26.477 "adrfam": "ipv4", 00:31:26.477 "trsvcid": "4420", 00:31:26.477 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:26.477 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:26.477 "hdgst": false, 00:31:26.477 "ddgst": false 00:31:26.477 }, 00:31:26.477 "method": "bdev_nvme_attach_controller" 00:31:26.477 },{ 00:31:26.477 "params": { 00:31:26.477 "name": "Nvme1", 00:31:26.477 "trtype": "tcp", 00:31:26.477 "traddr": "10.0.0.2", 00:31:26.477 "adrfam": "ipv4", 00:31:26.477 "trsvcid": "4420", 00:31:26.477 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:26.477 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:26.477 "hdgst": false, 00:31:26.477 "ddgst": false 00:31:26.477 }, 00:31:26.477 "method": "bdev_nvme_attach_controller" 00:31:26.477 },{ 00:31:26.477 "params": { 00:31:26.477 "name": "Nvme2", 00:31:26.477 "trtype": "tcp", 00:31:26.477 "traddr": "10.0.0.2", 00:31:26.477 "adrfam": "ipv4", 00:31:26.477 "trsvcid": "4420", 00:31:26.477 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:31:26.477 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:31:26.477 "hdgst": false, 00:31:26.477 "ddgst": false 00:31:26.477 }, 00:31:26.477 "method": "bdev_nvme_attach_controller" 00:31:26.477 }' 00:31:26.477 10:17:32 -- common/autotest_common.sh@1324 -- # asan_lib= 00:31:26.477 10:17:32 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:31:26.477 10:17:32 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:31:26.477 10:17:32 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:26.477 10:17:32 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:31:26.477 10:17:32 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:31:26.477 10:17:32 -- common/autotest_common.sh@1324 -- # asan_lib= 00:31:26.477 10:17:32 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:31:26.477 10:17:32 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:26.477 10:17:32 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:26.477 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:31:26.477 ... 00:31:26.477 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:31:26.477 ... 00:31:26.477 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:31:26.477 ... 00:31:26.477 fio-3.35 00:31:26.477 Starting 24 threads 00:31:26.735 EAL: No free 2048 kB hugepages reported on node 1 00:31:27.669 [2024-07-13 10:17:33.121088] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:27.669 [2024-07-13 10:17:33.121176] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:37.659 00:31:37.659 filename0: (groupid=0, jobs=1): err= 0: pid=2955612: Sat Jul 13 10:17:43 2024 00:31:37.659 read: IOPS=71, BW=286KiB/s (293kB/s)(2880KiB/10068msec) 00:31:37.659 slat (usec): min=6, max=112, avg=40.00, stdev=27.05 00:31:37.659 clat (msec): min=17, max=437, avg=223.42, stdev=66.67 00:31:37.659 lat (msec): min=17, max=437, avg=223.46, stdev=66.67 00:31:37.659 clat percentiles (msec): 00:31:37.659 | 1.00th=[ 18], 5.00th=[ 129], 10.00th=[ 180], 20.00th=[ 186], 00:31:37.659 | 30.00th=[ 192], 40.00th=[ 197], 50.00th=[ 215], 60.00th=[ 236], 00:31:37.659 | 70.00th=[ 255], 80.00th=[ 279], 90.00th=[ 309], 95.00th=[ 309], 00:31:37.659 | 99.00th=[ 422], 99.50th=[ 439], 99.90th=[ 439], 99.95th=[ 439], 00:31:37.659 | 99.99th=[ 439] 00:31:37.659 bw ( KiB/s): min= 128, max= 512, per=4.67%, avg=281.60, stdev=93.21, samples=20 00:31:37.659 iops : min= 32, max= 128, avg=70.40, stdev=23.30, samples=20 00:31:37.659 lat (msec) : 20=2.22%, 50=0.97%, 100=1.25%, 250=61.67%, 500=33.89% 00:31:37.659 cpu : usr=98.28%, sys=1.27%, ctx=35, majf=0, minf=9 00:31:37.659 IO depths : 1=2.6%, 2=7.6%, 4=21.2%, 8=58.6%, 16=9.9%, 32=0.0%, >=64=0.0% 00:31:37.659 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.659 complete : 0=0.0%, 4=93.2%, 8=1.1%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.659 issued rwts: total=720,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.659 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.659 filename0: (groupid=0, jobs=1): err= 0: pid=2955613: Sat Jul 13 10:17:43 2024 00:31:37.659 read: IOPS=67, BW=272KiB/s (278kB/s)(2752KiB/10132msec) 00:31:37.659 slat (usec): min=4, max=126, avg=47.30, stdev=31.45 00:31:37.659 clat (msec): min=135, max=361, avg=235.21, stdev=58.24 00:31:37.659 lat (msec): min=135, max=361, avg=235.26, stdev=58.25 00:31:37.659 clat percentiles (msec): 00:31:37.659 | 1.00th=[ 136], 5.00th=[ 161], 10.00th=[ 174], 20.00th=[ 186], 00:31:37.659 | 30.00th=[ 192], 40.00th=[ 194], 50.00th=[ 215], 60.00th=[ 247], 00:31:37.659 | 70.00th=[ 275], 80.00th=[ 296], 90.00th=[ 309], 95.00th=[ 347], 00:31:37.659 | 99.00th=[ 363], 99.50th=[ 363], 99.90th=[ 363], 99.95th=[ 363], 00:31:37.659 | 99.99th=[ 363] 00:31:37.659 bw ( KiB/s): min= 128, max= 384, per=4.46%, avg=268.80, stdev=70.72, samples=20 00:31:37.659 iops : min= 32, max= 96, avg=67.20, stdev=17.68, samples=20 00:31:37.659 lat (msec) : 250=60.47%, 500=39.53% 00:31:37.659 cpu : usr=98.02%, sys=1.23%, ctx=35, majf=0, minf=9 00:31:37.659 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:31:37.659 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.659 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.659 issued rwts: total=688,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.659 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.659 filename0: (groupid=0, jobs=1): err= 0: pid=2955614: Sat Jul 13 10:17:43 2024 00:31:37.659 read: IOPS=60, BW=241KiB/s (247kB/s)(2432KiB/10098msec) 00:31:37.659 slat (usec): min=10, max=123, avg=68.52, stdev=23.25 00:31:37.659 clat (msec): min=120, max=457, avg=265.17, stdev=74.12 00:31:37.659 lat (msec): min=120, max=457, avg=265.23, stdev=74.13 00:31:37.659 clat percentiles (msec): 00:31:37.659 | 1.00th=[ 123], 5.00th=[ 184], 10.00th=[ 186], 20.00th=[ 192], 00:31:37.659 | 30.00th=[ 194], 40.00th=[ 215], 50.00th=[ 257], 60.00th=[ 296], 00:31:37.659 | 70.00th=[ 309], 80.00th=[ 338], 90.00th=[ 359], 95.00th=[ 376], 00:31:37.659 | 99.00th=[ 422], 99.50th=[ 435], 99.90th=[ 460], 99.95th=[ 460], 00:31:37.659 | 99.99th=[ 460] 00:31:37.659 bw ( KiB/s): min= 128, max= 384, per=3.92%, avg=236.80, stdev=82.50, samples=20 00:31:37.659 iops : min= 32, max= 96, avg=59.20, stdev=20.63, samples=20 00:31:37.659 lat (msec) : 250=45.72%, 500=54.28% 00:31:37.659 cpu : usr=97.57%, sys=1.56%, ctx=35, majf=0, minf=9 00:31:37.659 IO depths : 1=3.3%, 2=9.5%, 4=25.0%, 8=53.0%, 16=9.2%, 32=0.0%, >=64=0.0% 00:31:37.659 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.659 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.659 issued rwts: total=608,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.659 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.659 filename0: (groupid=0, jobs=1): err= 0: pid=2955615: Sat Jul 13 10:17:43 2024 00:31:37.659 read: IOPS=61, BW=247KiB/s (253kB/s)(2496KiB/10116msec) 00:31:37.659 slat (usec): min=8, max=100, avg=45.28, stdev=19.62 00:31:37.659 clat (msec): min=128, max=457, avg=259.00, stdev=74.24 00:31:37.659 lat (msec): min=128, max=457, avg=259.04, stdev=74.23 00:31:37.659 clat percentiles (msec): 00:31:37.659 | 1.00th=[ 130], 5.00th=[ 180], 10.00th=[ 186], 20.00th=[ 192], 00:31:37.659 | 30.00th=[ 192], 40.00th=[ 197], 50.00th=[ 251], 60.00th=[ 284], 00:31:37.659 | 70.00th=[ 309], 80.00th=[ 338], 90.00th=[ 359], 95.00th=[ 376], 00:31:37.659 | 99.00th=[ 426], 99.50th=[ 435], 99.90th=[ 460], 99.95th=[ 460], 00:31:37.659 | 99.99th=[ 460] 00:31:37.659 bw ( KiB/s): min= 128, max= 384, per=4.04%, avg=243.20, stdev=88.64, samples=20 00:31:37.659 iops : min= 32, max= 96, avg=60.80, stdev=22.16, samples=20 00:31:37.659 lat (msec) : 250=48.72%, 500=51.28% 00:31:37.659 cpu : usr=98.53%, sys=1.01%, ctx=23, majf=0, minf=9 00:31:37.659 IO depths : 1=3.2%, 2=9.5%, 4=25.0%, 8=53.0%, 16=9.3%, 32=0.0%, >=64=0.0% 00:31:37.659 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.659 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.659 issued rwts: total=624,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.659 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.659 filename0: (groupid=0, jobs=1): err= 0: pid=2955616: Sat Jul 13 10:17:43 2024 00:31:37.659 read: IOPS=61, BW=246KiB/s (252kB/s)(2488KiB/10106msec) 00:31:37.659 slat (usec): min=8, max=102, avg=37.13, stdev=22.10 00:31:37.659 clat (msec): min=126, max=493, avg=259.43, stdev=72.10 00:31:37.659 lat (msec): min=126, max=493, avg=259.47, stdev=72.08 00:31:37.659 clat percentiles (msec): 00:31:37.659 | 1.00th=[ 136], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 194], 00:31:37.659 | 30.00th=[ 194], 40.00th=[ 203], 50.00th=[ 247], 60.00th=[ 296], 00:31:37.659 | 70.00th=[ 309], 80.00th=[ 330], 90.00th=[ 363], 95.00th=[ 372], 00:31:37.659 | 99.00th=[ 397], 99.50th=[ 409], 99.90th=[ 493], 99.95th=[ 493], 00:31:37.659 | 99.99th=[ 493] 00:31:37.660 bw ( KiB/s): min= 128, max= 384, per=4.02%, avg=242.40, stdev=77.22, samples=20 00:31:37.660 iops : min= 32, max= 96, avg=60.60, stdev=19.30, samples=20 00:31:37.660 lat (msec) : 250=51.45%, 500=48.55% 00:31:37.660 cpu : usr=98.24%, sys=1.29%, ctx=37, majf=0, minf=9 00:31:37.660 IO depths : 1=1.8%, 2=8.0%, 4=25.1%, 8=54.5%, 16=10.6%, 32=0.0%, >=64=0.0% 00:31:37.660 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.660 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.660 issued rwts: total=622,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.660 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.660 filename0: (groupid=0, jobs=1): err= 0: pid=2955617: Sat Jul 13 10:17:43 2024 00:31:37.660 read: IOPS=60, BW=241KiB/s (247kB/s)(2432KiB/10099msec) 00:31:37.660 slat (usec): min=5, max=127, avg=23.77, stdev=12.45 00:31:37.660 clat (msec): min=182, max=457, avg=265.54, stdev=71.21 00:31:37.660 lat (msec): min=182, max=457, avg=265.57, stdev=71.21 00:31:37.660 clat percentiles (msec): 00:31:37.660 | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 186], 20.00th=[ 192], 00:31:37.660 | 30.00th=[ 197], 40.00th=[ 215], 50.00th=[ 255], 60.00th=[ 300], 00:31:37.660 | 70.00th=[ 309], 80.00th=[ 338], 90.00th=[ 359], 95.00th=[ 376], 00:31:37.660 | 99.00th=[ 426], 99.50th=[ 447], 99.90th=[ 460], 99.95th=[ 460], 00:31:37.660 | 99.99th=[ 460] 00:31:37.660 bw ( KiB/s): min= 128, max= 384, per=3.92%, avg=236.80, stdev=84.76, samples=20 00:31:37.660 iops : min= 32, max= 96, avg=59.20, stdev=21.19, samples=20 00:31:37.660 lat (msec) : 250=48.03%, 500=51.97% 00:31:37.660 cpu : usr=97.47%, sys=1.58%, ctx=79, majf=0, minf=9 00:31:37.660 IO depths : 1=5.6%, 2=11.8%, 4=25.0%, 8=50.7%, 16=6.9%, 32=0.0%, >=64=0.0% 00:31:37.660 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.660 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.660 issued rwts: total=608,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.660 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.660 filename0: (groupid=0, jobs=1): err= 0: pid=2955618: Sat Jul 13 10:17:43 2024 00:31:37.660 read: IOPS=61, BW=247KiB/s (253kB/s)(2496KiB/10117msec) 00:31:37.660 slat (usec): min=8, max=177, avg=38.22, stdev=21.51 00:31:37.660 clat (msec): min=129, max=462, avg=259.06, stdev=74.80 00:31:37.660 lat (msec): min=129, max=462, avg=259.10, stdev=74.79 00:31:37.660 clat percentiles (msec): 00:31:37.660 | 1.00th=[ 131], 5.00th=[ 180], 10.00th=[ 186], 20.00th=[ 192], 00:31:37.660 | 30.00th=[ 192], 40.00th=[ 199], 50.00th=[ 251], 60.00th=[ 288], 00:31:37.660 | 70.00th=[ 309], 80.00th=[ 338], 90.00th=[ 359], 95.00th=[ 376], 00:31:37.660 | 99.00th=[ 422], 99.50th=[ 447], 99.90th=[ 464], 99.95th=[ 464], 00:31:37.660 | 99.99th=[ 464] 00:31:37.660 bw ( KiB/s): min= 128, max= 384, per=4.04%, avg=243.20, stdev=87.73, samples=20 00:31:37.660 iops : min= 32, max= 96, avg=60.80, stdev=21.93, samples=20 00:31:37.660 lat (msec) : 250=49.68%, 500=50.32% 00:31:37.660 cpu : usr=98.09%, sys=1.20%, ctx=22, majf=0, minf=9 00:31:37.660 IO depths : 1=3.2%, 2=9.5%, 4=25.0%, 8=53.0%, 16=9.3%, 32=0.0%, >=64=0.0% 00:31:37.660 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.660 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.660 issued rwts: total=624,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.660 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.660 filename0: (groupid=0, jobs=1): err= 0: pid=2955619: Sat Jul 13 10:17:43 2024 00:31:37.660 read: IOPS=61, BW=246KiB/s (252kB/s)(2488KiB/10101msec) 00:31:37.660 slat (usec): min=8, max=111, avg=44.92, stdev=23.19 00:31:37.660 clat (msec): min=158, max=397, avg=259.20, stdev=71.66 00:31:37.660 lat (msec): min=158, max=397, avg=259.24, stdev=71.65 00:31:37.660 clat percentiles (msec): 00:31:37.660 | 1.00th=[ 159], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 192], 00:31:37.660 | 30.00th=[ 194], 40.00th=[ 199], 50.00th=[ 245], 60.00th=[ 296], 00:31:37.660 | 70.00th=[ 309], 80.00th=[ 334], 90.00th=[ 372], 95.00th=[ 376], 00:31:37.660 | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], 00:31:37.660 | 99.99th=[ 397] 00:31:37.660 bw ( KiB/s): min= 128, max= 384, per=4.02%, avg=242.40, stdev=81.96, samples=20 00:31:37.660 iops : min= 32, max= 96, avg=60.60, stdev=20.49, samples=20 00:31:37.660 lat (msec) : 250=51.13%, 500=48.87% 00:31:37.660 cpu : usr=97.99%, sys=1.37%, ctx=49, majf=0, minf=9 00:31:37.660 IO depths : 1=6.1%, 2=12.4%, 4=25.1%, 8=50.2%, 16=6.3%, 32=0.0%, >=64=0.0% 00:31:37.660 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.660 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.660 issued rwts: total=622,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.660 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.660 filename1: (groupid=0, jobs=1): err= 0: pid=2955620: Sat Jul 13 10:17:43 2024 00:31:37.660 read: IOPS=60, BW=241KiB/s (247kB/s)(2432KiB/10099msec) 00:31:37.660 slat (usec): min=13, max=115, avg=25.53, stdev=15.14 00:31:37.660 clat (msec): min=114, max=395, avg=265.53, stdev=71.14 00:31:37.660 lat (msec): min=114, max=395, avg=265.55, stdev=71.14 00:31:37.660 clat percentiles (msec): 00:31:37.660 | 1.00th=[ 122], 5.00th=[ 184], 10.00th=[ 186], 20.00th=[ 192], 00:31:37.660 | 30.00th=[ 197], 40.00th=[ 215], 50.00th=[ 275], 60.00th=[ 300], 00:31:37.660 | 70.00th=[ 309], 80.00th=[ 338], 90.00th=[ 359], 95.00th=[ 376], 00:31:37.660 | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], 00:31:37.660 | 99.99th=[ 397] 00:31:37.660 bw ( KiB/s): min= 128, max= 384, per=3.92%, avg=236.80, stdev=86.02, samples=20 00:31:37.660 iops : min= 32, max= 96, avg=59.20, stdev=21.51, samples=20 00:31:37.660 lat (msec) : 250=45.39%, 500=54.61% 00:31:37.660 cpu : usr=97.09%, sys=1.67%, ctx=140, majf=0, minf=9 00:31:37.660 IO depths : 1=5.3%, 2=11.5%, 4=25.0%, 8=51.0%, 16=7.2%, 32=0.0%, >=64=0.0% 00:31:37.660 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.660 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.660 issued rwts: total=608,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.660 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.660 filename1: (groupid=0, jobs=1): err= 0: pid=2955621: Sat Jul 13 10:17:43 2024 00:31:37.660 read: IOPS=61, BW=247KiB/s (253kB/s)(2496KiB/10116msec) 00:31:37.660 slat (usec): min=11, max=203, avg=48.09, stdev=35.40 00:31:37.660 clat (msec): min=127, max=460, avg=259.01, stdev=73.81 00:31:37.660 lat (msec): min=128, max=460, avg=259.06, stdev=73.84 00:31:37.660 clat percentiles (msec): 00:31:37.660 | 1.00th=[ 130], 5.00th=[ 184], 10.00th=[ 186], 20.00th=[ 192], 00:31:37.660 | 30.00th=[ 194], 40.00th=[ 199], 50.00th=[ 245], 60.00th=[ 288], 00:31:37.660 | 70.00th=[ 309], 80.00th=[ 338], 90.00th=[ 359], 95.00th=[ 376], 00:31:37.660 | 99.00th=[ 409], 99.50th=[ 430], 99.90th=[ 460], 99.95th=[ 460], 00:31:37.660 | 99.99th=[ 460] 00:31:37.660 bw ( KiB/s): min= 128, max= 384, per=4.04%, avg=243.20, stdev=86.65, samples=20 00:31:37.660 iops : min= 32, max= 96, avg=60.80, stdev=21.66, samples=20 00:31:37.660 lat (msec) : 250=51.28%, 500=48.72% 00:31:37.660 cpu : usr=96.15%, sys=2.24%, ctx=205, majf=0, minf=9 00:31:37.660 IO depths : 1=2.1%, 2=8.3%, 4=25.0%, 8=54.2%, 16=10.4%, 32=0.0%, >=64=0.0% 00:31:37.660 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.660 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.660 issued rwts: total=624,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.660 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.660 filename1: (groupid=0, jobs=1): err= 0: pid=2955622: Sat Jul 13 10:17:43 2024 00:31:37.660 read: IOPS=66, BW=265KiB/s (272kB/s)(2688KiB/10135msec) 00:31:37.660 slat (usec): min=6, max=128, avg=56.79, stdev=30.57 00:31:37.660 clat (msec): min=20, max=397, avg=239.44, stdev=79.52 00:31:37.660 lat (msec): min=20, max=397, avg=239.50, stdev=79.54 00:31:37.660 clat percentiles (msec): 00:31:37.660 | 1.00th=[ 21], 5.00th=[ 118], 10.00th=[ 167], 20.00th=[ 184], 00:31:37.660 | 30.00th=[ 192], 40.00th=[ 194], 50.00th=[ 239], 60.00th=[ 257], 00:31:37.660 | 70.00th=[ 300], 80.00th=[ 309], 90.00th=[ 334], 95.00th=[ 355], 00:31:37.660 | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], 00:31:37.660 | 99.99th=[ 397] 00:31:37.660 bw ( KiB/s): min= 128, max= 496, per=4.36%, avg=262.40, stdev=94.07, samples=20 00:31:37.660 iops : min= 32, max= 124, avg=65.60, stdev=23.52, samples=20 00:31:37.660 lat (msec) : 50=2.38%, 100=2.08%, 250=50.89%, 500=44.64% 00:31:37.660 cpu : usr=97.97%, sys=1.54%, ctx=47, majf=0, minf=9 00:31:37.660 IO depths : 1=4.9%, 2=11.2%, 4=25.0%, 8=51.3%, 16=7.6%, 32=0.0%, >=64=0.0% 00:31:37.660 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.660 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.660 issued rwts: total=672,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.660 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.660 filename1: (groupid=0, jobs=1): err= 0: pid=2955623: Sat Jul 13 10:17:43 2024 00:31:37.660 read: IOPS=61, BW=247KiB/s (253kB/s)(2496KiB/10117msec) 00:31:37.660 slat (usec): min=8, max=127, avg=39.13, stdev=20.91 00:31:37.660 clat (msec): min=159, max=397, avg=259.13, stdev=70.16 00:31:37.660 lat (msec): min=159, max=397, avg=259.16, stdev=70.17 00:31:37.660 clat percentiles (msec): 00:31:37.660 | 1.00th=[ 167], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 192], 00:31:37.660 | 30.00th=[ 194], 40.00th=[ 199], 50.00th=[ 247], 60.00th=[ 296], 00:31:37.660 | 70.00th=[ 309], 80.00th=[ 334], 90.00th=[ 363], 95.00th=[ 372], 00:31:37.660 | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], 00:31:37.660 | 99.99th=[ 397] 00:31:37.660 bw ( KiB/s): min= 128, max= 384, per=4.04%, avg=243.20, stdev=77.28, samples=20 00:31:37.660 iops : min= 32, max= 96, avg=60.80, stdev=19.32, samples=20 00:31:37.660 lat (msec) : 250=50.96%, 500=49.04% 00:31:37.660 cpu : usr=97.28%, sys=1.76%, ctx=29, majf=0, minf=9 00:31:37.660 IO depths : 1=0.3%, 2=6.6%, 4=25.0%, 8=55.9%, 16=12.2%, 32=0.0%, >=64=0.0% 00:31:37.660 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.660 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.660 issued rwts: total=624,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.660 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.660 filename1: (groupid=0, jobs=1): err= 0: pid=2955624: Sat Jul 13 10:17:43 2024 00:31:37.660 read: IOPS=60, BW=241KiB/s (247kB/s)(2432KiB/10098msec) 00:31:37.660 slat (nsec): min=8319, max=99492, avg=43740.38, stdev=22708.72 00:31:37.660 clat (msec): min=181, max=395, avg=265.33, stdev=69.89 00:31:37.660 lat (msec): min=181, max=395, avg=265.38, stdev=69.87 00:31:37.660 clat percentiles (msec): 00:31:37.660 | 1.00th=[ 182], 5.00th=[ 184], 10.00th=[ 186], 20.00th=[ 192], 00:31:37.660 | 30.00th=[ 194], 40.00th=[ 213], 50.00th=[ 255], 60.00th=[ 300], 00:31:37.660 | 70.00th=[ 309], 80.00th=[ 338], 90.00th=[ 359], 95.00th=[ 376], 00:31:37.660 | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], 00:31:37.660 | 99.99th=[ 397] 00:31:37.660 bw ( KiB/s): min= 128, max= 384, per=3.92%, avg=236.80, stdev=85.87, samples=20 00:31:37.660 iops : min= 32, max= 96, avg=59.20, stdev=21.47, samples=20 00:31:37.660 lat (msec) : 250=47.37%, 500=52.63% 00:31:37.661 cpu : usr=96.82%, sys=1.96%, ctx=81, majf=0, minf=9 00:31:37.661 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:31:37.661 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.661 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.661 issued rwts: total=608,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.661 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.661 filename1: (groupid=0, jobs=1): err= 0: pid=2955625: Sat Jul 13 10:17:43 2024 00:31:37.661 read: IOPS=60, BW=242KiB/s (248kB/s)(2432KiB/10036msec) 00:31:37.661 slat (usec): min=16, max=116, avg=37.62, stdev=21.69 00:31:37.661 clat (msec): min=182, max=397, avg=263.80, stdev=71.63 00:31:37.661 lat (msec): min=182, max=397, avg=263.83, stdev=71.64 00:31:37.661 clat percentiles (msec): 00:31:37.661 | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 186], 20.00th=[ 194], 00:31:37.661 | 30.00th=[ 194], 40.00th=[ 207], 50.00th=[ 247], 60.00th=[ 300], 00:31:37.661 | 70.00th=[ 317], 80.00th=[ 342], 90.00th=[ 372], 95.00th=[ 376], 00:31:37.661 | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], 00:31:37.661 | 99.99th=[ 397] 00:31:37.661 bw ( KiB/s): min= 128, max= 384, per=3.92%, avg=236.80, stdev=85.87, samples=20 00:31:37.661 iops : min= 32, max= 96, avg=59.20, stdev=21.47, samples=20 00:31:37.661 lat (msec) : 250=50.00%, 500=50.00% 00:31:37.661 cpu : usr=98.47%, sys=1.08%, ctx=28, majf=0, minf=9 00:31:37.661 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:31:37.661 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.661 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.661 issued rwts: total=608,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.661 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.661 filename1: (groupid=0, jobs=1): err= 0: pid=2955626: Sat Jul 13 10:17:43 2024 00:31:37.661 read: IOPS=61, BW=247KiB/s (253kB/s)(2496KiB/10117msec) 00:31:37.661 slat (usec): min=10, max=161, avg=47.91, stdev=32.01 00:31:37.661 clat (msec): min=163, max=384, avg=259.01, stdev=69.86 00:31:37.661 lat (msec): min=163, max=385, avg=259.05, stdev=69.88 00:31:37.661 clat percentiles (msec): 00:31:37.661 | 1.00th=[ 180], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 192], 00:31:37.661 | 30.00th=[ 192], 40.00th=[ 197], 50.00th=[ 253], 60.00th=[ 296], 00:31:37.661 | 70.00th=[ 309], 80.00th=[ 330], 90.00th=[ 363], 95.00th=[ 372], 00:31:37.661 | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], 00:31:37.661 | 99.99th=[ 384] 00:31:37.661 bw ( KiB/s): min= 128, max= 384, per=4.04%, avg=243.20, stdev=91.93, samples=20 00:31:37.661 iops : min= 32, max= 96, avg=60.80, stdev=22.98, samples=20 00:31:37.661 lat (msec) : 250=48.72%, 500=51.28% 00:31:37.661 cpu : usr=96.15%, sys=2.08%, ctx=165, majf=0, minf=9 00:31:37.661 IO depths : 1=6.1%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.4%, 32=0.0%, >=64=0.0% 00:31:37.661 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.661 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.661 issued rwts: total=624,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.661 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.661 filename1: (groupid=0, jobs=1): err= 0: pid=2955627: Sat Jul 13 10:17:43 2024 00:31:37.661 read: IOPS=61, BW=247KiB/s (253kB/s)(2496KiB/10116msec) 00:31:37.661 slat (nsec): min=8211, max=86238, avg=38051.02, stdev=17994.61 00:31:37.661 clat (msec): min=149, max=447, avg=259.03, stdev=70.58 00:31:37.661 lat (msec): min=149, max=447, avg=259.07, stdev=70.57 00:31:37.661 clat percentiles (msec): 00:31:37.661 | 1.00th=[ 150], 5.00th=[ 182], 10.00th=[ 184], 20.00th=[ 192], 00:31:37.661 | 30.00th=[ 194], 40.00th=[ 199], 50.00th=[ 251], 60.00th=[ 296], 00:31:37.661 | 70.00th=[ 309], 80.00th=[ 326], 90.00th=[ 368], 95.00th=[ 376], 00:31:37.661 | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 447], 99.95th=[ 447], 00:31:37.661 | 99.99th=[ 447] 00:31:37.661 bw ( KiB/s): min= 128, max= 384, per=4.04%, avg=243.20, stdev=91.93, samples=20 00:31:37.661 iops : min= 32, max= 96, avg=60.80, stdev=22.98, samples=20 00:31:37.661 lat (msec) : 250=48.72%, 500=51.28% 00:31:37.661 cpu : usr=98.34%, sys=1.23%, ctx=7, majf=0, minf=9 00:31:37.661 IO depths : 1=5.9%, 2=12.2%, 4=25.0%, 8=50.3%, 16=6.6%, 32=0.0%, >=64=0.0% 00:31:37.661 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.661 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.661 issued rwts: total=624,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.661 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.661 filename2: (groupid=0, jobs=1): err= 0: pid=2955628: Sat Jul 13 10:17:43 2024 00:31:37.661 read: IOPS=60, BW=242KiB/s (248kB/s)(2432KiB/10036msec) 00:31:37.661 slat (usec): min=4, max=195, avg=75.61, stdev=29.12 00:31:37.661 clat (msec): min=135, max=469, avg=263.47, stdev=75.85 00:31:37.661 lat (msec): min=135, max=469, avg=263.55, stdev=75.87 00:31:37.661 clat percentiles (msec): 00:31:37.661 | 1.00th=[ 138], 5.00th=[ 182], 10.00th=[ 184], 20.00th=[ 194], 00:31:37.661 | 30.00th=[ 194], 40.00th=[ 205], 50.00th=[ 245], 60.00th=[ 300], 00:31:37.661 | 70.00th=[ 317], 80.00th=[ 342], 90.00th=[ 372], 95.00th=[ 376], 00:31:37.661 | 99.00th=[ 435], 99.50th=[ 447], 99.90th=[ 468], 99.95th=[ 468], 00:31:37.661 | 99.99th=[ 468] 00:31:37.661 bw ( KiB/s): min= 128, max= 384, per=3.92%, avg=236.80, stdev=82.50, samples=20 00:31:37.661 iops : min= 32, max= 96, avg=59.20, stdev=20.63, samples=20 00:31:37.661 lat (msec) : 250=50.99%, 500=49.01% 00:31:37.661 cpu : usr=97.04%, sys=1.71%, ctx=93, majf=0, minf=9 00:31:37.661 IO depths : 1=3.3%, 2=9.5%, 4=25.0%, 8=53.0%, 16=9.2%, 32=0.0%, >=64=0.0% 00:31:37.661 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.661 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.661 issued rwts: total=608,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.661 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.661 filename2: (groupid=0, jobs=1): err= 0: pid=2955629: Sat Jul 13 10:17:43 2024 00:31:37.661 read: IOPS=60, BW=241KiB/s (247kB/s)(2432KiB/10099msec) 00:31:37.661 slat (nsec): min=8552, max=97340, avg=44144.13, stdev=22441.35 00:31:37.661 clat (msec): min=113, max=462, avg=265.38, stdev=74.86 00:31:37.661 lat (msec): min=113, max=462, avg=265.42, stdev=74.84 00:31:37.661 clat percentiles (msec): 00:31:37.661 | 1.00th=[ 116], 5.00th=[ 184], 10.00th=[ 186], 20.00th=[ 192], 00:31:37.661 | 30.00th=[ 194], 40.00th=[ 215], 50.00th=[ 264], 60.00th=[ 300], 00:31:37.661 | 70.00th=[ 309], 80.00th=[ 338], 90.00th=[ 359], 95.00th=[ 376], 00:31:37.661 | 99.00th=[ 439], 99.50th=[ 447], 99.90th=[ 464], 99.95th=[ 464], 00:31:37.661 | 99.99th=[ 464] 00:31:37.661 bw ( KiB/s): min= 128, max= 384, per=3.92%, avg=236.80, stdev=83.64, samples=20 00:31:37.661 iops : min= 32, max= 96, avg=59.20, stdev=20.91, samples=20 00:31:37.661 lat (msec) : 250=46.71%, 500=53.29% 00:31:37.661 cpu : usr=97.76%, sys=1.43%, ctx=23, majf=0, minf=9 00:31:37.661 IO depths : 1=3.5%, 2=9.7%, 4=25.0%, 8=52.8%, 16=9.0%, 32=0.0%, >=64=0.0% 00:31:37.661 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.661 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.661 issued rwts: total=608,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.661 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.661 filename2: (groupid=0, jobs=1): err= 0: pid=2955630: Sat Jul 13 10:17:43 2024 00:31:37.661 read: IOPS=61, BW=247KiB/s (253kB/s)(2496KiB/10106msec) 00:31:37.661 slat (usec): min=8, max=120, avg=51.54, stdev=27.49 00:31:37.661 clat (msec): min=137, max=568, avg=258.68, stdev=75.50 00:31:37.661 lat (msec): min=137, max=568, avg=258.73, stdev=75.49 00:31:37.661 clat percentiles (msec): 00:31:37.661 | 1.00th=[ 138], 5.00th=[ 182], 10.00th=[ 184], 20.00th=[ 192], 00:31:37.661 | 30.00th=[ 194], 40.00th=[ 203], 50.00th=[ 245], 60.00th=[ 279], 00:31:37.661 | 70.00th=[ 309], 80.00th=[ 330], 90.00th=[ 363], 95.00th=[ 372], 00:31:37.661 | 99.00th=[ 405], 99.50th=[ 527], 99.90th=[ 567], 99.95th=[ 567], 00:31:37.661 | 99.99th=[ 567] 00:31:37.661 bw ( KiB/s): min= 128, max= 384, per=4.04%, avg=243.20, stdev=77.28, samples=20 00:31:37.661 iops : min= 32, max= 96, avg=60.80, stdev=19.32, samples=20 00:31:37.661 lat (msec) : 250=51.92%, 500=47.12%, 750=0.96% 00:31:37.661 cpu : usr=98.30%, sys=1.23%, ctx=29, majf=0, minf=9 00:31:37.661 IO depths : 1=4.3%, 2=10.6%, 4=25.0%, 8=51.9%, 16=8.2%, 32=0.0%, >=64=0.0% 00:31:37.661 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.661 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.661 issued rwts: total=624,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.661 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.661 filename2: (groupid=0, jobs=1): err= 0: pid=2955631: Sat Jul 13 10:17:43 2024 00:31:37.661 read: IOPS=61, BW=246KiB/s (252kB/s)(2496KiB/10133msec) 00:31:37.661 slat (nsec): min=8698, max=55320, avg=20993.15, stdev=5645.23 00:31:37.661 clat (msec): min=108, max=462, avg=259.61, stdev=75.71 00:31:37.661 lat (msec): min=108, max=462, avg=259.63, stdev=75.71 00:31:37.661 clat percentiles (msec): 00:31:37.661 | 1.00th=[ 136], 5.00th=[ 176], 10.00th=[ 184], 20.00th=[ 192], 00:31:37.661 | 30.00th=[ 194], 40.00th=[ 197], 50.00th=[ 247], 60.00th=[ 300], 00:31:37.661 | 70.00th=[ 309], 80.00th=[ 338], 90.00th=[ 359], 95.00th=[ 376], 00:31:37.661 | 99.00th=[ 418], 99.50th=[ 435], 99.90th=[ 464], 99.95th=[ 464], 00:31:37.661 | 99.99th=[ 464] 00:31:37.661 bw ( KiB/s): min= 128, max= 384, per=4.04%, avg=243.20, stdev=89.85, samples=20 00:31:37.661 iops : min= 32, max= 96, avg=60.80, stdev=22.46, samples=20 00:31:37.661 lat (msec) : 250=52.24%, 500=47.76% 00:31:37.661 cpu : usr=97.70%, sys=1.63%, ctx=28, majf=0, minf=9 00:31:37.661 IO depths : 1=4.6%, 2=10.9%, 4=25.0%, 8=51.6%, 16=7.9%, 32=0.0%, >=64=0.0% 00:31:37.661 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.661 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.661 issued rwts: total=624,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.661 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.661 filename2: (groupid=0, jobs=1): err= 0: pid=2955632: Sat Jul 13 10:17:43 2024 00:31:37.661 read: IOPS=80, BW=322KiB/s (330kB/s)(3264KiB/10138msec) 00:31:37.661 slat (usec): min=6, max=137, avg=27.34, stdev=24.28 00:31:37.661 clat (msec): min=17, max=333, avg=198.33, stdev=51.71 00:31:37.661 lat (msec): min=17, max=333, avg=198.36, stdev=51.71 00:31:37.661 clat percentiles (msec): 00:31:37.661 | 1.00th=[ 18], 5.00th=[ 131], 10.00th=[ 157], 20.00th=[ 169], 00:31:37.661 | 30.00th=[ 186], 40.00th=[ 192], 50.00th=[ 194], 60.00th=[ 199], 00:31:37.661 | 70.00th=[ 211], 80.00th=[ 236], 90.00th=[ 264], 95.00th=[ 284], 00:31:37.661 | 99.00th=[ 296], 99.50th=[ 334], 99.90th=[ 334], 99.95th=[ 334], 00:31:37.661 | 99.99th=[ 334] 00:31:37.661 bw ( KiB/s): min= 256, max= 512, per=5.32%, avg=320.00, stdev=72.68, samples=20 00:31:37.661 iops : min= 64, max= 128, avg=80.00, stdev=18.17, samples=20 00:31:37.661 lat (msec) : 20=1.72%, 50=0.49%, 100=1.72%, 250=79.17%, 500=16.91% 00:31:37.661 cpu : usr=97.89%, sys=1.34%, ctx=27, majf=0, minf=9 00:31:37.661 IO depths : 1=1.2%, 2=7.2%, 4=24.3%, 8=56.0%, 16=11.3%, 32=0.0%, >=64=0.0% 00:31:37.661 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.662 complete : 0=0.0%, 4=94.1%, 8=0.3%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.662 issued rwts: total=816,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.662 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.662 filename2: (groupid=0, jobs=1): err= 0: pid=2955633: Sat Jul 13 10:17:43 2024 00:31:37.662 read: IOPS=61, BW=247KiB/s (253kB/s)(2496KiB/10116msec) 00:31:37.662 slat (usec): min=8, max=178, avg=57.19, stdev=24.42 00:31:37.662 clat (msec): min=178, max=395, avg=258.87, stdev=69.73 00:31:37.662 lat (msec): min=178, max=395, avg=258.93, stdev=69.73 00:31:37.662 clat percentiles (msec): 00:31:37.662 | 1.00th=[ 180], 5.00th=[ 184], 10.00th=[ 186], 20.00th=[ 192], 00:31:37.662 | 30.00th=[ 192], 40.00th=[ 197], 50.00th=[ 251], 60.00th=[ 296], 00:31:37.662 | 70.00th=[ 309], 80.00th=[ 326], 90.00th=[ 363], 95.00th=[ 372], 00:31:37.662 | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], 00:31:37.662 | 99.99th=[ 397] 00:31:37.662 bw ( KiB/s): min= 128, max= 384, per=4.04%, avg=243.20, stdev=90.90, samples=20 00:31:37.662 iops : min= 32, max= 96, avg=60.80, stdev=22.72, samples=20 00:31:37.662 lat (msec) : 250=48.72%, 500=51.28% 00:31:37.662 cpu : usr=97.26%, sys=1.53%, ctx=54, majf=0, minf=9 00:31:37.662 IO depths : 1=5.0%, 2=11.2%, 4=25.0%, 8=51.3%, 16=7.5%, 32=0.0%, >=64=0.0% 00:31:37.662 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.662 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.662 issued rwts: total=624,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.662 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.662 filename2: (groupid=0, jobs=1): err= 0: pid=2955634: Sat Jul 13 10:17:43 2024 00:31:37.662 read: IOPS=60, BW=241KiB/s (247kB/s)(2432KiB/10101msec) 00:31:37.662 slat (usec): min=12, max=186, avg=73.24, stdev=25.56 00:31:37.662 clat (msec): min=121, max=395, avg=265.16, stdev=72.24 00:31:37.662 lat (msec): min=121, max=395, avg=265.24, stdev=72.26 00:31:37.662 clat percentiles (msec): 00:31:37.662 | 1.00th=[ 125], 5.00th=[ 184], 10.00th=[ 186], 20.00th=[ 192], 00:31:37.662 | 30.00th=[ 194], 40.00th=[ 215], 50.00th=[ 266], 60.00th=[ 300], 00:31:37.662 | 70.00th=[ 326], 80.00th=[ 338], 90.00th=[ 359], 95.00th=[ 376], 00:31:37.662 | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], 00:31:37.662 | 99.99th=[ 397] 00:31:37.662 bw ( KiB/s): min= 128, max= 384, per=3.92%, avg=236.80, stdev=84.76, samples=20 00:31:37.662 iops : min= 32, max= 96, avg=59.20, stdev=21.19, samples=20 00:31:37.662 lat (msec) : 250=46.38%, 500=53.62% 00:31:37.662 cpu : usr=96.91%, sys=1.78%, ctx=271, majf=0, minf=9 00:31:37.662 IO depths : 1=4.8%, 2=11.0%, 4=25.0%, 8=51.5%, 16=7.7%, 32=0.0%, >=64=0.0% 00:31:37.662 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.662 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.662 issued rwts: total=608,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.662 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.662 filename2: (groupid=0, jobs=1): err= 0: pid=2955635: Sat Jul 13 10:17:43 2024 00:31:37.662 read: IOPS=61, BW=247KiB/s (253kB/s)(2496KiB/10118msec) 00:31:37.662 slat (nsec): min=7844, max=57178, avg=23981.83, stdev=9592.61 00:31:37.662 clat (msec): min=124, max=494, avg=259.18, stdev=72.56 00:31:37.662 lat (msec): min=124, max=494, avg=259.20, stdev=72.57 00:31:37.662 clat percentiles (msec): 00:31:37.662 | 1.00th=[ 138], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 192], 00:31:37.662 | 30.00th=[ 194], 40.00th=[ 205], 50.00th=[ 245], 60.00th=[ 296], 00:31:37.662 | 70.00th=[ 309], 80.00th=[ 326], 90.00th=[ 368], 95.00th=[ 376], 00:31:37.662 | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 493], 99.95th=[ 493], 00:31:37.662 | 99.99th=[ 493] 00:31:37.662 bw ( KiB/s): min= 128, max= 384, per=4.04%, avg=243.20, stdev=88.80, samples=20 00:31:37.662 iops : min= 32, max= 96, avg=60.80, stdev=22.20, samples=20 00:31:37.662 lat (msec) : 250=52.24%, 500=47.76% 00:31:37.662 cpu : usr=98.54%, sys=1.10%, ctx=23, majf=0, minf=9 00:31:37.662 IO depths : 1=1.6%, 2=7.9%, 4=25.0%, 8=54.6%, 16=10.9%, 32=0.0%, >=64=0.0% 00:31:37.662 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.662 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.662 issued rwts: total=624,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.662 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.662 00:31:37.662 Run status group 0 (all jobs): 00:31:37.662 READ: bw=6015KiB/s (6159kB/s), 241KiB/s-322KiB/s (247kB/s-330kB/s), io=59.5MiB (62.4MB), run=10036-10138msec 00:31:37.920 10:17:43 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:31:37.920 10:17:43 -- target/dif.sh@43 -- # local sub 00:31:37.920 10:17:43 -- target/dif.sh@45 -- # for sub in "$@" 00:31:37.920 10:17:43 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:37.920 10:17:43 -- target/dif.sh@36 -- # local sub_id=0 00:31:37.920 10:17:43 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:37.920 10:17:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:37.920 10:17:43 -- common/autotest_common.sh@10 -- # set +x 00:31:37.921 10:17:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:37.921 10:17:43 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:37.921 10:17:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:37.921 10:17:43 -- common/autotest_common.sh@10 -- # set +x 00:31:37.921 10:17:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:37.921 10:17:43 -- target/dif.sh@45 -- # for sub in "$@" 00:31:37.921 10:17:43 -- target/dif.sh@46 -- # destroy_subsystem 1 00:31:37.921 10:17:43 -- target/dif.sh@36 -- # local sub_id=1 00:31:37.921 10:17:43 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:37.921 10:17:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:37.921 10:17:43 -- common/autotest_common.sh@10 -- # set +x 00:31:37.921 10:17:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:37.921 10:17:43 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:31:37.921 10:17:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:37.921 10:17:43 -- common/autotest_common.sh@10 -- # set +x 00:31:37.921 10:17:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:37.921 10:17:43 -- target/dif.sh@45 -- # for sub in "$@" 00:31:37.921 10:17:43 -- target/dif.sh@46 -- # destroy_subsystem 2 00:31:37.921 10:17:43 -- target/dif.sh@36 -- # local sub_id=2 00:31:37.921 10:17:43 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:31:37.921 10:17:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:37.921 10:17:43 -- common/autotest_common.sh@10 -- # set +x 00:31:37.921 10:17:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:37.921 10:17:43 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:31:37.921 10:17:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:37.921 10:17:43 -- common/autotest_common.sh@10 -- # set +x 00:31:37.921 10:17:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:37.921 10:17:43 -- target/dif.sh@115 -- # NULL_DIF=1 00:31:37.921 10:17:43 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:31:37.921 10:17:43 -- target/dif.sh@115 -- # numjobs=2 00:31:37.921 10:17:43 -- target/dif.sh@115 -- # iodepth=8 00:31:37.921 10:17:43 -- target/dif.sh@115 -- # runtime=5 00:31:37.921 10:17:43 -- target/dif.sh@115 -- # files=1 00:31:37.921 10:17:43 -- target/dif.sh@117 -- # create_subsystems 0 1 00:31:37.921 10:17:43 -- target/dif.sh@28 -- # local sub 00:31:37.921 10:17:43 -- target/dif.sh@30 -- # for sub in "$@" 00:31:37.921 10:17:43 -- target/dif.sh@31 -- # create_subsystem 0 00:31:37.921 10:17:43 -- target/dif.sh@18 -- # local sub_id=0 00:31:37.921 10:17:43 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:37.921 10:17:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:37.921 10:17:43 -- common/autotest_common.sh@10 -- # set +x 00:31:37.921 bdev_null0 00:31:37.921 10:17:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:37.921 10:17:43 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:37.921 10:17:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:37.921 10:17:43 -- common/autotest_common.sh@10 -- # set +x 00:31:37.921 10:17:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:37.921 10:17:43 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:37.921 10:17:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:37.921 10:17:43 -- common/autotest_common.sh@10 -- # set +x 00:31:37.921 10:17:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:37.921 10:17:43 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:37.921 10:17:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:37.921 10:17:43 -- common/autotest_common.sh@10 -- # set +x 00:31:37.921 [2024-07-13 10:17:43.686889] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:37.921 10:17:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:37.921 10:17:43 -- target/dif.sh@30 -- # for sub in "$@" 00:31:37.921 10:17:43 -- target/dif.sh@31 -- # create_subsystem 1 00:31:37.921 10:17:43 -- target/dif.sh@18 -- # local sub_id=1 00:31:37.921 10:17:43 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:31:37.921 10:17:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:37.921 10:17:43 -- common/autotest_common.sh@10 -- # set +x 00:31:37.921 bdev_null1 00:31:37.921 10:17:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:37.921 10:17:43 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:31:37.921 10:17:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:37.921 10:17:43 -- common/autotest_common.sh@10 -- # set +x 00:31:37.921 10:17:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:37.921 10:17:43 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:31:37.921 10:17:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:37.921 10:17:43 -- common/autotest_common.sh@10 -- # set +x 00:31:37.921 10:17:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:37.921 10:17:43 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:37.921 10:17:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:37.921 10:17:43 -- common/autotest_common.sh@10 -- # set +x 00:31:37.921 10:17:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:37.921 10:17:43 -- target/dif.sh@118 -- # fio /dev/fd/62 00:31:37.921 10:17:43 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:31:37.921 10:17:43 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:31:37.921 10:17:43 -- nvmf/common.sh@520 -- # config=() 00:31:37.921 10:17:43 -- nvmf/common.sh@520 -- # local subsystem config 00:31:37.921 10:17:43 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:37.921 10:17:43 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:37.921 { 00:31:37.921 "params": { 00:31:37.921 "name": "Nvme$subsystem", 00:31:37.921 "trtype": "$TEST_TRANSPORT", 00:31:37.921 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:37.921 "adrfam": "ipv4", 00:31:37.921 "trsvcid": "$NVMF_PORT", 00:31:37.921 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:37.921 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:37.921 "hdgst": ${hdgst:-false}, 00:31:37.921 "ddgst": ${ddgst:-false} 00:31:37.921 }, 00:31:37.921 "method": "bdev_nvme_attach_controller" 00:31:37.921 } 00:31:37.921 EOF 00:31:37.921 )") 00:31:37.921 10:17:43 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:37.921 10:17:43 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:37.921 10:17:43 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:31:37.921 10:17:43 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:37.921 10:17:43 -- common/autotest_common.sh@1318 -- # local sanitizers 00:31:37.921 10:17:43 -- target/dif.sh@82 -- # gen_fio_conf 00:31:37.921 10:17:43 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:37.921 10:17:43 -- common/autotest_common.sh@1320 -- # shift 00:31:37.921 10:17:43 -- target/dif.sh@54 -- # local file 00:31:37.921 10:17:43 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:31:37.921 10:17:43 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:31:37.921 10:17:43 -- target/dif.sh@56 -- # cat 00:31:37.921 10:17:43 -- nvmf/common.sh@542 -- # cat 00:31:37.921 10:17:43 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:37.921 10:17:43 -- common/autotest_common.sh@1324 -- # grep libasan 00:31:37.921 10:17:43 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:31:37.921 10:17:43 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:37.921 10:17:43 -- target/dif.sh@72 -- # (( file <= files )) 00:31:37.921 10:17:43 -- target/dif.sh@73 -- # cat 00:31:37.921 10:17:43 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:37.921 10:17:43 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:37.921 { 00:31:37.921 "params": { 00:31:37.921 "name": "Nvme$subsystem", 00:31:37.921 "trtype": "$TEST_TRANSPORT", 00:31:37.921 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:37.921 "adrfam": "ipv4", 00:31:37.921 "trsvcid": "$NVMF_PORT", 00:31:37.921 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:37.921 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:37.921 "hdgst": ${hdgst:-false}, 00:31:37.921 "ddgst": ${ddgst:-false} 00:31:37.921 }, 00:31:37.921 "method": "bdev_nvme_attach_controller" 00:31:37.921 } 00:31:37.921 EOF 00:31:37.921 )") 00:31:37.921 10:17:43 -- nvmf/common.sh@542 -- # cat 00:31:37.921 10:17:43 -- target/dif.sh@72 -- # (( file++ )) 00:31:37.921 10:17:43 -- target/dif.sh@72 -- # (( file <= files )) 00:31:37.921 10:17:43 -- nvmf/common.sh@544 -- # jq . 00:31:37.921 10:17:43 -- nvmf/common.sh@545 -- # IFS=, 00:31:37.921 10:17:43 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:37.921 "params": { 00:31:37.921 "name": "Nvme0", 00:31:37.921 "trtype": "tcp", 00:31:37.921 "traddr": "10.0.0.2", 00:31:37.921 "adrfam": "ipv4", 00:31:37.921 "trsvcid": "4420", 00:31:37.921 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:37.921 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:37.921 "hdgst": false, 00:31:37.921 "ddgst": false 00:31:37.921 }, 00:31:37.921 "method": "bdev_nvme_attach_controller" 00:31:37.921 },{ 00:31:37.921 "params": { 00:31:37.921 "name": "Nvme1", 00:31:37.921 "trtype": "tcp", 00:31:37.921 "traddr": "10.0.0.2", 00:31:37.921 "adrfam": "ipv4", 00:31:37.921 "trsvcid": "4420", 00:31:37.921 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:37.921 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:37.921 "hdgst": false, 00:31:37.921 "ddgst": false 00:31:37.921 }, 00:31:37.921 "method": "bdev_nvme_attach_controller" 00:31:37.921 }' 00:31:38.181 10:17:43 -- common/autotest_common.sh@1324 -- # asan_lib= 00:31:38.181 10:17:43 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:31:38.181 10:17:43 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:31:38.181 10:17:43 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:38.181 10:17:43 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:31:38.181 10:17:43 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:31:38.181 10:17:43 -- common/autotest_common.sh@1324 -- # asan_lib= 00:31:38.181 10:17:43 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:31:38.181 10:17:43 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:38.181 10:17:43 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:38.181 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:31:38.181 ... 00:31:38.181 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:31:38.181 ... 00:31:38.181 fio-3.35 00:31:38.181 Starting 4 threads 00:31:38.440 EAL: No free 2048 kB hugepages reported on node 1 00:31:38.700 [2024-07-13 10:17:44.502077] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:38.700 [2024-07-13 10:17:44.502154] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:44.001 00:31:44.001 filename0: (groupid=0, jobs=1): err= 0: pid=2957074: Sat Jul 13 10:17:49 2024 00:31:44.001 read: IOPS=1970, BW=15.4MiB/s (16.1MB/s)(77.0MiB/5001msec) 00:31:44.001 slat (nsec): min=3850, max=60501, avg=15943.54, stdev=8378.29 00:31:44.001 clat (usec): min=731, max=7472, avg=4007.07, stdev=560.61 00:31:44.001 lat (usec): min=744, max=7483, avg=4023.01, stdev=560.25 00:31:44.001 clat percentiles (usec): 00:31:44.001 | 1.00th=[ 2671], 5.00th=[ 3294], 10.00th=[ 3490], 20.00th=[ 3720], 00:31:44.001 | 30.00th=[ 3851], 40.00th=[ 3916], 50.00th=[ 3949], 60.00th=[ 4015], 00:31:44.001 | 70.00th=[ 4080], 80.00th=[ 4178], 90.00th=[ 4424], 95.00th=[ 5342], 00:31:44.001 | 99.00th=[ 5932], 99.50th=[ 6194], 99.90th=[ 6587], 99.95th=[ 7111], 00:31:44.001 | 99.99th=[ 7504] 00:31:44.001 bw ( KiB/s): min=15600, max=16208, per=24.91%, avg=15791.89, stdev=231.39, samples=9 00:31:44.001 iops : min= 1950, max= 2026, avg=1973.89, stdev=28.99, samples=9 00:31:44.001 lat (usec) : 750=0.01%, 1000=0.03% 00:31:44.001 lat (msec) : 2=0.41%, 4=56.60%, 10=42.95% 00:31:44.001 cpu : usr=95.26%, sys=4.14%, ctx=65, majf=0, minf=46 00:31:44.001 IO depths : 1=0.1%, 2=10.4%, 4=62.2%, 8=27.4%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:44.001 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:44.001 complete : 0=0.0%, 4=92.3%, 8=7.7%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:44.001 issued rwts: total=9853,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:44.001 latency : target=0, window=0, percentile=100.00%, depth=8 00:31:44.001 filename0: (groupid=0, jobs=1): err= 0: pid=2957075: Sat Jul 13 10:17:49 2024 00:31:44.001 read: IOPS=1959, BW=15.3MiB/s (16.0MB/s)(76.6MiB/5002msec) 00:31:44.001 slat (nsec): min=3655, max=77222, avg=16029.64, stdev=7130.65 00:31:44.001 clat (usec): min=801, max=7607, avg=4030.73, stdev=598.13 00:31:44.001 lat (usec): min=815, max=7627, avg=4046.76, stdev=598.51 00:31:44.001 clat percentiles (usec): 00:31:44.001 | 1.00th=[ 2638], 5.00th=[ 3359], 10.00th=[ 3523], 20.00th=[ 3752], 00:31:44.001 | 30.00th=[ 3851], 40.00th=[ 3916], 50.00th=[ 3982], 60.00th=[ 4047], 00:31:44.001 | 70.00th=[ 4113], 80.00th=[ 4228], 90.00th=[ 4490], 95.00th=[ 5014], 00:31:44.001 | 99.00th=[ 6521], 99.50th=[ 6915], 99.90th=[ 7308], 99.95th=[ 7439], 00:31:44.001 | 99.99th=[ 7635] 00:31:44.001 bw ( KiB/s): min=15120, max=16832, per=24.79%, avg=15715.44, stdev=632.69, samples=9 00:31:44.001 iops : min= 1890, max= 2104, avg=1964.33, stdev=79.08, samples=9 00:31:44.001 lat (usec) : 1000=0.06% 00:31:44.001 lat (msec) : 2=0.65%, 4=54.22%, 10=45.06% 00:31:44.001 cpu : usr=94.88%, sys=4.50%, ctx=56, majf=0, minf=46 00:31:44.001 IO depths : 1=0.1%, 2=9.2%, 4=61.9%, 8=28.8%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:44.001 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:44.001 complete : 0=0.0%, 4=93.3%, 8=6.7%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:44.001 issued rwts: total=9800,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:44.001 latency : target=0, window=0, percentile=100.00%, depth=8 00:31:44.001 filename1: (groupid=0, jobs=1): err= 0: pid=2957076: Sat Jul 13 10:17:49 2024 00:31:44.001 read: IOPS=1988, BW=15.5MiB/s (16.3MB/s)(77.7MiB/5002msec) 00:31:44.001 slat (nsec): min=3812, max=60607, avg=16920.75, stdev=8139.97 00:31:44.001 clat (usec): min=704, max=7579, avg=3967.30, stdev=559.43 00:31:44.001 lat (usec): min=717, max=7589, avg=3984.22, stdev=559.52 00:31:44.001 clat percentiles (usec): 00:31:44.001 | 1.00th=[ 2540], 5.00th=[ 3228], 10.00th=[ 3490], 20.00th=[ 3654], 00:31:44.001 | 30.00th=[ 3818], 40.00th=[ 3884], 50.00th=[ 3949], 60.00th=[ 4015], 00:31:44.001 | 70.00th=[ 4080], 80.00th=[ 4146], 90.00th=[ 4359], 95.00th=[ 5080], 00:31:44.001 | 99.00th=[ 6063], 99.50th=[ 6194], 99.90th=[ 6915], 99.95th=[ 6980], 00:31:44.001 | 99.99th=[ 7570] 00:31:44.001 bw ( KiB/s): min=15568, max=16352, per=25.11%, avg=15918.22, stdev=263.08, samples=9 00:31:44.001 iops : min= 1946, max= 2044, avg=1989.78, stdev=32.89, samples=9 00:31:44.001 lat (usec) : 750=0.01%, 1000=0.05% 00:31:44.001 lat (msec) : 2=0.48%, 4=58.45%, 10=41.01% 00:31:44.001 cpu : usr=94.84%, sys=4.38%, ctx=12, majf=0, minf=43 00:31:44.001 IO depths : 1=0.2%, 2=9.3%, 4=63.1%, 8=27.4%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:44.001 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:44.001 complete : 0=0.0%, 4=92.4%, 8=7.6%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:44.001 issued rwts: total=9944,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:44.001 latency : target=0, window=0, percentile=100.00%, depth=8 00:31:44.001 filename1: (groupid=0, jobs=1): err= 0: pid=2957077: Sat Jul 13 10:17:49 2024 00:31:44.001 read: IOPS=2005, BW=15.7MiB/s (16.4MB/s)(78.4MiB/5002msec) 00:31:44.001 slat (nsec): min=3716, max=61914, avg=14589.54, stdev=7555.62 00:31:44.002 clat (usec): min=1006, max=7286, avg=3939.39, stdev=528.24 00:31:44.002 lat (usec): min=1019, max=7301, avg=3953.98, stdev=528.43 00:31:44.002 clat percentiles (usec): 00:31:44.002 | 1.00th=[ 2606], 5.00th=[ 3163], 10.00th=[ 3392], 20.00th=[ 3621], 00:31:44.002 | 30.00th=[ 3785], 40.00th=[ 3884], 50.00th=[ 3949], 60.00th=[ 3982], 00:31:44.002 | 70.00th=[ 4047], 80.00th=[ 4146], 90.00th=[ 4293], 95.00th=[ 5014], 00:31:44.002 | 99.00th=[ 5800], 99.50th=[ 5997], 99.90th=[ 6980], 99.95th=[ 7177], 00:31:44.002 | 99.99th=[ 7242] 00:31:44.002 bw ( KiB/s): min=15488, max=16816, per=25.29%, avg=16032.00, stdev=420.97, samples=9 00:31:44.002 iops : min= 1936, max= 2102, avg=2004.00, stdev=52.62, samples=9 00:31:44.002 lat (msec) : 2=0.10%, 4=60.41%, 10=39.49% 00:31:44.002 cpu : usr=95.18%, sys=4.26%, ctx=37, majf=0, minf=31 00:31:44.002 IO depths : 1=0.1%, 2=10.1%, 4=62.9%, 8=26.9%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:44.002 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:44.002 complete : 0=0.0%, 4=91.9%, 8=8.1%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:44.002 issued rwts: total=10034,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:44.002 latency : target=0, window=0, percentile=100.00%, depth=8 00:31:44.002 00:31:44.002 Run status group 0 (all jobs): 00:31:44.002 READ: bw=61.9MiB/s (64.9MB/s), 15.3MiB/s-15.7MiB/s (16.0MB/s-16.4MB/s), io=310MiB (325MB), run=5001-5002msec 00:31:44.002 10:17:49 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:31:44.002 10:17:49 -- target/dif.sh@43 -- # local sub 00:31:44.002 10:17:49 -- target/dif.sh@45 -- # for sub in "$@" 00:31:44.002 10:17:49 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:44.002 10:17:49 -- target/dif.sh@36 -- # local sub_id=0 00:31:44.002 10:17:49 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:44.002 10:17:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:44.002 10:17:49 -- common/autotest_common.sh@10 -- # set +x 00:31:44.262 10:17:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:44.262 10:17:49 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:44.262 10:17:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:44.262 10:17:49 -- common/autotest_common.sh@10 -- # set +x 00:31:44.262 10:17:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:44.262 10:17:49 -- target/dif.sh@45 -- # for sub in "$@" 00:31:44.262 10:17:49 -- target/dif.sh@46 -- # destroy_subsystem 1 00:31:44.262 10:17:49 -- target/dif.sh@36 -- # local sub_id=1 00:31:44.262 10:17:49 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:44.262 10:17:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:44.262 10:17:49 -- common/autotest_common.sh@10 -- # set +x 00:31:44.262 10:17:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:44.262 10:17:49 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:31:44.262 10:17:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:44.262 10:17:49 -- common/autotest_common.sh@10 -- # set +x 00:31:44.262 10:17:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:44.262 00:31:44.262 real 0m24.144s 00:31:44.262 user 4m33.974s 00:31:44.262 sys 0m6.672s 00:31:44.262 10:17:49 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:31:44.262 10:17:49 -- common/autotest_common.sh@10 -- # set +x 00:31:44.262 ************************************ 00:31:44.262 END TEST fio_dif_rand_params 00:31:44.262 ************************************ 00:31:44.262 10:17:49 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:31:44.262 10:17:49 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:31:44.262 10:17:49 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:31:44.262 10:17:49 -- common/autotest_common.sh@10 -- # set +x 00:31:44.262 ************************************ 00:31:44.262 START TEST fio_dif_digest 00:31:44.262 ************************************ 00:31:44.262 10:17:49 -- common/autotest_common.sh@1104 -- # fio_dif_digest 00:31:44.262 10:17:49 -- target/dif.sh@123 -- # local NULL_DIF 00:31:44.262 10:17:49 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:31:44.262 10:17:49 -- target/dif.sh@125 -- # local hdgst ddgst 00:31:44.262 10:17:49 -- target/dif.sh@127 -- # NULL_DIF=3 00:31:44.262 10:17:49 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:31:44.262 10:17:49 -- target/dif.sh@127 -- # numjobs=3 00:31:44.262 10:17:49 -- target/dif.sh@127 -- # iodepth=3 00:31:44.262 10:17:49 -- target/dif.sh@127 -- # runtime=10 00:31:44.262 10:17:49 -- target/dif.sh@128 -- # hdgst=true 00:31:44.262 10:17:49 -- target/dif.sh@128 -- # ddgst=true 00:31:44.262 10:17:49 -- target/dif.sh@130 -- # create_subsystems 0 00:31:44.262 10:17:49 -- target/dif.sh@28 -- # local sub 00:31:44.262 10:17:49 -- target/dif.sh@30 -- # for sub in "$@" 00:31:44.262 10:17:49 -- target/dif.sh@31 -- # create_subsystem 0 00:31:44.262 10:17:49 -- target/dif.sh@18 -- # local sub_id=0 00:31:44.262 10:17:49 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:31:44.262 10:17:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:44.262 10:17:49 -- common/autotest_common.sh@10 -- # set +x 00:31:44.262 bdev_null0 00:31:44.262 10:17:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:44.262 10:17:49 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:44.262 10:17:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:44.262 10:17:49 -- common/autotest_common.sh@10 -- # set +x 00:31:44.262 10:17:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:44.262 10:17:49 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:44.262 10:17:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:44.262 10:17:49 -- common/autotest_common.sh@10 -- # set +x 00:31:44.262 10:17:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:44.262 10:17:49 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:44.262 10:17:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:44.262 10:17:49 -- common/autotest_common.sh@10 -- # set +x 00:31:44.262 [2024-07-13 10:17:49.908552] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:44.262 10:17:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:44.262 10:17:49 -- target/dif.sh@131 -- # fio /dev/fd/62 00:31:44.262 10:17:49 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:31:44.262 10:17:49 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:31:44.262 10:17:49 -- nvmf/common.sh@520 -- # config=() 00:31:44.262 10:17:49 -- nvmf/common.sh@520 -- # local subsystem config 00:31:44.262 10:17:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:44.262 10:17:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:44.262 { 00:31:44.262 "params": { 00:31:44.262 "name": "Nvme$subsystem", 00:31:44.262 "trtype": "$TEST_TRANSPORT", 00:31:44.262 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:44.262 "adrfam": "ipv4", 00:31:44.262 "trsvcid": "$NVMF_PORT", 00:31:44.262 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:44.262 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:44.262 "hdgst": ${hdgst:-false}, 00:31:44.262 "ddgst": ${ddgst:-false} 00:31:44.262 }, 00:31:44.262 "method": "bdev_nvme_attach_controller" 00:31:44.262 } 00:31:44.262 EOF 00:31:44.262 )") 00:31:44.262 10:17:49 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:44.262 10:17:49 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:44.262 10:17:49 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:31:44.262 10:17:49 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:44.262 10:17:49 -- common/autotest_common.sh@1318 -- # local sanitizers 00:31:44.262 10:17:49 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:44.262 10:17:49 -- target/dif.sh@82 -- # gen_fio_conf 00:31:44.262 10:17:49 -- common/autotest_common.sh@1320 -- # shift 00:31:44.262 10:17:49 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:31:44.262 10:17:49 -- target/dif.sh@54 -- # local file 00:31:44.262 10:17:49 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:31:44.262 10:17:49 -- target/dif.sh@56 -- # cat 00:31:44.262 10:17:49 -- nvmf/common.sh@542 -- # cat 00:31:44.262 10:17:49 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:44.262 10:17:49 -- common/autotest_common.sh@1324 -- # grep libasan 00:31:44.262 10:17:49 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:31:44.262 10:17:49 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:44.262 10:17:49 -- target/dif.sh@72 -- # (( file <= files )) 00:31:44.262 10:17:49 -- nvmf/common.sh@544 -- # jq . 00:31:44.262 10:17:49 -- nvmf/common.sh@545 -- # IFS=, 00:31:44.262 10:17:49 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:44.262 "params": { 00:31:44.262 "name": "Nvme0", 00:31:44.262 "trtype": "tcp", 00:31:44.262 "traddr": "10.0.0.2", 00:31:44.262 "adrfam": "ipv4", 00:31:44.262 "trsvcid": "4420", 00:31:44.262 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:44.262 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:44.262 "hdgst": true, 00:31:44.262 "ddgst": true 00:31:44.262 }, 00:31:44.262 "method": "bdev_nvme_attach_controller" 00:31:44.262 }' 00:31:44.262 10:17:49 -- common/autotest_common.sh@1324 -- # asan_lib= 00:31:44.262 10:17:49 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:31:44.262 10:17:49 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:31:44.262 10:17:49 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:44.262 10:17:49 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:31:44.262 10:17:49 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:31:44.262 10:17:49 -- common/autotest_common.sh@1324 -- # asan_lib= 00:31:44.262 10:17:49 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:31:44.262 10:17:49 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:44.262 10:17:49 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:44.521 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:31:44.521 ... 00:31:44.521 fio-3.35 00:31:44.521 Starting 3 threads 00:31:44.521 EAL: No free 2048 kB hugepages reported on node 1 00:31:44.779 [2024-07-13 10:17:50.521026] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:44.779 [2024-07-13 10:17:50.521086] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:56.998 00:31:56.998 filename0: (groupid=0, jobs=1): err= 0: pid=2957859: Sat Jul 13 10:18:00 2024 00:31:56.998 read: IOPS=212, BW=26.6MiB/s (27.9MB/s)(267MiB/10046msec) 00:31:56.998 slat (nsec): min=4361, max=38359, avg=16018.81, stdev=3541.88 00:31:56.998 clat (usec): min=8695, max=53982, avg=14061.78, stdev=1604.56 00:31:56.998 lat (usec): min=8709, max=54000, avg=14077.80, stdev=1604.61 00:31:56.998 clat percentiles (usec): 00:31:56.998 | 1.00th=[10945], 5.00th=[12256], 10.00th=[12649], 20.00th=[13173], 00:31:56.998 | 30.00th=[13566], 40.00th=[13829], 50.00th=[14091], 60.00th=[14222], 00:31:56.998 | 70.00th=[14484], 80.00th=[14877], 90.00th=[15401], 95.00th=[15926], 00:31:56.998 | 99.00th=[16909], 99.50th=[17171], 99.90th=[22676], 99.95th=[45876], 00:31:56.998 | 99.99th=[53740] 00:31:56.998 bw ( KiB/s): min=26112, max=28928, per=33.61%, avg=27317.80, stdev=649.58, samples=20 00:31:56.998 iops : min= 204, max= 226, avg=213.40, stdev= 5.11, samples=20 00:31:56.998 lat (msec) : 10=0.80%, 20=99.06%, 50=0.09%, 100=0.05% 00:31:56.998 cpu : usr=94.47%, sys=5.02%, ctx=12, majf=0, minf=131 00:31:56.998 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:56.998 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:56.998 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:56.998 issued rwts: total=2137,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:56.998 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:56.998 filename0: (groupid=0, jobs=1): err= 0: pid=2957861: Sat Jul 13 10:18:00 2024 00:31:56.998 read: IOPS=215, BW=27.0MiB/s (28.3MB/s)(271MiB/10045msec) 00:31:56.998 slat (nsec): min=4351, max=37396, avg=15960.54, stdev=3449.02 00:31:56.998 clat (usec): min=8977, max=55287, avg=13872.54, stdev=1655.26 00:31:56.998 lat (usec): min=8990, max=55306, avg=13888.50, stdev=1655.38 00:31:56.998 clat percentiles (usec): 00:31:56.998 | 1.00th=[10552], 5.00th=[11994], 10.00th=[12387], 20.00th=[12911], 00:31:56.998 | 30.00th=[13304], 40.00th=[13566], 50.00th=[13829], 60.00th=[14091], 00:31:56.998 | 70.00th=[14353], 80.00th=[14746], 90.00th=[15270], 95.00th=[15795], 00:31:56.998 | 99.00th=[16581], 99.50th=[17171], 99.90th=[22152], 99.95th=[49546], 00:31:56.998 | 99.99th=[55313] 00:31:56.998 bw ( KiB/s): min=26880, max=28416, per=34.08%, avg=27699.20, stdev=403.49, samples=20 00:31:56.998 iops : min= 210, max= 222, avg=216.40, stdev= 3.15, samples=20 00:31:56.998 lat (msec) : 10=0.55%, 20=99.31%, 50=0.09%, 100=0.05% 00:31:56.998 cpu : usr=94.65%, sys=4.87%, ctx=24, majf=0, minf=107 00:31:56.998 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:56.998 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:56.998 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:56.998 issued rwts: total=2166,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:56.998 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:56.998 filename0: (groupid=0, jobs=1): err= 0: pid=2957862: Sat Jul 13 10:18:00 2024 00:31:56.998 read: IOPS=206, BW=25.8MiB/s (27.1MB/s)(260MiB/10045msec) 00:31:56.998 slat (nsec): min=4316, max=84760, avg=17368.67, stdev=4698.99 00:31:56.998 clat (usec): min=11043, max=56975, avg=14453.00, stdev=2585.73 00:31:56.998 lat (usec): min=11057, max=56994, avg=14470.37, stdev=2585.88 00:31:56.998 clat percentiles (usec): 00:31:56.998 | 1.00th=[11731], 5.00th=[12518], 10.00th=[12911], 20.00th=[13435], 00:31:56.998 | 30.00th=[13698], 40.00th=[13960], 50.00th=[14353], 60.00th=[14615], 00:31:56.998 | 70.00th=[14877], 80.00th=[15270], 90.00th=[15795], 95.00th=[16188], 00:31:56.998 | 99.00th=[17433], 99.50th=[19006], 99.90th=[55837], 99.95th=[56361], 00:31:56.998 | 99.99th=[56886] 00:31:56.998 bw ( KiB/s): min=24064, max=27648, per=32.65%, avg=26537.10, stdev=796.67, samples=20 00:31:56.998 iops : min= 188, max= 216, avg=207.30, stdev= 6.20, samples=20 00:31:56.998 lat (msec) : 20=99.66%, 50=0.05%, 100=0.29% 00:31:56.998 cpu : usr=94.59%, sys=4.93%, ctx=19, majf=0, minf=177 00:31:56.998 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:56.998 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:56.998 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:56.998 issued rwts: total=2076,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:56.998 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:56.998 00:31:56.998 Run status group 0 (all jobs): 00:31:56.998 READ: bw=79.4MiB/s (83.2MB/s), 25.8MiB/s-27.0MiB/s (27.1MB/s-28.3MB/s), io=797MiB (836MB), run=10045-10046msec 00:31:56.998 10:18:00 -- target/dif.sh@132 -- # destroy_subsystems 0 00:31:56.998 10:18:00 -- target/dif.sh@43 -- # local sub 00:31:56.998 10:18:00 -- target/dif.sh@45 -- # for sub in "$@" 00:31:56.998 10:18:00 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:56.998 10:18:00 -- target/dif.sh@36 -- # local sub_id=0 00:31:56.998 10:18:00 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:56.998 10:18:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:56.998 10:18:00 -- common/autotest_common.sh@10 -- # set +x 00:31:56.998 10:18:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:56.998 10:18:00 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:56.998 10:18:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:56.998 10:18:00 -- common/autotest_common.sh@10 -- # set +x 00:31:56.998 10:18:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:56.998 00:31:56.998 real 0m11.003s 00:31:56.998 user 0m29.605s 00:31:56.998 sys 0m1.730s 00:31:56.998 10:18:00 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:31:56.998 10:18:00 -- common/autotest_common.sh@10 -- # set +x 00:31:56.998 ************************************ 00:31:56.998 END TEST fio_dif_digest 00:31:56.998 ************************************ 00:31:56.998 10:18:00 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:31:56.998 10:18:00 -- target/dif.sh@147 -- # nvmftestfini 00:31:56.998 10:18:00 -- nvmf/common.sh@476 -- # nvmfcleanup 00:31:56.998 10:18:00 -- nvmf/common.sh@116 -- # sync 00:31:56.998 10:18:00 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:31:56.998 10:18:00 -- nvmf/common.sh@119 -- # set +e 00:31:56.998 10:18:00 -- nvmf/common.sh@120 -- # for i in {1..20} 00:31:56.998 10:18:00 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:31:56.998 rmmod nvme_tcp 00:31:56.998 rmmod nvme_fabrics 00:31:56.998 rmmod nvme_keyring 00:31:56.998 10:18:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:31:56.998 10:18:00 -- nvmf/common.sh@123 -- # set -e 00:31:56.998 10:18:00 -- nvmf/common.sh@124 -- # return 0 00:31:56.998 10:18:00 -- nvmf/common.sh@477 -- # '[' -n 2951537 ']' 00:31:56.998 10:18:00 -- nvmf/common.sh@478 -- # killprocess 2951537 00:31:56.998 10:18:00 -- common/autotest_common.sh@926 -- # '[' -z 2951537 ']' 00:31:56.998 10:18:00 -- common/autotest_common.sh@930 -- # kill -0 2951537 00:31:56.998 10:18:00 -- common/autotest_common.sh@931 -- # uname 00:31:56.998 10:18:00 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:31:56.998 10:18:00 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2951537 00:31:56.998 10:18:01 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:31:56.998 10:18:01 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:31:56.998 10:18:01 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2951537' 00:31:56.998 killing process with pid 2951537 00:31:56.998 10:18:01 -- common/autotest_common.sh@945 -- # kill 2951537 00:31:56.998 10:18:01 -- common/autotest_common.sh@950 -- # wait 2951537 00:31:56.998 10:18:01 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:31:56.998 10:18:01 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:31:56.998 Waiting for block devices as requested 00:31:56.998 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:31:56.998 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:31:56.998 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:31:56.998 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:31:56.998 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:31:56.998 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:31:57.256 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:31:57.256 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:31:57.256 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:31:57.256 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:31:57.513 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:31:57.513 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:31:57.513 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:31:57.513 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:31:57.771 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:31:57.771 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:31:57.771 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:31:58.030 10:18:03 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:31:58.030 10:18:03 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:31:58.030 10:18:03 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:31:58.030 10:18:03 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:31:58.030 10:18:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:58.030 10:18:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:58.030 10:18:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:59.931 10:18:05 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:31:59.931 00:31:59.931 real 1m7.129s 00:31:59.931 user 6m32.119s 00:31:59.931 sys 0m17.218s 00:31:59.931 10:18:05 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:31:59.931 10:18:05 -- common/autotest_common.sh@10 -- # set +x 00:31:59.931 ************************************ 00:31:59.931 END TEST nvmf_dif 00:31:59.931 ************************************ 00:31:59.931 10:18:05 -- spdk/autotest.sh@301 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:31:59.931 10:18:05 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:31:59.931 10:18:05 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:31:59.931 10:18:05 -- common/autotest_common.sh@10 -- # set +x 00:31:59.931 ************************************ 00:31:59.931 START TEST nvmf_abort_qd_sizes 00:31:59.931 ************************************ 00:31:59.931 10:18:05 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:31:59.931 * Looking for test storage... 00:31:59.931 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:31:59.931 10:18:05 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:31:59.931 10:18:05 -- nvmf/common.sh@7 -- # uname -s 00:31:59.931 10:18:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:59.931 10:18:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:59.931 10:18:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:59.931 10:18:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:59.931 10:18:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:59.931 10:18:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:59.931 10:18:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:59.931 10:18:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:59.931 10:18:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:59.931 10:18:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:59.931 10:18:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:31:59.931 10:18:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:31:59.931 10:18:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:59.931 10:18:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:59.931 10:18:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:59.931 10:18:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:59.931 10:18:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:59.931 10:18:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:59.931 10:18:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:59.931 10:18:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:59.931 10:18:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:59.931 10:18:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:59.931 10:18:05 -- paths/export.sh@5 -- # export PATH 00:31:59.931 10:18:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:59.931 10:18:05 -- nvmf/common.sh@46 -- # : 0 00:31:59.931 10:18:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:31:59.931 10:18:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:31:59.931 10:18:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:31:59.931 10:18:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:59.931 10:18:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:59.931 10:18:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:31:59.931 10:18:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:31:59.931 10:18:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:31:59.931 10:18:05 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:31:59.931 10:18:05 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:31:59.931 10:18:05 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:31:59.931 10:18:05 -- nvmf/common.sh@436 -- # prepare_net_devs 00:31:59.932 10:18:05 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:31:59.932 10:18:05 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:31:59.932 10:18:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:59.932 10:18:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:59.932 10:18:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:59.932 10:18:05 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:31:59.932 10:18:05 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:31:59.932 10:18:05 -- nvmf/common.sh@284 -- # xtrace_disable 00:31:59.932 10:18:05 -- common/autotest_common.sh@10 -- # set +x 00:32:01.833 10:18:07 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:32:01.833 10:18:07 -- nvmf/common.sh@290 -- # pci_devs=() 00:32:01.833 10:18:07 -- nvmf/common.sh@290 -- # local -a pci_devs 00:32:01.833 10:18:07 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:32:01.833 10:18:07 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:32:01.833 10:18:07 -- nvmf/common.sh@292 -- # pci_drivers=() 00:32:01.833 10:18:07 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:32:01.833 10:18:07 -- nvmf/common.sh@294 -- # net_devs=() 00:32:01.833 10:18:07 -- nvmf/common.sh@294 -- # local -ga net_devs 00:32:01.833 10:18:07 -- nvmf/common.sh@295 -- # e810=() 00:32:01.833 10:18:07 -- nvmf/common.sh@295 -- # local -ga e810 00:32:01.833 10:18:07 -- nvmf/common.sh@296 -- # x722=() 00:32:01.833 10:18:07 -- nvmf/common.sh@296 -- # local -ga x722 00:32:01.833 10:18:07 -- nvmf/common.sh@297 -- # mlx=() 00:32:01.833 10:18:07 -- nvmf/common.sh@297 -- # local -ga mlx 00:32:01.833 10:18:07 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:32:01.833 10:18:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:32:01.833 10:18:07 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:32:01.833 10:18:07 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:32:01.833 10:18:07 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:32:01.833 10:18:07 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:32:01.833 10:18:07 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:32:01.833 10:18:07 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:32:01.833 10:18:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:32:01.833 10:18:07 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:32:01.833 10:18:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:32:01.833 10:18:07 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:32:01.833 10:18:07 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:32:01.833 10:18:07 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:32:01.833 10:18:07 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:32:01.833 10:18:07 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:32:01.833 10:18:07 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:32:01.833 10:18:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:01.833 10:18:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:32:01.833 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:32:01.833 10:18:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:01.833 10:18:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:01.833 10:18:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:01.834 10:18:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:01.834 10:18:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:01.834 10:18:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:01.834 10:18:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:32:01.834 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:32:01.834 10:18:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:01.834 10:18:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:01.834 10:18:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:01.834 10:18:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:01.834 10:18:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:01.834 10:18:07 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:32:01.834 10:18:07 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:32:01.834 10:18:07 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:32:01.834 10:18:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:01.834 10:18:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:01.834 10:18:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:01.834 10:18:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:01.834 10:18:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:32:01.834 Found net devices under 0000:0a:00.0: cvl_0_0 00:32:01.834 10:18:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:01.834 10:18:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:01.834 10:18:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:01.834 10:18:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:01.834 10:18:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:01.834 10:18:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:32:01.834 Found net devices under 0000:0a:00.1: cvl_0_1 00:32:01.834 10:18:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:01.834 10:18:07 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:32:01.834 10:18:07 -- nvmf/common.sh@402 -- # is_hw=yes 00:32:01.834 10:18:07 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:32:01.834 10:18:07 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:32:01.834 10:18:07 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:32:01.834 10:18:07 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:32:01.834 10:18:07 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:32:01.834 10:18:07 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:32:01.834 10:18:07 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:32:01.834 10:18:07 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:32:01.834 10:18:07 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:32:01.834 10:18:07 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:32:01.834 10:18:07 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:32:01.834 10:18:07 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:32:01.834 10:18:07 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:32:01.834 10:18:07 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:32:01.834 10:18:07 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:32:01.834 10:18:07 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:32:02.092 10:18:07 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:32:02.092 10:18:07 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:32:02.092 10:18:07 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:32:02.092 10:18:07 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:32:02.092 10:18:07 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:32:02.092 10:18:07 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:32:02.092 10:18:07 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:32:02.092 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:32:02.092 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.117 ms 00:32:02.092 00:32:02.092 --- 10.0.0.2 ping statistics --- 00:32:02.092 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:02.092 rtt min/avg/max/mdev = 0.117/0.117/0.117/0.000 ms 00:32:02.092 10:18:07 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:32:02.092 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:32:02.092 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.173 ms 00:32:02.092 00:32:02.092 --- 10.0.0.1 ping statistics --- 00:32:02.092 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:02.092 rtt min/avg/max/mdev = 0.173/0.173/0.173/0.000 ms 00:32:02.092 10:18:07 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:32:02.092 10:18:07 -- nvmf/common.sh@410 -- # return 0 00:32:02.092 10:18:07 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:32:02.092 10:18:07 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:32:03.472 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:32:03.472 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:32:03.472 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:32:03.472 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:32:03.472 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:32:03.472 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:32:03.472 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:32:03.472 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:32:03.472 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:32:03.472 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:32:03.472 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:32:03.472 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:32:03.472 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:32:03.472 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:32:03.472 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:32:03.472 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:32:04.411 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:32:04.411 10:18:10 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:32:04.411 10:18:10 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:32:04.411 10:18:10 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:32:04.411 10:18:10 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:32:04.411 10:18:10 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:32:04.411 10:18:10 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:32:04.411 10:18:10 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:32:04.411 10:18:10 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:32:04.411 10:18:10 -- common/autotest_common.sh@712 -- # xtrace_disable 00:32:04.411 10:18:10 -- common/autotest_common.sh@10 -- # set +x 00:32:04.411 10:18:10 -- nvmf/common.sh@469 -- # nvmfpid=2963478 00:32:04.411 10:18:10 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:32:04.411 10:18:10 -- nvmf/common.sh@470 -- # waitforlisten 2963478 00:32:04.411 10:18:10 -- common/autotest_common.sh@819 -- # '[' -z 2963478 ']' 00:32:04.411 10:18:10 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:32:04.411 10:18:10 -- common/autotest_common.sh@824 -- # local max_retries=100 00:32:04.411 10:18:10 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:32:04.411 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:32:04.411 10:18:10 -- common/autotest_common.sh@828 -- # xtrace_disable 00:32:04.411 10:18:10 -- common/autotest_common.sh@10 -- # set +x 00:32:04.411 [2024-07-13 10:18:10.158853] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... 00:32:04.411 [2024-07-13 10:18:10.158937] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:32:04.411 EAL: No free 2048 kB hugepages reported on node 1 00:32:04.411 [2024-07-13 10:18:10.226211] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:32:04.670 [2024-07-13 10:18:10.312279] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:32:04.670 [2024-07-13 10:18:10.312431] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:32:04.670 [2024-07-13 10:18:10.312448] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:32:04.670 [2024-07-13 10:18:10.312460] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:32:04.670 [2024-07-13 10:18:10.312511] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:32:04.670 [2024-07-13 10:18:10.312568] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:32:04.670 [2024-07-13 10:18:10.312645] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:32:04.670 [2024-07-13 10:18:10.312647] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:32:05.609 10:18:11 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:32:05.609 10:18:11 -- common/autotest_common.sh@852 -- # return 0 00:32:05.609 10:18:11 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:32:05.609 10:18:11 -- common/autotest_common.sh@718 -- # xtrace_disable 00:32:05.609 10:18:11 -- common/autotest_common.sh@10 -- # set +x 00:32:05.609 10:18:11 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:32:05.609 10:18:11 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:32:05.609 10:18:11 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:32:05.609 10:18:11 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:32:05.609 10:18:11 -- scripts/common.sh@311 -- # local bdf bdfs 00:32:05.609 10:18:11 -- scripts/common.sh@312 -- # local nvmes 00:32:05.609 10:18:11 -- scripts/common.sh@314 -- # [[ -n 0000:88:00.0 ]] 00:32:05.609 10:18:11 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:32:05.609 10:18:11 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:32:05.609 10:18:11 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:88:00.0 ]] 00:32:05.609 10:18:11 -- scripts/common.sh@322 -- # uname -s 00:32:05.609 10:18:11 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:32:05.609 10:18:11 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:32:05.609 10:18:11 -- scripts/common.sh@327 -- # (( 1 )) 00:32:05.609 10:18:11 -- scripts/common.sh@328 -- # printf '%s\n' 0000:88:00.0 00:32:05.609 10:18:11 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:32:05.609 10:18:11 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:88:00.0 00:32:05.609 10:18:11 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:32:05.609 10:18:11 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:32:05.609 10:18:11 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:32:05.609 10:18:11 -- common/autotest_common.sh@10 -- # set +x 00:32:05.609 ************************************ 00:32:05.609 START TEST spdk_target_abort 00:32:05.609 ************************************ 00:32:05.609 10:18:11 -- common/autotest_common.sh@1104 -- # spdk_target 00:32:05.609 10:18:11 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:32:05.609 10:18:11 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:32:05.609 10:18:11 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:88:00.0 -b spdk_target 00:32:05.609 10:18:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:05.609 10:18:11 -- common/autotest_common.sh@10 -- # set +x 00:32:08.926 spdk_targetn1 00:32:08.926 10:18:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:08.926 10:18:13 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:32:08.926 10:18:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:08.926 10:18:13 -- common/autotest_common.sh@10 -- # set +x 00:32:08.926 [2024-07-13 10:18:13.972147] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:32:08.926 10:18:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:08.926 10:18:13 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:32:08.926 10:18:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:08.926 10:18:13 -- common/autotest_common.sh@10 -- # set +x 00:32:08.926 10:18:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:08.926 10:18:13 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:32:08.926 10:18:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:08.926 10:18:13 -- common/autotest_common.sh@10 -- # set +x 00:32:08.926 10:18:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:08.926 10:18:13 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:32:08.926 10:18:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:08.926 10:18:13 -- common/autotest_common.sh@10 -- # set +x 00:32:08.926 [2024-07-13 10:18:14.004423] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:08.926 10:18:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:08.926 10:18:14 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:32:08.926 10:18:14 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:32:08.926 10:18:14 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:32:08.926 10:18:14 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:32:08.926 10:18:14 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:32:08.926 10:18:14 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:32:08.926 10:18:14 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:32:08.926 10:18:14 -- target/abort_qd_sizes.sh@24 -- # local target r 00:32:08.926 10:18:14 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:32:08.926 10:18:14 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:08.926 10:18:14 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:32:08.926 10:18:14 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:08.927 10:18:14 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:32:08.927 10:18:14 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:08.927 10:18:14 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:32:08.927 10:18:14 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:08.927 10:18:14 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:32:08.927 10:18:14 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:08.927 10:18:14 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:08.927 10:18:14 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:08.927 10:18:14 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:08.927 EAL: No free 2048 kB hugepages reported on node 1 00:32:11.459 Initializing NVMe Controllers 00:32:11.459 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:11.459 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:11.459 Initialization complete. Launching workers. 00:32:11.459 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 10404, failed: 0 00:32:11.459 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1237, failed to submit 9167 00:32:11.459 success 763, unsuccess 474, failed 0 00:32:11.459 10:18:17 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:11.459 10:18:17 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:11.459 EAL: No free 2048 kB hugepages reported on node 1 00:32:14.745 [2024-07-13 10:18:20.341562] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaeb660 is same with the state(5) to be set 00:32:14.745 [2024-07-13 10:18:20.341634] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaeb660 is same with the state(5) to be set 00:32:14.745 [2024-07-13 10:18:20.341650] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaeb660 is same with the state(5) to be set 00:32:14.745 [2024-07-13 10:18:20.341663] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaeb660 is same with the state(5) to be set 00:32:14.745 [2024-07-13 10:18:20.341675] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaeb660 is same with the state(5) to be set 00:32:14.745 [2024-07-13 10:18:20.341687] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaeb660 is same with the state(5) to be set 00:32:14.745 [2024-07-13 10:18:20.341698] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaeb660 is same with the state(5) to be set 00:32:14.745 [2024-07-13 10:18:20.341711] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaeb660 is same with the state(5) to be set 00:32:14.745 [2024-07-13 10:18:20.341723] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaeb660 is same with the state(5) to be set 00:32:14.745 [2024-07-13 10:18:20.341735] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaeb660 is same with the state(5) to be set 00:32:14.745 [2024-07-13 10:18:20.341747] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaeb660 is same with the state(5) to be set 00:32:14.745 [2024-07-13 10:18:20.341773] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaeb660 is same with the state(5) to be set 00:32:14.745 Initializing NVMe Controllers 00:32:14.745 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:14.745 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:14.745 Initialization complete. Launching workers. 00:32:14.745 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8598, failed: 0 00:32:14.745 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1219, failed to submit 7379 00:32:14.745 success 351, unsuccess 868, failed 0 00:32:14.745 10:18:20 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:14.745 10:18:20 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:14.745 EAL: No free 2048 kB hugepages reported on node 1 00:32:18.028 Initializing NVMe Controllers 00:32:18.028 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:18.028 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:18.028 Initialization complete. Launching workers. 00:32:18.028 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 31960, failed: 0 00:32:18.028 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2646, failed to submit 29314 00:32:18.028 success 559, unsuccess 2087, failed 0 00:32:18.028 10:18:23 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:32:18.028 10:18:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:18.028 10:18:23 -- common/autotest_common.sh@10 -- # set +x 00:32:18.028 10:18:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:18.028 10:18:23 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:32:18.028 10:18:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:18.028 10:18:23 -- common/autotest_common.sh@10 -- # set +x 00:32:19.406 10:18:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:19.406 10:18:24 -- target/abort_qd_sizes.sh@62 -- # killprocess 2963478 00:32:19.406 10:18:24 -- common/autotest_common.sh@926 -- # '[' -z 2963478 ']' 00:32:19.406 10:18:24 -- common/autotest_common.sh@930 -- # kill -0 2963478 00:32:19.406 10:18:24 -- common/autotest_common.sh@931 -- # uname 00:32:19.406 10:18:24 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:32:19.406 10:18:24 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2963478 00:32:19.406 10:18:24 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:32:19.406 10:18:24 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:32:19.406 10:18:24 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2963478' 00:32:19.406 killing process with pid 2963478 00:32:19.406 10:18:24 -- common/autotest_common.sh@945 -- # kill 2963478 00:32:19.406 10:18:24 -- common/autotest_common.sh@950 -- # wait 2963478 00:32:19.406 00:32:19.407 real 0m14.055s 00:32:19.407 user 0m55.788s 00:32:19.407 sys 0m2.594s 00:32:19.407 10:18:25 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:32:19.407 10:18:25 -- common/autotest_common.sh@10 -- # set +x 00:32:19.407 ************************************ 00:32:19.407 END TEST spdk_target_abort 00:32:19.407 ************************************ 00:32:19.407 10:18:25 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:32:19.407 10:18:25 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:32:19.407 10:18:25 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:32:19.407 10:18:25 -- common/autotest_common.sh@10 -- # set +x 00:32:19.407 ************************************ 00:32:19.407 START TEST kernel_target_abort 00:32:19.407 ************************************ 00:32:19.407 10:18:25 -- common/autotest_common.sh@1104 -- # kernel_target 00:32:19.407 10:18:25 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:32:19.407 10:18:25 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:32:19.407 10:18:25 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:32:19.407 10:18:25 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:32:19.407 10:18:25 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:32:19.407 10:18:25 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:32:19.407 10:18:25 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:32:19.407 10:18:25 -- nvmf/common.sh@627 -- # local block nvme 00:32:19.407 10:18:25 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:32:19.407 10:18:25 -- nvmf/common.sh@630 -- # modprobe nvmet 00:32:19.665 10:18:25 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:32:19.665 10:18:25 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:20.605 Waiting for block devices as requested 00:32:20.605 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:32:20.864 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:20.864 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:20.864 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:21.123 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:21.123 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:21.123 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:21.123 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:21.123 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:21.381 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:21.381 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:21.381 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:21.381 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:21.639 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:21.639 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:21.639 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:21.639 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:21.898 10:18:27 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:32:21.898 10:18:27 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:32:21.898 10:18:27 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:32:21.898 10:18:27 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:32:21.898 10:18:27 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:32:21.898 No valid GPT data, bailing 00:32:21.898 10:18:27 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:32:21.898 10:18:27 -- scripts/common.sh@393 -- # pt= 00:32:21.898 10:18:27 -- scripts/common.sh@394 -- # return 1 00:32:21.898 10:18:27 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:32:21.898 10:18:27 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:32:21.898 10:18:27 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:32:21.898 10:18:27 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:32:21.898 10:18:27 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:32:21.898 10:18:27 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:32:21.898 10:18:27 -- nvmf/common.sh@654 -- # echo 1 00:32:21.898 10:18:27 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:32:21.898 10:18:27 -- nvmf/common.sh@656 -- # echo 1 00:32:21.898 10:18:27 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:32:21.898 10:18:27 -- nvmf/common.sh@663 -- # echo tcp 00:32:21.898 10:18:27 -- nvmf/common.sh@664 -- # echo 4420 00:32:21.898 10:18:27 -- nvmf/common.sh@665 -- # echo ipv4 00:32:21.898 10:18:27 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:32:21.899 10:18:27 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:32:21.899 00:32:21.899 Discovery Log Number of Records 2, Generation counter 2 00:32:21.899 =====Discovery Log Entry 0====== 00:32:21.899 trtype: tcp 00:32:21.899 adrfam: ipv4 00:32:21.899 subtype: current discovery subsystem 00:32:21.899 treq: not specified, sq flow control disable supported 00:32:21.899 portid: 1 00:32:21.899 trsvcid: 4420 00:32:21.899 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:32:21.899 traddr: 10.0.0.1 00:32:21.899 eflags: none 00:32:21.899 sectype: none 00:32:21.899 =====Discovery Log Entry 1====== 00:32:21.899 trtype: tcp 00:32:21.899 adrfam: ipv4 00:32:21.899 subtype: nvme subsystem 00:32:21.899 treq: not specified, sq flow control disable supported 00:32:21.899 portid: 1 00:32:21.899 trsvcid: 4420 00:32:21.899 subnqn: kernel_target 00:32:21.899 traddr: 10.0.0.1 00:32:21.899 eflags: none 00:32:21.899 sectype: none 00:32:21.899 10:18:27 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:32:21.899 10:18:27 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:32:21.899 10:18:27 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:32:21.899 10:18:27 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:32:21.899 10:18:27 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:32:21.899 10:18:27 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:32:21.899 10:18:27 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:32:21.899 10:18:27 -- target/abort_qd_sizes.sh@24 -- # local target r 00:32:21.899 10:18:27 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:32:21.899 10:18:27 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:21.899 10:18:27 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:32:21.899 10:18:27 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:21.899 10:18:27 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:32:21.899 10:18:27 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:21.899 10:18:27 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:32:21.899 10:18:27 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:21.899 10:18:27 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:32:21.899 10:18:27 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:21.899 10:18:27 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:21.899 10:18:27 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:21.899 10:18:27 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:22.158 EAL: No free 2048 kB hugepages reported on node 1 00:32:25.446 Initializing NVMe Controllers 00:32:25.446 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:32:25.446 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:32:25.446 Initialization complete. Launching workers. 00:32:25.446 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 32217, failed: 0 00:32:25.446 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 32217, failed to submit 0 00:32:25.446 success 0, unsuccess 32217, failed 0 00:32:25.446 10:18:30 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:25.446 10:18:30 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:25.446 EAL: No free 2048 kB hugepages reported on node 1 00:32:28.730 Initializing NVMe Controllers 00:32:28.730 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:32:28.730 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:32:28.730 Initialization complete. Launching workers. 00:32:28.730 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 63960, failed: 0 00:32:28.730 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 16134, failed to submit 47826 00:32:28.730 success 0, unsuccess 16134, failed 0 00:32:28.730 10:18:33 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:28.730 10:18:33 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:28.730 EAL: No free 2048 kB hugepages reported on node 1 00:32:31.299 Initializing NVMe Controllers 00:32:31.299 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:32:31.299 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:32:31.299 Initialization complete. Launching workers. 00:32:31.299 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 62329, failed: 0 00:32:31.299 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 15574, failed to submit 46755 00:32:31.299 success 0, unsuccess 15574, failed 0 00:32:31.299 10:18:37 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:32:31.299 10:18:37 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:32:31.299 10:18:37 -- nvmf/common.sh@677 -- # echo 0 00:32:31.299 10:18:37 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:32:31.299 10:18:37 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:32:31.299 10:18:37 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:32:31.299 10:18:37 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:32:31.299 10:18:37 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:32:31.299 10:18:37 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:32:31.299 00:32:31.299 real 0m11.859s 00:32:31.299 user 0m4.552s 00:32:31.299 sys 0m2.474s 00:32:31.299 10:18:37 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:32:31.299 10:18:37 -- common/autotest_common.sh@10 -- # set +x 00:32:31.299 ************************************ 00:32:31.299 END TEST kernel_target_abort 00:32:31.299 ************************************ 00:32:31.299 10:18:37 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:32:31.299 10:18:37 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:32:31.299 10:18:37 -- nvmf/common.sh@476 -- # nvmfcleanup 00:32:31.299 10:18:37 -- nvmf/common.sh@116 -- # sync 00:32:31.299 10:18:37 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:32:31.299 10:18:37 -- nvmf/common.sh@119 -- # set +e 00:32:31.299 10:18:37 -- nvmf/common.sh@120 -- # for i in {1..20} 00:32:31.299 10:18:37 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:32:31.299 rmmod nvme_tcp 00:32:31.299 rmmod nvme_fabrics 00:32:31.556 rmmod nvme_keyring 00:32:31.557 10:18:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:32:31.557 10:18:37 -- nvmf/common.sh@123 -- # set -e 00:32:31.557 10:18:37 -- nvmf/common.sh@124 -- # return 0 00:32:31.557 10:18:37 -- nvmf/common.sh@477 -- # '[' -n 2963478 ']' 00:32:31.557 10:18:37 -- nvmf/common.sh@478 -- # killprocess 2963478 00:32:31.557 10:18:37 -- common/autotest_common.sh@926 -- # '[' -z 2963478 ']' 00:32:31.557 10:18:37 -- common/autotest_common.sh@930 -- # kill -0 2963478 00:32:31.557 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (2963478) - No such process 00:32:31.557 10:18:37 -- common/autotest_common.sh@953 -- # echo 'Process with pid 2963478 is not found' 00:32:31.557 Process with pid 2963478 is not found 00:32:31.557 10:18:37 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:32:31.557 10:18:37 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:32.490 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:32:32.490 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:32:32.748 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:32:32.748 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:32:32.748 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:32:32.748 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:32:32.748 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:32:32.748 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:32:32.748 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:32:32.748 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:32:32.748 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:32:32.748 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:32:32.748 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:32:32.748 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:32:32.748 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:32:32.748 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:32:32.748 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:32:32.748 10:18:38 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:32:32.748 10:18:38 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:32:32.748 10:18:38 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:32:32.749 10:18:38 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:32:32.749 10:18:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:32.749 10:18:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:32.749 10:18:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:35.282 10:18:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:32:35.282 00:32:35.282 real 0m34.938s 00:32:35.282 user 1m2.663s 00:32:35.282 sys 0m8.379s 00:32:35.282 10:18:40 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:32:35.282 10:18:40 -- common/autotest_common.sh@10 -- # set +x 00:32:35.282 ************************************ 00:32:35.282 END TEST nvmf_abort_qd_sizes 00:32:35.282 ************************************ 00:32:35.282 10:18:40 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:32:35.282 10:18:40 -- spdk/autotest.sh@315 -- # '[' 0 -eq 1 ']' 00:32:35.282 10:18:40 -- spdk/autotest.sh@319 -- # '[' 0 -eq 1 ']' 00:32:35.282 10:18:40 -- spdk/autotest.sh@324 -- # '[' 0 -eq 1 ']' 00:32:35.282 10:18:40 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:32:35.282 10:18:40 -- spdk/autotest.sh@338 -- # '[' 0 -eq 1 ']' 00:32:35.282 10:18:40 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:32:35.282 10:18:40 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:32:35.282 10:18:40 -- spdk/autotest.sh@350 -- # '[' 0 -eq 1 ']' 00:32:35.282 10:18:40 -- spdk/autotest.sh@355 -- # '[' 0 -eq 1 ']' 00:32:35.282 10:18:40 -- spdk/autotest.sh@359 -- # '[' 0 -eq 1 ']' 00:32:35.282 10:18:40 -- spdk/autotest.sh@366 -- # [[ 0 -eq 1 ]] 00:32:35.282 10:18:40 -- spdk/autotest.sh@370 -- # [[ 0 -eq 1 ]] 00:32:35.282 10:18:40 -- spdk/autotest.sh@374 -- # [[ 0 -eq 1 ]] 00:32:35.282 10:18:40 -- spdk/autotest.sh@378 -- # [[ 0 -eq 1 ]] 00:32:35.282 10:18:40 -- spdk/autotest.sh@383 -- # trap - SIGINT SIGTERM EXIT 00:32:35.282 10:18:40 -- spdk/autotest.sh@385 -- # timing_enter post_cleanup 00:32:35.282 10:18:40 -- common/autotest_common.sh@712 -- # xtrace_disable 00:32:35.282 10:18:40 -- common/autotest_common.sh@10 -- # set +x 00:32:35.282 10:18:40 -- spdk/autotest.sh@386 -- # autotest_cleanup 00:32:35.282 10:18:40 -- common/autotest_common.sh@1371 -- # local autotest_es=0 00:32:35.282 10:18:40 -- common/autotest_common.sh@1372 -- # xtrace_disable 00:32:35.282 10:18:40 -- common/autotest_common.sh@10 -- # set +x 00:32:36.655 INFO: APP EXITING 00:32:36.655 INFO: killing all VMs 00:32:36.655 INFO: killing vhost app 00:32:36.655 INFO: EXIT DONE 00:32:37.588 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:32:37.588 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:32:37.588 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:32:37.588 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:32:37.845 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:32:37.845 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:32:37.845 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:32:37.845 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:32:37.846 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:32:37.846 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:32:37.846 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:32:37.846 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:32:37.846 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:32:37.846 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:32:37.846 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:32:37.846 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:32:37.846 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:32:39.223 Cleaning 00:32:39.223 Removing: /var/run/dpdk/spdk0/config 00:32:39.223 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:32:39.223 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:32:39.223 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:32:39.223 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:32:39.223 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:32:39.223 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:32:39.223 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:32:39.223 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:32:39.223 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:32:39.223 Removing: /var/run/dpdk/spdk0/hugepage_info 00:32:39.223 Removing: /var/run/dpdk/spdk1/config 00:32:39.223 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:32:39.223 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:32:39.223 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:32:39.223 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:32:39.223 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:32:39.223 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:32:39.223 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:32:39.223 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:32:39.223 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:32:39.223 Removing: /var/run/dpdk/spdk1/hugepage_info 00:32:39.223 Removing: /var/run/dpdk/spdk1/mp_socket 00:32:39.223 Removing: /var/run/dpdk/spdk2/config 00:32:39.223 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:32:39.223 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:32:39.223 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:32:39.223 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:32:39.223 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:32:39.223 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:32:39.223 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:32:39.223 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:32:39.223 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:32:39.223 Removing: /var/run/dpdk/spdk2/hugepage_info 00:32:39.223 Removing: /var/run/dpdk/spdk3/config 00:32:39.223 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:32:39.223 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:32:39.223 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:32:39.223 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:32:39.223 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:32:39.223 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:32:39.223 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:32:39.223 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:32:39.223 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:32:39.223 Removing: /var/run/dpdk/spdk3/hugepage_info 00:32:39.223 Removing: /var/run/dpdk/spdk4/config 00:32:39.223 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:32:39.223 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:32:39.223 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:32:39.223 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:32:39.223 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:32:39.223 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:32:39.223 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:32:39.223 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:32:39.223 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:32:39.223 Removing: /var/run/dpdk/spdk4/hugepage_info 00:32:39.223 Removing: /dev/shm/bdev_svc_trace.1 00:32:39.223 Removing: /dev/shm/nvmf_trace.0 00:32:39.223 Removing: /dev/shm/spdk_tgt_trace.pid2688225 00:32:39.223 Removing: /var/run/dpdk/spdk0 00:32:39.223 Removing: /var/run/dpdk/spdk1 00:32:39.223 Removing: /var/run/dpdk/spdk2 00:32:39.223 Removing: /var/run/dpdk/spdk3 00:32:39.223 Removing: /var/run/dpdk/spdk4 00:32:39.223 Removing: /var/run/dpdk/spdk_pid2686527 00:32:39.223 Removing: /var/run/dpdk/spdk_pid2687275 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2688225 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2688710 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2689934 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2690872 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2691178 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2691376 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2691712 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2691906 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2692066 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2692228 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2692477 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2692994 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2695411 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2695712 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2695878 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2696020 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2696444 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2696472 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2696909 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2697043 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2697219 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2697362 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2697526 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2697669 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2698040 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2698196 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2698388 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2698685 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2698714 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2698892 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2699036 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2699202 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2699342 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2699614 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2699764 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2699920 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2700067 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2700319 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2700483 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2700646 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2700789 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2701013 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2701212 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2701368 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2701516 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2701708 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2701935 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2702095 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2702233 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2702442 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2702656 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2702822 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2702961 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2703193 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2703385 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2703557 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2703703 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2703979 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2704120 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2704284 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2704424 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2704702 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2704850 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2705012 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2705160 00:32:39.224 Removing: /var/run/dpdk/spdk_pid2705435 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2705586 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2705744 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2705890 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2706163 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2706238 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2706442 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2708498 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2764244 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2766898 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2774487 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2777834 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2780333 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2780756 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2784507 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2784577 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2785187 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2785863 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2786468 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2786951 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2786959 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2787105 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2787245 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2787248 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2787924 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2788499 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2789157 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2789564 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2789575 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2789835 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2790880 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2791695 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2797224 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2797505 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2800172 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2804567 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2806728 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2813311 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2818837 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2820060 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2820751 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2831239 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2833477 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2836181 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2837511 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2839504 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2839651 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2839807 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2840075 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2840567 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2842036 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2842933 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2843384 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2846942 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2850442 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2854087 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2878077 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2880795 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2884627 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2885605 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2886858 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2889435 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2891958 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2896338 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2896347 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2899275 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2899419 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2899559 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2899864 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2899884 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2901687 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2902907 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2904122 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2905335 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2906556 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2907775 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2911653 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2912118 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2913451 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2914209 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2917983 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2920028 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2923638 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2927263 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2931427 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2931966 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2932390 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2932809 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2933398 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2933952 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2934382 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2934933 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2937598 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2937832 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2941640 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2941919 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2943565 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2948715 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2948720 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2951673 00:32:39.482 Removing: /var/run/dpdk/spdk_pid2953112 00:32:39.741 Removing: /var/run/dpdk/spdk_pid2954552 00:32:39.741 Removing: /var/run/dpdk/spdk_pid2955429 00:32:39.741 Removing: /var/run/dpdk/spdk_pid2956892 00:32:39.741 Removing: /var/run/dpdk/spdk_pid2957789 00:32:39.741 Removing: /var/run/dpdk/spdk_pid2963921 00:32:39.741 Removing: /var/run/dpdk/spdk_pid2964319 00:32:39.741 Removing: /var/run/dpdk/spdk_pid2964723 00:32:39.741 Removing: /var/run/dpdk/spdk_pid2966195 00:32:39.741 Removing: /var/run/dpdk/spdk_pid2966612 00:32:39.741 Removing: /var/run/dpdk/spdk_pid2967035 00:32:39.741 Clean 00:32:39.741 killing process with pid 2658221 00:32:47.852 killing process with pid 2658218 00:32:47.852 killing process with pid 2658220 00:32:47.852 killing process with pid 2658219 00:32:47.852 10:18:53 -- common/autotest_common.sh@1436 -- # return 0 00:32:47.852 10:18:53 -- spdk/autotest.sh@387 -- # timing_exit post_cleanup 00:32:47.852 10:18:53 -- common/autotest_common.sh@718 -- # xtrace_disable 00:32:47.852 10:18:53 -- common/autotest_common.sh@10 -- # set +x 00:32:47.852 10:18:53 -- spdk/autotest.sh@389 -- # timing_exit autotest 00:32:47.852 10:18:53 -- common/autotest_common.sh@718 -- # xtrace_disable 00:32:47.852 10:18:53 -- common/autotest_common.sh@10 -- # set +x 00:32:47.852 10:18:53 -- spdk/autotest.sh@390 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:32:47.852 10:18:53 -- spdk/autotest.sh@392 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:32:47.852 10:18:53 -- spdk/autotest.sh@392 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:32:47.852 10:18:53 -- spdk/autotest.sh@394 -- # hash lcov 00:32:47.852 10:18:53 -- spdk/autotest.sh@394 -- # [[ CC_TYPE=gcc == *\c\l\a\n\g* ]] 00:32:47.852 10:18:53 -- spdk/autotest.sh@396 -- # hostname 00:32:47.852 10:18:53 -- spdk/autotest.sh@396 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -c -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-11 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:32:47.852 geninfo: WARNING: invalid characters removed from testname! 00:33:14.434 10:19:19 -- spdk/autotest.sh@397 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:18.620 10:19:23 -- spdk/autotest.sh@398 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:21.145 10:19:26 -- spdk/autotest.sh@399 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:23.671 10:19:29 -- spdk/autotest.sh@400 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:26.951 10:19:32 -- spdk/autotest.sh@401 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:29.474 10:19:34 -- spdk/autotest.sh@402 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:32.001 10:19:37 -- spdk/autotest.sh@403 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:33:32.001 10:19:37 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:33:32.001 10:19:37 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:33:32.001 10:19:37 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:33:32.001 10:19:37 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:33:32.001 10:19:37 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:32.001 10:19:37 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:32.001 10:19:37 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:32.001 10:19:37 -- paths/export.sh@5 -- $ export PATH 00:33:32.001 10:19:37 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:32.001 10:19:37 -- common/autobuild_common.sh@434 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:33:32.001 10:19:37 -- common/autobuild_common.sh@435 -- $ date +%s 00:33:32.001 10:19:37 -- common/autobuild_common.sh@435 -- $ mktemp -dt spdk_1720858777.XXXXXX 00:33:32.001 10:19:37 -- common/autobuild_common.sh@435 -- $ SPDK_WORKSPACE=/tmp/spdk_1720858777.PznhVW 00:33:32.001 10:19:37 -- common/autobuild_common.sh@437 -- $ [[ -n '' ]] 00:33:32.001 10:19:37 -- common/autobuild_common.sh@441 -- $ '[' -n v22.11.4 ']' 00:33:32.002 10:19:37 -- common/autobuild_common.sh@442 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:33:32.002 10:19:37 -- common/autobuild_common.sh@442 -- $ scanbuild_exclude=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk' 00:33:32.002 10:19:37 -- common/autobuild_common.sh@448 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:33:32.002 10:19:37 -- common/autobuild_common.sh@450 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:33:32.002 10:19:37 -- common/autobuild_common.sh@451 -- $ get_config_params 00:33:32.002 10:19:37 -- common/autotest_common.sh@387 -- $ xtrace_disable 00:33:32.002 10:19:37 -- common/autotest_common.sh@10 -- $ set +x 00:33:32.002 10:19:37 -- common/autobuild_common.sh@451 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build' 00:33:32.002 10:19:37 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:33:32.002 10:19:37 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:33:32.002 10:19:37 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:33:32.002 10:19:37 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:33:32.002 10:19:37 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:33:32.002 10:19:37 -- spdk/autopackage.sh@19 -- $ timing_finish 00:33:32.002 10:19:37 -- common/autotest_common.sh@724 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:33:32.002 10:19:37 -- common/autotest_common.sh@725 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:33:32.002 10:19:37 -- common/autotest_common.sh@727 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:33:32.002 10:19:37 -- spdk/autopackage.sh@20 -- $ exit 0 00:33:32.002 + [[ -n 2603421 ]] 00:33:32.002 + sudo kill 2603421 00:33:32.010 [Pipeline] } 00:33:32.028 [Pipeline] // stage 00:33:32.033 [Pipeline] } 00:33:32.044 [Pipeline] // timeout 00:33:32.048 [Pipeline] } 00:33:32.059 [Pipeline] // catchError 00:33:32.064 [Pipeline] } 00:33:32.076 [Pipeline] // wrap 00:33:32.087 [Pipeline] } 00:33:32.098 [Pipeline] // catchError 00:33:32.105 [Pipeline] stage 00:33:32.106 [Pipeline] { (Epilogue) 00:33:32.116 [Pipeline] catchError 00:33:32.117 [Pipeline] { 00:33:32.129 [Pipeline] echo 00:33:32.130 Cleanup processes 00:33:32.134 [Pipeline] sh 00:33:32.460 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:33:32.460 2979072 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:33:32.474 [Pipeline] sh 00:33:32.757 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:33:32.757 ++ grep -v 'sudo pgrep' 00:33:32.757 ++ awk '{print $1}' 00:33:32.757 + sudo kill -9 00:33:32.757 + true 00:33:32.769 [Pipeline] sh 00:33:33.053 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:33:43.029 [Pipeline] sh 00:33:43.312 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:33:43.312 Artifacts sizes are good 00:33:43.327 [Pipeline] archiveArtifacts 00:33:43.335 Archiving artifacts 00:33:43.565 [Pipeline] sh 00:33:43.844 + sudo chown -R sys_sgci /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:33:43.859 [Pipeline] cleanWs 00:33:43.870 [WS-CLEANUP] Deleting project workspace... 00:33:43.870 [WS-CLEANUP] Deferred wipeout is used... 00:33:43.876 [WS-CLEANUP] done 00:33:43.878 [Pipeline] } 00:33:43.899 [Pipeline] // catchError 00:33:43.912 [Pipeline] sh 00:33:44.193 + logger -p user.info -t JENKINS-CI 00:33:44.201 [Pipeline] } 00:33:44.219 [Pipeline] // stage 00:33:44.225 [Pipeline] } 00:33:44.244 [Pipeline] // node 00:33:44.250 [Pipeline] End of Pipeline 00:33:44.287 Finished: SUCCESS